2024-09-19T08:27:26.363 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T08:27:26.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T08:27:26.476 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911862 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/forward-scrub} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911862' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected - object missing on disk - Invalid tag char sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEebT1m6U2Q14e8UwzDO1pxP9n6QrxO6g0O4aGa6pJkIiKPiTIsLnIFTp21i/UMZOc72selwdXPyWl+v+yT3gJ0= smithi146.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEZBBL32PqWKesC3e6w+dOa5mIThTYCquqmBSlp1epGRa55FsOsl/2Y5xyrzLIj+y6F0CzzzmZqFjKuqkxyXiak= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T08:27:26.476 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T08:27:26.477 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T08:27:26.477 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T08:27:26.479 INFO:teuthology.task.internal:Checking packages... 2024-09-19T08:27:26.501 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T08:27:26.502 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T08:27:26.502 INFO:teuthology.packaging:ref: None 2024-09-19T08:27:26.502 INFO:teuthology.packaging:tag: None 2024-09-19T08:27:26.502 INFO:teuthology.packaging:branch: squid 2024-09-19T08:27:26.502 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:27:26.502 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T08:27:26.742 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T08:27:26.744 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T08:27:26.753 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T08:27:26.753 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T08:27:26.818 INFO:teuthology.task.internal:Saving configuration 2024-09-19T08:27:26.835 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T08:27:26.895 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T08:27:26.920 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911862', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:22:17.424039', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEebT1m6U2Q14e8UwzDO1pxP9n6QrxO6g0O4aGa6pJkIiKPiTIsLnIFTp21i/UMZOc72selwdXPyWl+v+yT3gJ0='} 2024-09-19T08:27:26.941 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911862', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:22:17.425271', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEZBBL32PqWKesC3e6w+dOa5mIThTYCquqmBSlp1epGRa55FsOsl/2Y5xyrzLIj+y6F0CzzzmZqFjKuqkxyXiak='} 2024-09-19T08:27:26.941 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T08:27:26.947 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-19T08:27:26.947 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-19T08:27:26.947 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T08:27:27.031 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f716eddbbe0>, signals=[15]) 2024-09-19T08:27:27.032 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T08:27:27.038 INFO:teuthology.task.internal:Opening connections... 2024-09-19T08:27:27.038 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T08:27:27.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:27:27.116 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2024-09-19T08:27:27.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:27:27.194 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T08:27:27.202 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-09-19T08:27:27.222 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-09-19T08:27:27.222 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-09-19T08:27:27.279 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2024-09-19T08:27:27.279 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9" 2024-09-19T08:27:27.280 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2024-09-19T08:27:27.280 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:27:27.280 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9" 2024-09-19T08:27:27.280 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:27:27.280 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:27:27.280 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2024-09-19T08:27:27.280 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:27:27.280 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:27:27.280 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:27:27.280 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:27:27.280 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:27:27.280 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:27:27.281 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-09-19T08:27:27.306 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2024-09-19T08:27:27.326 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2024-09-19T08:27:27.326 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2024-09-19T08:27:27.384 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2024-09-19T08:27:27.384 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9" 2024-09-19T08:27:27.384 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2024-09-19T08:27:27.384 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:27:27.385 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9" 2024-09-19T08:27:27.385 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:27:27.385 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:27:27.385 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2024-09-19T08:27:27.385 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:27:27.385 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:27:27.385 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:27:27.385 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:27:27.385 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:27:27.385 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:27:27.386 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2024-09-19T08:27:27.423 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T08:27:27.434 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T08:27:27.465 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T08:27:27.465 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:27:27.468 DEBUG:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:27:27.485 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T08:27:27.491 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T08:27:27.491 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:27:27.526 DEBUG:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:27:27.606 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T08:27:27.658 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T08:27:27.672 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-19T08:27:27.673 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-19T08:27:27.673 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:27:27.673 DEBUG:teuthology.orchestra.run.smithi146:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:27:27.690 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:27:27.691 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-09-19T08:27:27.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:27:27.692 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2024-09-19T08:27:27.749 INFO:teuthology.orchestra.run.smithi117.stdout:5.14.0-503.el9.x86_64 2024-09-19T08:27:27.753 INFO:teuthology.task.kernel:Running kernel on smithi117: 5.14.0-503.el9.x86_64 2024-09-19T08:27:27.753 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum install -y kernel 2024-09-19T08:27:27.754 INFO:teuthology.orchestra.run.smithi146.stdout:5.14.0-503.el9.x86_64 2024-09-19T08:27:27.754 INFO:teuthology.task.kernel:Running kernel on smithi146: 5.14.0-503.el9.x86_64 2024-09-19T08:27:27.754 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum install -y kernel 2024-09-19T08:27:30.282 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 9.8 MB/s | 8.3 MB 00:00 2024-09-19T08:27:32.081 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.3 MB 00:02 2024-09-19T08:27:33.000 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 12 MB/s | 20 MB 00:01 2024-09-19T08:27:35.283 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 20 MB 00:02 2024-09-19T08:27:37.658 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 7.3 MB/s | 6.5 MB 00:00 2024-09-19T08:27:39.325 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-19T08:27:40.288 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-19T08:27:41.516 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.5 MB 00:02 2024-09-19T08:27:43.074 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 19 kB 00:00 2024-09-19T08:27:43.879 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-19T08:27:45.851 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 5.3 kB/s | 1.7 kB 00:00 2024-09-19T08:27:47.758 INFO:teuthology.orchestra.run.smithi117.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T08:27:47.758 INFO:teuthology.orchestra.run.smithi117.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T08:27:47.850 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T08:27:47.861 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T08:27:47.861 INFO:teuthology.orchestra.run.smithi117.stdout: Package Architecture Version Repository Size 2024-09-19T08:27:47.861 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T08:27:47.861 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-19T08:27:47.861 INFO:teuthology.orchestra.run.smithi117.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T08:27:47.862 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-19T08:27:47.862 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T08:27:47.862 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T08:27:47.862 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T08:27:47.862 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:27:47.862 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-19T08:27:47.862 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T08:27:47.862 INFO:teuthology.orchestra.run.smithi117.stdout:Install 4 Packages 2024-09-19T08:27:47.863 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:27:47.863 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 79 M 2024-09-19T08:27:47.863 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 126 M 2024-09-19T08:27:47.863 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-19T08:27:48.103 INFO:teuthology.orchestra.run.smithi117.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 289 kB/s | 36 kB 00:00 2024-09-19T08:27:48.611 INFO:teuthology.orchestra.run.smithi117.stdout:(2/4): kernel-modules-core-5.14.0-508.el9.x86_6 56 MB/s | 29 MB 00:00 2024-09-19T08:27:48.928 INFO:teuthology.orchestra.run.smithi117.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 36 MB/s | 35 MB 00:00 2024-09-19T08:27:49.279 INFO:teuthology.orchestra.run.smithi117.stdout:(4/4): kernel-core-5.14.0-508.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-09-19T08:27:49.279 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:27:49.279 INFO:teuthology.orchestra.run.smithi117.stdout:Total 56 MB/s | 79 MB 00:01 2024-09-19T08:27:49.393 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-19T08:27:49.964 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-19T08:27:50.342 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-19T08:27:50.342 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-19T08:27:51.284 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-19T08:27:51.284 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-19T08:27:51.341 INFO:teuthology.orchestra.run.smithi146.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T08:27:51.341 INFO:teuthology.orchestra.run.smithi146.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T08:27:51.446 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-19T08:27:51.456 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-19T08:27:51.456 INFO:teuthology.orchestra.run.smithi146.stdout: Package Architecture Version Repository Size 2024-09-19T08:27:51.456 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-19T08:27:51.456 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-19T08:27:51.456 INFO:teuthology.orchestra.run.smithi146.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T08:27:51.456 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2024-09-19T08:27:51.456 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T08:27:51.456 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T08:27:51.456 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T08:27:51.456 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:27:51.457 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-19T08:27:51.457 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-19T08:27:51.457 INFO:teuthology.orchestra.run.smithi146.stdout:Install 4 Packages 2024-09-19T08:27:51.457 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:27:51.457 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 79 M 2024-09-19T08:27:51.457 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 126 M 2024-09-19T08:27:51.457 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-19T08:27:51.660 INFO:teuthology.orchestra.run.smithi146.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 408 kB/s | 36 kB 00:00 2024-09-19T08:27:52.045 INFO:teuthology.orchestra.run.smithi146.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-19T08:27:52.495 INFO:teuthology.orchestra.run.smithi146.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 37 MB/s | 35 MB 00:00 2024-09-19T08:27:52.820 INFO:teuthology.orchestra.run.smithi146.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-19T08:27:52.820 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:27:52.820 INFO:teuthology.orchestra.run.smithi146.stdout:Total 58 MB/s | 79 MB 00:01 2024-09-19T08:27:53.503 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-19T08:27:53.719 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-19T08:27:53.870 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-19T08:27:53.870 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-19T08:27:54.431 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:27:54.514 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:27:54.845 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-19T08:27:54.845 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-19T08:27:57.253 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-19T08:27:57.265 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:27:57.406 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:27:57.972 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:27:58.070 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:28:00.833 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:28:00.965 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:28:02.204 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:28:02.331 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:28:05.782 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:28:05.823 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:28:07.153 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:28:10.654 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:28:45.102 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:28:45.141 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:28:45.491 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:28:45.491 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:28:45.491 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:28:45.491 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:28:46.345 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:28:46.345 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:28:46.345 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-19T08:28:46.345 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T08:28:46.345 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T08:28:46.345 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T08:28:46.345 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T08:28:46.345 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:28:46.345 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T08:28:46.726 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:28:46.821 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:28:46.821 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:28:46.822 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T08:28:46.822 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T08:28:46.822 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T08:28:46.822 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-19T08:28:46.822 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi117.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T08:28:46.822 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:28:46.879 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:28:46.880 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:28:46.880 DEBUG:teuthology.orchestra.run.smithi117:> sudo rpm -qi grub2-tools 2024-09-19T08:28:46.919 INFO:teuthology.orchestra.run.smithi117.stdout:Name : grub2-tools 2024-09-19T08:28:46.919 INFO:teuthology.orchestra.run.smithi117.stdout:Epoch : 1 2024-09-19T08:28:46.919 INFO:teuthology.orchestra.run.smithi117.stdout:Version : 2.06 2024-09-19T08:28:46.919 INFO:teuthology.orchestra.run.smithi117.stdout:Release : 82.el9 2024-09-19T08:28:46.919 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: x86_64 2024-09-19T08:28:46.919 INFO:teuthology.orchestra.run.smithi117.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T08:28:46.919 INFO:teuthology.orchestra.run.smithi117.stdout:Group : Unspecified 2024-09-19T08:28:46.919 INFO:teuthology.orchestra.run.smithi117.stdout:Size : 8274670 2024-09-19T08:28:46.919 INFO:teuthology.orchestra.run.smithi117.stdout:License : GPLv3+ 2024-09-19T08:28:46.919 INFO:teuthology.orchestra.run.smithi117.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T08:28:46.919 INFO:teuthology.orchestra.run.smithi117.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T08:28:46.920 INFO:teuthology.orchestra.run.smithi117.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T08:28:46.920 INFO:teuthology.orchestra.run.smithi117.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T08:28:46.920 INFO:teuthology.orchestra.run.smithi117.stdout:Packager : builder@centos.org 2024-09-19T08:28:46.920 INFO:teuthology.orchestra.run.smithi117.stdout:Vendor : CentOS 2024-09-19T08:28:46.920 INFO:teuthology.orchestra.run.smithi117.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T08:28:46.920 INFO:teuthology.orchestra.run.smithi117.stdout:Summary : Support tools for GRUB. 2024-09-19T08:28:46.920 INFO:teuthology.orchestra.run.smithi117.stdout:Description : 2024-09-19T08:28:46.920 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:28:46.920 INFO:teuthology.orchestra.run.smithi117.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T08:28:46.920 INFO:teuthology.orchestra.run.smithi117.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T08:28:46.920 INFO:teuthology.orchestra.run.smithi117.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T08:28:46.920 INFO:teuthology.orchestra.run.smithi117.stdout:hardware devices. 2024-09-19T08:28:46.920 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:28:46.921 INFO:teuthology.orchestra.run.smithi117.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T08:28:46.922 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T08:28:46.922 INFO:teuthology.task.kernel:Updating grub on smithi117 to boot 5.14.0-508.el9.x86_64 2024-09-19T08:28:46.922 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T08:28:47.577 INFO:teuthology.orchestra.run.smithi117.stderr:Generating grub configuration file ... 2024-09-19T08:28:48.780 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:28:48.820 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:28:48.900 INFO:teuthology.orchestra.run.smithi117.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T08:28:48.926 INFO:teuthology.orchestra.run.smithi117.stderr:done 2024-09-19T08:28:48.928 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-09-19T08:28:48.944 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.1s86R4LeaL 2024-09-19T08:28:48.945 DEBUG:teuthology.orchestra.run.smithi117:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.1s86R4LeaL 2024-09-19T08:28:49.012 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.1s86R4LeaL 2024-09-19T08:28:49.136 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:28:49.137 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:28:49.137 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:28:49.137 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:28:49.156 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.1s86R4LeaL is 6KB 2024-09-19T08:28:49.178 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.1s86R4LeaL 2024-09-19T08:28:49.194 DEBUG:teuthology.orchestra.run.smithi117:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T08:28:49.259 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T08:28:49.260 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T08:28:49.260 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T08:28:49.260 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T08:28:49.261 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T08:28:49.412 DEBUG:teuthology.orchestra.run.smithi117:> sudo shutdown -r now 2024-09-19T08:28:49.982 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:28:49.982 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:28:49.982 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-19T08:28:49.982 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T08:28:49.982 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T08:28:49.983 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T08:28:49.983 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T08:28:49.983 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:28:49.983 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-19T08:28:50.310 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:28:50.393 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:28:50.393 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:28:50.393 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T08:28:50.394 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T08:28:50.394 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T08:28:50.394 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-19T08:28:50.394 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi146.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T08:28:50.394 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:28:50.453 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:28:50.453 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:28:50.454 DEBUG:teuthology.orchestra.run.smithi146:> sudo rpm -qi grub2-tools 2024-09-19T08:28:50.486 INFO:teuthology.orchestra.run.smithi146.stdout:Name : grub2-tools 2024-09-19T08:28:50.486 INFO:teuthology.orchestra.run.smithi146.stdout:Epoch : 1 2024-09-19T08:28:50.486 INFO:teuthology.orchestra.run.smithi146.stdout:Version : 2.06 2024-09-19T08:28:50.486 INFO:teuthology.orchestra.run.smithi146.stdout:Release : 82.el9 2024-09-19T08:28:50.486 INFO:teuthology.orchestra.run.smithi146.stdout:Architecture: x86_64 2024-09-19T08:28:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T08:28:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:Group : Unspecified 2024-09-19T08:28:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:Size : 8274670 2024-09-19T08:28:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:License : GPLv3+ 2024-09-19T08:28:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T08:28:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T08:28:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T08:28:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T08:28:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:Packager : builder@centos.org 2024-09-19T08:28:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:Vendor : CentOS 2024-09-19T08:28:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T08:28:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:Summary : Support tools for GRUB. 2024-09-19T08:28:50.487 INFO:teuthology.orchestra.run.smithi146.stdout:Description : 2024-09-19T08:28:50.487 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:28:50.488 INFO:teuthology.orchestra.run.smithi146.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T08:28:50.488 INFO:teuthology.orchestra.run.smithi146.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T08:28:50.488 INFO:teuthology.orchestra.run.smithi146.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T08:28:50.488 INFO:teuthology.orchestra.run.smithi146.stdout:hardware devices. 2024-09-19T08:28:50.488 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:28:50.488 INFO:teuthology.orchestra.run.smithi146.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T08:28:50.489 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T08:28:50.489 INFO:teuthology.task.kernel:Updating grub on smithi146 to boot 5.14.0-508.el9.x86_64 2024-09-19T08:28:50.489 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T08:28:51.148 INFO:teuthology.orchestra.run.smithi146.stderr:Generating grub configuration file ... 2024-09-19T08:28:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T08:28:52.501 INFO:teuthology.orchestra.run.smithi146.stderr:done 2024-09-19T08:28:52.504 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2024-09-19T08:28:52.520 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.YMuq5JgVUe 2024-09-19T08:28:52.520 DEBUG:teuthology.orchestra.run.smithi146:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YMuq5JgVUe 2024-09-19T08:28:52.587 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.YMuq5JgVUe 2024-09-19T08:28:52.743 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.YMuq5JgVUe is 6KB 2024-09-19T08:28:52.776 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.YMuq5JgVUe 2024-09-19T08:28:52.793 DEBUG:teuthology.orchestra.run.smithi146:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T08:28:52.868 INFO:teuthology.orchestra.run.smithi146.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T08:28:52.868 INFO:teuthology.orchestra.run.smithi146.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T08:28:52.868 INFO:teuthology.orchestra.run.smithi146.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T08:28:52.868 INFO:teuthology.orchestra.run.smithi146.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T08:28:52.869 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T08:28:53.055 DEBUG:teuthology.orchestra.run.smithi146:> sudo shutdown -r now 2024-09-19T08:29:19.438 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-19T08:29:19.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-19T08:29:19.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:29:23.061 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-19T08:29:23.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-19T08:29:23.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:29:37.981 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-09-19T08:29:41.565 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-09-19T08:29:46.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-19T08:29:46.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:29:50.045 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-09-19T08:29:50.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-19T08:29:50.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:29:53.629 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-09-19T08:30:02.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-19T08:30:02.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:30:05.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-19T08:30:05.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:30:20.481 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-09-19T08:30:35.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-19T08:30:35.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:30:35.814 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-09-19T08:30:36.142 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-19T08:30:36.142 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-19T08:30:36.143 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-09-19T08:30:36.158 INFO:teuthology.orchestra.run.smithi117.stdout:5.14.0-508.el9.x86_64 2024-09-19T08:30:36.158 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T08:30:36.158 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T08:30:36.158 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T08:30:37.210 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-19T08:30:37.210 DEBUG:teuthology.orchestra.run.smithi117:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T08:30:37.338 INFO:teuthology.orchestra.run.smithi117.stdout:ttyS1 2024-09-19T08:30:37.361 DEBUG:teuthology.parallel:result is None 2024-09-19T08:30:37.491 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-09-19T08:30:37.926 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-19T08:30:37.926 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-19T08:30:37.927 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2024-09-19T08:30:37.941 INFO:teuthology.orchestra.run.smithi146.stdout:5.14.0-508.el9.x86_64 2024-09-19T08:30:37.942 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T08:30:37.942 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T08:30:37.942 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T08:30:38.943 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-19T08:30:38.943 DEBUG:teuthology.orchestra.run.smithi146:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T08:30:39.028 INFO:teuthology.orchestra.run.smithi146.stdout:ttyS1 2024-09-19T08:30:39.052 DEBUG:teuthology.parallel:result is None 2024-09-19T08:30:39.053 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T08:30:39.061 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T08:30:39.061 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:30:39.064 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:30:39.079 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T08:30:39.107 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T08:30:39.150 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T08:30:39.150 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:30:39.153 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:30:39.196 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T08:30:39.203 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T08:30:39.204 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:30:39.216 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:30:39.245 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:30:39.256 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:30:39.275 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:30:39.285 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:30:39.290 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T08:30:39.297 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T08:30:39.298 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:30:39.300 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:30:39.354 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T08:30:39.367 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T08:30:39.368 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:30:39.371 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:30:39.410 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:30:39.473 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:30:39.531 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:30:39.613 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:30:39.654 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:30:39.655 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:30:39.720 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:30:39.763 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:30:39.807 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:30:39.891 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:30:39.931 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:30:39.932 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:30:39.997 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2024-09-19T08:30:39.999 DEBUG:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2024-09-19T08:30:40.042 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:30:40.084 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:30:40.552 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T08:30:40.560 INFO:teuthology.task.internal:Starting timer... 2024-09-19T08:30:40.560 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T08:30:40.611 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T08:30:40.657 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-19T08:30:40.657 DEBUG:teuthology.orchestra.run.smithi117:> sudo service auditd rotate 2024-09-19T08:30:40.711 INFO:teuthology.orchestra.run.smithi117.stdout:Rotating logs: 2024-09-19T08:30:40.713 DEBUG:teuthology.orchestra.run.smithi146:> sudo service auditd rotate 2024-09-19T08:30:40.799 INFO:teuthology.orchestra.run.smithi146.stdout:Rotating logs: 2024-09-19T08:30:40.801 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T08:30:40.801 DEBUG:teuthology.orchestra.run.smithi117:> /usr/sbin/getenforce 2024-09-19T08:30:40.827 INFO:teuthology.orchestra.run.smithi117.stdout:Permissive 2024-09-19T08:30:40.828 DEBUG:teuthology.orchestra.run.smithi146:> /usr/sbin/getenforce 2024-09-19T08:30:40.853 INFO:teuthology.orchestra.run.smithi146.stdout:Permissive 2024-09-19T08:30:40.854 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi117.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi146.front.sepia.ceph.com': 'permissive'} 2024-09-19T08:30:40.854 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:30:40.895 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:30:40.896 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:30:40.921 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:30:40.921 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T08:30:40.922 DEBUG:teuthology.orchestra.run.smithi117:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:30:40.976 DEBUG:teuthology.orchestra.run.smithi146:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:30:41.014 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T08:30:41.024 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-19T08:30:41.027 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-19T08:30:41.178 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T08:30:41.191 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T08:30:41.194 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi117.front.sepia.ceph.com,smithi146.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T08:34:27.711 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi117.front.sepia.ceph.com'), Remote(name='ubuntu@smithi146.front.sepia.ceph.com')] 2024-09-19T08:34:27.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-19T08:34:27.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:34:27.789 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-09-19T08:34:27.868 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-19T08:34:27.868 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-19T08:34:27.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:34:27.946 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-09-19T08:34:28.024 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-19T08:34:28.025 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T08:34:28.035 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T08:34:28.035 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:34:28.035 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:34:28.038 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:34:28.038 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:34:28.064 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:34:28.078 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:34:28.094 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:34:28.103 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: ntpd: command not found 2024-09-19T08:34:28.108 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:34:28.113 INFO:teuthology.orchestra.run.smithi117.stdout:506 Cannot talk to daemon 2024-09-19T08:34:28.128 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:34:28.133 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: ntpd: command not found 2024-09-19T08:34:28.141 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:34:28.145 INFO:teuthology.orchestra.run.smithi146.stdout:506 Cannot talk to daemon 2024-09-19T08:34:28.159 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:34:28.173 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:34:28.200 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:34:28.203 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:34:28.203 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-09-19T08:34:28.203 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:34:28.203 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:34:28.203 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:34:28.203 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:34:28.238 INFO:teuthology.orchestra.run.smithi146.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:34:28.241 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:34:28.241 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2024-09-19T08:34:28.241 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:34:28.241 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:34:28.241 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:34:28.241 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:34:28.242 INFO:teuthology.run_tasks:Running task install... 2024-09-19T08:34:28.250 DEBUG:teuthology.task.install:project ceph 2024-09-19T08:34:28.250 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T08:34:28.250 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T08:34:28.250 INFO:teuthology.task.install:Using flavor: default 2024-09-19T08:34:28.256 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T08:34:28.256 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T08:34:28.256 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:34:28.257 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:34:28.259 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:34:28.259 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:34:28.407 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T08:34:28.407 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T08:34:28.421 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T08:34:28.421 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T08:34:28.526 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:34:28.526 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:34:28.526 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:34:28.532 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:34:28.532 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:34:28.533 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:34:28.553 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T08:34:28.553 DEBUG:teuthology.orchestra.run.smithi117:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:34:28.558 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T08:34:28.558 DEBUG:teuthology.orchestra.run.smithi146:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:34:28.619 DEBUG:teuthology.orchestra.run.smithi117:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:34:28.624 DEBUG:teuthology.orchestra.run.smithi146:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:34:28.694 DEBUG:teuthology.orchestra.run.smithi117:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:34:28.702 DEBUG:teuthology.orchestra.run.smithi146:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:34:28.758 INFO:teuthology.orchestra.run.smithi117.stdout:check_obsoletes = 1 2024-09-19T08:34:28.760 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum clean all 2024-09-19T08:34:28.767 INFO:teuthology.orchestra.run.smithi146.stdout:check_obsoletes = 1 2024-09-19T08:34:28.768 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum clean all 2024-09-19T08:34:28.990 INFO:teuthology.orchestra.run.smithi117.stdout:45 files removed 2024-09-19T08:34:29.008 INFO:teuthology.orchestra.run.smithi146.stdout:45 files removed 2024-09-19T08:34:29.017 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T08:34:29.036 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T08:34:29.610 INFO:teuthology.orchestra.run.smithi117.stdout:ceph packages for x86_64 273 kB/s | 84 kB 00:00 2024-09-19T08:34:29.628 INFO:teuthology.orchestra.run.smithi146.stdout:ceph packages for x86_64 272 kB/s | 84 kB 00:00 2024-09-19T08:34:29.910 INFO:teuthology.orchestra.run.smithi117.stdout:ceph noarch packages 46 kB/s | 12 kB 00:00 2024-09-19T08:34:29.929 INFO:teuthology.orchestra.run.smithi146.stdout:ceph noarch packages 46 kB/s | 12 kB 00:00 2024-09-19T08:34:30.211 INFO:teuthology.orchestra.run.smithi117.stdout:ceph source packages 7.2 kB/s | 1.9 kB 00:00 2024-09-19T08:34:30.238 INFO:teuthology.orchestra.run.smithi146.stdout:ceph source packages 7.0 kB/s | 1.9 kB 00:00 2024-09-19T08:34:31.011 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-19T08:34:33.179 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.3 MB 00:02 2024-09-19T08:34:34.787 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 7.6 MB/s | 20 MB 00:02 2024-09-19T08:34:36.514 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 20 MB 00:02 2024-09-19T08:34:39.087 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-19T08:34:40.696 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 19 kB 00:00 2024-09-19T08:34:41.859 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-19T08:34:41.989 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-19T08:34:43.615 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 19 kB 00:00 2024-09-19T08:34:44.627 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-19T08:34:47.264 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-19T08:34:49.460 INFO:teuthology.orchestra.run.smithi117.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:34:49.461 INFO:teuthology.orchestra.run.smithi117.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:34:49.474 INFO:teuthology.orchestra.run.smithi117.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T08:34:49.475 INFO:teuthology.orchestra.run.smithi117.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T08:34:49.476 INFO:teuthology.orchestra.run.smithi117.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T08:34:49.477 INFO:teuthology.orchestra.run.smithi117.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T08:34:49.478 INFO:teuthology.orchestra.run.smithi117.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T08:34:49.481 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T08:34:49.482 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T08:34:49.545 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T08:34:49.561 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================== 2024-09-19T08:34:49.561 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-19T08:34:49.561 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================== 2024-09-19T08:34:49.561 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-19T08:34:49.562 INFO:teuthology.orchestra.run.smithi117.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T08:34:49.562 INFO:teuthology.orchestra.run.smithi117.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T08:34:49.562 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T08:34:49.562 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T08:34:49.562 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T08:34:49.562 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T08:34:49.562 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T08:34:49.562 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T08:34:49.562 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T08:34:49.562 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T08:34:49.562 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T08:34:49.562 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T08:34:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T08:34:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T08:34:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T08:34:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T08:34:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T08:34:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T08:34:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T08:34:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T08:34:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T08:34:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T08:34:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T08:34:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T08:34:49.563 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T08:34:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T08:34:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T08:34:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T08:34:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T08:34:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T08:34:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T08:34:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T08:34:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T08:34:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T08:34:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T08:34:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T08:34:49.564 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T08:34:49.565 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2024-09-19T08:34:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T08:34:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T08:34:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T08:34:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T08:34:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T08:34:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T08:34:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T08:34:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T08:34:49.565 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-19T08:34:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T08:34:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T08:34:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:34:49.565 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T08:34:49.566 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T08:34:49.566 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T08:34:49.566 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T08:34:49.566 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T08:34:49.566 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T08:34:49.566 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T08:34:49.566 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T08:34:49.566 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:34:49.566 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:34:49.566 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:34:49.566 INFO:teuthology.orchestra.run.smithi117.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:34:49.566 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:34:49.566 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T08:34:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:34:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:34:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T08:34:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:34:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:34:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:34:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:34:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:34:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T08:34:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:34:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T08:34:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:34:49.567 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T08:34:49.568 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:34:49.568 INFO:teuthology.orchestra.run.smithi117.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T08:34:49.568 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T08:34:49.568 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T08:34:49.568 INFO:teuthology.orchestra.run.smithi117.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:34:49.568 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:34:49.568 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:34:49.568 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T08:34:49.568 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T08:34:49.568 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T08:34:49.569 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:34:49.569 INFO:teuthology.orchestra.run.smithi117.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T08:34:49.569 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:34:49.569 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:34:49.569 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:34:49.569 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T08:34:49.569 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T08:34:49.569 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:34:49.569 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:34:49.569 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:34:49.569 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:34:49.569 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T08:34:49.569 INFO:teuthology.orchestra.run.smithi117.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T08:34:49.570 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:34:49.570 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:34:49.570 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:34:49.570 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T08:34:49.570 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T08:34:49.570 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:34:49.570 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:34:49.570 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:34:49.570 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:34:49.570 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:34:49.570 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:34:49.570 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:34:49.570 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:34:49.571 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:34:49.571 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:34:49.571 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:34:49.571 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:34:49.571 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:34:49.571 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:34:49.571 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:34:49.571 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:34:49.571 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:34:49.571 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T08:34:49.571 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:34:49.571 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:34:49.571 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:34:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:34:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T08:34:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:34:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:34:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:34:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:34:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T08:34:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:34:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:34:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:34:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:34:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:34:49.572 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:34:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:34:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:34:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:34:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:34:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:34:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T08:34:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:34:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:34:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:34:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:34:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T08:34:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T08:34:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:34:49.573 INFO:teuthology.orchestra.run.smithi117.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:34:49.574 INFO:teuthology.orchestra.run.smithi117.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:34:49.574 INFO:teuthology.orchestra.run.smithi117.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T08:34:49.574 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:34:49.574 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T08:34:49.574 INFO:teuthology.orchestra.run.smithi117.stdout:Installing weak dependencies: 2024-09-19T08:34:49.574 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T08:34:49.574 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:34:49.574 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-19T08:34:49.574 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================== 2024-09-19T08:34:49.574 INFO:teuthology.orchestra.run.smithi117.stdout:Install 148 Packages 2024-09-19T08:34:49.574 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 8 Packages 2024-09-19T08:34:49.574 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:34:49.575 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 226 M 2024-09-19T08:34:49.575 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-19T08:34:49.958 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-19T08:34:50.640 INFO:teuthology.orchestra.run.smithi117.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 47 kB/s | 6.6 kB 00:00 2024-09-19T08:34:50.841 INFO:teuthology.orchestra.run.smithi117.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.4 MB/s | 896 kB 00:00 2024-09-19T08:34:50.932 INFO:teuthology.orchestra.run.smithi117.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.6 MB/s | 145 kB 00:00 2024-09-19T08:34:51.049 INFO:teuthology.orchestra.run.smithi117.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 9.9 MB/s | 5.4 MB 00:00 2024-09-19T08:34:51.158 INFO:teuthology.orchestra.run.smithi117.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 14 MB/s | 1.5 MB 00:00 2024-09-19T08:34:51.216 INFO:teuthology.orchestra.run.smithi117.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 8.4 MB/s | 2.4 MB 00:00 2024-09-19T08:34:51.651 INFO:teuthology.orchestra.run.smithi117.stdout:(7/156): ceph-common-19.1.1-361.g2f599a46.el9.x 18 MB/s | 21 MB 00:01 2024-09-19T08:34:52.050 INFO:teuthology.orchestra.run.smithi117.stdout:(8/156): ceph-radosgw-19.1.1-361.g2f599a46.el9. 27 MB/s | 11 MB 00:00 2024-09-19T08:34:52.101 INFO:teuthology.orchestra.run.smithi117.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 505 kB/s | 25 kB 00:00 2024-09-19T08:34:52.159 INFO:teuthology.orchestra.run.smithi117.stdout:(10/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86 4.7 MB/s | 4.7 MB 00:01 2024-09-19T08:34:52.159 INFO:teuthology.orchestra.run.smithi146.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:34:52.160 INFO:teuthology.orchestra.run.smithi146.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:34:52.171 INFO:teuthology.orchestra.run.smithi146.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T08:34:52.172 INFO:teuthology.orchestra.run.smithi146.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T08:34:52.173 INFO:teuthology.orchestra.run.smithi146.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T08:34:52.173 INFO:teuthology.orchestra.run.smithi146.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T08:34:52.175 INFO:teuthology.orchestra.run.smithi146.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T08:34:52.177 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T08:34:52.178 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T08:34:52.241 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-19T08:34:52.258 INFO:teuthology.orchestra.run.smithi146.stdout:====================================================================================== 2024-09-19T08:34:52.259 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2024-09-19T08:34:52.259 INFO:teuthology.orchestra.run.smithi146.stdout:====================================================================================== 2024-09-19T08:34:52.259 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-19T08:34:52.259 INFO:teuthology.orchestra.run.smithi146.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T08:34:52.259 INFO:teuthology.orchestra.run.smithi146.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T08:34:52.259 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T08:34:52.259 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T08:34:52.259 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T08:34:52.259 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T08:34:52.259 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T08:34:52.259 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T08:34:52.259 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T08:34:52.260 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T08:34:52.260 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T08:34:52.260 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T08:34:52.260 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T08:34:52.260 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T08:34:52.260 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T08:34:52.260 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T08:34:52.260 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T08:34:52.260 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T08:34:52.260 INFO:teuthology.orchestra.run.smithi146.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T08:34:52.260 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T08:34:52.260 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T08:34:52.260 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T08:34:52.261 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T08:34:52.261 INFO:teuthology.orchestra.run.smithi146.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T08:34:52.261 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T08:34:52.261 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T08:34:52.261 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T08:34:52.261 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T08:34:52.261 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T08:34:52.261 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T08:34:52.261 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T08:34:52.261 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T08:34:52.261 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T08:34:52.261 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T08:34:52.261 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T08:34:52.262 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T08:34:52.262 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T08:34:52.262 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrading: 2024-09-19T08:34:52.262 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T08:34:52.262 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T08:34:52.262 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T08:34:52.262 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T08:34:52.262 INFO:teuthology.orchestra.run.smithi146.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T08:34:52.262 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T08:34:52.262 INFO:teuthology.orchestra.run.smithi146.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T08:34:52.262 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T08:34:52.263 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2024-09-19T08:34:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T08:34:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T08:34:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:34:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T08:34:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T08:34:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T08:34:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T08:34:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T08:34:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T08:34:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T08:34:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T08:34:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:34:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:34:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:34:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:34:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:34:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T08:34:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:34:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:34:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T08:34:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:34:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:34:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:34:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:34:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:34:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T08:34:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:34:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T08:34:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:34:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T08:34:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:34:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T08:34:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T08:34:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T08:34:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:34:52.265 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:34:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:34:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T08:34:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T08:34:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T08:34:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:34:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T08:34:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:34:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:34:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:34:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T08:34:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T08:34:52.266 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:34:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:34:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:34:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:34:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T08:34:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T08:34:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:34:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:34:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:34:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T08:34:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T08:34:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:34:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:34:52.267 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:34:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:34:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:34:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:34:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:34:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:34:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:34:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:34:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:34:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:34:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:34:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:34:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:34:52.268 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:34:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:34:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T08:34:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:34:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:34:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:34:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:34:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T08:34:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:34:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:34:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:34:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:34:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T08:34:52.269 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:34:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:34:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:34:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:34:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:34:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:34:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:34:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:34:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:34:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:34:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:34:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T08:34:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:34:52.270 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:34:52.271 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:34:52.271 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:34:52.271 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T08:34:52.271 INFO:teuthology.orchestra.run.smithi146.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T08:34:52.271 INFO:teuthology.orchestra.run.smithi146.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:34:52.271 INFO:teuthology.orchestra.run.smithi146.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:34:52.271 INFO:teuthology.orchestra.run.smithi146.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:34:52.271 INFO:teuthology.orchestra.run.smithi146.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T08:34:52.271 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:34:52.271 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T08:34:52.271 INFO:teuthology.orchestra.run.smithi146.stdout:Installing weak dependencies: 2024-09-19T08:34:52.272 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T08:34:52.272 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:34:52.272 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-19T08:34:52.272 INFO:teuthology.orchestra.run.smithi146.stdout:====================================================================================== 2024-09-19T08:34:52.272 INFO:teuthology.orchestra.run.smithi146.stdout:Install 148 Packages 2024-09-19T08:34:52.272 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrade 8 Packages 2024-09-19T08:34:52.272 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:34:52.273 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 226 M 2024-09-19T08:34:52.273 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-19T08:34:52.326 INFO:teuthology.orchestra.run.smithi117.stdout:(11/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 15 MB/s | 17 MB 00:01 2024-09-19T08:34:52.351 INFO:teuthology.orchestra.run.smithi117.stdout:(12/156): cephfs-mirror-19.1.1-361.g2f599a46.el 1.2 MB/s | 228 kB 00:00 2024-09-19T08:34:52.376 INFO:teuthology.orchestra.run.smithi117.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 541 kB/s | 27 kB 00:00 2024-09-19T08:34:52.402 INFO:teuthology.orchestra.run.smithi117.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 633 kB/s | 32 kB 00:00 2024-09-19T08:34:52.444 INFO:teuthology.orchestra.run.smithi117.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 11 MB/s | 751 kB 00:00 2024-09-19T08:34:52.469 INFO:teuthology.orchestra.run.smithi117.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.4 MB/s | 163 kB 00:00 2024-09-19T08:34:52.503 INFO:teuthology.orchestra.run.smithi117.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.1 MB/s | 127 kB 00:00 2024-09-19T08:34:52.536 INFO:teuthology.orchestra.run.smithi117.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 7.4 MB/s | 506 kB 00:00 2024-09-19T08:34:52.595 INFO:teuthology.orchestra.run.smithi117.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 770 kB/s | 45 kB 00:00 2024-09-19T08:34:52.679 INFO:teuthology.orchestra.run.smithi117.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.6 MB/s | 136 kB 00:00 2024-09-19T08:34:52.821 INFO:teuthology.orchestra.run.smithi117.stdout:(21/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 5.3 MB 00:00 2024-09-19T08:34:52.846 INFO:teuthology.orchestra.run.smithi117.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 967 kB/s | 161 kB 00:00 2024-09-19T08:34:52.871 INFO:teuthology.orchestra.run.smithi117.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 6.2 MB/s | 320 kB 00:00 2024-09-19T08:34:52.896 INFO:teuthology.orchestra.run.smithi117.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.9 MB/s | 300 kB 00:00 2024-09-19T08:34:52.922 INFO:teuthology.orchestra.run.smithi117.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T08:34:52.947 INFO:teuthology.orchestra.run.smithi117.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T08:34:52.997 INFO:teuthology.orchestra.run.smithi117.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-19T08:34:53.089 INFO:teuthology.orchestra.run.smithi117.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 19 MB/s | 3.1 MB 00:00 2024-09-19T08:34:53.114 INFO:teuthology.orchestra.run.smithi117.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 272 kB/s | 32 kB 00:00 2024-09-19T08:34:53.140 INFO:teuthology.orchestra.run.smithi117.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T08:34:53.357 INFO:teuthology.orchestra.run.smithi117.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 15 MB/s | 3.6 MB 00:00 2024-09-19T08:34:53.424 INFO:teuthology.orchestra.run.smithi117.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 3.7 MB/s | 249 kB 00:00 2024-09-19T08:34:53.442 INFO:teuthology.orchestra.run.smithi146.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 26 kB/s | 6.6 kB 00:00 2024-09-19T08:34:53.524 INFO:teuthology.orchestra.run.smithi117.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 494 kB/s | 49 kB 00:00 2024-09-19T08:34:53.616 INFO:teuthology.orchestra.run.smithi117.stdout:(34/156): ceph-mgr-diskprediction-local-19.1.1- 16 MB/s | 7.4 MB 00:00 2024-09-19T08:34:53.641 INFO:teuthology.orchestra.run.smithi117.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 141 kB/s | 16 kB 00:00 2024-09-19T08:34:53.666 INFO:teuthology.orchestra.run.smithi117.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.6 MB/s | 285 kB 00:00 2024-09-19T08:34:53.684 INFO:teuthology.orchestra.run.smithi146.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 3.6 MB/s | 896 kB 00:00 2024-09-19T08:34:53.700 INFO:teuthology.orchestra.run.smithi117.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 13 MB/s | 765 kB 00:00 2024-09-19T08:34:53.717 INFO:teuthology.orchestra.run.smithi117.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 362 kB/s | 18 kB 00:00 2024-09-19T08:34:53.734 INFO:teuthology.orchestra.run.smithi146.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 2.9 MB/s | 145 kB 00:00 2024-09-19T08:34:53.867 INFO:teuthology.orchestra.run.smithi117.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 479 kB/s | 80 kB 00:00 2024-09-19T08:34:53.926 INFO:teuthology.orchestra.run.smithi117.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.8 MB/s | 801 kB 00:00 2024-09-19T08:34:53.943 INFO:teuthology.orchestra.run.smithi146.stdout:(4/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 2.4 MB 00:00 2024-09-19T08:34:54.035 INFO:teuthology.orchestra.run.smithi146.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 1.5 MB 00:00 2024-09-19T08:34:54.218 INFO:teuthology.orchestra.run.smithi146.stdout:(6/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 26 MB/s | 4.7 MB 00:00 2024-09-19T08:34:54.385 INFO:teuthology.orchestra.run.smithi117.stdout:(41/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 21 MB/s | 49 MB 00:02 2024-09-19T08:34:54.418 INFO:teuthology.orchestra.run.smithi117.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 347 kB/s | 191 kB 00:00 2024-09-19T08:34:54.444 INFO:teuthology.orchestra.run.smithi117.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 489 kB/s | 253 kB 00:00 2024-09-19T08:34:54.502 INFO:teuthology.orchestra.run.smithi117.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-19T08:34:54.527 INFO:teuthology.orchestra.run.smithi117.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-19T08:34:54.594 INFO:teuthology.orchestra.run.smithi117.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-19T08:34:54.620 INFO:teuthology.orchestra.run.smithi117.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-19T08:34:54.662 INFO:teuthology.orchestra.run.smithi117.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 4.4 MB/s | 1.2 MB 00:00 2024-09-19T08:34:54.777 INFO:teuthology.orchestra.run.smithi146.stdout:(7/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86_ 30 MB/s | 17 MB 00:00 2024-09-19T08:34:54.821 INFO:teuthology.orchestra.run.smithi117.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 676 kB/s | 107 kB 00:00 2024-09-19T08:34:54.852 INFO:teuthology.orchestra.run.smithi146.stdout:(8/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 3.3 MB/s | 5.4 MB 00:01 2024-09-19T08:34:54.854 INFO:teuthology.orchestra.run.smithi117.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-09-19T08:34:54.880 INFO:teuthology.orchestra.run.smithi117.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 370 kB/s | 22 kB 00:00 2024-09-19T08:34:54.902 INFO:teuthology.orchestra.run.smithi146.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 507 kB/s | 25 kB 00:00 2024-09-19T08:34:54.921 INFO:teuthology.orchestra.run.smithi117.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-09-19T08:34:54.947 INFO:teuthology.orchestra.run.smithi117.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-09-19T08:34:54.972 INFO:teuthology.orchestra.run.smithi117.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-19T08:34:54.997 INFO:teuthology.orchestra.run.smithi117.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-19T08:34:55.022 INFO:teuthology.orchestra.run.smithi117.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-19T08:34:55.081 INFO:teuthology.orchestra.run.smithi117.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-09-19T08:34:55.106 INFO:teuthology.orchestra.run.smithi117.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 541 kB/s | 45 kB 00:00 2024-09-19T08:34:55.138 INFO:teuthology.orchestra.run.smithi146.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 29 MB/s | 11 MB 00:00 2024-09-19T08:34:55.140 INFO:teuthology.orchestra.run.smithi117.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-09-19T08:34:55.182 INFO:teuthology.orchestra.run.smithi117.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 662 kB 00:00 2024-09-19T08:34:55.197 INFO:teuthology.orchestra.run.smithi146.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.8 MB/s | 228 kB 00:00 2024-09-19T08:34:55.207 INFO:teuthology.orchestra.run.smithi117.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 367 kB/s | 24 kB 00:00 2024-09-19T08:34:55.232 INFO:teuthology.orchestra.run.smithi117.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2024-09-19T08:34:55.255 INFO:teuthology.orchestra.run.smithi146.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 465 kB/s | 27 kB 00:00 2024-09-19T08:34:55.257 INFO:teuthology.orchestra.run.smithi117.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 631 kB/s | 47 kB 00:00 2024-09-19T08:34:55.291 INFO:teuthology.orchestra.run.smithi117.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-19T08:34:55.313 INFO:teuthology.orchestra.run.smithi146.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 545 kB/s | 32 kB 00:00 2024-09-19T08:34:55.317 INFO:teuthology.orchestra.run.smithi117.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-19T08:34:55.342 INFO:teuthology.orchestra.run.smithi117.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 458 kB/s | 38 kB 00:00 2024-09-19T08:34:55.398 INFO:teuthology.orchestra.run.smithi146.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 8.8 MB/s | 751 kB 00:00 2024-09-19T08:34:55.448 INFO:teuthology.orchestra.run.smithi146.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 3.2 MB/s | 163 kB 00:00 2024-09-19T08:34:55.453 INFO:teuthology.orchestra.run.smithi117.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T08:34:55.506 INFO:teuthology.orchestra.run.smithi146.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 2.1 MB/s | 127 kB 00:00 2024-09-19T08:34:55.517 INFO:teuthology.orchestra.run.smithi117.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 13 MB/s | 910 kB 00:00 2024-09-19T08:34:55.573 INFO:teuthology.orchestra.run.smithi146.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 7.4 MB/s | 506 kB 00:00 2024-09-19T08:34:55.593 INFO:teuthology.orchestra.run.smithi117.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 16 MB/s | 4.9 MB 00:00 2024-09-19T08:34:55.626 INFO:teuthology.orchestra.run.smithi117.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-19T08:34:55.702 INFO:teuthology.orchestra.run.smithi117.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-19T08:34:55.735 INFO:teuthology.orchestra.run.smithi117.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-19T08:34:55.760 INFO:teuthology.orchestra.run.smithi117.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T08:34:55.774 INFO:teuthology.orchestra.run.smithi146.stdout:(18/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 27 MB/s | 5.3 MB 00:00 2024-09-19T08:34:55.824 INFO:teuthology.orchestra.run.smithi146.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 909 kB/s | 45 kB 00:00 2024-09-19T08:34:55.844 INFO:teuthology.orchestra.run.smithi117.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-19T08:34:55.870 INFO:teuthology.orchestra.run.smithi117.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 563 kB/s | 61 kB 00:00 2024-09-19T08:34:55.903 INFO:teuthology.orchestra.run.smithi117.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-19T08:34:55.929 INFO:teuthology.orchestra.run.smithi117.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-19T08:34:55.954 INFO:teuthology.orchestra.run.smithi117.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-19T08:34:55.979 INFO:teuthology.orchestra.run.smithi117.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-19T08:34:56.004 INFO:teuthology.orchestra.run.smithi117.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-19T08:34:56.030 INFO:teuthology.orchestra.run.smithi117.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-09-19T08:34:56.049 INFO:teuthology.orchestra.run.smithi146.stdout:(20/156): ceph-common-19.1.1-361.g2f599a46.el9. 7.4 MB/s | 21 MB 00:02 2024-09-19T08:34:56.074 INFO:teuthology.orchestra.run.smithi146.stdout:(21/156): python3-ceph-common-19.1.1-361.g2f599 544 kB/s | 136 kB 00:00 2024-09-19T08:34:56.099 INFO:teuthology.orchestra.run.smithi146.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.2 MB/s | 161 kB 00:00 2024-09-19T08:34:56.113 INFO:teuthology.orchestra.run.smithi117.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-19T08:34:56.125 INFO:teuthology.orchestra.run.smithi146.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 6.2 MB/s | 320 kB 00:00 2024-09-19T08:34:56.138 INFO:teuthology.orchestra.run.smithi117.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-19T08:34:56.150 INFO:teuthology.orchestra.run.smithi146.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.9 MB/s | 300 kB 00:00 2024-09-19T08:34:56.164 INFO:teuthology.orchestra.run.smithi117.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-09-19T08:34:56.175 INFO:teuthology.orchestra.run.smithi146.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T08:34:56.189 INFO:teuthology.orchestra.run.smithi117.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T08:34:56.200 INFO:teuthology.orchestra.run.smithi146.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T08:34:56.215 INFO:teuthology.orchestra.run.smithi117.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 839 kB/s | 42 kB 00:00 2024-09-19T08:34:56.240 INFO:teuthology.orchestra.run.smithi117.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-19T08:34:56.273 INFO:teuthology.orchestra.run.smithi117.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-19T08:34:56.284 INFO:teuthology.orchestra.run.smithi146.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.0 MB/s | 171 kB 00:00 2024-09-19T08:34:56.298 INFO:teuthology.orchestra.run.smithi117.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-19T08:34:56.324 INFO:teuthology.orchestra.run.smithi117.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T08:34:56.334 INFO:teuthology.orchestra.run.smithi146.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 20 MB/s | 3.1 MB 00:00 2024-09-19T08:34:56.349 INFO:teuthology.orchestra.run.smithi117.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T08:34:56.360 INFO:teuthology.orchestra.run.smithi146.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 425 kB/s | 32 kB 00:00 2024-09-19T08:34:56.385 INFO:teuthology.orchestra.run.smithi146.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T08:34:56.433 INFO:teuthology.orchestra.run.smithi117.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-19T08:34:56.458 INFO:teuthology.orchestra.run.smithi117.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-19T08:34:56.483 INFO:teuthology.orchestra.run.smithi117.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 881 kB/s | 44 kB 00:00 2024-09-19T08:34:56.508 INFO:teuthology.orchestra.run.smithi117.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-19T08:34:56.534 INFO:teuthology.orchestra.run.smithi117.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-09-19T08:34:56.559 INFO:teuthology.orchestra.run.smithi117.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-19T08:34:56.584 INFO:teuthology.orchestra.run.smithi117.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-19T08:34:56.610 INFO:teuthology.orchestra.run.smithi117.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T08:34:56.635 INFO:teuthology.orchestra.run.smithi117.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T08:34:56.660 INFO:teuthology.orchestra.run.smithi117.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T08:34:56.668 INFO:teuthology.orchestra.run.smithi146.stdout:(31/156): ceph-mgr-diskprediction-local-19.1.1- 26 MB/s | 7.4 MB 00:00 2024-09-19T08:34:56.685 INFO:teuthology.orchestra.run.smithi117.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-19T08:34:56.752 INFO:teuthology.orchestra.run.smithi146.stdout:(32/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 9.1 MB/s | 3.6 MB 00:00 2024-09-19T08:34:56.778 INFO:teuthology.orchestra.run.smithi146.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.2 MB/s | 249 kB 00:00 2024-09-19T08:34:56.802 INFO:teuthology.orchestra.run.smithi117.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 157 kB/s | 22 kB 00:00 2024-09-19T08:34:56.828 INFO:teuthology.orchestra.run.smithi146.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 658 kB/s | 49 kB 00:00 2024-09-19T08:34:56.847 INFO:teuthology.orchestra.run.smithi146.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 246 kB/s | 16 kB 00:00 2024-09-19T08:34:56.886 INFO:teuthology.orchestra.run.smithi146.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.5 MB/s | 285 kB 00:00 2024-09-19T08:34:56.903 INFO:teuthology.orchestra.run.smithi117.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 5.4 MB/s | 548 kB 00:00 2024-09-19T08:34:56.912 INFO:teuthology.orchestra.run.smithi146.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 11 MB/s | 765 kB 00:00 2024-09-19T08:34:56.929 INFO:teuthology.orchestra.run.smithi146.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 365 kB/s | 18 kB 00:00 2024-09-19T08:34:56.936 INFO:teuthology.orchestra.run.smithi117.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-19T08:34:56.961 INFO:teuthology.orchestra.run.smithi117.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-19T08:34:57.187 INFO:teuthology.orchestra.run.smithi117.stdout:(107/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-19T08:34:57.263 INFO:teuthology.orchestra.run.smithi117.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-19T08:34:57.287 INFO:teuthology.orchestra.run.smithi117.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-19T08:34:57.304 INFO:teuthology.orchestra.run.smithi146.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 204 kB/s | 80 kB 00:00 2024-09-19T08:34:57.313 INFO:teuthology.orchestra.run.smithi117.stdout:(110/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 207 kB/s | 26 kB 00:00 2024-09-19T08:34:57.338 INFO:teuthology.orchestra.run.smithi117.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-19T08:34:57.371 INFO:teuthology.orchestra.run.smithi117.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-19T08:34:57.413 INFO:teuthology.orchestra.run.smithi117.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-19T08:34:57.447 INFO:teuthology.orchestra.run.smithi117.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-19T08:34:57.473 INFO:teuthology.orchestra.run.smithi117.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 741 kB/s | 43 kB 00:00 2024-09-19T08:34:57.498 INFO:teuthology.orchestra.run.smithi117.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-19T08:34:57.513 INFO:teuthology.orchestra.run.smithi146.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 917 kB/s | 191 kB 00:00 2024-09-19T08:34:57.523 INFO:teuthology.orchestra.run.smithi117.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-19T08:34:57.546 INFO:teuthology.orchestra.run.smithi146.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 801 kB 00:00 2024-09-19T08:34:57.548 INFO:teuthology.orchestra.run.smithi117.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T08:34:57.574 INFO:teuthology.orchestra.run.smithi117.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-19T08:34:57.599 INFO:teuthology.orchestra.run.smithi117.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-19T08:34:57.624 INFO:teuthology.orchestra.run.smithi117.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T08:34:57.658 INFO:teuthology.orchestra.run.smithi117.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-19T08:34:57.680 INFO:teuthology.orchestra.run.smithi146.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-19T08:34:57.683 INFO:teuthology.orchestra.run.smithi117.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-19T08:34:57.709 INFO:teuthology.orchestra.run.smithi117.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-19T08:34:57.734 INFO:teuthology.orchestra.run.smithi117.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 933 kB/s | 23 kB 00:00 2024-09-19T08:34:57.755 INFO:teuthology.orchestra.run.smithi146.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-19T08:34:57.759 INFO:teuthology.orchestra.run.smithi117.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 782 kB/s | 19 kB 00:00 2024-09-19T08:34:57.809 INFO:teuthology.orchestra.run.smithi117.stdout:(127/156): python3-grpcio-1.46.7-10.el9.x86_64. 9.7 MB/s | 2.0 MB 00:00 2024-09-19T08:34:57.830 INFO:teuthology.orchestra.run.smithi146.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-19T08:34:57.835 INFO:teuthology.orchestra.run.smithi117.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-09-19T08:34:57.860 INFO:teuthology.orchestra.run.smithi117.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T08:34:57.906 INFO:teuthology.orchestra.run.smithi146.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-19T08:34:57.910 INFO:teuthology.orchestra.run.smithi117.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-09-19T08:34:57.944 INFO:teuthology.orchestra.run.smithi117.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 1.8 MB/s | 58 kB 00:00 2024-09-19T08:34:57.973 INFO:teuthology.orchestra.run.smithi146.stdout:(46/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-19T08:34:57.986 INFO:teuthology.orchestra.run.smithi117.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 6.4 MB/s | 272 kB 00:00 2024-09-19T08:34:58.006 INFO:teuthology.orchestra.run.smithi146.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 2.7 MB/s | 1.2 MB 00:00 2024-09-19T08:34:58.011 INFO:teuthology.orchestra.run.smithi117.stdout:(133/156): python3-more-itertools-8.12.0-2.el9. 527 kB/s | 79 kB 00:00 2024-09-19T08:34:58.036 INFO:teuthology.orchestra.run.smithi117.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-19T08:34:58.070 INFO:teuthology.orchestra.run.smithi117.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-19T08:34:58.095 INFO:teuthology.orchestra.run.smithi117.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 481 kB/s | 28 kB 00:00 2024-09-19T08:34:58.121 INFO:teuthology.orchestra.run.smithi117.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-19T08:34:58.146 INFO:teuthology.orchestra.run.smithi117.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-19T08:34:58.171 INFO:teuthology.orchestra.run.smithi117.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-19T08:34:58.197 INFO:teuthology.orchestra.run.smithi117.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-19T08:34:58.215 INFO:teuthology.orchestra.run.smithi146.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 689 kB 00:00 2024-09-19T08:34:58.230 INFO:teuthology.orchestra.run.smithi117.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-19T08:34:58.256 INFO:teuthology.orchestra.run.smithi117.stdout:(142/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-09-19T08:34:58.265 INFO:teuthology.orchestra.run.smithi146.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 3.6 MB/s | 943 kB 00:00 2024-09-19T08:34:58.289 INFO:teuthology.orchestra.run.smithi117.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-19T08:34:58.290 INFO:teuthology.orchestra.run.smithi146.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-19T08:34:58.306 INFO:teuthology.orchestra.run.smithi117.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-19T08:34:58.316 INFO:teuthology.orchestra.run.smithi146.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-19T08:34:58.331 INFO:teuthology.orchestra.run.smithi117.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-19T08:34:58.349 INFO:teuthology.orchestra.run.smithi146.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-09-19T08:34:58.365 INFO:teuthology.orchestra.run.smithi117.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T08:34:58.375 INFO:teuthology.orchestra.run.smithi146.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-09-19T08:34:58.416 INFO:teuthology.orchestra.run.smithi117.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-19T08:34:58.449 INFO:teuthology.orchestra.run.smithi117.stdout:(148/156): protobuf-compiler-3.14.0-13.el9.x86_ 490 kB/s | 863 kB 00:01 2024-09-19T08:34:58.608 INFO:teuthology.orchestra.run.smithi117.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 15 MB/s | 2.3 MB 00:00 2024-09-19T08:34:58.666 INFO:teuthology.orchestra.run.smithi117.stdout:(150/156): librados2-19.1.1-361.g2f599a46.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-19T08:34:58.728 INFO:teuthology.orchestra.run.smithi117.stdout:(151/156): librbd1-19.1.1-361.g2f599a46.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-19T08:34:58.750 INFO:teuthology.orchestra.run.smithi117.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 490 kB/s | 41 kB 00:00 2024-09-19T08:34:58.783 INFO:teuthology.orchestra.run.smithi146.stdout:(54/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 13 MB/s | 49 MB 00:03 2024-09-19T08:34:58.784 INFO:teuthology.orchestra.run.smithi117.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 10 MB/s | 1.8 MB 00:00 2024-09-19T08:34:58.808 INFO:teuthology.orchestra.run.smithi146.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 42 kB/s | 18 kB 00:00 2024-09-19T08:34:58.809 INFO:teuthology.orchestra.run.smithi117.stdout:(154/156): NetworkManager-tui-1.51.0-1.el9.x86_ 2.9 MB/s | 249 kB 00:00 2024-09-19T08:34:58.859 INFO:teuthology.orchestra.run.smithi146.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 149 kB/s | 11 kB 00:00 2024-09-19T08:34:58.859 INFO:teuthology.orchestra.run.smithi117.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-19T08:34:58.884 INFO:teuthology.orchestra.run.smithi146.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-19T08:34:58.918 INFO:teuthology.orchestra.run.smithi117.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 18 MB/s | 2.4 MB 00:00 2024-09-19T08:34:58.923 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:34:58.923 INFO:teuthology.orchestra.run.smithi117.stdout:Total 24 MB/s | 226 MB 00:09 2024-09-19T08:34:58.934 INFO:teuthology.orchestra.run.smithi146.stdout:(58/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.1 MB/s | 3.0 MB 00:00 2024-09-19T08:34:58.959 INFO:teuthology.orchestra.run.smithi146.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 450 kB/s | 45 kB 00:00 2024-09-19T08:34:58.985 INFO:teuthology.orchestra.run.smithi146.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 662 kB 00:00 2024-09-19T08:34:59.010 INFO:teuthology.orchestra.run.smithi146.stdout:(61/156): libtool-2.4.6-46.el9.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2024-09-19T08:34:59.035 INFO:teuthology.orchestra.run.smithi146.stdout:(62/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 324 kB/s | 24 kB 00:00 2024-09-19T08:34:59.060 INFO:teuthology.orchestra.run.smithi146.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-09-19T08:34:59.086 INFO:teuthology.orchestra.run.smithi146.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-19T08:34:59.111 INFO:teuthology.orchestra.run.smithi146.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 770 kB/s | 38 kB 00:00 2024-09-19T08:34:59.136 INFO:teuthology.orchestra.run.smithi146.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-19T08:34:59.253 INFO:teuthology.orchestra.run.smithi146.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-09-19T08:34:59.312 INFO:teuthology.orchestra.run.smithi146.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 15 MB/s | 910 kB 00:00 2024-09-19T08:34:59.345 INFO:teuthology.orchestra.run.smithi146.stdout:(69/156): postgresql-13.16-1.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-09-19T08:34:59.371 INFO:teuthology.orchestra.run.smithi146.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-19T08:34:59.438 INFO:teuthology.orchestra.run.smithi146.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 14 MB/s | 4.9 MB 00:00 2024-09-19T08:34:59.480 INFO:teuthology.orchestra.run.smithi146.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-19T08:34:59.505 INFO:teuthology.orchestra.run.smithi146.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-19T08:34:59.547 INFO:teuthology.orchestra.run.smithi146.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-19T08:34:59.622 INFO:teuthology.orchestra.run.smithi146.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 21 MB/s | 5.8 MB 00:00 2024-09-19T08:34:59.647 INFO:teuthology.orchestra.run.smithi146.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-19T08:34:59.673 INFO:teuthology.orchestra.run.smithi146.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-19T08:34:59.689 INFO:teuthology.orchestra.run.smithi146.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 616 kB/s | 26 kB 00:00 2024-09-19T08:34:59.765 INFO:teuthology.orchestra.run.smithi146.stdout:(79/156): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 6.0 MB 00:00 2024-09-19T08:34:59.790 INFO:teuthology.orchestra.run.smithi146.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 163 kB/s | 19 kB 00:00 2024-09-19T08:34:59.840 INFO:teuthology.orchestra.run.smithi146.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 463 kB/s | 35 kB 00:00 2024-09-19T08:34:59.866 INFO:teuthology.orchestra.run.smithi146.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 979 kB/s | 172 kB 00:00 2024-09-19T08:34:59.891 INFO:teuthology.orchestra.run.smithi146.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-19T08:34:59.916 INFO:teuthology.orchestra.run.smithi146.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-19T08:34:59.941 INFO:teuthology.orchestra.run.smithi146.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T08:34:59.967 INFO:teuthology.orchestra.run.smithi146.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-19T08:34:59.992 INFO:teuthology.orchestra.run.smithi146.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-19T08:35:00.017 INFO:teuthology.orchestra.run.smithi146.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-19T08:35:00.042 INFO:teuthology.orchestra.run.smithi146.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-19T08:35:00.068 INFO:teuthology.orchestra.run.smithi146.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T08:35:00.093 INFO:teuthology.orchestra.run.smithi146.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T08:35:00.147 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-19T08:35:00.168 INFO:teuthology.orchestra.run.smithi146.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-19T08:35:00.193 INFO:teuthology.orchestra.run.smithi146.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-19T08:35:00.219 INFO:teuthology.orchestra.run.smithi146.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 880 kB/s | 44 kB 00:00 2024-09-19T08:35:00.244 INFO:teuthology.orchestra.run.smithi146.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-19T08:35:00.269 INFO:teuthology.orchestra.run.smithi146.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 716 kB/s | 36 kB 00:00 2024-09-19T08:35:00.294 INFO:teuthology.orchestra.run.smithi146.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-19T08:35:00.299 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-19T08:35:00.299 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-19T08:35:00.319 INFO:teuthology.orchestra.run.smithi146.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-19T08:35:00.345 INFO:teuthology.orchestra.run.smithi146.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T08:35:00.370 INFO:teuthology.orchestra.run.smithi146.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T08:35:00.396 INFO:teuthology.orchestra.run.smithi146.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T08:35:00.421 INFO:teuthology.orchestra.run.smithi146.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-19T08:35:00.905 INFO:teuthology.orchestra.run.smithi146.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-19T08:35:00.988 INFO:teuthology.orchestra.run.smithi146.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 6.5 MB/s | 548 kB 00:00 2024-09-19T08:35:01.022 INFO:teuthology.orchestra.run.smithi146.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-19T08:35:01.047 INFO:teuthology.orchestra.run.smithi146.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-19T08:35:01.081 INFO:teuthology.orchestra.run.smithi146.stdout:(107/156): lua-devel-5.4.4-4.el9.x86_64.rpm 33 kB/s | 22 kB 00:00 2024-09-19T08:35:01.147 INFO:teuthology.orchestra.run.smithi146.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 390 kB/s | 26 kB 00:00 2024-09-19T08:35:01.231 INFO:teuthology.orchestra.run.smithi146.stdout:(109/156): libarrow-9.0.0-11.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-09-19T08:35:01.257 INFO:teuthology.orchestra.run.smithi146.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 447 kB/s | 49 kB 00:00 2024-09-19T08:35:01.281 INFO:teuthology.orchestra.run.smithi146.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-19T08:35:01.307 INFO:teuthology.orchestra.run.smithi146.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-19T08:35:01.341 INFO:teuthology.orchestra.run.smithi146.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-19T08:35:01.374 INFO:teuthology.orchestra.run.smithi146.stdout:(114/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-19T08:35:01.399 INFO:teuthology.orchestra.run.smithi146.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 741 kB/s | 43 kB 00:00 2024-09-19T08:35:01.424 INFO:teuthology.orchestra.run.smithi146.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 643 kB/s | 32 kB 00:00 2024-09-19T08:35:01.442 INFO:teuthology.orchestra.run.smithi146.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 337 kB/s | 14 kB 00:00 2024-09-19T08:35:01.458 INFO:teuthology.orchestra.run.smithi146.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-19T08:35:01.484 INFO:teuthology.orchestra.run.smithi146.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 8.4 MB/s | 358 kB 00:00 2024-09-19T08:35:01.509 INFO:teuthology.orchestra.run.smithi146.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-19T08:35:01.535 INFO:teuthology.orchestra.run.smithi146.stdout:(121/156): protobuf-compiler-3.14.0-13.el9.x86_ 775 kB/s | 863 kB 00:01 2024-09-19T08:35:01.560 INFO:teuthology.orchestra.run.smithi146.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.8 MB/s | 220 kB 00:00 2024-09-19T08:35:01.585 INFO:teuthology.orchestra.run.smithi146.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 645 kB/s | 11 kB 00:00 2024-09-19T08:35:01.610 INFO:teuthology.orchestra.run.smithi146.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 768 kB/s | 18 kB 00:00 2024-09-19T08:35:01.627 INFO:teuthology.orchestra.run.smithi146.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-19T08:35:01.652 INFO:teuthology.orchestra.run.smithi146.stdout:(126/156): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-09-19T08:35:01.677 INFO:teuthology.orchestra.run.smithi146.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-19T08:35:01.703 INFO:teuthology.orchestra.run.smithi146.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-19T08:35:01.820 INFO:teuthology.orchestra.run.smithi146.stdout:(129/156): python3-grpcio-1.46.7-10.el9.x86_64. 6.6 MB/s | 2.0 MB 00:00 2024-09-19T08:35:01.920 INFO:teuthology.orchestra.run.smithi146.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 213 kB/s | 46 kB 00:00 2024-09-19T08:35:01.945 INFO:teuthology.orchestra.run.smithi146.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 629 kB/s | 79 kB 00:00 2024-09-19T08:35:01.971 INFO:teuthology.orchestra.run.smithi146.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-19T08:35:01.996 INFO:teuthology.orchestra.run.smithi146.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-09-19T08:35:02.021 INFO:teuthology.orchestra.run.smithi146.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-19T08:35:02.046 INFO:teuthology.orchestra.run.smithi146.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-19T08:35:02.072 INFO:teuthology.orchestra.run.smithi146.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-19T08:35:02.097 INFO:teuthology.orchestra.run.smithi146.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-19T08:35:02.131 INFO:teuthology.orchestra.run.smithi146.stdout:(138/156): python3-kubernetes-26.1.0-2.el9.noar 2.3 MB/s | 1.0 MB 00:00 2024-09-19T08:35:02.156 INFO:teuthology.orchestra.run.smithi146.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-19T08:35:02.181 INFO:teuthology.orchestra.run.smithi146.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-19T08:35:02.206 INFO:teuthology.orchestra.run.smithi146.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-19T08:35:02.232 INFO:teuthology.orchestra.run.smithi146.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-19T08:35:02.257 INFO:teuthology.orchestra.run.smithi146.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T08:35:02.282 INFO:teuthology.orchestra.run.smithi146.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T08:35:02.307 INFO:teuthology.orchestra.run.smithi146.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-19T08:35:02.333 INFO:teuthology.orchestra.run.smithi146.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T08:35:02.358 INFO:teuthology.orchestra.run.smithi146.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T08:35:02.450 INFO:teuthology.orchestra.run.smithi146.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-19T08:35:02.567 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-19T08:35:02.568 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-19T08:35:02.650 INFO:teuthology.orchestra.run.smithi146.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-19T08:35:02.800 INFO:teuthology.orchestra.run.smithi146.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.1 MB/s | 3.2 MB 00:00 2024-09-19T08:35:02.976 INFO:teuthology.orchestra.run.smithi146.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 233 kB/s | 41 kB 00:00 2024-09-19T08:35:03.109 INFO:teuthology.orchestra.run.smithi146.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 1.8 MB/s | 249 kB 00:00 2024-09-19T08:35:03.193 INFO:teuthology.orchestra.run.smithi146.stdout:(153/156): NetworkManager-1.51.0-1.el9.x86_64.r 3.1 MB/s | 2.3 MB 00:00 2024-09-19T08:35:03.318 INFO:teuthology.orchestra.run.smithi146.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 6.5 MB/s | 1.4 MB 00:00 2024-09-19T08:35:03.643 INFO:teuthology.orchestra.run.smithi146.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 5.3 MB/s | 2.4 MB 00:00 2024-09-19T08:35:03.868 INFO:teuthology.orchestra.run.smithi146.stdout:(156/156): NetworkManager-libnm-1.51.0-1.el9.x8 1.5 MB/s | 1.8 MB 00:01 2024-09-19T08:35:03.875 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:35:03.875 INFO:teuthology.orchestra.run.smithi146.stdout:Total 19 MB/s | 226 MB 00:11 2024-09-19T08:35:05.048 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-19T08:35:05.202 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-19T08:35:05.202 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-19T08:35:07.420 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-19T08:35:07.421 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-19T08:35:08.955 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-19T08:35:09.073 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T08:35:09.121 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T08:35:09.181 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T08:35:09.223 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T08:35:09.248 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T08:35:09.313 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T08:35:09.637 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T08:35:09.749 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:35:09.871 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:35:09.900 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:35:09.991 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:35:10.022 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:35:10.184 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T08:35:10.243 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T08:35:10.271 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:35:10.376 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:35:10.405 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:35:10.452 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:35:10.473 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:35:10.494 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:35:10.675 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:35:10.855 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:35:10.979 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T08:35:11.097 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:35:11.181 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:35:11.405 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:35:11.510 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T08:35:11.605 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T08:35:11.644 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T08:35:11.678 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T08:35:11.742 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T08:35:11.787 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T08:35:11.829 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T08:35:11.872 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T08:35:11.905 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T08:35:11.932 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T08:35:12.009 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T08:35:12.072 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T08:35:12.111 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T08:35:12.155 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T08:35:12.230 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T08:35:12.265 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T08:35:12.309 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T08:35:12.337 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T08:35:12.407 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T08:35:12.469 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T08:35:12.543 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T08:35:12.686 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T08:35:12.763 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T08:35:13.300 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T08:35:13.382 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T08:35:13.420 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T08:35:13.464 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T08:35:13.501 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T08:35:13.543 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T08:35:13.696 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T08:35:13.746 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T08:35:13.800 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T08:35:13.833 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-19T08:35:13.881 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T08:35:13.914 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T08:35:13.922 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T08:35:13.958 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T08:35:13.982 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T08:35:14.005 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T08:35:14.040 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T08:35:14.072 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T08:35:14.084 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T08:35:14.113 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T08:35:14.126 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T08:35:14.139 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T08:35:14.190 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T08:35:14.260 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T08:35:14.303 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T08:35:14.352 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T08:35:14.453 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T08:35:14.495 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T08:35:14.522 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T08:35:14.536 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T08:35:14.568 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T08:35:14.593 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T08:35:14.631 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:35:14.683 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T08:35:14.737 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:35:14.774 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:35:14.812 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T08:35:14.854 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:35:14.887 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:35:14.984 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T08:35:15.024 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T08:35:15.055 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T08:35:15.057 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T08:35:15.097 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T08:35:15.119 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T08:35:15.144 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:35:15.145 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T08:35:15.175 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T08:35:15.210 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T08:35:15.243 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T08:35:15.249 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:35:15.279 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:35:15.285 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T08:35:15.319 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T08:35:15.341 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:35:15.363 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:35:15.383 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:35:15.406 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T08:35:15.449 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T08:35:15.481 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T08:35:15.592 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T08:35:15.598 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:35:15.647 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T08:35:15.781 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:35:15.913 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T08:35:16.022 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:35:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:35:16.305 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:35:16.364 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T08:35:16.409 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T08:35:16.420 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T08:35:16.454 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T08:35:16.496 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T08:35:16.534 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T08:35:16.551 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T08:35:16.568 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T08:35:16.609 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T08:35:16.633 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T08:35:16.654 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T08:35:16.677 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T08:35:16.710 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T08:35:16.741 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T08:35:16.757 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T08:35:16.773 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T08:35:16.795 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T08:35:16.822 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T08:35:16.882 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T08:35:16.945 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T08:35:16.957 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T08:35:16.975 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T08:35:16.988 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T08:35:17.029 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T08:35:17.082 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T08:35:17.144 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T08:35:17.196 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T08:35:17.241 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T08:35:17.268 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T08:35:17.337 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T08:35:17.383 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T08:35:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T08:35:17.588 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T08:35:17.642 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T08:35:17.734 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T08:35:17.845 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T08:35:18.175 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T08:35:18.254 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T08:35:18.284 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T08:35:18.327 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T08:35:18.365 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T08:35:18.407 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T08:35:18.558 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T08:35:18.609 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T08:35:18.689 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T08:35:18.770 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T08:35:18.802 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T08:35:18.837 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T08:35:18.884 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T08:35:18.920 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T08:35:18.963 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T08:35:19.005 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T08:35:19.097 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T08:35:19.141 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T08:35:19.178 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T08:35:19.191 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T08:35:19.206 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T08:35:19.231 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T08:35:19.239 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T08:35:19.334 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T08:35:19.366 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T08:35:19.406 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T08:35:19.439 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T08:35:19.463 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T08:35:19.549 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T08:35:19.557 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T08:35:19.593 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:35:19.681 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T08:35:19.684 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:35:19.723 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T08:35:19.760 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T08:35:19.905 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T08:35:19.941 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T08:35:19.980 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T08:35:20.023 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T08:35:20.063 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T08:35:20.092 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T08:35:20.130 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T08:35:20.163 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T08:35:20.216 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T08:35:20.239 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T08:35:20.248 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T08:35:20.271 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:35:20.338 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T08:35:20.343 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:35:20.373 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T08:35:20.386 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T08:35:20.417 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T08:35:20.520 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T08:35:20.576 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T08:35:21.295 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T08:35:21.340 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T08:35:21.373 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T08:35:21.472 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T08:35:21.520 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T08:35:21.573 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T08:35:21.660 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T08:35:21.701 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T08:35:21.887 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T08:35:21.915 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T08:35:21.994 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T08:35:22.642 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T08:35:22.771 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T08:35:22.849 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:35:22.888 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:35:23.441 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:35:23.481 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:35:23.555 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:35:23.556 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:35:23.556 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:35:23.556 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:35:23.600 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:35:24.014 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T08:35:24.101 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T08:35:24.129 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T08:35:24.162 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T08:35:24.475 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T08:35:24.517 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:35:24.607 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:35:24.638 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T08:35:24.675 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T08:35:25.157 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T08:35:25.186 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:35:25.258 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:35:25.338 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T08:35:27.715 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:35:27.750 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:35:28.316 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:35:28.354 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:35:28.445 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:35:28.446 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:35:28.446 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:35:28.446 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:35:28.480 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:35:35.473 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:35:35.473 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /sys 2024-09-19T08:35:35.473 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /proc 2024-09-19T08:35:35.473 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /mnt 2024-09-19T08:35:35.473 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /var/tmp 2024-09-19T08:35:35.473 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /home 2024-09-19T08:35:35.473 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /root 2024-09-19T08:35:35.473 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /tmp 2024-09-19T08:35:35.473 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:35:35.659 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:35:35.675 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:35:35.675 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:35:35.675 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T08:35:35.675 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:35:37.180 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:35:37.207 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:35:37.207 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:35:37.207 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:35:37.207 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:35:37.207 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:35:37.207 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:35:37.439 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:35:37.462 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:35:37.462 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:35:37.462 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:35:37.463 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:35:37.463 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:35:37.463 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:35:37.898 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:35:37.921 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:35:37.921 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:35:37.921 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:35:37.921 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:35:37.922 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:35:37.922 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:35:38.019 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T08:35:38.067 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T08:35:38.123 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T08:35:38.316 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T08:35:38.365 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T08:35:38.443 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T08:35:38.531 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T08:35:38.670 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T08:35:38.740 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T08:35:38.772 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T08:35:38.800 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T08:35:39.228 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:35:39.256 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:35:39.288 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T08:35:39.350 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T08:35:39.380 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:35:40.354 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:35:40.354 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /sys 2024-09-19T08:35:40.354 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /proc 2024-09-19T08:35:40.354 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /mnt 2024-09-19T08:35:40.354 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /var/tmp 2024-09-19T08:35:40.354 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /home 2024-09-19T08:35:40.355 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /root 2024-09-19T08:35:40.355 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /tmp 2024-09-19T08:35:40.355 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:35:40.440 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:35:40.481 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:35:40.525 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:35:40.541 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:35:40.541 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:35:40.542 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T08:35:40.542 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:35:41.453 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:35:41.482 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:35:41.583 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:35:41.745 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T08:35:41.776 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:35:41.800 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:35:41.800 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:35:41.800 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:35:41.800 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:35:41.800 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:35:41.800 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:35:41.851 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:35:41.863 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:35:41.969 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T08:35:42.035 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T08:35:42.036 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:35:42.064 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:35:42.064 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:35:42.064 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:35:42.064 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:35:42.064 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:35:42.064 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:35:42.295 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:35:42.319 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:35:42.319 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:35:42.319 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:35:42.319 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:35:42.319 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:35:42.319 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:35:42.755 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:35:42.778 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:35:42.778 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:35:42.778 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:35:42.778 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:35:42.778 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:35:42.778 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:35:42.876 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T08:35:42.933 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T08:35:42.958 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T08:35:42.988 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T08:35:42.995 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:35:43.020 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:35:43.020 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:35:43.020 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:35:43.020 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:35:43.020 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:35:43.020 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:35:43.063 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:35:43.086 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:35:43.086 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:35:43.086 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:35:43.086 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:35:43.130 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:35:43.154 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:35:43.154 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:35:43.154 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T08:35:43.154 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:35:43.154 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:35:43.154 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:35:43.172 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T08:35:43.222 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T08:35:43.299 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T08:35:43.396 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T08:35:43.464 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:35:43.488 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:35:43.488 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:35:43.488 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:35:43.488 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:35:43.488 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:35:43.488 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:35:43.535 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T08:35:43.583 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T08:35:43.620 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T08:35:43.648 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T08:35:44.051 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:35:44.080 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:35:44.111 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T08:35:44.173 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T08:35:44.203 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:35:45.247 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:35:45.279 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:35:46.244 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:35:46.271 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:35:46.372 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:35:46.537 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T08:35:46.565 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:35:46.589 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:35:46.589 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:35:46.589 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:35:46.589 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:35:46.589 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:35:46.590 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:35:46.641 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:35:46.652 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:35:46.753 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T08:35:46.812 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T08:35:47.740 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T08:35:47.768 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:35:47.792 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:35:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:35:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:35:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:35:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:35:47.792 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:35:47.835 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:35:47.858 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:35:47.858 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:35:47.859 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:35:47.859 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:35:47.903 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:35:47.926 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:35:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:35:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T08:35:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:35:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:35:47.926 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:35:48.118 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:35:48.159 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:35:48.208 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:35:48.228 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:35:48.248 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:35:48.251 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:35:48.251 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:35:48.251 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:35:48.252 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:35:48.252 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:35:48.252 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:35:48.276 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:35:48.473 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:35:48.526 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:35:48.556 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:35:48.583 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:35:48.622 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:35:49.228 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:35:49.268 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:35:49.289 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:35:50.129 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:35:50.207 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:35:50.253 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:35:50.353 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:35:50.384 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:35:50.410 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:35:50.436 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:35:50.436 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:35:50.520 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:35:50.520 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:35:50.604 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:35:50.629 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:35:50.634 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:35:50.635 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:35:50.823 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:35:50.824 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:35:50.898 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:35:50.964 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:35:52.832 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:35:52.875 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:35:52.914 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:35:52.946 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:35:52.973 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:35:53.172 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:35:53.244 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:35:53.275 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:35:53.305 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:35:53.351 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:35:53.907 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:35:53.948 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:35:53.968 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:35:54.801 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:35:54.886 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:35:54.932 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:35:55.018 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:35:55.047 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:35:55.073 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:35:55.098 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:35:55.098 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:35:55.174 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:35:55.174 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:35:55.241 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:35:55.267 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:35:55.272 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:35:55.272 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:35:55.460 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:35:55.460 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:35:55.544 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:35:55.609 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:35:56.796 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:35:56.796 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:35:56.796 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:35:56.796 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:35:56.796 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:35:56.796 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:35:56.796 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:35:56.796 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:35:56.796 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:35:56.797 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:35:56.797 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:35:56.797 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:35:56.797 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:35:56.797 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:35:56.797 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:35:56.797 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:35:56.797 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:35:56.797 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:35:56.797 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:35:56.797 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:35:56.797 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:35:56.798 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:35:56.798 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:35:56.798 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:35:56.798 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:35:56.798 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:35:56.798 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:35:56.798 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:35:56.798 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:35:56.798 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:35:56.798 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:35:56.798 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:35:56.798 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:35:56.798 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:35:56.799 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:35:56.799 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:35:56.799 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:35:56.799 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:35:56.799 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:35:56.799 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:35:56.799 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:35:56.799 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:35:56.799 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:35:56.799 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:35:56.799 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:35:56.799 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:35:56.799 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:35:56.800 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:35:56.800 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:35:56.800 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:35:56.800 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:35:56.800 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:35:56.800 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:35:56.800 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:35:56.800 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:35:56.800 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:35:56.800 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:35:56.800 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:35:56.800 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:35:56.801 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:35:56.801 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:35:56.801 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:35:56.801 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:35:56.801 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:35:56.801 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:35:56.801 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:35:56.801 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:35:56.801 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:35:56.801 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:35:56.801 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:35:56.801 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:35:56.802 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:35:56.802 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:35:56.802 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:35:56.802 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:35:56.802 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:35:56.802 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:35:56.802 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:35:56.802 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:35:56.802 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:35:56.802 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:35:56.802 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:35:56.802 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:35:56.802 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:35:56.803 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:35:56.803 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:35:56.803 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:35:56.803 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:35:56.803 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:35:56.803 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:35:56.803 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:35:56.803 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:35:56.803 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:35:56.803 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:35:56.803 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:35:56.803 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:35:56.803 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:35:56.804 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:35:56.804 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:35:56.804 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:35:56.804 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:35:56.804 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:35:56.804 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:35:56.804 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:35:56.804 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:35:56.804 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:35:56.804 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:35:56.804 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:35:56.804 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:35:56.805 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:35:56.805 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:35:56.805 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:35:56.805 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:35:56.805 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:35:56.805 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:35:56.805 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:35:56.805 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:35:56.805 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:35:56.805 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:35:56.805 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:35:56.805 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:35:56.805 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:35:56.806 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:35:56.806 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:35:56.806 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:35:56.806 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:35:56.806 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:35:56.806 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:35:56.806 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:35:56.806 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:35:56.806 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:35:56.806 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:35:56.806 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:35:56.806 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:35:56.806 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:35:56.806 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:35:56.807 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:35:56.807 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:35:56.807 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:35:56.807 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:35:56.807 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:35:56.807 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:35:56.807 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:35:56.807 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:35:56.807 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:35:56.807 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:35:56.807 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:35:56.807 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:35:56.807 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:35:56.808 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:35:56.808 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:35:56.808 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:35:56.808 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:35:56.808 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:35:56.808 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:35:56.808 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:35:56.808 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:35:56.808 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:35:56.808 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:35:56.808 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:35:56.808 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:35:56.808 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:35:56.809 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:35:56.809 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:35:59.581 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:35:59.582 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:35:59.582 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2024-09-19T08:35:59.582 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:35:59.582 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:35:59.582 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:35:59.582 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:35:59.582 INFO:teuthology.orchestra.run.smithi117.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.582 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.582 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:35:59.582 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:35:59.582 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-19T08:35:59.582 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:35:59.582 INFO:teuthology.orchestra.run.smithi117.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:35:59.583 INFO:teuthology.orchestra.run.smithi117.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:35:59.583 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:35:59.583 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.583 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.583 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.583 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.583 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:35:59.583 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.583 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.583 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.583 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:35:59.583 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:35:59.584 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:35:59.584 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:35:59.584 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:35:59.584 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.584 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.584 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:35:59.584 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.584 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.584 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.584 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:35:59.584 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:35:59.584 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.585 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.585 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:35:59.585 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:35:59.585 INFO:teuthology.orchestra.run.smithi117.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:35:59.585 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:35:59.585 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:35:59.585 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:35:59.585 INFO:teuthology.orchestra.run.smithi117.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:35:59.585 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:35:59.585 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:35:59.585 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:35:59.585 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:35:59.586 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:35:59.586 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.586 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.586 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.586 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:35:59.586 INFO:teuthology.orchestra.run.smithi117.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:35:59.586 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:35:59.586 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:35:59.586 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:35:59.586 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.586 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.586 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:35:59.586 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.587 INFO:teuthology.orchestra.run.smithi117.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:35:59.587 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:35:59.587 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:35:59.587 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:35:59.587 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:35:59.587 INFO:teuthology.orchestra.run.smithi117.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:35:59.587 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:35:59.587 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:35:59.587 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:35:59.587 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:35:59.587 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:35:59.587 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:35:59.588 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:35:59.588 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:35:59.588 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:35:59.588 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:35:59.588 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:35:59.588 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:35:59.588 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:35:59.588 INFO:teuthology.orchestra.run.smithi117.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:35:59.588 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:35:59.588 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:35:59.588 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:35:59.588 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.588 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.589 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.589 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:35:59.589 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:35:59.589 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:35:59.589 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:35:59.589 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:35:59.589 INFO:teuthology.orchestra.run.smithi117.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:35:59.589 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:35:59.589 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:35:59.589 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:35:59.589 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:35:59.589 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:35:59.589 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:35:59.590 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:35:59.590 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:35:59.590 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:35:59.590 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:35:59.590 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:35:59.590 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:35:59.590 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:35:59.590 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:35:59.590 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:35:59.590 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:35:59.590 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:35:59.590 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:35:59.590 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:35:59.591 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:35:59.591 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:35:59.591 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:35:59.591 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:35:59.591 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:35:59.591 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:35:59.591 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:35:59.591 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:35:59.591 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:35:59.591 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:35:59.591 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:35:59.591 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:35:59.591 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:35:59.591 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:35:59.592 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:35:59.592 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.592 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.592 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:35:59.592 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:35:59.592 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:35:59.592 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.592 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:35:59.592 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:35:59.592 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:35:59.592 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:35:59.592 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:35:59.592 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:35:59.593 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:35:59.593 INFO:teuthology.orchestra.run.smithi117.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:35:59.593 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:35:59.593 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:35:59.593 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:35:59.593 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:35:59.593 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:35:59.593 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:35:59.593 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:35:59.593 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.593 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.593 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:35:59.593 INFO:teuthology.orchestra.run.smithi117.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:35:59.594 INFO:teuthology.orchestra.run.smithi117.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:35:59.594 INFO:teuthology.orchestra.run.smithi117.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:35:59.594 INFO:teuthology.orchestra.run.smithi117.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:35:59.594 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:35:59.594 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:35:59.594 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:35:59.594 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:35:59.594 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T08:35:59.975 DEBUG:teuthology.parallel:result is None 2024-09-19T08:36:01.111 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:36:01.112 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:36:01.112 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:36:01.112 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:36:01.112 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:36:01.112 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:36:01.112 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:36:01.112 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:36:01.112 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:36:01.113 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:36:01.113 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:36:01.113 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:36:01.113 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:36:01.113 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:36:01.113 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:36:01.113 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:36:01.113 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:36:01.113 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:36:01.114 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:36:01.114 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:36:01.114 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:36:01.114 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:36:01.114 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:36:01.114 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:36:01.114 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:36:01.114 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:36:01.114 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:36:01.114 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:36:01.114 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:36:01.115 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:36:01.115 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:36:01.129 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:36:01.129 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:36:01.129 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:36:01.129 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:36:01.129 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:36:01.129 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:36:01.130 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:36:01.130 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:36:01.130 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:36:01.130 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:36:01.130 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:36:01.130 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:36:01.130 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:36:01.130 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:36:01.130 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:36:01.130 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:36:01.130 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:36:01.131 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:36:01.131 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:36:01.131 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:36:01.131 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:36:01.131 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:36:01.131 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:36:01.131 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:36:01.131 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:36:01.131 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:36:01.131 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:36:01.131 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:36:01.132 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:36:01.132 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:36:01.132 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:36:01.132 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:36:01.132 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:36:01.132 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:36:01.132 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:36:01.132 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:36:01.132 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:36:01.132 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:36:01.132 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:36:01.133 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:36:01.133 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:36:01.133 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:36:01.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:36:01.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:36:01.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:36:01.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:36:01.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:36:01.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:36:01.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:36:01.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:36:01.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:36:01.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:36:01.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:36:01.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:36:01.134 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:36:01.135 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:36:01.135 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:36:01.135 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:36:01.135 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:36:01.135 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:36:01.135 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:36:01.135 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:36:01.135 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:36:01.135 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:36:01.135 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:36:01.135 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:36:01.135 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:36:01.135 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:36:01.136 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:36:01.136 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:36:01.136 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:36:01.136 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:36:01.136 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:36:01.136 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:36:01.136 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:36:01.136 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:36:01.136 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:36:01.136 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:36:01.136 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:36:01.136 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:36:01.137 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:36:01.137 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:36:01.137 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:36:01.137 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:36:01.137 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:36:01.137 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:36:01.137 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:36:01.137 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:36:01.137 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:36:01.137 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:36:01.137 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:36:01.137 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:36:01.137 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:36:01.137 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:36:01.138 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:36:01.138 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:36:01.138 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:36:01.138 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:36:01.138 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:36:01.138 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:36:01.138 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:36:01.138 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:36:01.138 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:36:01.138 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:36:01.138 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:36:01.138 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:36:01.138 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:36:01.139 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:36:01.139 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:36:01.139 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:36:01.139 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:36:01.139 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:36:01.139 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:36:01.139 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:36:01.139 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:36:01.139 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:36:01.139 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:36:01.139 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:36:01.139 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:36:01.139 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:36:01.139 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:36:01.140 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:36:01.140 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:36:01.140 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:36:01.140 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:36:01.140 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:36:01.140 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:36:01.140 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:36:01.140 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:36:01.140 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:36:01.140 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:36:01.140 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:36:01.140 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:36:03.655 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:36:03.655 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:03.655 INFO:teuthology.orchestra.run.smithi146.stdout:Upgraded: 2024-09-19T08:36:03.655 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:36:03.655 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:36:03.655 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:36:03.655 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:36:03.656 INFO:teuthology.orchestra.run.smithi146.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.656 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.656 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:36:03.656 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:36:03.656 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-19T08:36:03.656 INFO:teuthology.orchestra.run.smithi146.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:36:03.656 INFO:teuthology.orchestra.run.smithi146.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:36:03.656 INFO:teuthology.orchestra.run.smithi146.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:36:03.656 INFO:teuthology.orchestra.run.smithi146.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:36:03.656 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.656 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.656 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.657 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.657 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:36:03.657 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.657 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.657 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.657 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:36:03.657 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:36:03.657 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:36:03.657 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:36:03.657 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:36:03.657 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.657 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:36:03.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:36:03.658 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:36:03.658 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.658 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.658 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:36:03.658 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:36:03.658 INFO:teuthology.orchestra.run.smithi146.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:36:03.659 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:36:03.659 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:36:03.659 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:36:03.659 INFO:teuthology.orchestra.run.smithi146.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:36:03.659 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:36:03.659 INFO:teuthology.orchestra.run.smithi146.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:36:03.659 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:36:03.659 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:36:03.659 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:36:03.659 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.659 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.660 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.660 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:36:03.660 INFO:teuthology.orchestra.run.smithi146.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:36:03.660 INFO:teuthology.orchestra.run.smithi146.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:36:03.660 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:36:03.660 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:36:03.660 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.660 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.660 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:36:03.660 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.660 INFO:teuthology.orchestra.run.smithi146.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:36:03.661 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:36:03.661 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:36:03.661 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:36:03.661 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:36:03.661 INFO:teuthology.orchestra.run.smithi146.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:36:03.661 INFO:teuthology.orchestra.run.smithi146.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:36:03.661 INFO:teuthology.orchestra.run.smithi146.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:36:03.661 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:36:03.661 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:36:03.661 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:36:03.661 INFO:teuthology.orchestra.run.smithi146.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:36:03.662 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:36:03.662 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:36:03.662 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:36:03.662 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:36:03.662 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:36:03.662 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:36:03.662 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:36:03.662 INFO:teuthology.orchestra.run.smithi146.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:36:03.662 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:36:03.662 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:36:03.662 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:36:03.662 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:36:03.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:36:03.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:36:03.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:36:03.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:36:03.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:36:03.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:36:03.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:36:03.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:36:03.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:36:03.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:36:03.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:36:03.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:36:03.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:36:03.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:36:03.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:36:03.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:36:03.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:36:03.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:36:03.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:36:03.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:36:03.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:36:03.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:36:03.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:36:03.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:36:03.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:36:03.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:36:03.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:36:03.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:36:03.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:36:03.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:36:03.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:36:03.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:36:03.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:36:03.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:36:03.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:36:03.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:36:03.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:36:03.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:36:03.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:36:03.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:36:03.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:36:03.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:36:03.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:36:03.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:36:03.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:36:03.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:36:03.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:36:03.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:36:03.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:36:03.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:36:03.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:36:03.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:36:03.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:36:03.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:36:03.667 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:36:03.667 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:36:03.667 INFO:teuthology.orchestra.run.smithi146.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:36:03.667 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.668 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.668 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:36:03.668 INFO:teuthology.orchestra.run.smithi146.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:36:03.668 INFO:teuthology.orchestra.run.smithi146.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:36:03.668 INFO:teuthology.orchestra.run.smithi146.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:36:03.668 INFO:teuthology.orchestra.run.smithi146.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:36:03.668 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:36:03.668 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:36:03.668 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:36:03.668 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:03.668 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-19T08:36:04.054 DEBUG:teuthology.parallel:result is None 2024-09-19T08:36:04.056 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:36:04.212 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:36:04.238 INFO:teuthology.orchestra.run.smithi117.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:36:04.239 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:36:04.239 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:36:04.241 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:36:04.381 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:36:04.403 INFO:teuthology.orchestra.run.smithi146.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:36:04.403 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:36:04.403 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:36:04.405 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T08:36:04.406 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:04.406 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:36:04.439 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:36:04.440 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:36:04.471 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T08:36:04.472 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:04.472 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:36:04.508 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:36:04.576 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:36:04.576 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:36:04.601 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:36:04.667 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T08:36:04.667 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:04.667 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:36:04.695 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:36:04.761 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:36:04.762 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:36:04.787 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:36:04.852 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T08:36:04.852 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:04.852 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:36:04.879 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:36:04.947 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:36:04.947 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:36:04.972 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:36:05.036 INFO:teuthology.run_tasks:Running task ceph... 2024-09-19T08:36:05.122 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-19T08:36:05.122 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /var/log/ceph 2024-09-19T08:36:05.125 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 777 /var/log/ceph 2024-09-19T08:36:05.151 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-19T08:36:05.152 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-19T08:36:05.192 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-19T08:36:05.217 INFO:tasks.ceph:Creating extra log directories... 2024-09-19T08:36:05.217 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-19T08:36:05.259 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-19T08:36:05.293 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-19T08:36:05.294 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-19T08:36:05.294 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-19T08:36:05.294 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:05.295 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-19T08:36:05.340 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-19T08:36:05.451 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-19T08:36:05.476 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:36:05.477 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-19T08:36:05.492 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-19T08:36:05.605 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-19T08:36:05.635 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-19T08:36:05.635 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected', 'object missing on disk', 'Invalid tag char'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-19T08:36:05.635 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911862', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/forward-scrub}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7911862', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected', 'object missing on disk', 'Invalid tag char'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '6fad5dd73c93545e52f57f681e140a9c3529c11e'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1747, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'sleep_before_teardown': 0, 'subset': '176/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '6fad5dd73c93545e52f57f681e140a9c3529c11e', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi117.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEebT1m6U2Q14e8UwzDO1pxP9n6QrxO6g0O4aGa6pJkIiKPiTIsLnIFTp21i/UMZOc72selwdXPyWl+v+yT3gJ0=', 'smithi146.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEZBBL32PqWKesC3e6w+dOa5mIThTYCquqmBSlp1epGRa55FsOsl/2Y5xyrzLIj+y6F0CzzzmZqFjKuqkxyXiak='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected', 'object missing on disk', 'Invalid tag char'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-18_21:24:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-19T08:36:05.636 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-19T08:36:05.638 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-19T08:36:05.686 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/run/ceph 2024-09-19T08:36:05.695 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/run/ceph 2024-09-19T08:36:05.752 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:05.752 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:36:05.773 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:36:05.774 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2024-09-19T08:36:05.829 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:36:05.829 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:36:05.829 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T08:36:05.829 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:36:05.829 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:36:05.829 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-19 08:35:51.366505831 +0000 2024-09-19T08:36:05.830 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-19 08:34:07.381871316 +0000 2024-09-19T08:36:05.830 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-19 08:34:07.381871316 +0000 2024-09-19T08:36:05.830 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-19 08:34:07.381871316 +0000 2024-09-19T08:36:05.830 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:36:05.896 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-19T08:36:05.896 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-19T08:36:05.896 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000202011 s, 2.5 MB/s 2024-09-19T08:36:05.897 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:36:05.954 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2024-09-19T08:36:06.010 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:36:06.010 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:36:06.010 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-19T08:36:06.010 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:36:06.011 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:36:06.011 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-19 08:35:51.366505831 +0000 2024-09-19T08:36:06.011 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-19 08:34:07.707865371 +0000 2024-09-19T08:36:06.011 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-19 08:34:07.707865371 +0000 2024-09-19T08:36:06.011 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-19 08:34:07.707865371 +0000 2024-09-19T08:36:06.011 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:36:06.074 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-19T08:36:06.074 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-19T08:36:06.074 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000223766 s, 2.3 MB/s 2024-09-19T08:36:06.075 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:36:06.132 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2024-09-19T08:36:06.188 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:36:06.188 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:36:06.188 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-19T08:36:06.189 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:36:06.189 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:36:06.189 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-19 08:35:51.367505812 +0000 2024-09-19T08:36:06.189 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-19 08:34:08.017859719 +0000 2024-09-19T08:36:06.189 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-19 08:34:08.017859719 +0000 2024-09-19T08:36:06.189 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-19 08:34:08.017859719 +0000 2024-09-19T08:36:06.189 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:36:06.252 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-19T08:36:06.252 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-19T08:36:06.252 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000186105 s, 2.8 MB/s 2024-09-19T08:36:06.254 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:36:06.310 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2024-09-19T08:36:06.366 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:36:06.366 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:36:06.366 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-19T08:36:06.366 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:36:06.366 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:36:06.366 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-19 08:35:51.367505812 +0000 2024-09-19T08:36:06.367 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-19 08:34:08.328854047 +0000 2024-09-19T08:36:06.367 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-19 08:34:08.328854047 +0000 2024-09-19T08:36:06.367 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-19 08:34:08.328854047 +0000 2024-09-19T08:36:06.367 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:36:06.430 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-19T08:36:06.430 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-19T08:36:06.430 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000184367 s, 2.8 MB/s 2024-09-19T08:36:06.431 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:36:06.488 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T08:36:06.488 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:36:06.489 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:36:06.507 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:36:06.507 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_1 2024-09-19T08:36:06.564 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:36:06.564 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:36:06.564 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T08:36:06.564 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:36:06.564 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:36:06.564 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-19 08:35:55.982979128 +0000 2024-09-19T08:36:06.565 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-19 08:34:07.397077462 +0000 2024-09-19T08:36:06.565 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-19 08:34:07.397077462 +0000 2024-09-19T08:36:06.565 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-09-19 08:34:07.397077462 +0000 2024-09-19T08:36:06.565 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:36:06.629 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-19T08:36:06.629 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-19T08:36:06.629 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000211072 s, 2.4 MB/s 2024-09-19T08:36:06.630 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:36:06.691 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_2 2024-09-19T08:36:06.747 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:36:06.747 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:36:06.747 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-19T08:36:06.747 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:36:06.747 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:36:06.747 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-19 08:35:55.983979112 +0000 2024-09-19T08:36:06.748 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-19 08:34:07.720072249 +0000 2024-09-19T08:36:06.748 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-19 08:34:07.720072249 +0000 2024-09-19T08:36:06.748 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-09-19 08:34:07.720072249 +0000 2024-09-19T08:36:06.748 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:36:06.811 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-19T08:36:06.811 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-19T08:36:06.811 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000181009 s, 2.8 MB/s 2024-09-19T08:36:06.812 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:36:06.869 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_3 2024-09-19T08:36:06.924 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:36:06.924 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:36:06.924 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T08:36:06.924 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:36:06.924 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:36:06.924 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-19 08:35:55.983979112 +0000 2024-09-19T08:36:06.924 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-19 08:34:08.064066697 +0000 2024-09-19T08:36:06.924 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-19 08:34:08.064066697 +0000 2024-09-19T08:36:06.925 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-09-19 08:34:08.064066697 +0000 2024-09-19T08:36:06.925 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:36:06.988 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-19T08:36:06.988 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-19T08:36:06.988 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000192828 s, 2.7 MB/s 2024-09-19T08:36:06.989 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:36:07.046 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_4 2024-09-19T08:36:07.101 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:36:07.101 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:36:07.101 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T08:36:07.101 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:36:07.101 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:36:07.101 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-19 08:35:55.983979112 +0000 2024-09-19T08:36:07.101 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-19 08:34:08.405061193 +0000 2024-09-19T08:36:07.102 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-19 08:34:08.405061193 +0000 2024-09-19T08:36:07.102 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-09-19 08:34:08.405061193 +0000 2024-09-19T08:36:07.102 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:36:07.165 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-19T08:36:07.165 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-19T08:36:07.165 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000195328 s, 2.6 MB/s 2024-09-19T08:36:07.166 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:36:07.223 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T08:36:07.223 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-19T08:36:07.223 INFO:tasks.ceph:Generating config... 2024-09-19T08:36:07.224 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-19T08:36:07.224 INFO:tasks.ceph:[client] debug client = 20 2024-09-19T08:36:07.224 INFO:tasks.ceph:[client] debug ms = 1 2024-09-19T08:36:07.224 INFO:tasks.ceph:[client] pid file = 2024-09-19T08:36:07.225 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-19T08:36:07.225 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-19T08:36:07.225 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-19T08:36:07.225 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-19T08:36:07.225 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-19T08:36:07.225 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-19T08:36:07.225 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-19T08:36:07.225 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-19T08:36:07.225 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-19T08:36:07.225 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-19T08:36:07.225 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-19T08:36:07.225 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-19T08:36:07.225 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-19T08:36:07.226 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-19T08:36:07.226 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-19T08:36:07.226 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-19T08:36:07.226 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-19T08:36:07.226 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-19T08:36:07.226 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-19T08:36:07.226 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-19T08:36:07.226 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-19T08:36:07.226 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-19T08:36:07.226 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-19T08:36:07.226 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-19T08:36:07.226 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-19T08:36:07.226 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-19T08:36:07.226 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-19T08:36:07.227 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-19T08:36:07.227 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-19T08:36:07.227 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-19T08:36:07.227 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-19T08:36:07.227 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-19T08:36:07.227 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-19T08:36:07.227 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-19T08:36:07.227 INFO:tasks.ceph:Setting up mon.a... 2024-09-19T08:36:07.227 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-19T08:36:07.290 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.keyring 2024-09-19T08:36:07.291 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-19T08:36:07.335 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T08:36:07.401 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.117'), ('mon.b', '172.21.15.146'), ('mon.c', '[v2:172.21.15.146:3301,v1:172.21.15.146:6790]')] 2024-09-19T08:36:07.402 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.117,172.21.15.146,[v2:172.21.15.146:3301,v1:172.21.15.146:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-19T08:36:07.403 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:07.403 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-19T08:36:07.458 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.117 --add b 172.21.15.146 --addv c '[v2:172.21.15.146:3301,v1:172.21.15.146:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-19T08:36:07.545 INFO:teuthology.orchestra.run.smithi117.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-19T08:36:07.545 INFO:teuthology.orchestra.run.smithi117.stdout:monmaptool: generated fsid 3be30853-f236-48ec-b905-15ecac86fc3f 2024-09-19T08:36:07.545 INFO:teuthology.orchestra.run.smithi117.stdout:setting min_mon_release = quincy 2024-09-19T08:36:07.545 INFO:teuthology.orchestra.run.smithi117.stdout:epoch 0 2024-09-19T08:36:07.545 INFO:teuthology.orchestra.run.smithi117.stdout:fsid 3be30853-f236-48ec-b905-15ecac86fc3f 2024-09-19T08:36:07.545 INFO:teuthology.orchestra.run.smithi117.stdout:last_changed 2024-09-19T08:36:07.546179+0000 2024-09-19T08:36:07.546 INFO:teuthology.orchestra.run.smithi117.stdout:created 2024-09-19T08:36:07.546179+0000 2024-09-19T08:36:07.546 INFO:teuthology.orchestra.run.smithi117.stdout:min_mon_release 17 (quincy) 2024-09-19T08:36:07.546 INFO:teuthology.orchestra.run.smithi117.stdout:election_strategy: 1 2024-09-19T08:36:07.546 INFO:teuthology.orchestra.run.smithi117.stdout:0: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.a 2024-09-19T08:36:07.546 INFO:teuthology.orchestra.run.smithi117.stdout:1: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.b 2024-09-19T08:36:07.546 INFO:teuthology.orchestra.run.smithi117.stdout:2: [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] mon.c 2024-09-19T08:36:07.546 INFO:teuthology.orchestra.run.smithi117.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-19T08:36:07.547 DEBUG:teuthology.orchestra.run.smithi117:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-19T08:36:07.562 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3be30853-f236-48ec-b905-15ecac86fc3f... 2024-09-19T08:36:07.563 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T08:36:07.605 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T08:36:07.645 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2024-09-19T08:36:07.645 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2024-09-19T08:36:07.646 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T08:36:07.646 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2024-09-19T08:36:07.646 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.646 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2024-09-19T08:36:07.646 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.646 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2024-09-19T08:36:07.646 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.646 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2024-09-19T08:36:07.646 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2024-09-19T08:36:07.646 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.646 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2024-09-19T08:36:07.646 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2024-09-19T08:36:07.647 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.647 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T08:36:07.647 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2024-09-19T08:36:07.647 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.647 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T08:36:07.647 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T08:36:07.647 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.647 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2024-09-19T08:36:07.647 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.647 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2024-09-19T08:36:07.647 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2024-09-19T08:36:07.647 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2024-09-19T08:36:07.648 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2024-09-19T08:36:07.648 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2024-09-19T08:36:07.648 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2024-09-19T08:36:07.648 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2024-09-19T08:36:07.648 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T08:36:07.648 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T08:36:07.648 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2024-09-19T08:36:07.648 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.649 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T08:36:07.649 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.649 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2024-09-19T08:36:07.649 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.649 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2024-09-19T08:36:07.649 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.650 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2024-09-19T08:36:07.650 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2024-09-19T08:36:07.650 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2024-09-19T08:36:07.650 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.117,172.21.15.146,[v2:172.21.15.146:3301,v1:172.21.15.146:6790]" 2024-09-19T08:36:07.650 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = 3be30853-f236-48ec-b905-15ecac86fc3f 2024-09-19T08:36:07.650 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.650 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2024-09-19T08:36:07.650 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2024-09-19T08:36:07.650 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.650 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2024-09-19T08:36:07.650 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2024-09-19T08:36:07.650 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2024-09-19T08:36:07.650 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.650 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2024-09-19T08:36:07.651 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2024-09-19T08:36:07.651 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.651 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2024-09-19T08:36:07.651 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2024-09-19T08:36:07.651 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2024-09-19T08:36:07.651 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug trim objects = true 2024-09-19T08:36:07.651 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.651 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2024-09-19T08:36:07.651 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2024-09-19T08:36:07.651 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.651 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2024-09-19T08:36:07.651 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.651 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2024-09-19T08:36:07.651 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.652 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2024-09-19T08:36:07.652 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.652 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2024-09-19T08:36:07.652 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2024-09-19T08:36:07.652 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.652 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2024-09-19T08:36:07.652 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2024-09-19T08:36:07.652 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2024-09-19T08:36:07.652 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2024-09-19T08:36:07.652 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 20 2024-09-19T08:36:07.652 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 20 2024-09-19T08:36:07.652 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-19T08:36:07.652 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2024-09-19T08:36:07.652 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 10 2024-09-19T08:36:07.653 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T08:36:07.653 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2024-09-19T08:36:07.653 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2024-09-19T08:36:07.653 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2024-09-19T08:36:07.653 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2024-09-19T08:36:07.653 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-09-19T08:36:07.653 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.653 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2024-09-19T08:36:07.653 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-19T08:36:07.653 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2024-09-19T08:36:07.653 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-09-19T08:36:07.653 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-09-19T08:36:07.654 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-09-19T08:36:07.654 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-09-19T08:36:07.654 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2024-09-19T08:36:07.654 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-09-19T08:36:07.654 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.654 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2024-09-19T08:36:07.654 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-19T08:36:07.654 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-09-19T08:36:07.654 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2024-09-19T08:36:07.654 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-09-19T08:36:07.654 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2024-09-19T08:36:07.654 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2024-09-19T08:36:07.654 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-09-19T08:36:07.654 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2024-09-19T08:36:07.655 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2024-09-19T08:36:07.655 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-09-19T08:36:07.655 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.655 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T08:36:07.655 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T08:36:07.655 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T08:36:07.655 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.655 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T08:36:07.655 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T08:36:07.655 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T08:36:07.655 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.655 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2024-09-19T08:36:07.655 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2024-09-19T08:36:07.656 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.656 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2024-09-19T08:36:07.656 INFO:teuthology.orchestra.run.smithi117.stdout: mon down mkfs grace = 300 2024-09-19T08:36:07.656 INFO:teuthology.orchestra.run.smithi117.stdout: mon op complaint time = 120 2024-09-19T08:36:07.656 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on pool no app = False 2024-09-19T08:36:07.656 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:07.656 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2024-09-19T08:36:07.656 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2024-09-19T08:36:07.656 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2024-09-19T08:36:07.656 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2024-09-19T08:36:07.656 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T08:36:07.656 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T08:36:07.656 INFO:teuthology.orchestra.run.smithi117.stdout: client mount timeout = 600 2024-09-19T08:36:07.656 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-09-19T08:36:07.657 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-19T08:36:07.657 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = "" 2024-09-19T08:36:07.657 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-09-19T08:36:07.657 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-09-19T08:36:07.657 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2024-09-19T08:36:07.657 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2024-09-19T08:36:07.657 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2024-09-19T08:36:07.657 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2024-09-19T08:36:07.657 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2024-09-19T08:36:07.657 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2024-09-19T08:36:07.657 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2024-09-19T08:36:07.657 INFO:teuthology.orchestra.run.smithi117.stdout:[mds] 2024-09-19T08:36:07.657 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds = 20 2024-09-19T08:36:07.657 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds balancer = 20 2024-09-19T08:36:07.658 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-09-19T08:36:07.658 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug frag = True 2024-09-19T08:36:07.658 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug scatterstat = True 2024-09-19T08:36:07.658 INFO:teuthology.orchestra.run.smithi117.stdout: mds op complaint time = 180 2024-09-19T08:36:07.658 INFO:teuthology.orchestra.run.smithi117.stdout: mds verify scatter = True 2024-09-19T08:36:07.658 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-09-19T08:36:07.658 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-09-19T08:36:07.658 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-09-19T08:36:07.659 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2024-09-19T08:36:07.659 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2024-09-19T08:36:07.659 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T08:36:07.659 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2024-09-19T08:36:07.659 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.659 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2024-09-19T08:36:07.659 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.659 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2024-09-19T08:36:07.659 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.659 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2024-09-19T08:36:07.659 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2024-09-19T08:36:07.660 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.660 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2024-09-19T08:36:07.660 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2024-09-19T08:36:07.660 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.660 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T08:36:07.660 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2024-09-19T08:36:07.660 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.660 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T08:36:07.661 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T08:36:07.661 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.661 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2024-09-19T08:36:07.661 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.661 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2024-09-19T08:36:07.661 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2024-09-19T08:36:07.661 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2024-09-19T08:36:07.661 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2024-09-19T08:36:07.661 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2024-09-19T08:36:07.661 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2024-09-19T08:36:07.661 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2024-09-19T08:36:07.662 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T08:36:07.662 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T08:36:07.662 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2024-09-19T08:36:07.662 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.662 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T08:36:07.662 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.662 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2024-09-19T08:36:07.662 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.662 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2024-09-19T08:36:07.662 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.662 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2024-09-19T08:36:07.662 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2024-09-19T08:36:07.662 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2024-09-19T08:36:07.663 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.117,172.21.15.146,[v2:172.21.15.146:3301,v1:172.21.15.146:6790]" 2024-09-19T08:36:07.663 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = 3be30853-f236-48ec-b905-15ecac86fc3f 2024-09-19T08:36:07.663 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.663 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2024-09-19T08:36:07.663 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2024-09-19T08:36:07.663 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.663 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2024-09-19T08:36:07.663 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2024-09-19T08:36:07.663 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock profile = high_recovery_ops 2024-09-19T08:36:07.663 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.663 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2024-09-19T08:36:07.663 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2024-09-19T08:36:07.663 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.663 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2024-09-19T08:36:07.663 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2024-09-19T08:36:07.664 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2024-09-19T08:36:07.664 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug trim objects = true 2024-09-19T08:36:07.664 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.664 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2024-09-19T08:36:07.664 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2024-09-19T08:36:07.664 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.664 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2024-09-19T08:36:07.664 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.664 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2024-09-19T08:36:07.664 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.664 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2024-09-19T08:36:07.664 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.664 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2024-09-19T08:36:07.664 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2024-09-19T08:36:07.665 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.665 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2024-09-19T08:36:07.665 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2024-09-19T08:36:07.665 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2024-09-19T08:36:07.665 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2024-09-19T08:36:07.665 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 20 2024-09-19T08:36:07.665 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 20 2024-09-19T08:36:07.665 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-19T08:36:07.665 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2024-09-19T08:36:07.665 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 10 2024-09-19T08:36:07.665 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T08:36:07.665 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2024-09-19T08:36:07.666 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2024-09-19T08:36:07.666 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2024-09-19T08:36:07.666 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2024-09-19T08:36:07.666 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2024-09-19T08:36:07.666 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.666 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2024-09-19T08:36:07.666 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-19T08:36:07.666 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2024-09-19T08:36:07.666 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-09-19T08:36:07.666 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-09-19T08:36:07.666 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-09-19T08:36:07.666 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-09-19T08:36:07.666 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2024-09-19T08:36:07.666 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2024-09-19T08:36:07.667 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.667 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2024-09-19T08:36:07.667 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-19T08:36:07.667 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-09-19T08:36:07.667 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2024-09-19T08:36:07.667 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-09-19T08:36:07.667 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2024-09-19T08:36:07.667 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2024-09-19T08:36:07.667 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-09-19T08:36:07.667 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2024-09-19T08:36:07.667 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2024-09-19T08:36:07.667 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-09-19T08:36:07.667 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.668 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T08:36:07.668 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T08:36:07.668 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T08:36:07.668 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.668 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T08:36:07.668 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T08:36:07.668 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T08:36:07.668 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.668 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2024-09-19T08:36:07.668 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2024-09-19T08:36:07.668 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.668 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2024-09-19T08:36:07.668 INFO:teuthology.orchestra.run.smithi146.stdout: mon down mkfs grace = 300 2024-09-19T08:36:07.669 INFO:teuthology.orchestra.run.smithi146.stdout: mon op complaint time = 120 2024-09-19T08:36:07.669 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on pool no app = False 2024-09-19T08:36:07.669 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-19T08:36:07.669 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2024-09-19T08:36:07.669 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2024-09-19T08:36:07.669 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2024-09-19T08:36:07.669 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2024-09-19T08:36:07.669 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T08:36:07.670 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T08:36:07.671 INFO:teuthology.orchestra.run.smithi146.stdout: client mount timeout = 600 2024-09-19T08:36:07.671 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2024-09-19T08:36:07.671 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-19T08:36:07.671 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = "" 2024-09-19T08:36:07.671 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2024-09-19T08:36:07.671 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2024-09-19T08:36:07.671 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2024-09-19T08:36:07.671 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2024-09-19T08:36:07.671 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2024-09-19T08:36:07.671 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2024-09-19T08:36:07.671 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2024-09-19T08:36:07.671 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2024-09-19T08:36:07.671 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2024-09-19T08:36:07.672 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2024-09-19T08:36:07.672 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds = 20 2024-09-19T08:36:07.672 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds balancer = 20 2024-09-19T08:36:07.672 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-19T08:36:07.672 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug frag = True 2024-09-19T08:36:07.672 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug scatterstat = True 2024-09-19T08:36:07.672 INFO:teuthology.orchestra.run.smithi146.stdout: mds op complaint time = 180 2024-09-19T08:36:07.672 INFO:teuthology.orchestra.run.smithi146.stdout: mds verify scatter = True 2024-09-19T08:36:07.672 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2024-09-19T08:36:07.672 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2024-09-19T08:36:07.672 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2024-09-19T08:36:07.674 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-19T08:36:07.674 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-19T08:36:07.768 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-19T08:36:07.768 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:07.768 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-19T08:36:07.784 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:07.784 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-19T08:36:07.840 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T08:36:07.840 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:07.840 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-19T08:36:07.840 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T08:36:07.915 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:07.915 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-19T08:36:07.971 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi146.front.sepia.ceph.com 2024-09-19T08:36:07.971 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:36:07.971 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-19T08:36:07.972 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T08:36:08.006 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:36:08.006 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-19T08:36:08.062 INFO:tasks.ceph:Setting up mon nodes... 2024-09-19T08:36:08.062 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-19T08:36:08.063 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-19T08:36:08.113 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-19T08:36:08.116 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-19T08:36:08.174 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-19T08:36:08.177 INFO:tasks.ceph:Setting up mds nodes... 2024-09-19T08:36:08.177 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-19T08:36:08.228 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-19T08:36:08.232 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-19T08:36:08.257 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-19T08:36:08.348 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-19T08:36:08.351 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-19T08:36:08.375 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-19T08:36:08.426 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-19T08:36:08.429 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-19T08:36:08.453 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-19T08:36:08.544 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-19T08:36:08.546 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-19T08:36:08.571 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-19T08:36:08.571 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T08:36:08.612 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-19T08:36:08.625 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-19T08:36:08.705 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-19T08:36:08.717 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-19T08:36:08.758 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-19T08:36:08.770 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-19T08:36:08.851 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-19T08:36:08.864 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-19T08:36:08.864 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-19T08:36:08.865 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-19T08:36:08.890 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T08:36:08.890 INFO:tasks.ceph:role: osd.0 2024-09-19T08:36:08.890 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T08:36:08.890 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-19T08:36:08.962 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T08:36:08.962 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T08:36:08.962 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T08:36:08.962 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T08:36:08.962 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T08:36:08.962 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-09-19T08:36:08.962 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T08:36:08.962 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T08:36:08.963 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T08:36:08.963 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T08:36:09.475 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-09-19T08:36:09.682 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-09-19T08:36:09.682 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-19T08:36:09.807 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-19T08:36:09.842 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-19T08:36:09.911 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T08:36:09.911 INFO:tasks.ceph:role: osd.1 2024-09-19T08:36:09.911 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T08:36:09.911 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-19T08:36:09.984 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T08:36:09.984 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T08:36:09.985 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T08:36:09.985 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T08:36:09.985 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T08:36:09.985 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-09-19T08:36:09.985 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T08:36:09.985 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T08:36:09.985 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T08:36:09.985 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T08:36:10.456 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-09-19T08:36:10.458 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-09-19T08:36:10.458 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-19T08:36:10.543 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-19T08:36:10.573 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-19T08:36:10.639 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T08:36:10.639 INFO:tasks.ceph:role: osd.2 2024-09-19T08:36:10.639 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T08:36:10.639 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-19T08:36:10.712 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T08:36:10.712 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T08:36:10.712 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T08:36:10.712 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T08:36:10.712 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T08:36:10.712 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-09-19T08:36:10.712 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T08:36:10.713 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T08:36:10.713 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T08:36:10.713 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T08:36:11.201 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-09-19T08:36:11.202 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-09-19T08:36:11.203 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-19T08:36:11.349 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-19T08:36:11.381 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-19T08:36:11.447 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T08:36:11.447 INFO:tasks.ceph:role: osd.3 2024-09-19T08:36:11.447 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T08:36:11.447 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-19T08:36:11.519 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T08:36:11.519 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T08:36:11.519 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T08:36:11.519 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T08:36:11.520 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T08:36:11.520 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-09-19T08:36:11.520 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T08:36:11.520 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T08:36:11.520 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T08:36:11.520 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T08:36:12.027 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-09-19T08:36:12.029 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-09-19T08:36:12.029 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-19T08:36:12.171 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-19T08:36:12.202 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T08:36:12.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:12.308+0000 7fa9e120f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-19T08:36:12.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:12.308+0000 7fa9e120f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-19T08:36:12.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:12.308+0000 7fa9e120f640 -1 bdev(0x55a9e6d63800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-19T08:36:12.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:12.308+0000 7fa9e120f640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-19T08:36:15.471 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T08:36:15.502 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T08:36:15.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:15.591+0000 7f4d0edd9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-19T08:36:15.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:15.592+0000 7f4d0edd9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-19T08:36:15.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:15.592+0000 7f4d0edd9640 -1 bdev(0x55e544e95800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-19T08:36:15.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:15.592+0000 7f4d0edd9640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-19T08:36:18.762 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T08:36:18.792 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T08:36:18.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:18.882+0000 7f4d1792e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-19T08:36:18.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:18.882+0000 7f4d1792e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-19T08:36:18.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:18.882+0000 7f4d1792e640 -1 bdev(0x5633f8275800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-19T08:36:18.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:18.882+0000 7f4d1792e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-19T08:36:21.791 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T08:36:21.816 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T08:36:21.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:21.901+0000 7f848161b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-19T08:36:21.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:21.901+0000 7f848161b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-19T08:36:21.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:21.901+0000 7f848161b640 -1 bdev(0x5650b37a7800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-19T08:36:21.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:21.901+0000 7f848161b640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-19T08:36:25.065 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T08:36:25.094 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-19T08:36:25.125 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T08:36:25.125 INFO:tasks.ceph:role: osd.4 2024-09-19T08:36:25.125 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-19T08:36:25.125 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-19T08:36:25.201 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T08:36:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T08:36:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T08:36:25.201 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T08:36:25.202 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T08:36:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-09-19T08:36:25.202 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T08:36:25.202 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T08:36:25.202 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T08:36:25.202 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T08:36:25.712 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-09-19T08:36:25.714 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-09-19T08:36:25.715 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-19T08:36:25.838 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-19T08:36:25.869 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-19T08:36:25.935 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T08:36:25.935 INFO:tasks.ceph:role: osd.5 2024-09-19T08:36:25.935 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-19T08:36:25.936 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-19T08:36:26.007 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T08:36:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T08:36:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T08:36:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T08:36:26.008 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T08:36:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-09-19T08:36:26.008 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T08:36:26.008 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T08:36:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T08:36:26.008 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T08:36:26.472 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-09-19T08:36:26.474 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-09-19T08:36:26.474 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-19T08:36:26.560 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-19T08:36:26.589 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-19T08:36:26.654 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T08:36:26.654 INFO:tasks.ceph:role: osd.6 2024-09-19T08:36:26.654 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-19T08:36:26.655 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-19T08:36:26.727 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T08:36:26.728 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T08:36:26.728 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T08:36:26.728 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T08:36:26.728 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T08:36:26.728 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-09-19T08:36:26.728 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T08:36:26.728 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T08:36:26.728 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T08:36:26.728 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T08:36:27.215 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-09-19T08:36:27.217 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-09-19T08:36:27.218 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-19T08:36:27.370 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-19T08:36:27.401 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-19T08:36:27.467 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T08:36:27.467 INFO:tasks.ceph:role: osd.7 2024-09-19T08:36:27.468 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-19T08:36:27.468 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-19T08:36:27.541 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T08:36:27.541 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T08:36:27.541 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T08:36:27.541 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T08:36:27.542 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T08:36:27.542 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-09-19T08:36:27.542 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T08:36:27.542 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T08:36:27.542 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T08:36:27.542 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T08:36:28.057 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-09-19T08:36:28.059 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-09-19T08:36:28.059 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-19T08:36:28.205 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-19T08:36:28.242 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T08:36:28.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:28.338+0000 7f36f0f34640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-19T08:36:28.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:28.339+0000 7f36f0f34640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-19T08:36:28.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:28.339+0000 7f36f0f34640 -1 bdev(0x560a59985800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-19T08:36:28.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:28.339+0000 7f36f0f34640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-19T08:36:31.749 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-19T08:36:31.779 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T08:36:31.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:31.869+0000 7f8e93120640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-19T08:36:31.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:31.869+0000 7f8e93120640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-19T08:36:31.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:31.869+0000 7f8e93120640 -1 bdev(0x55b463289800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-19T08:36:31.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:31.869+0000 7f8e93120640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-19T08:36:35.275 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-19T08:36:35.305 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T08:36:35.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:35.395+0000 7fd29f610640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-19T08:36:35.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:35.396+0000 7fd29f610640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-19T08:36:35.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:35.396+0000 7fd29f610640 -1 bdev(0x5651e930f800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-19T08:36:35.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:35.396+0000 7fd29f610640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-19T08:36:35.638 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T08:36:35.641 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T08:36:38.356 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-19T08:36:38.386 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T08:36:38.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:38.476+0000 7f5cd64dc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-19T08:36:38.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:38.476+0000 7f5cd64dc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-19T08:36:38.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:38.476+0000 7f5cd64dc640 -1 bdev(0x559b8bff7800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-19T08:36:38.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:38.476+0000 7f5cd64dc640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-19T08:36:41.648 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-19T08:36:41.678 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-19T08:36:41.678 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:41.678 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-19T08:36:41.707 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:41.708 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-19T08:36:41.776 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:41.776 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-19T08:36:41.843 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:41.844 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-19T08:36:41.910 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:41.910 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-19T08:36:41.975 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:41.975 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-19T08:36:42.041 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:42.042 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-19T08:36:42.107 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:36:42.107 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-19T08:36:42.138 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:36:42.138 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-19T08:36:42.207 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:36:42.207 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-19T08:36:42.275 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:36:42.275 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-19T08:36:42.343 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:36:42.343 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-19T08:36:42.410 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:36:42.411 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-19T08:36:42.477 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:36:42.477 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-19T08:36:42.542 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:42.543 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-19T08:36:42.559 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:42.559 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-19T08:36:42.614 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:36:42.615 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-19T08:36:42.630 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:36:42.630 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-19T08:36:42.686 INFO:tasks.ceph:Adding keys to all mons... 2024-09-19T08:36:42.686 DEBUG:teuthology.orchestra.run.smithi117:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-19T08:36:42.689 DEBUG:teuthology.orchestra.run.smithi146:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-19T08:36:42.730 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.y] 2024-09-19T08:36:42.730 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQB44utmU4TYBhAARfqD+WyAad5N6j/Dbg4azQ== 2024-09-19T08:36:42.730 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2024-09-19T08:36:42.731 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQB44utmHw2nDRAAoIVTtJpfdniBkgt/n50nHg== 2024-09-19T08:36:42.731 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2024-09-19T08:36:42.731 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQB44utme+LSFBAA/tadCvj4CzlxiMj1w/T6/A== 2024-09-19T08:36:42.731 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.0] 2024-09-19T08:36:42.731 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQB84utmxBpsEhAABdz/Goew538p9BNfIgRrsQ== 2024-09-19T08:36:42.731 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.1] 2024-09-19T08:36:42.731 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQB/4utmHUdUIxAAG09ixI0+EoBdrDIJcwIGnQ== 2024-09-19T08:36:42.731 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.2] 2024-09-19T08:36:42.731 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQCC4utmGxKkNBAAZ7PRYmJzVPiO4MJKhDi4Dg== 2024-09-19T08:36:42.731 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.3] 2024-09-19T08:36:42.731 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQCF4utmITrTNRAAx1Vb1imQtiwe7bmAubkpAw== 2024-09-19T08:36:42.731 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.x] 2024-09-19T08:36:42.731 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQB44utmIExxChAAnLzpZuo2zLAlA3djNp6qhQ== 2024-09-19T08:36:42.732 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2024-09-19T08:36:42.732 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQB44utmifiDGRAA34GAUAJ4KhXW2WGLdHa9xQ== 2024-09-19T08:36:42.732 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2024-09-19T08:36:42.732 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQB44utmS0KGIBAAsTEM5IiQpHXzO5J+j1wn3w== 2024-09-19T08:36:42.732 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.4] 2024-09-19T08:36:42.732 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQCM4utmhQxCFBAATgkv9JUObRF+tpU1GYcPDw== 2024-09-19T08:36:42.732 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.5] 2024-09-19T08:36:42.732 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQCP4utmwQLhMxAAgaQDJyUNuUAorZcg3ujn1g== 2024-09-19T08:36:42.732 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.6] 2024-09-19T08:36:42.732 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQCT4utm8hylFxAAZIkKmzbAkG47lxMgxAQXYg== 2024-09-19T08:36:42.732 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.7] 2024-09-19T08:36:42.732 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQCW4utm5q1yHBAA129yQst2D7WxXHl8n8H67A== 2024-09-19T08:36:42.733 INFO:teuthology.orchestra.run.smithi117.stdout:[client.0] 2024-09-19T08:36:42.733 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQB44utm6+SOJBAAd1SCpjEGh0tRc3cpmnVJDA== 2024-09-19T08:36:42.733 INFO:teuthology.orchestra.run.smithi117.stdout:[client.2] 2024-09-19T08:36:42.733 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQB44utm+kIcKhAAChWsl4sULIR5oEpWzebQBw== 2024-09-19T08:36:42.733 INFO:teuthology.orchestra.run.smithi117.stdout:[client.1] 2024-09-19T08:36:42.733 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQB44utmwZhILRAA7XsdtUcwcRNMsBtD7b0oEg== 2024-09-19T08:36:42.733 INFO:teuthology.orchestra.run.smithi117.stdout:[client.3] 2024-09-19T08:36:42.733 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQB44utmovjYMhAAM8bTiJHlA0Cs8jOoDV5N2w== 2024-09-19T08:36:42.750 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.y] 2024-09-19T08:36:42.750 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQB44utmU4TYBhAARfqD+WyAad5N6j/Dbg4azQ== 2024-09-19T08:36:42.750 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2024-09-19T08:36:42.751 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQB44utmHw2nDRAAoIVTtJpfdniBkgt/n50nHg== 2024-09-19T08:36:42.751 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2024-09-19T08:36:42.751 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQB44utme+LSFBAA/tadCvj4CzlxiMj1w/T6/A== 2024-09-19T08:36:42.751 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.0] 2024-09-19T08:36:42.751 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQB84utmxBpsEhAABdz/Goew538p9BNfIgRrsQ== 2024-09-19T08:36:42.751 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.1] 2024-09-19T08:36:42.751 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQB/4utmHUdUIxAAG09ixI0+EoBdrDIJcwIGnQ== 2024-09-19T08:36:42.751 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.2] 2024-09-19T08:36:42.751 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCC4utmGxKkNBAAZ7PRYmJzVPiO4MJKhDi4Dg== 2024-09-19T08:36:42.751 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.3] 2024-09-19T08:36:42.751 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCF4utmITrTNRAAx1Vb1imQtiwe7bmAubkpAw== 2024-09-19T08:36:42.751 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.x] 2024-09-19T08:36:42.751 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQB44utmIExxChAAnLzpZuo2zLAlA3djNp6qhQ== 2024-09-19T08:36:42.752 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2024-09-19T08:36:42.752 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQB44utmifiDGRAA34GAUAJ4KhXW2WGLdHa9xQ== 2024-09-19T08:36:42.752 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2024-09-19T08:36:42.752 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQB44utmS0KGIBAAsTEM5IiQpHXzO5J+j1wn3w== 2024-09-19T08:36:42.752 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.4] 2024-09-19T08:36:42.752 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCM4utmhQxCFBAATgkv9JUObRF+tpU1GYcPDw== 2024-09-19T08:36:42.752 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.5] 2024-09-19T08:36:42.752 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCP4utmwQLhMxAAgaQDJyUNuUAorZcg3ujn1g== 2024-09-19T08:36:42.752 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.6] 2024-09-19T08:36:42.752 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCT4utm8hylFxAAZIkKmzbAkG47lxMgxAQXYg== 2024-09-19T08:36:42.752 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.7] 2024-09-19T08:36:42.752 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCW4utm5q1yHBAA129yQst2D7WxXHl8n8H67A== 2024-09-19T08:36:42.752 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-09-19T08:36:42.753 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQB44utm6+SOJBAAd1SCpjEGh0tRc3cpmnVJDA== 2024-09-19T08:36:42.753 INFO:teuthology.orchestra.run.smithi146.stdout:[client.2] 2024-09-19T08:36:42.753 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQB44utm+kIcKhAAChWsl4sULIR5oEpWzebQBw== 2024-09-19T08:36:42.753 INFO:teuthology.orchestra.run.smithi146.stdout:[client.1] 2024-09-19T08:36:42.753 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQB44utmwZhILRAA7XsdtUcwcRNMsBtD7b0oEg== 2024-09-19T08:36:42.753 INFO:teuthology.orchestra.run.smithi146.stdout:[client.3] 2024-09-19T08:36:42.753 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQB44utmovjYMhAAM8bTiJHlA0Cs8jOoDV5N2w== 2024-09-19T08:36:42.754 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T08:36:42.777 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T08:36:42.845 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T08:36:42.848 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T08:36:42.902 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T08:36:42.904 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T08:36:42.959 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T08:36:42.961 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T08:36:43.012 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T08:36:43.016 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T08:36:43.066 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T08:36:43.069 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T08:36:43.120 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T08:36:43.124 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T08:36:43.176 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T08:36:43.178 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T08:36:43.229 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T08:36:43.232 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T08:36:43.285 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T08:36:43.287 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T08:36:43.341 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T08:36:43.344 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T08:36:43.394 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T08:36:43.396 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T08:36:43.446 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T08:36:43.448 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T08:36:43.499 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T08:36:43.501 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T08:36:43.553 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T08:36:43.556 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T08:36:43.609 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T08:36:43.612 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T08:36:43.665 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T08:36:43.668 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T08:36:43.721 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T08:36:43.724 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T08:36:43.777 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-19T08:36:43.777 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-19T08:36:43.802 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T08:36:43.899 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-19T08:36:43.925 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-19T08:36:43.950 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T08:36:44.046 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-19T08:36:44.071 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-19T08:36:44.137 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T08:36:44.233 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-19T08:36:44.258 DEBUG:teuthology.orchestra.run.smithi117:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-19T08:36:44.261 DEBUG:teuthology.orchestra.run.smithi146:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-19T08:36:44.314 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-19T08:36:44.315 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-19T08:36:44.315 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-19T08:36:44.318 INFO:tasks.ceph.mon.a:Started 2024-09-19T08:36:44.318 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-19T08:36:44.319 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-19T08:36:44.356 INFO:tasks.ceph.mon.b:Started 2024-09-19T08:36:44.356 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-19T08:36:44.357 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-19T08:36:44.359 INFO:tasks.ceph.mon.c:Started 2024-09-19T08:36:44.359 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-19T08:36:44.359 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-19T08:36:44.359 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-19T08:36:44.362 INFO:tasks.ceph.mgr.y:Started 2024-09-19T08:36:44.362 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-19T08:36:44.362 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-19T08:36:44.364 INFO:tasks.ceph.mgr.x:Started 2024-09-19T08:36:44.364 INFO:tasks.ceph:Setting crush tunables to default 2024-09-19T08:36:44.365 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd crush tunables default 2024-09-19T08:36:44.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.464+0000 7f5b4a21e640 1 Processor -- start 2024-09-19T08:36:44.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.464+0000 7f5b4a21e640 1 -- start start 2024-09-19T08:36:44.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.465+0000 7f5b4a21e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 0x7f5b440d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:44.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.465+0000 7f5b4a21e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 0x7f5b440d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:44.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.465+0000 7f5b4a21e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b440cdee0 con 0x7f5b4415c2c0 2024-09-19T08:36:44.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.465+0000 7f5b4a21e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5b440ceaf0 con 0x7f5b440cf910 2024-09-19T08:36:44.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.465+0000 7f5b4a21e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f5b440ce1c0 con 0x7f5b4415bee0 2024-09-19T08:36:44.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.465+0000 7f5b43fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 0x7f5b440d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:44.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.465+0000 7f5b43fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 0x7f5b440d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43868/0 (socket says 172.21.15.117:43868) 2024-09-19T08:36:44.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.465+0000 7f5b43fff640 1 -- 172.21.15.117:0/1268600623 learned_addr learned my addr 172.21.15.117:0/1268600623 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:36:44.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.465+0000 7f5b43fff640 1 -- 172.21.15.117:0/1268600623 >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 msgr2=0x7f5b440d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T08:36:44.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.465+0000 7f5b43fff640 1 -- 172.21.15.117:0/1268600623 >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 msgr2=0x7f5b440d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T08:36:44.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.465+0000 7f5b43fff640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 0x7f5b440d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:36:44.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.465+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 0x7f5b440d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:44.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.465+0000 7f5b43fff640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 0x7f5b440d09f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:36:44.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.465+0000 7f5b437fe640 1 -- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 msgr2=0x7f5b440d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T08:36:44.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.465+0000 7f5b437fe640 1 -- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 msgr2=0x7f5b440d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T08:36:44.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.465+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 0x7f5b440d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:36:44.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.465+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 0x7f5b440d04b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:36:44.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.666+0000 7f5b43fff640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 0x7f5b440d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:44.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.666+0000 7f5b43fff640 1 -- 172.21.15.117:0/1268600623 >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 msgr2=0x7f5b440d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T08:36:44.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.666+0000 7f5b43fff640 1 -- 172.21.15.117:0/1268600623 >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 msgr2=0x7f5b440d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T08:36:44.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.666+0000 7f5b43fff640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 0x7f5b440d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:36:44.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.666+0000 7f5b43fff640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 0x7f5b440d09f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:36:44.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.666+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 0x7f5b440d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:44.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.666+0000 7f5b437fe640 1 -- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 msgr2=0x7f5b440d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T08:36:44.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.666+0000 7f5b437fe640 1 -- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 msgr2=0x7f5b440d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T08:36:44.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.666+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 0x7f5b440d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:36:44.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:44.666+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 0x7f5b440d04b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:36:45.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:45.067+0000 7f5b43fff640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 0x7f5b440d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:45.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:45.067+0000 7f5b43fff640 1 -- 172.21.15.117:0/1268600623 >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 msgr2=0x7f5b440d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T08:36:45.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:45.067+0000 7f5b43fff640 1 -- 172.21.15.117:0/1268600623 >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 msgr2=0x7f5b440d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T08:36:45.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:45.067+0000 7f5b43fff640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 0x7f5b440d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:36:45.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:45.067+0000 7f5b43fff640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 0x7f5b440d09f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T08:36:45.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:45.067+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 0x7f5b440d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:45.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:45.067+0000 7f5b437fe640 1 -- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 msgr2=0x7f5b440d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T08:36:45.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:45.067+0000 7f5b437fe640 1 -- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 msgr2=0x7f5b440d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T08:36:45.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:45.067+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 0x7f5b440d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:36:45.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:45.067+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 0x7f5b440d04b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T08:36:45.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:45.868+0000 7f5b43fff640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 0x7f5b440d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:45.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:45.868+0000 7f5b43fff640 1 -- 172.21.15.117:0/1268600623 >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 msgr2=0x7f5b440d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T08:36:45.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:45.868+0000 7f5b43fff640 1 -- 172.21.15.117:0/1268600623 >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 msgr2=0x7f5b440d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T08:36:45.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:45.868+0000 7f5b43fff640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 0x7f5b440d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:36:45.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:45.868+0000 7f5b43fff640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 0x7f5b440d09f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T08:36:45.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:45.868+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 0x7f5b440d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:45.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:45.868+0000 7f5b437fe640 1 -- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 msgr2=0x7f5b440d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-19T08:36:45.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:45.868+0000 7f5b437fe640 1 -- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 msgr2=0x7f5b440d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T08:36:45.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:45.868+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 0x7f5b440d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:36:45.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:45.868+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 0x7f5b440d04b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T08:36:47.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:47.465+0000 7f5b417fa640 1 -- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 msgr2=0x7f5b440d04b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:36:47.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:47.465+0000 7f5b417fa640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b4415bee0 0x7f5b440d04b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:47.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:47.465+0000 7f5b417fa640 1 -- 172.21.15.117:0/1268600623 >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 msgr2=0x7f5b440d09f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:36:47.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:47.465+0000 7f5b417fa640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.117:3300/0 conn(0x7f5b440cf910 0x7f5b440d09f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:47.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:47.465+0000 7f5b417fa640 1 -- 172.21.15.117:0/1268600623 >> v1:172.21.15.146:6789/0 conn(0x7f5b4415c2c0 legacy=0x7f5b440cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:47.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:47.465+0000 7f5b417fa640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 0x7f5b30005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:47.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:47.465+0000 7f5b417fa640 1 -- 172.21.15.117:0/1268600623 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b440ce4a0 con 0x7f5b30006170 2024-09-19T08:36:47.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:47.465+0000 7f5b417fa640 1 -- 172.21.15.117:0/1268600623 --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f5b440ceaf0 con 0x7f5b300036c0 2024-09-19T08:36:47.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:47.466+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 0x7f5b30005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:47.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:47.466+0000 7f5b437fe640 1 -- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 msgr2=0x7f5b30005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T08:36:47.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:47.466+0000 7f5b437fe640 1 -- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 msgr2=0x7f5b30005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T08:36:47.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:47.466+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 0x7f5b30005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:36:47.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:47.466+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 0x7f5b30005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:36:47.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:47.667+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 0x7f5b30005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:47.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:47.667+0000 7f5b437fe640 1 -- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 msgr2=0x7f5b30005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T08:36:47.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:47.667+0000 7f5b437fe640 1 -- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 msgr2=0x7f5b30005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T08:36:47.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:47.667+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 0x7f5b30005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:36:47.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:47.667+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 0x7f5b30005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:36:48.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:48.068+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 0x7f5b30005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:48.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:48.068+0000 7f5b437fe640 1 -- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 msgr2=0x7f5b30005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T08:36:48.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:48.068+0000 7f5b437fe640 1 -- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 msgr2=0x7f5b30005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T08:36:48.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:48.068+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 0x7f5b30005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:36:48.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:48.068+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 0x7f5b30005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T08:36:48.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:48.870+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 0x7f5b30005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:48.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:48.870+0000 7f5b437fe640 1 -- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 msgr2=0x7f5b30005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T08:36:48.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:48.870+0000 7f5b437fe640 1 -- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 msgr2=0x7f5b30005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T08:36:48.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:48.870+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 0x7f5b30005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:36:48.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:48.870+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 0x7f5b30005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T08:36:49.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.638+0000 7f5b427fc640 1 -- 172.21.15.117:0/1268600623 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 262159991 0 0) 0x7f5b440ce4a0 con 0x7f5b30006170 2024-09-19T08:36:49.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.638+0000 7f5b427fc640 1 -- 172.21.15.117:0/1268600623 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b2c003520 con 0x7f5b30006170 2024-09-19T08:36:49.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.638+0000 7f5b427fc640 1 -- 172.21.15.117:0/1268600623 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4060543824 0 0) 0x7f5b2c003520 con 0x7f5b30006170 2024-09-19T08:36:49.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.638+0000 7f5b427fc640 1 -- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 msgr2=0x7f5b30005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:36:49.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.638+0000 7f5b427fc640 1 --2- 172.21.15.117:0/1268600623 >> v2:172.21.15.146:3300/0 conn(0x7f5b300036c0 0x7f5b30005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:49.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.638+0000 7f5b427fc640 1 -- 172.21.15.117:0/1268600623 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3000af50 con 0x7f5b30006170 2024-09-19T08:36:49.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.638+0000 7f5b427fc640 1 -- 172.21.15.117:0/1268600623 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f5b380016f0 con 0x7f5b30006170 2024-09-19T08:36:49.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.638+0000 7f5b427fc640 1 -- 172.21.15.117:0/1268600623 >> v1:172.21.15.117:6789/0 conn(0x7f5b30006170 legacy=0x7f5b30008610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:49.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.638+0000 7f5b43fff640 1 -- 172.21.15.117:0/1268600623 reap_dead start 2024-09-19T08:36:49.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.638+0000 7f5b427fc640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b2c0039b0 0x7f5b2c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:49.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.638+0000 7f5b427fc640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b2c004800 0x7f5b2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:49.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.639+0000 7f5b427fc640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b2c0052e0 0x7f5b2c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:49.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.639+0000 7f5b427fc640 1 -- 172.21.15.117:0/1268600623 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5b440ceaf0 con 0x7f5b2c0039b0 2024-09-19T08:36:49.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.639+0000 7f5b427fc640 1 -- 172.21.15.117:0/1268600623 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2c00c230 con 0x7f5b2c0052e0 2024-09-19T08:36:49.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.639+0000 7f5b427fc640 1 -- 172.21.15.117:0/1268600623 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f5b2c00c430 con 0x7f5b2c004800 2024-09-19T08:36:49.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.639+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b2c0039b0 0x7f5b2c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:49.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.639+0000 7f5b42ffd640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b2c004800 0x7f5b2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:49.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.639+0000 7f5b43fff640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b2c0052e0 0x7f5b2c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:49.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.639+0000 7f5b437fe640 1 -- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b2c004800 msgr2=0x7f5b2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:36:49.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.639+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b2c004800 0x7f5b2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:49.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.639+0000 7f5b437fe640 1 -- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b2c0052e0 msgr2=0x7f5b2c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:36:49.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.639+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b2c0052e0 0x7f5b2c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:49.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.639+0000 7f5b437fe640 1 -- 172.21.15.117:0/1268600623 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2c003520 con 0x7f5b2c0039b0 2024-09-19T08:36:49.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.639+0000 7f5b43fff640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b2c0052e0 0x7f5b2c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:36:49.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.640+0000 7f5b437fe640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b2c0039b0 0x7f5b2c003db0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009610 tx=0x7f5b2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4920a76359195d39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:49.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.640+0000 7f5b427fc640 1 -- 172.21.15.117:0/1268600623 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b3403a070 con 0x7f5b2c0039b0 2024-09-19T08:36:49.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.640+0000 7f5b427fc640 1 -- 172.21.15.117:0/1268600623 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b34035410 con 0x7f5b2c0039b0 2024-09-19T08:36:49.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.640+0000 7f5b427fc640 1 -- 172.21.15.117:0/1268600623 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b34009bf0 con 0x7f5b2c0039b0 2024-09-19T08:36:49.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.641+0000 7f5b4a21e640 1 -- 172.21.15.117:0/1268600623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b2c0039b0 msgr2=0x7f5b2c003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:49.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.641+0000 7f5b4a21e640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b2c0039b0 0x7f5b2c003db0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009610 tx=0x7f5b2c005830 comp rx=0 tx=0).stop 2024-09-19T08:36:49.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.641+0000 7f5b4a21e640 1 -- 172.21.15.117:0/1268600623 shutdown_connections 2024-09-19T08:36:49.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.641+0000 7f5b4a21e640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b2c0052e0 0x7f5b2c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:49.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.641+0000 7f5b4a21e640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b2c004800 0x7f5b2c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:49.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.641+0000 7f5b4a21e640 1 --2- 172.21.15.117:0/1268600623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b2c0039b0 0x7f5b2c003db0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:49.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.641+0000 7f5b4a21e640 1 -- 172.21.15.117:0/1268600623 >> 172.21.15.117:0/1268600623 conn(0x7f5b4406bdf0 msgr2=0x7f5b4406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:49.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.641+0000 7f5b4a21e640 1 -- 172.21.15.117:0/1268600623 shutdown_connections 2024-09-19T08:36:49.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.641+0000 7f5b4a21e640 1 -- 172.21.15.117:0/1268600623 wait complete. 2024-09-19T08:36:49.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.643+0000 7f5b4a21e640 1 Processor -- start 2024-09-19T08:36:49.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.643+0000 7f5b4a21e640 1 -- start start 2024-09-19T08:36:49.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.644+0000 7f5b4a21e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b2c0039b0 0x7f5b4415ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:49.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.644+0000 7f5b4a21e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b2c004800 0x7f5b44071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:49.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.644+0000 7f5b4a21e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b2c0052e0 0x7f5b440722a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:49.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.644+0000 7f5b4a21e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5b440cf380 con 0x7f5b2c004800 2024-09-19T08:36:49.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.644+0000 7f5b4a21e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5b440cf200 con 0x7f5b2c0052e0 2024-09-19T08:36:49.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.644+0000 7f5b4a21e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f5b440cf500 con 0x7f5b2c0039b0 2024-09-19T08:36:49.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.644+0000 7f5b42ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b2c004800 0x7f5b44071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:49.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.644+0000 7f5b42ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b2c004800 0x7f5b44071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43944/0 (socket says 172.21.15.117:43944) 2024-09-19T08:36:49.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.644+0000 7f5b42ffd640 1 -- 172.21.15.117:0/4080778083 learned_addr learned my addr 172.21.15.117:0/4080778083 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:36:49.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.644+0000 7f5b437fe640 1 --2- 172.21.15.117:0/4080778083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b2c0039b0 0x7f5b4415ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:49.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.644+0000 7f5b43fff640 1 --2- 172.21.15.117:0/4080778083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b2c0052e0 0x7f5b440722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:49.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.644+0000 7f5b42ffd640 1 -- 172.21.15.117:0/4080778083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b2c0039b0 msgr2=0x7f5b4415ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:49.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.644+0000 7f5b42ffd640 1 --2- 172.21.15.117:0/4080778083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b2c0039b0 0x7f5b4415ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:49.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.644+0000 7f5b42ffd640 1 -- 172.21.15.117:0/4080778083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b2c0052e0 msgr2=0x7f5b440722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:49.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.644+0000 7f5b42ffd640 1 --2- 172.21.15.117:0/4080778083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b2c0052e0 0x7f5b440722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:49.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.644+0000 7f5b42ffd640 1 -- 172.21.15.117:0/4080778083 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b44159380 con 0x7f5b2c004800 2024-09-19T08:36:49.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.644+0000 7f5b42ffd640 1 --2- 172.21.15.117:0/4080778083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b2c004800 0x7f5b44071d60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5b38017370 tx=0x7f5b38017830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:49.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.645+0000 7f5b2bfff640 1 -- 172.21.15.117:0/4080778083 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b38022070 con 0x7f5b2c004800 2024-09-19T08:36:49.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.645+0000 7f5b2bfff640 1 -- 172.21.15.117:0/4080778083 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b38012e50 con 0x7f5b2c004800 2024-09-19T08:36:49.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.645+0000 7f5b4a21e640 1 -- 172.21.15.117:0/4080778083 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b440ccce0 con 0x7f5b2c004800 2024-09-19T08:36:49.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.645+0000 7f5b2bfff640 1 -- 172.21.15.117:0/4080778083 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b38012310 con 0x7f5b2c004800 2024-09-19T08:36:49.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.645+0000 7f5b4a21e640 1 -- 172.21.15.117:0/4080778083 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b440cd2a0 con 0x7f5b2c004800 2024-09-19T08:36:49.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.645+0000 7f5b2bfff640 1 -- 172.21.15.117:0/4080778083 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5b38025070 con 0x7f5b2c004800 2024-09-19T08:36:49.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.645+0000 7f5b2bfff640 1 -- 172.21.15.117:0/4080778083 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5b38003930 con 0x7f5b2c004800 2024-09-19T08:36:49.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.646+0000 7f5b4a21e640 1 -- 172.21.15.117:0/4080778083 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b440ce1c0 con 0x7f5b2c004800 2024-09-19T08:36:49.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.649+0000 7f5b2bfff640 1 -- 172.21.15.117:0/4080778083 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5b3802c020 con 0x7f5b2c004800 2024-09-19T08:36:49.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.711+0000 7f5b4a21e640 1 -- 172.21.15.117:0/4080778083 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f5b4406c270 con 0x7f5b2c004800 2024-09-19T08:36:49.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.715+0000 7f5b2bfff640 1 -- 172.21.15.117:0/4080778083 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f5b38019040 con 0x7f5b2c004800 2024-09-19T08:36:49.715 INFO:teuthology.orchestra.run.smithi117.stderr:adjusted tunables profile to default 2024-09-19T08:36:49.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.716+0000 7f5b4a21e640 1 -- 172.21.15.117:0/4080778083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b2c004800 msgr2=0x7f5b44071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:49.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.716+0000 7f5b4a21e640 1 --2- 172.21.15.117:0/4080778083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b2c004800 0x7f5b44071d60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5b38017370 tx=0x7f5b38017830 comp rx=0 tx=0).stop 2024-09-19T08:36:49.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.716+0000 7f5b4a21e640 1 -- 172.21.15.117:0/4080778083 shutdown_connections 2024-09-19T08:36:49.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.716+0000 7f5b4a21e640 1 --2- 172.21.15.117:0/4080778083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b2c0052e0 0x7f5b440722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:49.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.716+0000 7f5b4a21e640 1 --2- 172.21.15.117:0/4080778083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b2c004800 0x7f5b44071d60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:49.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.716+0000 7f5b4a21e640 1 --2- 172.21.15.117:0/4080778083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b2c0039b0 0x7f5b4415ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:49.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.716+0000 7f5b4a21e640 1 -- 172.21.15.117:0/4080778083 >> 172.21.15.117:0/4080778083 conn(0x7f5b4406bdf0 msgr2=0x7f5b4415b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:49.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.716+0000 7f5b4a21e640 1 -- 172.21.15.117:0/4080778083 shutdown_connections 2024-09-19T08:36:49.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:49.716+0000 7f5b4a21e640 1 -- 172.21.15.117:0/4080778083 wait complete. 2024-09-19T08:36:49.727 INFO:tasks.ceph:check_enable_crimson: False 2024-09-19T08:36:49.727 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-19T08:36:49.727 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:49.728 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-19T08:36:49.745 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:49.746+0000 7f2fe27d6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:36:49.753 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:49.753 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-19T08:36:49.788 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:49.788+0000 7f2fe27d6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:36:49.819 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:49.820 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-19T08:36:49.885 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:36:49.885 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-19T08:36:49.933 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:49.933+0000 7f2fe27d6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:36:49.949 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:36:49.949 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-19T08:36:49.975 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:36:49.975 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-19T08:36:49.986 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:49.987+0000 7f2fe27d6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:36:50.010 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:36:50.010 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-19T08:36:50.076 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:36:50.076 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-19T08:36:50.141 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new dab3472e-2259-47fd-912f-24c427b3c8b3 0 2024-09-19T08:36:50.177 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:50.177+0000 7f2fe27d6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:36:50.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.276+0000 7f1ad7bf6640 1 Processor -- start 2024-09-19T08:36:50.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.276+0000 7f1ad7bf6640 1 -- start start 2024-09-19T08:36:50.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.277+0000 7f1ad7bf6640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1ad00b4d90 0x7f1ad00b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:50.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.277+0000 7f1ad7bf6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1ad015b360 0x7f1ad015d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:50.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.277+0000 7f1ad7bf6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ad015c610 con 0x7f1ad00b45c0 2024-09-19T08:36:50.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.277+0000 7f1ad7bf6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1ad015d220 con 0x7f1ad015b360 2024-09-19T08:36:50.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.277+0000 7f1ad7bf6640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f1ad015c8f0 con 0x7f1ad00b4d90 2024-09-19T08:36:50.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.277+0000 7f1ad5992640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1ad00b4d90 0x7f1ad00b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:50.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.277+0000 7f1ad5992640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1ad00b4d90 0x7f1ad00b4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58796/0 (socket says 172.21.15.146:58796) 2024-09-19T08:36:50.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.277+0000 7f1ad5992640 1 -- 172.21.15.146:0/703883256 learned_addr learned my addr 172.21.15.146:0/703883256 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-19T08:36:50.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.277+0000 7f1ad6193640 1 --2- 172.21.15.146:0/703883256 >> v2:172.21.15.117:3300/0 conn(0x7f1ad015b360 0x7f1ad015d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:50.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.278+0000 7f1ad5992640 1 -- 172.21.15.146:0/703883256 >> v2:172.21.15.117:3300/0 conn(0x7f1ad015b360 msgr2=0x7f1ad015d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:36:50.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.278+0000 7f1ad5992640 1 --2- 172.21.15.146:0/703883256 >> v2:172.21.15.117:3300/0 conn(0x7f1ad015b360 0x7f1ad015d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.278+0000 7f1ad5992640 1 -- 172.21.15.146:0/703883256 >> v1:172.21.15.117:6789/0 conn(0x7f1ad00b45c0 legacy=0x7f1ad015ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:36:50.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.278+0000 7f1ad5992640 1 -- 172.21.15.146:0/703883256 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad015cbd0 con 0x7f1ad00b4d90 2024-09-19T08:36:50.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.278+0000 7f1ad5992640 1 --2- 172.21.15.146:0/703883256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ad00b4d90 0x7f1ad00b4080 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1ad00b7340 tx=0x7f1ac002c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7b2d696dd86c7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:50.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.278+0000 7f1ad4990640 1 -- 172.21.15.146:0/703883256 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0036020 con 0x7f1ad00b4d90 2024-09-19T08:36:50.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.278+0000 7f1ad4990640 1 -- 172.21.15.146:0/703883256 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac0032830 con 0x7f1ad00b4d90 2024-09-19T08:36:50.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.278+0000 7f1ad4990640 1 -- 172.21.15.146:0/703883256 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0032c00 con 0x7f1ad00b4d90 2024-09-19T08:36:50.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.279+0000 7f1ad7bf6640 1 -- 172.21.15.146:0/703883256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ad00b4d90 msgr2=0x7f1ad00b4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:50.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.279+0000 7f1ad7bf6640 1 --2- 172.21.15.146:0/703883256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ad00b4d90 0x7f1ad00b4080 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1ad00b7340 tx=0x7f1ac002c970 comp rx=0 tx=0).stop 2024-09-19T08:36:50.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.279+0000 7f1ad7bf6640 1 -- 172.21.15.146:0/703883256 shutdown_connections 2024-09-19T08:36:50.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.279+0000 7f1ad7bf6640 1 --2- 172.21.15.146:0/703883256 >> v2:172.21.15.117:3300/0 conn(0x7f1ad015b360 0x7f1ad015d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.279+0000 7f1ad7bf6640 1 --2- 172.21.15.146:0/703883256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ad00b4d90 0x7f1ad00b4080 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.279+0000 7f1ad7bf6640 1 -- 172.21.15.146:0/703883256 >> 172.21.15.146:0/703883256 conn(0x7f1ad009a9f0 msgr2=0x7f1ad00b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:50.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.279+0000 7f1ad7bf6640 1 -- 172.21.15.146:0/703883256 shutdown_connections 2024-09-19T08:36:50.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.279+0000 7f1ad7bf6640 1 -- 172.21.15.146:0/703883256 wait complete. 2024-09-19T08:36:50.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.280+0000 7f1ad7bf6640 1 Processor -- start 2024-09-19T08:36:50.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.281+0000 7f1ad7bf6640 1 -- start start 2024-09-19T08:36:50.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.281+0000 7f1ad7bf6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ad00b4d90 0x7f1ad01efb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:50.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.281+0000 7f1ad7bf6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ad015b360 0x7f1ad009cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:50.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.281+0000 7f1ad7bf6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ad014eed0 0x7f1ad01509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.281+0000 7f1ad7bf6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad015c3d0 con 0x7f1ad00b4d90 2024-09-19T08:36:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.281+0000 7f1ad7bf6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad015c250 con 0x7f1ad014eed0 2024-09-19T08:36:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.281+0000 7f1ad7bf6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f1ad00b5170 con 0x7f1ad015b360 2024-09-19T08:36:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.281+0000 7f1ad5191640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ad015b360 0x7f1ad009cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.281+0000 7f1ad6193640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ad014eed0 0x7f1ad01509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.281+0000 7f1ad5191640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ad015b360 0x7f1ad009cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:46860/0 (socket says 172.21.15.146:46860) 2024-09-19T08:36:50.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.281+0000 7f1ad5191640 1 -- 172.21.15.146:0/927992786 learned_addr learned my addr 172.21.15.146:0/927992786 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-19T08:36:50.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.281+0000 7f1ad5992640 1 --2- 172.21.15.146:0/927992786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ad00b4d90 0x7f1ad01efb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:50.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.282+0000 7f1ad5191640 1 -- 172.21.15.146:0/927992786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ad014eed0 msgr2=0x7f1ad01509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:50.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.282+0000 7f1ad5191640 1 --2- 172.21.15.146:0/927992786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ad014eed0 0x7f1ad01509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.282+0000 7f1ad5191640 1 -- 172.21.15.146:0/927992786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ad00b4d90 msgr2=0x7f1ad01efb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:50.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.282+0000 7f1ad5191640 1 --2- 172.21.15.146:0/927992786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ad00b4d90 0x7f1ad01efb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.282+0000 7f1ad5191640 1 -- 172.21.15.146:0/927992786 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad014f3d0 con 0x7f1ad015b360 2024-09-19T08:36:50.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.282+0000 7f1ad5191640 1 --2- 172.21.15.146:0/927992786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ad015b360 0x7f1ad009cbd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1acc00c460 tx=0x7f1acc00c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:50.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.282+0000 7f1ac67fc640 1 -- 172.21.15.146:0/927992786 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc016020 con 0x7f1ad015b360 2024-09-19T08:36:50.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.282+0000 7f1ac67fc640 1 -- 172.21.15.146:0/927992786 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1acc012870 con 0x7f1ad015b360 2024-09-19T08:36:50.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.282+0000 7f1ad7bf6640 1 -- 172.21.15.146:0/927992786 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ad014f6b0 con 0x7f1ad015b360 2024-09-19T08:36:50.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.282+0000 7f1ac67fc640 1 -- 172.21.15.146:0/927992786 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc012c60 con 0x7f1ad015b360 2024-09-19T08:36:50.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.282+0000 7f1ad7bf6640 1 -- 172.21.15.146:0/927992786 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ad014fc70 con 0x7f1ad015b360 2024-09-19T08:36:50.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.282+0000 7f1ac67fc640 1 -- 172.21.15.146:0/927992786 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1acc019020 con 0x7f1ad015b360 2024-09-19T08:36:50.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.282+0000 7f1ac67fc640 1 -- 172.21.15.146:0/927992786 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f1acc01a840 con 0x7f1ad015b360 2024-09-19T08:36:50.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.283+0000 7f1ad7bf6640 1 -- 172.21.15.146:0/927992786 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ad00b5650 con 0x7f1ad015b360 2024-09-19T08:36:50.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.285+0000 7f1ac67fc640 1 -- 172.21.15.146:0/927992786 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1ad00b5650 con 0x7f1ad015b360 2024-09-19T08:36:50.297 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:50.295+0000 7f2fe27d6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:36:50.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.355+0000 7f1ad7bf6640 1 -- 172.21.15.146:0/927992786 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dab3472e-2259-47fd-912f-24c427b3c8b3", "id": 0} v 0) -- 0x7f1ad006e9d0 con 0x7f1ad015b360 2024-09-19T08:36:50.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.358+0000 7f1ac67fc640 1 -- 172.21.15.146:0/927992786 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dab3472e-2259-47fd-912f-24c427b3c8b3", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f1acc020030 con 0x7f1ad015b360 2024-09-19T08:36:50.358 INFO:teuthology.orchestra.run.smithi146.stdout:0 2024-09-19T08:36:50.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.359+0000 7f1ad7bf6640 1 -- 172.21.15.146:0/927992786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ad015b360 msgr2=0x7f1ad009cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:50.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.359+0000 7f1ad7bf6640 1 --2- 172.21.15.146:0/927992786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ad015b360 0x7f1ad009cbd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1acc00c460 tx=0x7f1acc00c920 comp rx=0 tx=0).stop 2024-09-19T08:36:50.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.359+0000 7f1ad7bf6640 1 -- 172.21.15.146:0/927992786 shutdown_connections 2024-09-19T08:36:50.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.359+0000 7f1ad7bf6640 1 --2- 172.21.15.146:0/927992786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ad014eed0 0x7f1ad01509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.359+0000 7f1ad7bf6640 1 --2- 172.21.15.146:0/927992786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ad015b360 0x7f1ad009cbd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.359+0000 7f1ad7bf6640 1 --2- 172.21.15.146:0/927992786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ad00b4d90 0x7f1ad01efb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.359+0000 7f1ad7bf6640 1 -- 172.21.15.146:0/927992786 >> 172.21.15.146:0/927992786 conn(0x7f1ad009a9f0 msgr2=0x7f1ad015ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:50.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.359+0000 7f1ad7bf6640 1 -- 172.21.15.146:0/927992786 shutdown_connections 2024-09-19T08:36:50.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.359+0000 7f1ad7bf6640 1 -- 172.21.15.146:0/927992786 wait complete. 2024-09-19T08:36:50.369 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 1c52ad63-39de-4ce6-a85e-75a815269b06 1 2024-09-19T08:36:50.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.468+0000 7f796f837640 1 Processor -- start 2024-09-19T08:36:50.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.469+0000 7f796f837640 1 -- start start 2024-09-19T08:36:50.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.469+0000 7f796f837640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79680b4d90 0x7f79680b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:50.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.469+0000 7f796f837640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f79680b45c0 0x7f796815ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:50.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.469+0000 7f796f837640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f796815c610 con 0x7f79680b5170 2024-09-19T08:36:50.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.469+0000 7f796f837640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f796815d220 con 0x7f79680b45c0 2024-09-19T08:36:50.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.469+0000 7f796f837640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f796815c8f0 con 0x7f79680b4d90 2024-09-19T08:36:50.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.469+0000 7f796d5d3640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79680b4d90 0x7f79680b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:50.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.469+0000 7f796d5d3640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79680b4d90 0x7f79680b4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58826/0 (socket says 172.21.15.146:58826) 2024-09-19T08:36:50.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.469+0000 7f796ddd4640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f79680b5170 0x7f796815eda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43694/0 (socket says 172.21.15.146:43694) 2024-09-19T08:36:50.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.469+0000 7f796d5d3640 1 -- 172.21.15.146:0/2103640477 learned_addr learned my addr 172.21.15.146:0/2103640477 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-19T08:36:50.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.470+0000 7f796cdd2640 1 --2- 172.21.15.146:0/2103640477 >> v2:172.21.15.117:3300/0 conn(0x7f79680b45c0 0x7f796815ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:50.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.470+0000 7f796d5d3640 1 -- 172.21.15.146:0/2103640477 >> v2:172.21.15.117:3300/0 conn(0x7f79680b45c0 msgr2=0x7f796815ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:36:50.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.470+0000 7f796d5d3640 1 --2- 172.21.15.146:0/2103640477 >> v2:172.21.15.117:3300/0 conn(0x7f79680b45c0 0x7f796815ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.470+0000 7f796d5d3640 1 -- 172.21.15.146:0/2103640477 >> v1:172.21.15.146:6789/0 conn(0x7f79680b5170 legacy=0x7f796815eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:50.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.470+0000 7f795bfff640 1 -- 172.21.15.146:0/2103640477 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2596408963 0 0) 0x7f796815c610 con 0x7f79680b5170 2024-09-19T08:36:50.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.470+0000 7f796d5d3640 1 -- 172.21.15.146:0/2103640477 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f796815cbd0 con 0x7f79680b4d90 2024-09-19T08:36:50.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.470+0000 7f796d5d3640 1 --2- 172.21.15.146:0/2103640477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79680b4d90 0x7f79680b4080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f79680b7340 tx=0x7f796402c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e6837a9de9cd874 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:50.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.471+0000 7f795bfff640 1 -- 172.21.15.146:0/2103640477 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7964035070 con 0x7f79680b4d90 2024-09-19T08:36:50.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.471+0000 7f795bfff640 1 -- 172.21.15.146:0/2103640477 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7964031830 con 0x7f79680b4d90 2024-09-19T08:36:50.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.471+0000 7f795bfff640 1 -- 172.21.15.146:0/2103640477 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7964031c00 con 0x7f79680b4d90 2024-09-19T08:36:50.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.471+0000 7f796f837640 1 -- 172.21.15.146:0/2103640477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79680b4d90 msgr2=0x7f79680b4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:50.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.471+0000 7f796f837640 1 --2- 172.21.15.146:0/2103640477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79680b4d90 0x7f79680b4080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f79680b7340 tx=0x7f796402c9d0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.471+0000 7f796f837640 1 -- 172.21.15.146:0/2103640477 shutdown_connections 2024-09-19T08:36:50.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.471+0000 7f796f837640 1 --2- 172.21.15.146:0/2103640477 >> v2:172.21.15.117:3300/0 conn(0x7f79680b45c0 0x7f796815ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.471+0000 7f796f837640 1 --2- 172.21.15.146:0/2103640477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79680b4d90 0x7f79680b4080 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.471+0000 7f796f837640 1 -- 172.21.15.146:0/2103640477 >> 172.21.15.146:0/2103640477 conn(0x7f796809a9f0 msgr2=0x7f79680b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:50.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.471+0000 7f796f837640 1 -- 172.21.15.146:0/2103640477 shutdown_connections 2024-09-19T08:36:50.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.471+0000 7f796f837640 1 -- 172.21.15.146:0/2103640477 wait complete. 2024-09-19T08:36:50.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.472+0000 7f796f837640 1 Processor -- start 2024-09-19T08:36:50.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.472+0000 7f796f837640 1 -- start start 2024-09-19T08:36:50.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.473+0000 7f796f837640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79680b4d90 0x7f796814ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:50.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.473+0000 7f796f837640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79680b5170 0x7f7968155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:50.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.473+0000 7f796f837640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79681504e0 0x7f7968151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:50.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.473+0000 7f796f837640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f796815c3d0 con 0x7f79681504e0 2024-09-19T08:36:50.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.473+0000 7f796f837640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f796815c250 con 0x7f79680b4d90 2024-09-19T08:36:50.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.473+0000 7f796f837640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f796815e6c0 con 0x7f79680b5170 2024-09-19T08:36:50.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.473+0000 7f796d5d3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79680b4d90 0x7f796814ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:50.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.473+0000 7f796d5d3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79680b4d90 0x7f796814ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58832/0 (socket says 172.21.15.146:58832) 2024-09-19T08:36:50.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.473+0000 7f796d5d3640 1 -- 172.21.15.146:0/1777308747 learned_addr learned my addr 172.21.15.146:0/1777308747 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-19T08:36:50.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.473+0000 7f796cdd2640 1 --2- 172.21.15.146:0/1777308747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79680b5170 0x7f7968155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:50.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.473+0000 7f796ddd4640 1 --2- 172.21.15.146:0/1777308747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79681504e0 0x7f7968151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:50.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.474+0000 7f796d5d3640 1 -- 172.21.15.146:0/1777308747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79680b5170 msgr2=0x7f7968155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:50.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.474+0000 7f796d5d3640 1 --2- 172.21.15.146:0/1777308747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79680b5170 0x7f7968155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.474+0000 7f796d5d3640 1 -- 172.21.15.146:0/1777308747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79681504e0 msgr2=0x7f7968151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:50.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.474+0000 7f796d5d3640 1 --2- 172.21.15.146:0/1777308747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79681504e0 0x7f7968151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.474+0000 7f796d5d3640 1 -- 172.21.15.146:0/1777308747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7968150970 con 0x7f79680b4d90 2024-09-19T08:36:50.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.474+0000 7f796d5d3640 1 --2- 172.21.15.146:0/1777308747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79680b4d90 0x7f796814ac30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f796402ca10 tx=0x7f79640046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:50.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.474+0000 7f7959ffb640 1 -- 172.21.15.146:0/1777308747 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7964035040 con 0x7f79680b4d90 2024-09-19T08:36:50.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.474+0000 7f7959ffb640 1 -- 172.21.15.146:0/1777308747 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f796403a660 con 0x7f79680b4d90 2024-09-19T08:36:50.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.474+0000 7f796f837640 1 -- 172.21.15.146:0/1777308747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7968150c50 con 0x7f79680b4d90 2024-09-19T08:36:50.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.474+0000 7f7959ffb640 1 -- 172.21.15.146:0/1777308747 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796403aa70 con 0x7f79680b4d90 2024-09-19T08:36:50.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.474+0000 7f796f837640 1 -- 172.21.15.146:0/1777308747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7968151210 con 0x7f79680b4d90 2024-09-19T08:36:50.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.474+0000 7f7959ffb640 1 -- 172.21.15.146:0/1777308747 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7964038070 con 0x7f79680b4d90 2024-09-19T08:36:50.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.474+0000 7f7959ffb640 1 -- 172.21.15.146:0/1777308747 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f796404cd40 con 0x7f79680b4d90 2024-09-19T08:36:50.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.475+0000 7f796f837640 1 -- 172.21.15.146:0/1777308747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7968151650 con 0x7f79680b4d90 2024-09-19T08:36:50.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.478+0000 7f7959ffb640 1 -- 172.21.15.146:0/1777308747 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7964031800 con 0x7f79680b4d90 2024-09-19T08:36:50.535 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:50.535+0000 7f146e421040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:36:50.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.548+0000 7f796f837640 1 -- 172.21.15.146:0/1777308747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1c52ad63-39de-4ce6-a85e-75a815269b06", "id": 1} v 0) -- 0x7f79680b4080 con 0x7f79680b4d90 2024-09-19T08:36:50.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.553+0000 7f7959ffb640 1 -- 172.21.15.146:0/1777308747 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1c52ad63-39de-4ce6-a85e-75a815269b06", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f796404c400 con 0x7f79680b4d90 2024-09-19T08:36:50.553 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-19T08:36:50.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.554+0000 7f796f837640 1 -- 172.21.15.146:0/1777308747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79680b4d90 msgr2=0x7f796814ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:50.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.554+0000 7f796f837640 1 --2- 172.21.15.146:0/1777308747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79680b4d90 0x7f796814ac30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f796402ca10 tx=0x7f79640046c0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.554+0000 7f796f837640 1 -- 172.21.15.146:0/1777308747 shutdown_connections 2024-09-19T08:36:50.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.554+0000 7f796f837640 1 --2- 172.21.15.146:0/1777308747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79681504e0 0x7f7968151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.554+0000 7f796f837640 1 --2- 172.21.15.146:0/1777308747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79680b5170 0x7f7968155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.554+0000 7f796f837640 1 --2- 172.21.15.146:0/1777308747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79680b4d90 0x7f796814ac30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.554+0000 7f796f837640 1 -- 172.21.15.146:0/1777308747 >> 172.21.15.146:0/1777308747 conn(0x7f796809a9f0 msgr2=0x7f7968156fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:50.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.554+0000 7f796f837640 1 -- 172.21.15.146:0/1777308747 shutdown_connections 2024-09-19T08:36:50.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.554+0000 7f796f837640 1 -- 172.21.15.146:0/1777308747 wait complete. 2024-09-19T08:36:50.564 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 80197f7c-2aab-482a-998f-3cd9a87c0349 2 2024-09-19T08:36:50.576 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:50.576+0000 7f146e421040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:36:50.650 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:50.650+0000 7f2fe27d6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:36:50.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.664+0000 7fdb8c186640 1 Processor -- start 2024-09-19T08:36:50.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.664+0000 7fdb8c186640 1 -- start start 2024-09-19T08:36:50.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.665+0000 7fdb8c186640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdb84145a20 0x7fdb840b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:50.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.665+0000 7fdb8c186640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb840b0460 0x7fdb8406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:50.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.665+0000 7fdb8c186640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdb84145e00 0x7fdb8406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:50.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.665+0000 7fdb8c186640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fdb840b1570 con 0x7fdb84145a20 2024-09-19T08:36:50.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.665+0000 7fdb8c186640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fdb8406ca00 con 0x7fdb84145e00 2024-09-19T08:36:50.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.665+0000 7fdb8c186640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fdb840b0960 con 0x7fdb840b0460 2024-09-19T08:36:50.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.665+0000 7fdb89721640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb840b0460 0x7fdb8406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:50.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.665+0000 7fdb8a723640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdb84145e00 0x7fdb8406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:50.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.665+0000 7fdb89721640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb840b0460 0x7fdb8406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:46880/0 (socket says 172.21.15.146:46880) 2024-09-19T08:36:50.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.665+0000 7fdb89721640 1 -- 172.21.15.146:0/2739716786 learned_addr learned my addr 172.21.15.146:0/2739716786 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-19T08:36:50.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.665+0000 7fdb89f22640 1 --2- 172.21.15.146:0/2739716786 >> v2:172.21.15.117:3300/0 conn(0x7fdb84145a20 0x7fdb840b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:50.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.665+0000 7fdb8a723640 1 -- 172.21.15.146:0/2739716786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb840b0460 msgr2=0x7fdb8406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:36:50.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.665+0000 7fdb8a723640 1 --2- 172.21.15.146:0/2739716786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb840b0460 0x7fdb8406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.665+0000 7fdb8a723640 1 -- 172.21.15.146:0/2739716786 >> v2:172.21.15.117:3300/0 conn(0x7fdb84145a20 msgr2=0x7fdb840b6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:36:50.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.665+0000 7fdb8a723640 1 --2- 172.21.15.146:0/2739716786 >> v2:172.21.15.117:3300/0 conn(0x7fdb84145a20 0x7fdb840b6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.665+0000 7fdb8a723640 1 -- 172.21.15.146:0/2739716786 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb840b0c40 con 0x7fdb84145e00 2024-09-19T08:36:50.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.665+0000 7fdb89721640 1 --2- 172.21.15.146:0/2739716786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb840b0460 0x7fdb8406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:36:50.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.666+0000 7fdb8a723640 1 --2- 172.21.15.146:0/2739716786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb84145e00 0x7fdb8406c150 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009d90 tx=0x7fdb7c02a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49323987dbf68afe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:50.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.666+0000 7fdb88f20640 1 -- 172.21.15.146:0/2739716786 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c031600 con 0x7fdb84145e00 2024-09-19T08:36:50.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.666+0000 7fdb88f20640 1 -- 172.21.15.146:0/2739716786 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7c0317a0 con 0x7fdb84145e00 2024-09-19T08:36:50.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.666+0000 7fdb88f20640 1 -- 172.21.15.146:0/2739716786 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c031b70 con 0x7fdb84145e00 2024-09-19T08:36:50.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.667+0000 7fdb8c186640 1 -- 172.21.15.146:0/2739716786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb84145e00 msgr2=0x7fdb8406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:50.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.667+0000 7fdb8c186640 1 --2- 172.21.15.146:0/2739716786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb84145e00 0x7fdb8406c150 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009d90 tx=0x7fdb7c02a610 comp rx=0 tx=0).stop 2024-09-19T08:36:50.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.667+0000 7fdb8c186640 1 -- 172.21.15.146:0/2739716786 shutdown_connections 2024-09-19T08:36:50.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.667+0000 7fdb8c186640 1 --2- 172.21.15.146:0/2739716786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb840b0460 0x7fdb8406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.667+0000 7fdb8c186640 1 --2- 172.21.15.146:0/2739716786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb84145e00 0x7fdb8406c150 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.667+0000 7fdb8c186640 1 --2- 172.21.15.146:0/2739716786 >> v2:172.21.15.117:3300/0 conn(0x7fdb84145a20 0x7fdb840b6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.667+0000 7fdb8c186640 1 -- 172.21.15.146:0/2739716786 >> 172.21.15.146:0/2739716786 conn(0x7fdb8409a9f0 msgr2=0x7fdb840b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:50.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.667+0000 7fdb8c186640 1 -- 172.21.15.146:0/2739716786 shutdown_connections 2024-09-19T08:36:50.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.667+0000 7fdb8c186640 1 -- 172.21.15.146:0/2739716786 wait complete. 2024-09-19T08:36:50.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.668+0000 7fdb8c186640 1 Processor -- start 2024-09-19T08:36:50.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.668+0000 7fdb8c186640 1 -- start start 2024-09-19T08:36:50.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.669+0000 7fdb8c186640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb840b0460 0x7fdb8415be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:50.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.669+0000 7fdb8c186640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb84145a20 0x7fdb84155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:50.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.669+0000 7fdb8c186640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb84145e00 0x7fdb84155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:50.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.669+0000 7fdb8c186640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdb840d1070 con 0x7fdb840b0460 2024-09-19T08:36:50.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.669+0000 7fdb8c186640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdb840b1200 con 0x7fdb84145e00 2024-09-19T08:36:50.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.669+0000 7fdb8c186640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fdb840d11f0 con 0x7fdb84145a20 2024-09-19T08:36:50.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.669+0000 7fdb8a723640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb84145e00 0x7fdb84155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:50.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.669+0000 7fdb89721640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb84145a20 0x7fdb84155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:50.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.669+0000 7fdb89721640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb84145a20 0x7fdb84155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:46892/0 (socket says 172.21.15.146:46892) 2024-09-19T08:36:50.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.669+0000 7fdb8a723640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb84145e00 0x7fdb84155840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58844/0 (socket says 172.21.15.146:58844) 2024-09-19T08:36:50.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.669+0000 7fdb89721640 1 -- 172.21.15.146:0/1544010132 learned_addr learned my addr 172.21.15.146:0/1544010132 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-19T08:36:50.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.669+0000 7fdb89f22640 1 --2- 172.21.15.146:0/1544010132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb840b0460 0x7fdb8415be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:50.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.669+0000 7fdb89721640 1 -- 172.21.15.146:0/1544010132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb84145e00 msgr2=0x7fdb84155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:50.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.669+0000 7fdb89721640 1 --2- 172.21.15.146:0/1544010132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb84145e00 0x7fdb84155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.669+0000 7fdb89721640 1 -- 172.21.15.146:0/1544010132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb840b0460 msgr2=0x7fdb8415be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:50.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.669+0000 7fdb89721640 1 --2- 172.21.15.146:0/1544010132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb840b0460 0x7fdb8415be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.669+0000 7fdb89721640 1 -- 172.21.15.146:0/1544010132 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8409b170 con 0x7fdb84145a20 2024-09-19T08:36:50.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.669+0000 7fdb89f22640 1 --2- 172.21.15.146:0/1544010132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb840b0460 0x7fdb8415be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:36:50.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.669+0000 7fdb89721640 1 --2- 172.21.15.146:0/1544010132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb84145a20 0x7fdb84155300 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdb74006e00 tx=0x7fdb7400ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:50.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.670+0000 7fdb7a7fc640 1 -- 172.21.15.146:0/1544010132 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7400ca00 con 0x7fdb84145a20 2024-09-19T08:36:50.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.670+0000 7fdb7a7fc640 1 -- 172.21.15.146:0/1544010132 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7400cba0 con 0x7fdb84145a20 2024-09-19T08:36:50.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.670+0000 7fdb8c186640 1 -- 172.21.15.146:0/1544010132 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb8409b430 con 0x7fdb84145a20 2024-09-19T08:36:50.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.670+0000 7fdb7a7fc640 1 -- 172.21.15.146:0/1544010132 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74004030 con 0x7fdb84145a20 2024-09-19T08:36:50.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.670+0000 7fdb8c186640 1 -- 172.21.15.146:0/1544010132 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb84150170 con 0x7fdb84145a20 2024-09-19T08:36:50.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.670+0000 7fdb7a7fc640 1 -- 172.21.15.146:0/1544010132 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdb74003610 con 0x7fdb84145a20 2024-09-19T08:36:50.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.670+0000 7fdb7a7fc640 1 -- 172.21.15.146:0/1544010132 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fdb74013bb0 con 0x7fdb84145a20 2024-09-19T08:36:50.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.671+0000 7fdb8c186640 1 -- 172.21.15.146:0/1544010132 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb840b6cb0 con 0x7fdb84145a20 2024-09-19T08:36:50.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.673+0000 7fdb7a7fc640 1 -- 172.21.15.146:0/1544010132 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fdb74017020 con 0x7fdb84145a20 2024-09-19T08:36:50.705 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:50.706+0000 7f2fe27d6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:36:50.721 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:50.721+0000 7f146e421040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:36:50.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.740+0000 7fdb8c186640 1 -- 172.21.15.146:0/1544010132 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd new", "uuid": "80197f7c-2aab-482a-998f-3cd9a87c0349", "id": 2} v 0) -- 0x7fdb84143cc0 con 0x7fdb84145a20 2024-09-19T08:36:50.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.745+0000 7fdb7a7fc640 1 -- 172.21.15.146:0/1544010132 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "80197f7c-2aab-482a-998f-3cd9a87c0349", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fdb74013790 con 0x7fdb84145a20 2024-09-19T08:36:50.745 INFO:teuthology.orchestra.run.smithi146.stdout:2 2024-09-19T08:36:50.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.746+0000 7fdb8c186640 1 -- 172.21.15.146:0/1544010132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb84145a20 msgr2=0x7fdb84155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:50.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.746+0000 7fdb8c186640 1 --2- 172.21.15.146:0/1544010132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb84145a20 0x7fdb84155300 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdb74006e00 tx=0x7fdb7400ee10 comp rx=0 tx=0).stop 2024-09-19T08:36:50.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.746+0000 7fdb8c186640 1 -- 172.21.15.146:0/1544010132 shutdown_connections 2024-09-19T08:36:50.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.746+0000 7fdb8c186640 1 --2- 172.21.15.146:0/1544010132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb84145e00 0x7fdb84155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.746+0000 7fdb8c186640 1 --2- 172.21.15.146:0/1544010132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb84145a20 0x7fdb84155300 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.746+0000 7fdb8c186640 1 --2- 172.21.15.146:0/1544010132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb840b0460 0x7fdb8415be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.746+0000 7fdb8c186640 1 -- 172.21.15.146:0/1544010132 >> 172.21.15.146:0/1544010132 conn(0x7fdb8409a9f0 msgr2=0x7fdb840afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:50.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.746+0000 7fdb8c186640 1 -- 172.21.15.146:0/1544010132 shutdown_connections 2024-09-19T08:36:50.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.746+0000 7fdb8c186640 1 -- 172.21.15.146:0/1544010132 wait complete. 2024-09-19T08:36:50.757 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new a26f33dd-5d70-4c6e-b951-1a08a2e13054 3 2024-09-19T08:36:50.772 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:50.772+0000 7f146e421040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:36:50.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.855+0000 7f9024b28640 1 Processor -- start 2024-09-19T08:36:50.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.855+0000 7f9024b28640 1 -- start start 2024-09-19T08:36:50.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.856+0000 7f9024b28640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f902006bc10 0x7f90200b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:50.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.856+0000 7f9024b28640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90200b4010 0x7f90200b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:50.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.856+0000 7f9024b28640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90200b5c80 con 0x7f90200adff0 2024-09-19T08:36:50.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.856+0000 7f9024b28640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f90200b7180 con 0x7f902006bc10 2024-09-19T08:36:50.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.856+0000 7f9024b28640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f90200b5ef0 con 0x7f90200b4010 2024-09-19T08:36:50.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.856+0000 7f901ed9d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90200b4010 0x7f90200b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:50.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.856+0000 7f901ed9d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90200b4010 0x7f90200b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:46896/0 (socket says 172.21.15.146:46896) 2024-09-19T08:36:50.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.856+0000 7f901ed9d640 1 -- 172.21.15.146:0/4201204477 learned_addr learned my addr 172.21.15.146:0/4201204477 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-19T08:36:50.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.856+0000 7f901e59c640 1 --2- 172.21.15.146:0/4201204477 >> v2:172.21.15.117:3300/0 conn(0x7f902006bc10 0x7f90200b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:50.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.856+0000 7f901ed9d640 1 -- 172.21.15.146:0/4201204477 >> v2:172.21.15.117:3300/0 conn(0x7f902006bc10 msgr2=0x7f90200b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:36:50.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.856+0000 7f901ed9d640 1 --2- 172.21.15.146:0/4201204477 >> v2:172.21.15.117:3300/0 conn(0x7f902006bc10 0x7f90200b6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.856+0000 7f901ed9d640 1 -- 172.21.15.146:0/4201204477 >> v1:172.21.15.117:6789/0 conn(0x7f90200adff0 legacy=0x7f902006bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:50.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.856+0000 7f901ed9d640 1 -- 172.21.15.146:0/4201204477 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90200b61d0 con 0x7f90200b4010 2024-09-19T08:36:50.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.857+0000 7f901ed9d640 1 --2- 172.21.15.146:0/4201204477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90200b4010 0x7f90200b13f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9018009e50 tx=0x7f901802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaed74d16b6db594 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:50.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.857+0000 7f901dd9b640 1 -- 172.21.15.146:0/4201204477 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9018036070 con 0x7f90200b4010 2024-09-19T08:36:50.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.857+0000 7f901dd9b640 1 -- 172.21.15.146:0/4201204477 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9018031600 con 0x7f90200b4010 2024-09-19T08:36:50.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.857+0000 7f901dd9b640 1 -- 172.21.15.146:0/4201204477 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90180319d0 con 0x7f90200b4010 2024-09-19T08:36:50.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.858+0000 7f9024b28640 1 -- 172.21.15.146:0/4201204477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90200b4010 msgr2=0x7f90200b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:50.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.858+0000 7f9024b28640 1 --2- 172.21.15.146:0/4201204477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90200b4010 0x7f90200b13f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9018009e50 tx=0x7f901802a710 comp rx=0 tx=0).stop 2024-09-19T08:36:50.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.858+0000 7f9024b28640 1 -- 172.21.15.146:0/4201204477 shutdown_connections 2024-09-19T08:36:50.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.858+0000 7f9024b28640 1 --2- 172.21.15.146:0/4201204477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90200b4010 0x7f90200b13f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.858+0000 7f9024b28640 1 --2- 172.21.15.146:0/4201204477 >> v2:172.21.15.117:3300/0 conn(0x7f902006bc10 0x7f90200b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.858+0000 7f9024b28640 1 -- 172.21.15.146:0/4201204477 >> 172.21.15.146:0/4201204477 conn(0x7f902009a9f0 msgr2=0x7f90200b6530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:50.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.858+0000 7f9024b28640 1 -- 172.21.15.146:0/4201204477 shutdown_connections 2024-09-19T08:36:50.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.858+0000 7f9024b28640 1 -- 172.21.15.146:0/4201204477 wait complete. 2024-09-19T08:36:50.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.859+0000 7f9024b28640 1 Processor -- start 2024-09-19T08:36:50.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.859+0000 7f9024b28640 1 -- start start 2024-09-19T08:36:50.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.860+0000 7f9024b28640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f902006bc10 0x7f902015fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:50.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.860+0000 7f9024b28640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90200adff0 0x7f902014dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:50.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.860+0000 7f9024b28640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90200b4010 0x7f902009d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:50.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.860+0000 7f9024b28640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f90200b4510 con 0x7f90200adff0 2024-09-19T08:36:50.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.860+0000 7f9024b28640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f90200b0740 con 0x7f90200b4010 2024-09-19T08:36:50.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.860+0000 7f9024b28640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f90200b4690 con 0x7f902006bc10 2024-09-19T08:36:50.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.860+0000 7f901e59c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f902006bc10 0x7f902015fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:50.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.860+0000 7f901e59c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f902006bc10 0x7f902015fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:46910/0 (socket says 172.21.15.146:46910) 2024-09-19T08:36:50.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.860+0000 7f901e59c640 1 -- 172.21.15.146:0/2446289934 learned_addr learned my addr 172.21.15.146:0/2446289934 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-19T08:36:50.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.860+0000 7f901ed9d640 1 --2- 172.21.15.146:0/2446289934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90200b4010 0x7f902009d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:50.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.860+0000 7f9017fff640 1 --2- 172.21.15.146:0/2446289934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90200adff0 0x7f902014dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:50.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.860+0000 7f901e59c640 1 -- 172.21.15.146:0/2446289934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90200b4010 msgr2=0x7f902009d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:50.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.860+0000 7f901e59c640 1 --2- 172.21.15.146:0/2446289934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90200b4010 0x7f902009d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.860+0000 7f901e59c640 1 -- 172.21.15.146:0/2446289934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90200adff0 msgr2=0x7f902014dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:50.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.860+0000 7f901e59c640 1 --2- 172.21.15.146:0/2446289934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90200adff0 0x7f902014dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.860+0000 7f901e59c640 1 -- 172.21.15.146:0/2446289934 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902009c120 con 0x7f902006bc10 2024-09-19T08:36:50.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.860+0000 7f901ed9d640 1 --2- 172.21.15.146:0/2446289934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90200b4010 0x7f902009d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:36:50.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.860+0000 7f901e59c640 1 --2- 172.21.15.146:0/2446289934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f902006bc10 0x7f902015fcd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f901000e9b0 tx=0x7f901000ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:50.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.861+0000 7f9016ffd640 1 -- 172.21.15.146:0/2446289934 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9010017070 con 0x7f902006bc10 2024-09-19T08:36:50.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.861+0000 7f9016ffd640 1 -- 172.21.15.146:0/2446289934 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f901000c9a0 con 0x7f902006bc10 2024-09-19T08:36:50.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.861+0000 7f9024b28640 1 -- 172.21.15.146:0/2446289934 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f902009c400 con 0x7f902006bc10 2024-09-19T08:36:50.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.861+0000 7f9016ffd640 1 -- 172.21.15.146:0/2446289934 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901000cd90 con 0x7f902006bc10 2024-09-19T08:36:50.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.861+0000 7f9024b28640 1 -- 172.21.15.146:0/2446289934 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f902009cca0 con 0x7f902006bc10 2024-09-19T08:36:50.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.861+0000 7f9016ffd640 1 -- 172.21.15.146:0/2446289934 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f901001a070 con 0x7f902006bc10 2024-09-19T08:36:50.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.861+0000 7f9016ffd640 1 -- 172.21.15.146:0/2446289934 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f901001c9d0 con 0x7f902006bc10 2024-09-19T08:36:50.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.862+0000 7f9024b28640 1 -- 172.21.15.146:0/2446289934 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f902015d320 con 0x7f902006bc10 2024-09-19T08:36:50.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.864+0000 7f9016ffd640 1 -- 172.21.15.146:0/2446289934 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f901001ccd0 con 0x7f902006bc10 2024-09-19T08:36:50.865 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:50.865+0000 7f2fe27d6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:36:50.937 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:50.937+0000 7f146e421040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:36:50.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.953+0000 7f9024b28640 1 -- 172.21.15.146:0/2446289934 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a26f33dd-5d70-4c6e-b951-1a08a2e13054", "id": 3} v 0) -- 0x7f90200af3b0 con 0x7f902006bc10 2024-09-19T08:36:50.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.958+0000 7f9016ffd640 1 -- 172.21.15.146:0/2446289934 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a26f33dd-5d70-4c6e-b951-1a08a2e13054", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f901001c540 con 0x7f902006bc10 2024-09-19T08:36:50.958 INFO:teuthology.orchestra.run.smithi146.stdout:3 2024-09-19T08:36:50.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.959+0000 7f9024b28640 1 -- 172.21.15.146:0/2446289934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f902006bc10 msgr2=0x7f902015fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:50.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.959+0000 7f9024b28640 1 --2- 172.21.15.146:0/2446289934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f902006bc10 0x7f902015fcd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f901000e9b0 tx=0x7f901000ee70 comp rx=0 tx=0).stop 2024-09-19T08:36:50.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.959+0000 7f9024b28640 1 -- 172.21.15.146:0/2446289934 shutdown_connections 2024-09-19T08:36:50.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.959+0000 7f9024b28640 1 --2- 172.21.15.146:0/2446289934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90200b4010 0x7f902009d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.959+0000 7f9024b28640 1 --2- 172.21.15.146:0/2446289934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90200adff0 0x7f902014dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.959+0000 7f9024b28640 1 --2- 172.21.15.146:0/2446289934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f902006bc10 0x7f902015fcd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:50.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.959+0000 7f9024b28640 1 -- 172.21.15.146:0/2446289934 >> 172.21.15.146:0/2446289934 conn(0x7f902009a9f0 msgr2=0x7f902006eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:50.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.959+0000 7f9024b28640 1 -- 172.21.15.146:0/2446289934 shutdown_connections 2024-09-19T08:36:50.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:50.959+0000 7f9024b28640 1 -- 172.21.15.146:0/2446289934 wait complete. 2024-09-19T08:36:50.969 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 5f2b0d06-4755-400d-a907-969bb3db18a2 4 2024-09-19T08:36:51.046 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:51.047+0000 7f146e421040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:36:51.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.068+0000 7fa920bc4640 1 Processor -- start 2024-09-19T08:36:51.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.068+0000 7fa920bc4640 1 -- start start 2024-09-19T08:36:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.069+0000 7fa920bc4640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa91c145a20 0x7fa91c0b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.069+0000 7fa920bc4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa91c0b0460 0x7fa91c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.069+0000 7fa920bc4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa91c145e00 0x7fa91c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.069+0000 7fa920bc4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa91c0b1570 con 0x7fa91c0b0460 2024-09-19T08:36:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.069+0000 7fa920bc4640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fa91c06ca00 con 0x7fa91c145a20 2024-09-19T08:36:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.069+0000 7fa920bc4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fa91c0b0960 con 0x7fa91c145e00 2024-09-19T08:36:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.069+0000 7fa91a59c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa91c145a20 0x7fa91c0b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.069+0000 7fa91a59c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa91c145a20 0x7fa91c0b6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58856/0 (socket says 172.21.15.146:58856) 2024-09-19T08:36:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.069+0000 7fa91ad9d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa91c145e00 0x7fa91c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.070+0000 7fa91a59c640 1 -- 172.21.15.146:0/1482657777 learned_addr learned my addr 172.21.15.146:0/1482657777 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-19T08:36:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.070+0000 7fa919d9b640 1 --2- 172.21.15.146:0/1482657777 >> v2:172.21.15.117:3300/0 conn(0x7fa91c0b0460 0x7fa91c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.070+0000 7fa91a59c640 1 -- 172.21.15.146:0/1482657777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa91c145e00 msgr2=0x7fa91c06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:36:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.070+0000 7fa91a59c640 1 --2- 172.21.15.146:0/1482657777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa91c145e00 0x7fa91c06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.070+0000 7fa91a59c640 1 -- 172.21.15.146:0/1482657777 >> v2:172.21.15.117:3300/0 conn(0x7fa91c0b0460 msgr2=0x7fa91c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:36:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.070+0000 7fa91a59c640 1 --2- 172.21.15.146:0/1482657777 >> v2:172.21.15.117:3300/0 conn(0x7fa91c0b0460 0x7fa91c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.070+0000 7fa91a59c640 1 -- 172.21.15.146:0/1482657777 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91c0b0c40 con 0x7fa91c145a20 2024-09-19T08:36:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.070+0000 7fa91ad9d640 1 --2- 172.21.15.146:0/1482657777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa91c145e00 0x7fa91c06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:36:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.070+0000 7fa91a59c640 1 --2- 172.21.15.146:0/1482657777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa91c145a20 0x7fa91c0b6cb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0b3e40 tx=0x7fa90c02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e48db4309445353 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.071+0000 7fa91959a640 1 -- 172.21.15.146:0/1482657777 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c037070 con 0x7fa91c145a20 2024-09-19T08:36:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.071+0000 7fa91959a640 1 -- 172.21.15.146:0/1482657777 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa90c032440 con 0x7fa91c145a20 2024-09-19T08:36:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.071+0000 7fa91959a640 1 -- 172.21.15.146:0/1482657777 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c032810 con 0x7fa91c145a20 2024-09-19T08:36:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.071+0000 7fa920bc4640 1 -- 172.21.15.146:0/1482657777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa91c145a20 msgr2=0x7fa91c0b6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.071+0000 7fa920bc4640 1 --2- 172.21.15.146:0/1482657777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa91c145a20 0x7fa91c0b6cb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0b3e40 tx=0x7fa90c02a1e0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.071+0000 7fa920bc4640 1 -- 172.21.15.146:0/1482657777 shutdown_connections 2024-09-19T08:36:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.071+0000 7fa920bc4640 1 --2- 172.21.15.146:0/1482657777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa91c145e00 0x7fa91c06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.071+0000 7fa920bc4640 1 --2- 172.21.15.146:0/1482657777 >> v2:172.21.15.117:3300/0 conn(0x7fa91c0b0460 0x7fa91c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.071+0000 7fa920bc4640 1 --2- 172.21.15.146:0/1482657777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa91c145a20 0x7fa91c0b6cb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.071+0000 7fa920bc4640 1 -- 172.21.15.146:0/1482657777 >> 172.21.15.146:0/1482657777 conn(0x7fa91c09a9f0 msgr2=0x7fa91c0b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.071+0000 7fa920bc4640 1 -- 172.21.15.146:0/1482657777 shutdown_connections 2024-09-19T08:36:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.071+0000 7fa920bc4640 1 -- 172.21.15.146:0/1482657777 wait complete. 2024-09-19T08:36:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.073+0000 7fa920bc4640 1 Processor -- start 2024-09-19T08:36:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.073+0000 7fa920bc4640 1 -- start start 2024-09-19T08:36:51.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa920bc4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa91c0b0460 0x7fa91c15ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa920bc4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa91c145a20 0x7fa91c13fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa920bc4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa91c145e00 0x7fa91c0b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa920bc4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa91c0d1070 con 0x7fa91c0b0460 2024-09-19T08:36:51.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa920bc4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa91c0b1200 con 0x7fa91c145a20 2024-09-19T08:36:51.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa920bc4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fa91c0d11f0 con 0x7fa91c145e00 2024-09-19T08:36:51.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa919d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa91c145a20 0x7fa91c13fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa91ad9d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa91c145e00 0x7fa91c0b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa91a59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa91c0b0460 0x7fa91c15ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa919d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa91c145a20 0x7fa91c13fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58872/0 (socket says 172.21.15.146:58872) 2024-09-19T08:36:51.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa919d9b640 1 -- 172.21.15.146:0/1683296650 learned_addr learned my addr 172.21.15.146:0/1683296650 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-19T08:36:51.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa91a59c640 1 -- 172.21.15.146:0/1683296650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa91c145e00 msgr2=0x7fa91c0b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa91a59c640 1 --2- 172.21.15.146:0/1683296650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa91c145e00 0x7fa91c0b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa91a59c640 1 -- 172.21.15.146:0/1683296650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa91c145a20 msgr2=0x7fa91c13fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa91a59c640 1 --2- 172.21.15.146:0/1683296650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa91c145a20 0x7fa91c13fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa91a59c640 1 -- 172.21.15.146:0/1683296650 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91c0d0000 con 0x7fa91c0b0460 2024-09-19T08:36:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa919d9b640 1 --2- 172.21.15.146:0/1683296650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa91c145a20 0x7fa91c13fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:36:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa91ad9d640 1 --2- 172.21.15.146:0/1683296650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa91c145e00 0x7fa91c0b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:36:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa91a59c640 1 --2- 172.21.15.146:0/1683296650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa91c0b0460 0x7fa91c15ab90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0b16f0 tx=0x7fa90c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa90affd640 1 -- 172.21.15.146:0/1683296650 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c041020 con 0x7fa91c0b0460 2024-09-19T08:36:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa90affd640 1 -- 172.21.15.146:0/1683296650 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa90c03d660 con 0x7fa91c0b0460 2024-09-19T08:36:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.074+0000 7fa920bc4640 1 -- 172.21.15.146:0/1683296650 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa91c0d02e0 con 0x7fa91c0b0460 2024-09-19T08:36:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.075+0000 7fa90affd640 1 -- 172.21.15.146:0/1683296650 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c037040 con 0x7fa91c0b0460 2024-09-19T08:36:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.075+0000 7fa920bc4640 1 -- 172.21.15.146:0/1683296650 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa91c0b4fa0 con 0x7fa91c0b0460 2024-09-19T08:36:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.075+0000 7fa90affd640 1 -- 172.21.15.146:0/1683296650 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa90c044020 con 0x7fa91c0b0460 2024-09-19T08:36:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.075+0000 7fa90affd640 1 -- 172.21.15.146:0/1683296650 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fa90c046b30 con 0x7fa91c0b0460 2024-09-19T08:36:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.075+0000 7fa920bc4640 1 -- 172.21.15.146:0/1683296650 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa91c0756d0 con 0x7fa91c0b0460 2024-09-19T08:36:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.078+0000 7fa90affd640 1 -- 172.21.15.146:0/1683296650 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa91c0756d0 con 0x7fa91c0b0460 2024-09-19T08:36:51.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.147+0000 7fa920bc4640 1 -- 172.21.15.146:0/1683296650 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5f2b0d06-4755-400d-a907-969bb3db18a2", "id": 4} v 0) -- 0x7fa91c070a70 con 0x7fa91c0b0460 2024-09-19T08:36:51.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.151+0000 7fa90affd640 1 -- 172.21.15.146:0/1683296650 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5f2b0d06-4755-400d-a907-969bb3db18a2", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fa90c04b030 con 0x7fa91c0b0460 2024-09-19T08:36:51.150 INFO:teuthology.orchestra.run.smithi146.stdout:4 2024-09-19T08:36:51.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.151+0000 7fa920bc4640 1 -- 172.21.15.146:0/1683296650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa91c0b0460 msgr2=0x7fa91c15ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.151+0000 7fa920bc4640 1 --2- 172.21.15.146:0/1683296650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa91c0b0460 0x7fa91c15ab90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0b16f0 tx=0x7fa90c0046c0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.151+0000 7fa920bc4640 1 -- 172.21.15.146:0/1683296650 shutdown_connections 2024-09-19T08:36:51.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.152+0000 7fa920bc4640 1 --2- 172.21.15.146:0/1683296650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa91c145e00 0x7fa91c0b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.152+0000 7fa920bc4640 1 --2- 172.21.15.146:0/1683296650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa91c145a20 0x7fa91c13fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.152+0000 7fa920bc4640 1 --2- 172.21.15.146:0/1683296650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa91c0b0460 0x7fa91c15ab90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.152+0000 7fa920bc4640 1 -- 172.21.15.146:0/1683296650 >> 172.21.15.146:0/1683296650 conn(0x7fa91c09a9f0 msgr2=0x7fa91c0b6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:51.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.152+0000 7fa920bc4640 1 -- 172.21.15.146:0/1683296650 shutdown_connections 2024-09-19T08:36:51.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.152+0000 7fa920bc4640 1 -- 172.21.15.146:0/1683296650 wait complete. 2024-09-19T08:36:51.161 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new df72b48a-47c7-4ca5-9e37-a596302a6c90 5 2024-09-19T08:36:51.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.261+0000 7f86b40f1640 1 Processor -- start 2024-09-19T08:36:51.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.261+0000 7f86b40f1640 1 -- start start 2024-09-19T08:36:51.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.262+0000 7f86b40f1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ac161af0 0x7f86ac162c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.262+0000 7f86b40f1640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f86ac0b47c0 0x7f86ac0d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.262+0000 7f86b40f1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86ac0d05e0 con 0x7f86ac09a9f0 2024-09-19T08:36:51.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.262+0000 7f86b40f1640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f86ac0d03b0 con 0x7f86ac0b47c0 2024-09-19T08:36:51.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.262+0000 7f86b40f1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f86ac163150 con 0x7f86ac161af0 2024-09-19T08:36:51.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.262+0000 7f86b1e8d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ac161af0 0x7f86ac162c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.262+0000 7f86b168c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f86ac0b47c0 0x7f86ac0d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.262+0000 7f86b168c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f86ac0b47c0 0x7f86ac0d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58882/0 (socket says 172.21.15.146:58882) 2024-09-19T08:36:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.262+0000 7f86b168c640 1 -- 172.21.15.146:0/651010151 learned_addr learned my addr 172.21.15.146:0/651010151 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-19T08:36:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.262+0000 7f86b1e8d640 1 --2- 172.21.15.146:0/651010151 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ac161af0 0x7f86ac162c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:46926/0 (socket says 172.21.15.146:46926) 2024-09-19T08:36:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.262+0000 7f86b168c640 1 -- 172.21.15.146:0/651010151 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ac161af0 msgr2=0x7f86ac162c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:36:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.262+0000 7f86b168c640 1 --2- 172.21.15.146:0/651010151 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ac161af0 0x7f86ac162c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.262+0000 7f86b168c640 1 -- 172.21.15.146:0/651010151 >> v1:172.21.15.117:6789/0 conn(0x7f86ac09a9f0 legacy=0x7f86ac0cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.262+0000 7f86b168c640 1 -- 172.21.15.146:0/651010151 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86ac0d08c0 con 0x7f86ac0b47c0 2024-09-19T08:36:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.262+0000 7f86b1e8d640 1 --2- 172.21.15.146:0/651010151 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ac161af0 0x7f86ac162c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:36:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.263+0000 7f86b168c640 1 --2- 172.21.15.146:0/651010151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ac0b47c0 0x7f86ac0d1680 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f86a80098a0 tx=0x7f86a802a320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f96c2d4df477d487 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.263+0000 7f86b0e8b640 1 -- 172.21.15.146:0/651010151 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8037070 con 0x7f86ac0b47c0 2024-09-19T08:36:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.263+0000 7f86b0e8b640 1 -- 172.21.15.146:0/651010151 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86a8032640 con 0x7f86ac0b47c0 2024-09-19T08:36:51.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.263+0000 7f86b0e8b640 1 -- 172.21.15.146:0/651010151 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8032a10 con 0x7f86ac0b47c0 2024-09-19T08:36:51.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.264+0000 7f86b40f1640 1 -- 172.21.15.146:0/651010151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ac0b47c0 msgr2=0x7f86ac0d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.264+0000 7f86b40f1640 1 --2- 172.21.15.146:0/651010151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ac0b47c0 0x7f86ac0d1680 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f86a80098a0 tx=0x7f86a802a320 comp rx=0 tx=0).stop 2024-09-19T08:36:51.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.264+0000 7f86b40f1640 1 -- 172.21.15.146:0/651010151 shutdown_connections 2024-09-19T08:36:51.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.264+0000 7f86b40f1640 1 --2- 172.21.15.146:0/651010151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ac0b47c0 0x7f86ac0d1680 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.264+0000 7f86b40f1640 1 --2- 172.21.15.146:0/651010151 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ac161af0 0x7f86ac162c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.264+0000 7f86b40f1640 1 -- 172.21.15.146:0/651010151 >> 172.21.15.146:0/651010151 conn(0x7f86ac0b3ca0 msgr2=0x7f86ac0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:51.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.264+0000 7f86b40f1640 1 -- 172.21.15.146:0/651010151 shutdown_connections 2024-09-19T08:36:51.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.264+0000 7f86b40f1640 1 -- 172.21.15.146:0/651010151 wait complete. 2024-09-19T08:36:51.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.265+0000 7f86b40f1640 1 Processor -- start 2024-09-19T08:36:51.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.265+0000 7f86b40f1640 1 -- start start 2024-09-19T08:36:51.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.266+0000 7f86b40f1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ac09a9f0 0x7f86ac154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.266+0000 7f86b40f1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86ac0b47c0 0x7f86ac155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.266+0000 7f86b40f1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ac161af0 0x7f86ac15f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.266+0000 7f86b40f1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f86ac0d1160 con 0x7f86ac0b47c0 2024-09-19T08:36:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.266+0000 7f86b40f1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f86ac0d0e80 con 0x7f86ac09a9f0 2024-09-19T08:36:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.266+0000 7f86b40f1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f86ac161ed0 con 0x7f86ac161af0 2024-09-19T08:36:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.266+0000 7f86b1e8d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ac09a9f0 0x7f86ac154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.266+0000 7f86b1e8d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ac09a9f0 0x7f86ac154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58888/0 (socket says 172.21.15.146:58888) 2024-09-19T08:36:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.266+0000 7f86b1e8d640 1 -- 172.21.15.146:0/307062066 learned_addr learned my addr 172.21.15.146:0/307062066 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-19T08:36:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.266+0000 7f86b268e640 1 --2- 172.21.15.146:0/307062066 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ac161af0 0x7f86ac15f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.266+0000 7f86b168c640 1 --2- 172.21.15.146:0/307062066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86ac0b47c0 0x7f86ac155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.266+0000 7f86b1e8d640 1 -- 172.21.15.146:0/307062066 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ac161af0 msgr2=0x7f86ac15f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.266+0000 7f86b1e8d640 1 --2- 172.21.15.146:0/307062066 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ac161af0 0x7f86ac15f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.266+0000 7f86b1e8d640 1 -- 172.21.15.146:0/307062066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86ac0b47c0 msgr2=0x7f86ac155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.266+0000 7f86b1e8d640 1 --2- 172.21.15.146:0/307062066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86ac0b47c0 0x7f86ac155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.266+0000 7f86b1e8d640 1 -- 172.21.15.146:0/307062066 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86ac15fde0 con 0x7f86ac09a9f0 2024-09-19T08:36:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.267+0000 7f86b1e8d640 1 --2- 172.21.15.146:0/307062066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ac09a9f0 0x7f86ac154800 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f869c00e960 tx=0x7f869c00ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.267+0000 7f86a27fc640 1 -- 172.21.15.146:0/307062066 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c017070 con 0x7f86ac09a9f0 2024-09-19T08:36:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.267+0000 7f86a27fc640 1 -- 172.21.15.146:0/307062066 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f869c00ca00 con 0x7f86ac09a9f0 2024-09-19T08:36:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.267+0000 7f86a27fc640 1 -- 172.21.15.146:0/307062066 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c00cdd0 con 0x7f86ac09a9f0 2024-09-19T08:36:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.267+0000 7f86b40f1640 1 -- 172.21.15.146:0/307062066 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86ac1e9850 con 0x7f86ac09a9f0 2024-09-19T08:36:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.267+0000 7f86b40f1640 1 -- 172.21.15.146:0/307062066 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86ac154d40 con 0x7f86ac09a9f0 2024-09-19T08:36:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.267+0000 7f86a27fc640 1 -- 172.21.15.146:0/307062066 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f869c01a070 con 0x7f86ac09a9f0 2024-09-19T08:36:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.267+0000 7f86a27fc640 1 -- 172.21.15.146:0/307062066 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f869c009400 con 0x7f86ac09a9f0 2024-09-19T08:36:51.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.268+0000 7f86b40f1640 1 -- 172.21.15.146:0/307062066 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86ac162c10 con 0x7f86ac09a9f0 2024-09-19T08:36:51.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.270+0000 7f86a27fc640 1 -- 172.21.15.146:0/307062066 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f869c013470 con 0x7f86ac09a9f0 2024-09-19T08:36:51.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.339+0000 7f86b40f1640 1 -- 172.21.15.146:0/307062066 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd new", "uuid": "df72b48a-47c7-4ca5-9e37-a596302a6c90", "id": 5} v 0) -- 0x7f86ac0cfa20 con 0x7f86ac09a9f0 2024-09-19T08:36:51.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.344+0000 7f86a27fc640 1 -- 172.21.15.146:0/307062066 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "df72b48a-47c7-4ca5-9e37-a596302a6c90", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f869c02a020 con 0x7f86ac09a9f0 2024-09-19T08:36:51.344 INFO:teuthology.orchestra.run.smithi146.stdout:5 2024-09-19T08:36:51.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.345+0000 7f86b40f1640 1 -- 172.21.15.146:0/307062066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ac09a9f0 msgr2=0x7f86ac154800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.345+0000 7f86b40f1640 1 --2- 172.21.15.146:0/307062066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ac09a9f0 0x7f86ac154800 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f869c00e960 tx=0x7f869c00ee20 comp rx=0 tx=0).stop 2024-09-19T08:36:51.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.345+0000 7f86b40f1640 1 -- 172.21.15.146:0/307062066 shutdown_connections 2024-09-19T08:36:51.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.345+0000 7f86b40f1640 1 --2- 172.21.15.146:0/307062066 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ac161af0 0x7f86ac15f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.345+0000 7f86b40f1640 1 --2- 172.21.15.146:0/307062066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86ac0b47c0 0x7f86ac155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.345+0000 7f86b40f1640 1 --2- 172.21.15.146:0/307062066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ac09a9f0 0x7f86ac154800 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.345+0000 7f86b40f1640 1 -- 172.21.15.146:0/307062066 >> 172.21.15.146:0/307062066 conn(0x7f86ac0b3ca0 msgr2=0x7f86ac070180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:51.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.346+0000 7f86b40f1640 1 -- 172.21.15.146:0/307062066 shutdown_connections 2024-09-19T08:36:51.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.346+0000 7f86b40f1640 1 -- 172.21.15.146:0/307062066 wait complete. 2024-09-19T08:36:51.356 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new e3c825e6-660d-4a1b-8833-78dda4219eaf 6 2024-09-19T08:36:51.369 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:51.370+0000 7f146e421040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:36:51.415 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:51.416+0000 7f146e421040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:36:51.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.455+0000 7f53743c4640 1 Processor -- start 2024-09-19T08:36:51.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.455+0000 7f53743c4640 1 -- start start 2024-09-19T08:36:51.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.456+0000 7f53743c4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f536c06f0b0 0x7f536c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.456+0000 7f53743c4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f536c0b5670 0x7f536c0b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.456+0000 7f53743c4640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f536c06f7e0 con 0x7f536c0af860 2024-09-19T08:36:51.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.456+0000 7f53743c4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f536c06fac0 con 0x7f536c0b5670 2024-09-19T08:36:51.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.456+0000 7f53743c4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f536c06fda0 con 0x7f536c06f0b0 2024-09-19T08:36:51.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.456+0000 7f537195f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f536c06f0b0 0x7f536c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.456+0000 7f537195f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f536c06f0b0 0x7f536c070ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:46952/0 (socket says 172.21.15.146:46952) 2024-09-19T08:36:51.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.456+0000 7f5372160640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f536c0af860 0x7f536c0afc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43710/0 (socket says 172.21.15.146:43710) 2024-09-19T08:36:51.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.456+0000 7f537195f640 1 -- 172.21.15.146:0/272166807 learned_addr learned my addr 172.21.15.146:0/272166807 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-19T08:36:51.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.456+0000 7f5372961640 1 --2- 172.21.15.146:0/272166807 >> v2:172.21.15.117:3300/0 conn(0x7f536c0b5670 0x7f536c0b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.456+0000 7f537115e640 1 -- 172.21.15.146:0/272166807 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 687940625 0 0) 0x7f536c06f7e0 con 0x7f536c0af860 2024-09-19T08:36:51.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.457+0000 7f537115e640 1 -- 172.21.15.146:0/272166807 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5358003520 con 0x7f536c0af860 2024-09-19T08:36:51.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.457+0000 7f537195f640 1 -- 172.21.15.146:0/272166807 >> v2:172.21.15.117:3300/0 conn(0x7f536c0b5670 msgr2=0x7f536c0b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:36:51.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.457+0000 7f537195f640 1 --2- 172.21.15.146:0/272166807 >> v2:172.21.15.117:3300/0 conn(0x7f536c0b5670 0x7f536c0b5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.457+0000 7f537195f640 1 -- 172.21.15.146:0/272166807 >> v1:172.21.15.146:6789/0 conn(0x7f536c0af860 legacy=0x7f536c0afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.457+0000 7f537195f640 1 -- 172.21.15.146:0/272166807 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f536c070080 con 0x7f536c06f0b0 2024-09-19T08:36:51.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.457+0000 7f537195f640 1 --2- 172.21.15.146:0/272166807 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f536c06f0b0 0x7f536c070ab0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5368009870 tx=0x7f536802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc2e9429fb4bc47b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:51.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.457+0000 7f537115e640 1 -- 172.21.15.146:0/272166807 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5368037070 con 0x7f536c06f0b0 2024-09-19T08:36:51.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.457+0000 7f537115e640 1 -- 172.21.15.146:0/272166807 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5368032440 con 0x7f536c06f0b0 2024-09-19T08:36:51.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.457+0000 7f537115e640 1 -- 172.21.15.146:0/272166807 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5368032810 con 0x7f536c06f0b0 2024-09-19T08:36:51.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.458+0000 7f53743c4640 1 -- 172.21.15.146:0/272166807 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f536c06f0b0 msgr2=0x7f536c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.458+0000 7f53743c4640 1 --2- 172.21.15.146:0/272166807 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f536c06f0b0 0x7f536c070ab0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5368009870 tx=0x7f536802a270 comp rx=0 tx=0).stop 2024-09-19T08:36:51.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.458+0000 7f53743c4640 1 -- 172.21.15.146:0/272166807 shutdown_connections 2024-09-19T08:36:51.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.458+0000 7f53743c4640 1 --2- 172.21.15.146:0/272166807 >> v2:172.21.15.117:3300/0 conn(0x7f536c0b5670 0x7f536c0b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.458+0000 7f53743c4640 1 --2- 172.21.15.146:0/272166807 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f536c06f0b0 0x7f536c070ab0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.458+0000 7f53743c4640 1 -- 172.21.15.146:0/272166807 >> 172.21.15.146:0/272166807 conn(0x7f536c073010 msgr2=0x7f536c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:51.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.458+0000 7f53743c4640 1 -- 172.21.15.146:0/272166807 shutdown_connections 2024-09-19T08:36:51.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.458+0000 7f53743c4640 1 -- 172.21.15.146:0/272166807 wait complete. 2024-09-19T08:36:51.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.459+0000 7f53743c4640 1 Processor -- start 2024-09-19T08:36:51.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.459+0000 7f53743c4640 1 -- start start 2024-09-19T08:36:51.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.460+0000 7f53743c4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f536c06f0b0 0x7f536c0cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.460+0000 7f53743c4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f536c0af860 0x7f536c1f4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.460+0000 7f53743c4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f536c0b5670 0x7f536c14d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.460+0000 7f53743c4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f536c15e4f0 con 0x7f536c0b5670 2024-09-19T08:36:51.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.460+0000 7f53743c4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f536c06f4f0 con 0x7f536c06f0b0 2024-09-19T08:36:51.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.460+0000 7f53743c4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f536c15e670 con 0x7f536c0af860 2024-09-19T08:36:51.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.460+0000 7f537195f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f536c0af860 0x7f536c1f4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.460+0000 7f537195f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f536c0af860 0x7f536c1f4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:46954/0 (socket says 172.21.15.146:46954) 2024-09-19T08:36:51.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.460+0000 7f5372160640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f536c06f0b0 0x7f536c0cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.460+0000 7f537195f640 1 -- 172.21.15.146:0/2348446308 learned_addr learned my addr 172.21.15.146:0/2348446308 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-19T08:36:51.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.460+0000 7f5372961640 1 --2- 172.21.15.146:0/2348446308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f536c0b5670 0x7f536c14d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.460+0000 7f537195f640 1 -- 172.21.15.146:0/2348446308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f536c06f0b0 msgr2=0x7f536c0cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.460+0000 7f537195f640 1 --2- 172.21.15.146:0/2348446308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f536c06f0b0 0x7f536c0cedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.460+0000 7f537195f640 1 -- 172.21.15.146:0/2348446308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f536c0b5670 msgr2=0x7f536c14d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.460+0000 7f537195f640 1 --2- 172.21.15.146:0/2348446308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f536c0b5670 0x7f536c14d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.461+0000 7f537195f640 1 -- 172.21.15.146:0/2348446308 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f536c0cf4b0 con 0x7f536c0af860 2024-09-19T08:36:51.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.461+0000 7f537195f640 1 --2- 172.21.15.146:0/2348446308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f536c0af860 0x7f536c1f4d60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5368000c00 tx=0x7f53680046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:51.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.461+0000 7f5362ffd640 1 -- 172.21.15.146:0/2348446308 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5368041020 con 0x7f536c0af860 2024-09-19T08:36:51.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.461+0000 7f5362ffd640 1 -- 172.21.15.146:0/2348446308 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f536803d620 con 0x7f536c0af860 2024-09-19T08:36:51.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.461+0000 7f53743c4640 1 -- 172.21.15.146:0/2348446308 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f536c0cf790 con 0x7f536c0af860 2024-09-19T08:36:51.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.461+0000 7f5362ffd640 1 -- 172.21.15.146:0/2348446308 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5368037040 con 0x7f536c0af860 2024-09-19T08:36:51.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.461+0000 7f53743c4640 1 -- 172.21.15.146:0/2348446308 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f536c0cfd50 con 0x7f536c0af860 2024-09-19T08:36:51.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.461+0000 7f5362ffd640 1 -- 172.21.15.146:0/2348446308 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5368044020 con 0x7f536c0af860 2024-09-19T08:36:51.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.461+0000 7f5362ffd640 1 -- 172.21.15.146:0/2348446308 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f5368046bd0 con 0x7f536c0af860 2024-09-19T08:36:51.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.462+0000 7f53743c4640 1 -- 172.21.15.146:0/2348446308 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f536c070ab0 con 0x7f536c0af860 2024-09-19T08:36:51.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.464+0000 7f5362ffd640 1 -- 172.21.15.146:0/2348446308 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f536804b030 con 0x7f536c0af860 2024-09-19T08:36:51.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.533+0000 7f53743c4640 1 -- 172.21.15.146:0/2348446308 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e3c825e6-660d-4a1b-8833-78dda4219eaf", "id": 6} v 0) -- 0x7f536c15d810 con 0x7f536c0af860 2024-09-19T08:36:51.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.539+0000 7f5362ffd640 1 -- 172.21.15.146:0/2348446308 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e3c825e6-660d-4a1b-8833-78dda4219eaf", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f5368046400 con 0x7f536c0af860 2024-09-19T08:36:51.539 INFO:teuthology.orchestra.run.smithi146.stdout:6 2024-09-19T08:36:51.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.540+0000 7f53743c4640 1 -- 172.21.15.146:0/2348446308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f536c0af860 msgr2=0x7f536c1f4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.540+0000 7f53743c4640 1 --2- 172.21.15.146:0/2348446308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f536c0af860 0x7f536c1f4d60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5368000c00 tx=0x7f53680046c0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.540+0000 7f53743c4640 1 -- 172.21.15.146:0/2348446308 shutdown_connections 2024-09-19T08:36:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.540+0000 7f53743c4640 1 --2- 172.21.15.146:0/2348446308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f536c0b5670 0x7f536c14d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.540+0000 7f53743c4640 1 --2- 172.21.15.146:0/2348446308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f536c0af860 0x7f536c1f4d60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.540+0000 7f53743c4640 1 --2- 172.21.15.146:0/2348446308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f536c06f0b0 0x7f536c0cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.540+0000 7f53743c4640 1 -- 172.21.15.146:0/2348446308 >> 172.21.15.146:0/2348446308 conn(0x7f536c073010 msgr2=0x7f536c154d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.540+0000 7f53743c4640 1 -- 172.21.15.146:0/2348446308 shutdown_connections 2024-09-19T08:36:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.540+0000 7f53743c4640 1 -- 172.21.15.146:0/2348446308 wait complete. 2024-09-19T08:36:51.550 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new d68921b4-1f6f-4941-a565-ba078c12d25e 7 2024-09-19T08:36:51.565 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:51.565+0000 7f146e421040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:36:51.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.649+0000 7f7119d33640 1 Processor -- start 2024-09-19T08:36:51.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.649+0000 7f7119d33640 1 -- start start 2024-09-19T08:36:51.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.650+0000 7f7119d33640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71140b1550 0x7f71140aec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.650+0000 7f7119d33640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71140b27c0 0x7f71140af140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.650+0000 7f7119d33640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71140b19e0 con 0x7f711415b1d0 2024-09-19T08:36:51.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.650+0000 7f7119d33640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f71140b2560 con 0x7f71140b1550 2024-09-19T08:36:51.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.650+0000 7f7119d33640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f71140b1cc0 con 0x7f71140b27c0 2024-09-19T08:36:51.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.650+0000 7f7112ffd640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71140b1550 0x7f71140aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.650+0000 7f7113fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71140b27c0 0x7f71140af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.650+0000 7f71137fe640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f711415b1d0 0x7f71140b4a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43712/0 (socket says 172.21.15.146:43712) 2024-09-19T08:36:51.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.650+0000 7f7113fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71140b27c0 0x7f71140af140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:46962/0 (socket says 172.21.15.146:46962) 2024-09-19T08:36:51.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.650+0000 7f71137fe640 1 -- 172.21.15.146:0/2768241986 learned_addr learned my addr 172.21.15.146:0/2768241986 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-09-19T08:36:51.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.650+0000 7f7112ffd640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71140b1550 0x7f71140aec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58906/0 (socket says 172.21.15.146:58906) 2024-09-19T08:36:51.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.650+0000 7f7112ffd640 1 -- 172.21.15.146:0/2768241986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71140b27c0 msgr2=0x7f71140af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:36:51.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.650+0000 7f7112ffd640 1 --2- 172.21.15.146:0/2768241986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71140b27c0 0x7f71140af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.650+0000 7f7112ffd640 1 -- 172.21.15.146:0/2768241986 >> v1:172.21.15.146:6789/0 conn(0x7f711415b1d0 legacy=0x7f71140b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.651+0000 7f7112ffd640 1 -- 172.21.15.146:0/2768241986 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71140b1fa0 con 0x7f71140b1550 2024-09-19T08:36:51.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.650+0000 7f71127fc640 1 -- 172.21.15.146:0/2768241986 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 734269754 0 0) 0x7f71140b19e0 con 0x7f711415b1d0 2024-09-19T08:36:51.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.651+0000 7f7113fff640 1 --2- 172.21.15.146:0/2768241986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71140b27c0 0x7f71140af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:36:51.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.651+0000 7f7112ffd640 1 --2- 172.21.15.146:0/2768241986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71140b1550 0x7f71140aec00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f71040097a0 tx=0x7f710402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=921815ad8e106e0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:51.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.651+0000 7f71127fc640 1 -- 172.21.15.146:0/2768241986 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7104037070 con 0x7f71140b1550 2024-09-19T08:36:51.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.651+0000 7f71127fc640 1 -- 172.21.15.146:0/2768241986 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7104032440 con 0x7f71140b1550 2024-09-19T08:36:51.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.651+0000 7f71127fc640 1 -- 172.21.15.146:0/2768241986 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7104032810 con 0x7f71140b1550 2024-09-19T08:36:51.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.652+0000 7f7119d33640 1 -- 172.21.15.146:0/2768241986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71140b1550 msgr2=0x7f71140aec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.652+0000 7f7119d33640 1 --2- 172.21.15.146:0/2768241986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71140b1550 0x7f71140aec00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f71040097a0 tx=0x7f710402a180 comp rx=0 tx=0).stop 2024-09-19T08:36:51.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.652+0000 7f7119d33640 1 -- 172.21.15.146:0/2768241986 shutdown_connections 2024-09-19T08:36:51.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.652+0000 7f7119d33640 1 --2- 172.21.15.146:0/2768241986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71140b27c0 0x7f71140af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.652+0000 7f7119d33640 1 --2- 172.21.15.146:0/2768241986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71140b1550 0x7f71140aec00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.652+0000 7f7119d33640 1 -- 172.21.15.146:0/2768241986 >> 172.21.15.146:0/2768241986 conn(0x7f711409a9f0 msgr2=0x7f71140b6530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:51.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.652+0000 7f7119d33640 1 -- 172.21.15.146:0/2768241986 shutdown_connections 2024-09-19T08:36:51.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.652+0000 7f7119d33640 1 -- 172.21.15.146:0/2768241986 wait complete. 2024-09-19T08:36:51.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.653+0000 7f7119d33640 1 Processor -- start 2024-09-19T08:36:51.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.653+0000 7f7119d33640 1 -- start start 2024-09-19T08:36:51.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.654+0000 7f7119d33640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71140b27c0 0x7f711414fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.654+0000 7f7119d33640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f711415b1d0 0x7f711415c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.654+0000 7f7119d33640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71141f42d0 0x7f71141f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.654+0000 7f7119d33640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f71140b5130 con 0x7f711415b1d0 2024-09-19T08:36:51.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.654+0000 7f7119d33640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f711415b5b0 con 0x7f71141f42d0 2024-09-19T08:36:51.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.654+0000 7f7119d33640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f71140b52b0 con 0x7f71140b27c0 2024-09-19T08:36:51.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.654+0000 7f71137fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71140b27c0 0x7f711414fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.654+0000 7f71137fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71140b27c0 0x7f711414fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:46978/0 (socket says 172.21.15.146:46978) 2024-09-19T08:36:51.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.654+0000 7f71137fe640 1 -- 172.21.15.146:0/2505843156 learned_addr learned my addr 172.21.15.146:0/2505843156 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-19T08:36:51.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.654+0000 7f7113fff640 1 --2- 172.21.15.146:0/2505843156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71141f42d0 0x7f71141f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.654+0000 7f7112ffd640 1 --2- 172.21.15.146:0/2505843156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f711415b1d0 0x7f711415c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.655+0000 7f71137fe640 1 -- 172.21.15.146:0/2505843156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71141f42d0 msgr2=0x7f71141f4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.655+0000 7f71137fe640 1 --2- 172.21.15.146:0/2505843156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71141f42d0 0x7f71141f4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.655+0000 7f71137fe640 1 -- 172.21.15.146:0/2505843156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f711415b1d0 msgr2=0x7f711415c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.655+0000 7f71137fe640 1 --2- 172.21.15.146:0/2505843156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f711415b1d0 0x7f711415c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.655+0000 7f71137fe640 1 -- 172.21.15.146:0/2505843156 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71141f4d60 con 0x7f71140b27c0 2024-09-19T08:36:51.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.655+0000 7f71137fe640 1 --2- 172.21.15.146:0/2505843156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71140b27c0 0x7f711414fe80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f710800c430 tx=0x7f710800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:51.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.655+0000 7f70fbfff640 1 -- 172.21.15.146:0/2505843156 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71080074e0 con 0x7f71140b27c0 2024-09-19T08:36:51.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.655+0000 7f70fbfff640 1 -- 172.21.15.146:0/2505843156 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71080047e0 con 0x7f71140b27c0 2024-09-19T08:36:51.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.655+0000 7f7119d33640 1 -- 172.21.15.146:0/2505843156 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71141f5040 con 0x7f71140b27c0 2024-09-19T08:36:51.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.655+0000 7f70fbfff640 1 -- 172.21.15.146:0/2505843156 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7108004bd0 con 0x7f71140b27c0 2024-09-19T08:36:51.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.655+0000 7f7119d33640 1 -- 172.21.15.146:0/2505843156 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f711415c610 con 0x7f71140b27c0 2024-09-19T08:36:51.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.655+0000 7f70fbfff640 1 -- 172.21.15.146:0/2505843156 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7108011070 con 0x7f71140b27c0 2024-09-19T08:36:51.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.655+0000 7f70fbfff640 1 -- 172.21.15.146:0/2505843156 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f7108013a20 con 0x7f71140b27c0 2024-09-19T08:36:51.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.656+0000 7f7119d33640 1 -- 172.21.15.146:0/2505843156 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71140b4010 con 0x7f71140b27c0 2024-09-19T08:36:51.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.658+0000 7f70fbfff640 1 -- 172.21.15.146:0/2505843156 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7108004dc0 con 0x7f71140b27c0 2024-09-19T08:36:51.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.726+0000 7f7119d33640 1 -- 172.21.15.146:0/2505843156 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d68921b4-1f6f-4941-a565-ba078c12d25e", "id": 7} v 0) -- 0x7f711406e9c0 con 0x7f71140b27c0 2024-09-19T08:36:51.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.732+0000 7f70fbfff640 1 -- 172.21.15.146:0/2505843156 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d68921b4-1f6f-4941-a565-ba078c12d25e", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f7108013df0 con 0x7f71140b27c0 2024-09-19T08:36:51.732 INFO:teuthology.orchestra.run.smithi146.stdout:7 2024-09-19T08:36:51.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.733+0000 7f7119d33640 1 -- 172.21.15.146:0/2505843156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71140b27c0 msgr2=0x7f711414fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.733+0000 7f7119d33640 1 --2- 172.21.15.146:0/2505843156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71140b27c0 0x7f711414fe80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f710800c430 tx=0x7f710800c8f0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.733+0000 7f7119d33640 1 -- 172.21.15.146:0/2505843156 shutdown_connections 2024-09-19T08:36:51.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.733+0000 7f7119d33640 1 --2- 172.21.15.146:0/2505843156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71141f42d0 0x7f71141f4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.733+0000 7f7119d33640 1 --2- 172.21.15.146:0/2505843156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f711415b1d0 0x7f711415c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.733+0000 7f7119d33640 1 --2- 172.21.15.146:0/2505843156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71140b27c0 0x7f711414fe80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.733+0000 7f7119d33640 1 -- 172.21.15.146:0/2505843156 >> 172.21.15.146:0/2505843156 conn(0x7f711409a9f0 msgr2=0x7f71140b6510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:51.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.733+0000 7f7119d33640 1 -- 172.21.15.146:0/2505843156 shutdown_connections 2024-09-19T08:36:51.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:36:51.733+0000 7f7119d33640 1 -- 172.21.15.146:0/2505843156 wait complete. 2024-09-19T08:36:51.743 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-19T08:36:51.743 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-19T08:36:51.746 INFO:tasks.ceph.osd.0:Started 2024-09-19T08:36:51.746 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-19T08:36:51.746 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-19T08:36:51.748 INFO:tasks.ceph.osd.1:Started 2024-09-19T08:36:51.748 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-19T08:36:51.748 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-19T08:36:51.750 INFO:tasks.ceph.osd.2:Started 2024-09-19T08:36:51.750 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-19T08:36:51.751 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-19T08:36:51.753 INFO:tasks.ceph.osd.3:Started 2024-09-19T08:36:51.754 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-19T08:36:51.754 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-19T08:36:51.756 INFO:tasks.ceph.osd.4:Started 2024-09-19T08:36:51.756 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-19T08:36:51.756 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-19T08:36:51.758 INFO:tasks.ceph.osd.5:Started 2024-09-19T08:36:51.758 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-19T08:36:51.758 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-19T08:36:51.760 INFO:tasks.ceph.osd.6:Started 2024-09-19T08:36:51.760 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-19T08:36:51.761 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-19T08:36:51.762 INFO:tasks.ceph.osd.7:Started 2024-09-19T08:36:51.763 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:36:51.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.875+0000 7f0f5c752640 1 Processor -- start 2024-09-19T08:36:51.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.875+0000 7f0f5c752640 1 -- start start 2024-09-19T08:36:51.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.876+0000 7f0f5c752640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0f540d2750 0x7f0f5413f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.876+0000 7f0f5c752640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f5413fda0 con 0x7f0f54072250 2024-09-19T08:36:51.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.876+0000 7f0f5c752640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f540d2b30 con 0x7f0f540726c0 2024-09-19T08:36:51.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.876+0000 7f0f5c752640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f0f54145bd0 con 0x7f0f540d2750 2024-09-19T08:36:51.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.876+0000 7f0f59ced640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f0f54072250 0x7f0f540cfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:59822/0 (socket says 172.21.15.117:59822) 2024-09-19T08:36:51.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.876+0000 7f0f59ced640 1 -- 172.21.15.117:0/2923955061 learned_addr learned my addr 172.21.15.117:0/2923955061 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:36:51.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.876+0000 7f0f5a4ee640 1 --2- 172.21.15.117:0/2923955061 >> v2:172.21.15.146:3300/0 conn(0x7f0f540d2750 0x7f0f5413f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.876+0000 7f0f594ec640 1 -- 172.21.15.117:0/2923955061 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1237632298 0 0) 0x7f0f5413fda0 con 0x7f0f54072250 2024-09-19T08:36:51.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.876+0000 7f0f594ec640 1 -- 172.21.15.117:0/2923955061 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f40003520 con 0x7f0f54072250 2024-09-19T08:36:51.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.876+0000 7f0f594ec640 1 -- 172.21.15.117:0/2923955061 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3170321879 0 0) 0x7f0f40003520 con 0x7f0f54072250 2024-09-19T08:36:51.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.876+0000 7f0f5a4ee640 1 -- 172.21.15.117:0/2923955061 >> v1:172.21.15.146:6789/0 conn(0x7f0f540726c0 legacy=0x7f0f54160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.876+0000 7f0f5a4ee640 1 -- 172.21.15.117:0/2923955061 >> v1:172.21.15.117:6789/0 conn(0x7f0f54072250 legacy=0x7f0f540cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.876+0000 7f0f5a4ee640 1 -- 172.21.15.117:0/2923955061 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f54141c60 con 0x7f0f540d2750 2024-09-19T08:36:51.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.877+0000 7f0f5a4ee640 1 --2- 172.21.15.117:0/2923955061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f540d2750 0x7f0f5413f860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0f500097a0 tx=0x7f0f5002a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=566dbdeb23eb102 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:51.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.877+0000 7f0f594ec640 1 -- 172.21.15.117:0/2923955061 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f50037070 con 0x7f0f540d2750 2024-09-19T08:36:51.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.877+0000 7f0f594ec640 1 -- 172.21.15.117:0/2923955061 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f5002aad0 con 0x7f0f540d2750 2024-09-19T08:36:51.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.877+0000 7f0f594ec640 1 -- 172.21.15.117:0/2923955061 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44001670 con 0x7f0f540d2750 2024-09-19T08:36:51.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.878+0000 7f0f5c752640 1 -- 172.21.15.117:0/2923955061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f540d2750 msgr2=0x7f0f5413f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.878+0000 7f0f5c752640 1 --2- 172.21.15.117:0/2923955061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f540d2750 0x7f0f5413f860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0f500097a0 tx=0x7f0f5002a040 comp rx=0 tx=0).stop 2024-09-19T08:36:51.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.878+0000 7f0f5c752640 1 -- 172.21.15.117:0/2923955061 shutdown_connections 2024-09-19T08:36:51.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.878+0000 7f0f5c752640 1 --2- 172.21.15.117:0/2923955061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f540d2750 0x7f0f5413f860 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.878+0000 7f0f5c752640 1 -- 172.21.15.117:0/2923955061 >> 172.21.15.117:0/2923955061 conn(0x7f0f540b4040 msgr2=0x7f0f540b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:51.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.878+0000 7f0f5c752640 1 -- 172.21.15.117:0/2923955061 shutdown_connections 2024-09-19T08:36:51.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.878+0000 7f0f5c752640 1 -- 172.21.15.117:0/2923955061 wait complete. 2024-09-19T08:36:51.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.879+0000 7f0f5c752640 1 Processor -- start 2024-09-19T08:36:51.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.879+0000 7f0f5c752640 1 -- start start 2024-09-19T08:36:51.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.880+0000 7f0f5c752640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f54072250 0x7f0f54145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.880+0000 7f0f5c752640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f540726c0 0x7f0f5415e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.880+0000 7f0f5c752640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f540d2750 0x7f0f540b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:51.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.880+0000 7f0f5c752640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0f54142220 con 0x7f0f54072250 2024-09-19T08:36:51.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.880+0000 7f0f5c752640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0f541427e0 con 0x7f0f540d2750 2024-09-19T08:36:51.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.880+0000 7f0f5c752640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f0f54142500 con 0x7f0f540726c0 2024-09-19T08:36:51.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.880+0000 7f0f5a4ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f54072250 0x7f0f54145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.880+0000 7f0f5a4ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f54072250 0x7f0f54145470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43976/0 (socket says 172.21.15.117:43976) 2024-09-19T08:36:51.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.880+0000 7f0f5a4ee640 1 -- 172.21.15.117:0/3091286381 learned_addr learned my addr 172.21.15.117:0/3091286381 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:36:51.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.880+0000 7f0f5acef640 1 --2- 172.21.15.117:0/3091286381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f540d2750 0x7f0f540b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.880+0000 7f0f59ced640 1 --2- 172.21.15.117:0/3091286381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f540726c0 0x7f0f5415e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:51.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.880+0000 7f0f5a4ee640 1 -- 172.21.15.117:0/3091286381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f540726c0 msgr2=0x7f0f5415e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.880+0000 7f0f5a4ee640 1 --2- 172.21.15.117:0/3091286381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f540726c0 0x7f0f5415e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.880+0000 7f0f5a4ee640 1 -- 172.21.15.117:0/3091286381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f540d2750 msgr2=0x7f0f540b7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.880+0000 7f0f5a4ee640 1 --2- 172.21.15.117:0/3091286381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f540d2750 0x7f0f540b7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.880+0000 7f0f5a4ee640 1 -- 172.21.15.117:0/3091286381 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f541459b0 con 0x7f0f54072250 2024-09-19T08:36:51.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.880+0000 7f0f5a4ee640 1 --2- 172.21.15.117:0/3091286381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f54072250 0x7f0f54145470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0f500097a0 tx=0x7f0f500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:51.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.880+0000 7f0f4affd640 1 -- 172.21.15.117:0/3091286381 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f50037040 con 0x7f0f54072250 2024-09-19T08:36:51.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.880+0000 7f0f4affd640 1 -- 172.21.15.117:0/3091286381 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f50004030 con 0x7f0f54072250 2024-09-19T08:36:51.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.881+0000 7f0f5c752640 1 -- 172.21.15.117:0/3091286381 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f54153b30 con 0x7f0f54072250 2024-09-19T08:36:51.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.881+0000 7f0f4affd640 1 -- 172.21.15.117:0/3091286381 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f50004400 con 0x7f0f54072250 2024-09-19T08:36:51.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.881+0000 7f0f5c752640 1 -- 172.21.15.117:0/3091286381 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f5415d960 con 0x7f0f54072250 2024-09-19T08:36:51.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.881+0000 7f0f4affd640 1 -- 172.21.15.117:0/3091286381 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0f5003a040 con 0x7f0f54072250 2024-09-19T08:36:51.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.881+0000 7f0f4affd640 1 -- 172.21.15.117:0/3091286381 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f0f5003ebd0 con 0x7f0f54072250 2024-09-19T08:36:51.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.882+0000 7f0f5c752640 1 -- 172.21.15.117:0/3091286381 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f541418b0 con 0x7f0f54072250 2024-09-19T08:36:51.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.884+0000 7f0f4affd640 1 -- 172.21.15.117:0/3091286381 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0f50042020 con 0x7f0f54072250 2024-09-19T08:36:51.904 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:51.904+0000 7f2fe27d6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:36:51.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.943+0000 7f0f5c752640 1 -- 172.21.15.117:0/3091286381 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f540c8520 con 0x7f0f54072250 2024-09-19T08:36:51.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.943+0000 7f0f4affd640 1 -- 172.21.15.117:0/3091286381 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f0f5003ee20 con 0x7f0f54072250 2024-09-19T08:36:51.944 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:36:51.944 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":10,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:36:51.728223+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:36:51.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.944+0000 7f0f5c752640 1 -- 172.21.15.117:0/3091286381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f54072250 msgr2=0x7f0f54145470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:51.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.944+0000 7f0f5c752640 1 --2- 172.21.15.117:0/3091286381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f54072250 0x7f0f54145470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0f500097a0 tx=0x7f0f500046c0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.944+0000 7f0f5c752640 1 -- 172.21.15.117:0/3091286381 shutdown_connections 2024-09-19T08:36:51.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.944+0000 7f0f5c752640 1 --2- 172.21.15.117:0/3091286381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f540d2750 0x7f0f540b7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.944+0000 7f0f5c752640 1 --2- 172.21.15.117:0/3091286381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f540726c0 0x7f0f5415e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.944+0000 7f0f5c752640 1 --2- 172.21.15.117:0/3091286381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f54072250 0x7f0f54145470 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:51.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.944+0000 7f0f5c752640 1 -- 172.21.15.117:0/3091286381 >> 172.21.15.117:0/3091286381 conn(0x7f0f540b4040 msgr2=0x7f0f540b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:51.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.944+0000 7f0f5c752640 1 -- 172.21.15.117:0/3091286381 shutdown_connections 2024-09-19T08:36:51.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:36:51.944+0000 7f0f5c752640 1 -- 172.21.15.117:0/3091286381 wait complete. 2024-09-19T08:36:51.954 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-19T08:36:51.955 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-19T08:36:51.956 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:51.956+0000 7f2fe27d6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:36:52.329 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:52.329+0000 7f2fe27d6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:36:52.415 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:52.415+0000 7f2fe27d6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:36:52.525 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:52.525+0000 7f2fe27d6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:36:52.555 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:52.555+0000 7f146e421040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:36:52.571 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:52.571+0000 7f2fe27d6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:36:52.606 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:52.607+0000 7f146e421040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:36:52.686 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:52.686+0000 7f2fe27d6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:36:52.741 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:52.742+0000 7f2fe27d6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:36:52.761 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T08:36:52.788 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:52.788+0000 7f2fe27d6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:36:52.852 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.852+0000 7fa57b877640 1 Processor -- start 2024-09-19T08:36:52.852 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.852+0000 7fa57b877640 1 -- start start 2024-09-19T08:36:52.855 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.854+0000 7fa57b877640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5740b2340 0x7fa5740b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:52.855 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.854+0000 7fa57b877640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5740b2cf0 con 0x7fa57415b680 2024-09-19T08:36:52.855 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.854+0000 7fa57b877640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5740b12a0 con 0x7fa57415b2a0 2024-09-19T08:36:52.855 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.854+0000 7fa57b877640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fa5740b1580 con 0x7fa5740b2340 2024-09-19T08:36:52.855 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.854+0000 7fa578e12640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fa57415b680 0x7fa57415bad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:59828/0 (socket says 172.21.15.117:59828) 2024-09-19T08:36:52.855 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.854+0000 7fa578e12640 1 -- 172.21.15.117:0/87674810 learned_addr learned my addr 172.21.15.117:0/87674810 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:36:52.855 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.854+0000 7fa579e14640 1 --2- 172.21.15.117:0/87674810 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5740b2340 0x7fa5740b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:52.855 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.854+0000 7fa567fff640 1 -- 172.21.15.117:0/87674810 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1982175838 0 0) 0x7fa5740b2cf0 con 0x7fa57415b680 2024-09-19T08:36:52.855 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.854+0000 7fa567fff640 1 -- 172.21.15.117:0/87674810 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa560003520 con 0x7fa57415b680 2024-09-19T08:36:52.855 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.854+0000 7fa567fff640 1 -- 172.21.15.117:0/87674810 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 297692331 0 0) 0x7fa5740b12a0 con 0x7fa57415b2a0 2024-09-19T08:36:52.855 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.854+0000 7fa567fff640 1 -- 172.21.15.117:0/87674810 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5740b2cf0 con 0x7fa57415b2a0 2024-09-19T08:36:52.855 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.854+0000 7fa579e14640 1 -- 172.21.15.117:0/87674810 >> v1:172.21.15.146:6789/0 conn(0x7fa57415b2a0 legacy=0x7fa5740b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:52.856 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.854+0000 7fa579e14640 1 -- 172.21.15.117:0/87674810 >> v1:172.21.15.117:6789/0 conn(0x7fa57415b680 legacy=0x7fa57415bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:52.856 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.854+0000 7fa579e14640 1 -- 172.21.15.117:0/87674810 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5740b1860 con 0x7fa5740b2340 2024-09-19T08:36:52.856 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.855+0000 7fa579e14640 1 --2- 172.21.15.117:0/87674810 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5740b2340 0x7fa5740b27b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa56c009dc0 tx=0x7fa56c02a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ef97bbf5e7187c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:52.856 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.855+0000 7fa567fff640 1 -- 172.21.15.117:0/87674810 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c007740 con 0x7fa5740b2340 2024-09-19T08:36:52.856 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.855+0000 7fa567fff640 1 -- 172.21.15.117:0/87674810 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa56c0078e0 con 0x7fa5740b2340 2024-09-19T08:36:52.856 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.855+0000 7fa567fff640 1 -- 172.21.15.117:0/87674810 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c007cb0 con 0x7fa5740b2340 2024-09-19T08:36:52.859 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.856+0000 7fa57b877640 1 -- 172.21.15.117:0/87674810 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5740b2340 msgr2=0x7fa5740b27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:52.859 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.856+0000 7fa57b877640 1 --2- 172.21.15.117:0/87674810 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5740b2340 0x7fa5740b27b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa56c009dc0 tx=0x7fa56c02a760 comp rx=0 tx=0).stop 2024-09-19T08:36:52.859 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.856+0000 7fa57b877640 1 -- 172.21.15.117:0/87674810 shutdown_connections 2024-09-19T08:36:52.859 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.856+0000 7fa57b877640 1 --2- 172.21.15.117:0/87674810 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5740b2340 0x7fa5740b27b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:52.859 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.856+0000 7fa57b877640 1 -- 172.21.15.117:0/87674810 >> 172.21.15.117:0/87674810 conn(0x7fa5740b6730 msgr2=0x7fa5740b6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:52.859 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.856+0000 7fa57b877640 1 -- 172.21.15.117:0/87674810 shutdown_connections 2024-09-19T08:36:52.860 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.856+0000 7fa57b877640 1 -- 172.21.15.117:0/87674810 wait complete. 2024-09-19T08:36:52.860 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.857+0000 7fa57b877640 1 Processor -- start 2024-09-19T08:36:52.860 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.857+0000 7fa57b877640 1 -- start start 2024-09-19T08:36:52.860 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.858+0000 7fa57b877640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5740b2340 0x7fa57414cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:52.860 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.858+0000 7fa57b877640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa57415b2a0 0x7fa5741e44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:52.860 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.858+0000 7fa57b877640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa57415b680 0x7fa57409e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:52.860 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.858+0000 7fa57b877640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa57406bb10 con 0x7fa57415b2a0 2024-09-19T08:36:52.860 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.858+0000 7fa57b877640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa5740b1e20 con 0x7fa5740b2340 2024-09-19T08:36:52.860 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.858+0000 7fa57b877640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fa57406bc90 con 0x7fa57415b680 2024-09-19T08:36:52.860 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.858+0000 7fa578e12640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa57415b2a0 0x7fa5741e44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:52.860 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.858+0000 7fa578e12640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa57415b2a0 0x7fa5741e44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43980/0 (socket says 172.21.15.117:43980) 2024-09-19T08:36:52.860 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.858+0000 7fa578e12640 1 -- 172.21.15.117:0/534298994 learned_addr learned my addr 172.21.15.117:0/534298994 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:36:52.861 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.858+0000 7fa579613640 1 --2- 172.21.15.117:0/534298994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5740b2340 0x7fa57414cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:52.861 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.858+0000 7fa579e14640 1 --2- 172.21.15.117:0/534298994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa57415b680 0x7fa57409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:52.861 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.858+0000 7fa578e12640 1 -- 172.21.15.117:0/534298994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa57415b680 msgr2=0x7fa57409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:52.861 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.858+0000 7fa578e12640 1 --2- 172.21.15.117:0/534298994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa57415b680 0x7fa57409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:52.861 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.858+0000 7fa578e12640 1 -- 172.21.15.117:0/534298994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5740b2340 msgr2=0x7fa57414cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:52.861 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.858+0000 7fa578e12640 1 --2- 172.21.15.117:0/534298994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5740b2340 0x7fa57414cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:52.861 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.858+0000 7fa578e12640 1 -- 172.21.15.117:0/534298994 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa57409d470 con 0x7fa57415b2a0 2024-09-19T08:36:52.861 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.858+0000 7fa578e12640 1 --2- 172.21.15.117:0/534298994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa57415b2a0 0x7fa5741e44c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa57000c3e0 tx=0x7fa57000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:52.861 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.858+0000 7fa565ffb640 1 -- 172.21.15.117:0/534298994 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa570017070 con 0x7fa57415b2a0 2024-09-19T08:36:52.861 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.858+0000 7fa565ffb640 1 -- 172.21.15.117:0/534298994 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa570005d00 con 0x7fa57415b2a0 2024-09-19T08:36:52.861 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.858+0000 7fa565ffb640 1 -- 172.21.15.117:0/534298994 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa570007310 con 0x7fa57415b2a0 2024-09-19T08:36:52.861 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.858+0000 7fa57b877640 1 -- 172.21.15.117:0/534298994 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa57409d7b0 con 0x7fa57415b2a0 2024-09-19T08:36:52.861 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.859+0000 7fa565ffb640 1 -- 172.21.15.117:0/534298994 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa57001a070 con 0x7fa57415b2a0 2024-09-19T08:36:52.862 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.859+0000 7fa57b877640 1 -- 172.21.15.117:0/534298994 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa57414d080 con 0x7fa57415b2a0 2024-09-19T08:36:52.862 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.859+0000 7fa565ffb640 1 -- 172.21.15.117:0/534298994 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fa570012db0 con 0x7fa57415b2a0 2024-09-19T08:36:52.862 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.860+0000 7fa57b877640 1 -- 172.21.15.117:0/534298994 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5740b27b0 con 0x7fa57415b2a0 2024-09-19T08:36:52.862 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.862+0000 7fa565ffb640 1 -- 172.21.15.117:0/534298994 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa570022080 con 0x7fa57415b2a0 2024-09-19T08:36:52.900 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:52.901+0000 7f2fe27d6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:36:52.918 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.919+0000 7fa57b877640 1 -- 172.21.15.117:0/534298994 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa574159c20 con 0x7fa57415b2a0 2024-09-19T08:36:52.919 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.919+0000 7fa565ffb640 1 -- 172.21.15.117:0/534298994 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fa57409d7b0 con 0x7fa57415b2a0 2024-09-19T08:36:52.919 INFO:teuthology.misc.health.smithi117.stdout: 2024-09-19T08:36:52.919 INFO:teuthology.misc.health.smithi117.stdout:{"epoch":10,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:36:51.728223+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:36:52.920 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.920+0000 7fa57b877640 1 -- 172.21.15.117:0/534298994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa57415b2a0 msgr2=0x7fa5741e44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:52.920 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.920+0000 7fa57b877640 1 --2- 172.21.15.117:0/534298994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa57415b2a0 0x7fa5741e44c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa57000c3e0 tx=0x7fa57000c8a0 comp rx=0 tx=0).stop 2024-09-19T08:36:52.920 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.920+0000 7fa57b877640 1 -- 172.21.15.117:0/534298994 shutdown_connections 2024-09-19T08:36:52.920 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.920+0000 7fa57b877640 1 --2- 172.21.15.117:0/534298994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa57415b680 0x7fa57409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:52.920 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.920+0000 7fa57b877640 1 --2- 172.21.15.117:0/534298994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa57415b2a0 0x7fa5741e44c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:52.921 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.920+0000 7fa57b877640 1 --2- 172.21.15.117:0/534298994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5740b2340 0x7fa57414cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:52.921 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.920+0000 7fa57b877640 1 -- 172.21.15.117:0/534298994 >> 172.21.15.117:0/534298994 conn(0x7fa5740b6730 msgr2=0x7fa5740751d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:52.921 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.920+0000 7fa57b877640 1 -- 172.21.15.117:0/534298994 shutdown_connections 2024-09-19T08:36:52.921 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:52.920+0000 7fa57b877640 1 -- 172.21.15.117:0/534298994 wait complete. 2024-09-19T08:36:52.929 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-19T08:36:52.950 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:52.951+0000 7f2fe27d6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:36:52.983 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:52.983+0000 7f146e421040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:36:52.987 INFO:tasks.ceph.osd.2.smithi117.stderr:2024-09-19T08:36:52.987+0000 7fd56fbd4640 -1 Falling back to public interface 2024-09-19T08:36:53.003 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:53.004+0000 7f2fe27d6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:36:53.025 INFO:tasks.ceph.osd.7.smithi146.stderr:2024-09-19T08:36:53.025+0000 7f59c2e2f640 -1 Falling back to public interface 2024-09-19T08:36:53.067 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:53.067+0000 7f146e421040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:36:53.072 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:53.073+0000 7f2fe27d6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:36:53.117 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:53.117+0000 7f2fe27d6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:36:53.160 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:53.161+0000 7f2fe27d6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:36:53.171 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:53.171+0000 7f146e421040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:36:53.189 INFO:tasks.ceph.osd.0.smithi117.stderr:2024-09-19T08:36:53.189+0000 7f1f4f83e640 -1 Falling back to public interface 2024-09-19T08:36:53.219 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:53.219+0000 7f146e421040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:36:53.239 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-19T08:36:53.239+0000 7f60d362a640 -1 Falling back to public interface 2024-09-19T08:36:53.244 INFO:tasks.ceph.osd.3.smithi117.stderr:2024-09-19T08:36:53.244+0000 7fc94260d640 -1 Falling back to public interface 2024-09-19T08:36:53.252 INFO:tasks.ceph.osd.4.smithi146.stderr:2024-09-19T08:36:53.252+0000 7f928e015640 -1 Falling back to public interface 2024-09-19T08:36:53.334 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:53.333+0000 7f146e421040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:36:53.385 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:53.385+0000 7f146e421040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:36:53.429 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:53.429+0000 7f146e421040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:36:53.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-09-19T08:36:53.470+0000 7feb44a0e640 -1 Falling back to public interface 2024-09-19T08:36:53.475 INFO:tasks.ceph.osd.5.smithi146.stderr:2024-09-19T08:36:53.475+0000 7f65c6c0b640 -1 Falling back to public interface 2024-09-19T08:36:53.543 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:53.543+0000 7f146e421040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:36:53.592 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:53.592+0000 7f146e421040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:36:53.643 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:53.643+0000 7f146e421040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:36:53.709 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:53.709+0000 7f146e421040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:36:53.754 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:53.754+0000 7f146e421040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:36:53.798 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:53.798+0000 7f146e421040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:36:53.829 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:53.829+0000 7f2fe27d6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:36:54.454 INFO:tasks.ceph.mgr.y.smithi117.stderr:2024-09-19T08:36:54.454+0000 7f146e421040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:36:54.845 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:54.845+0000 7f2f81509640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-19T08:36:54.845 INFO:tasks.ceph.mgr.x.smithi146.stderr:2024-09-19T08:36:54.845+0000 7f2f81509640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-19T08:36:56.564 INFO:tasks.ceph.osd.7.smithi146.stderr:2024-09-19T08:36:56.563+0000 7f59c2e2f640 -1 osd.7 0 log_to_monitors true 2024-09-19T08:36:56.959 INFO:tasks.ceph.osd.0.smithi117.stderr:2024-09-19T08:36:56.959+0000 7f1f4f83e640 -1 osd.0 0 log_to_monitors true 2024-09-19T08:36:57.030 INFO:tasks.ceph.osd.4.smithi146.stderr:2024-09-19T08:36:57.029+0000 7f928e015640 -1 osd.4 0 log_to_monitors true 2024-09-19T08:36:57.078 INFO:tasks.ceph.osd.2.smithi117.stderr:2024-09-19T08:36:57.078+0000 7fd56fbd4640 -1 osd.2 0 log_to_monitors true 2024-09-19T08:36:57.243 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-19T08:36:57.242+0000 7f60d362a640 -1 osd.6 0 log_to_monitors true 2024-09-19T08:36:57.475 INFO:tasks.ceph.osd.5.smithi146.stderr:2024-09-19T08:36:57.474+0000 7f65c6c0b640 -1 osd.5 0 log_to_monitors true 2024-09-19T08:36:57.523 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-09-19T08:36:57.523+0000 7feb44a0e640 -1 osd.1 0 log_to_monitors true 2024-09-19T08:36:57.566 INFO:tasks.ceph.osd.3.smithi117.stderr:2024-09-19T08:36:57.566+0000 7fc94260d640 -1 osd.3 0 log_to_monitors true 2024-09-19T08:36:59.305 INFO:tasks.ceph.osd.7.smithi146.stderr:2024-09-19T08:36:59.304+0000 7f59be385640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T08:36:59.359 INFO:tasks.ceph.osd.7.smithi146.stderr:2024-09-19T08:36:59.358+0000 7f59b61a5640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:36:59.736 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T08:36:59.834 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.834+0000 7f7e86a47640 1 Processor -- start 2024-09-19T08:36:59.834 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.834+0000 7f7e86a47640 1 -- start start 2024-09-19T08:36:59.835 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.835+0000 7f7e86a47640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7e8006db60 0x7f7e8006dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:59.835 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.835+0000 7f7e86a47640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e800cfe20 con 0x7f7e8015e6d0 2024-09-19T08:36:59.836 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.835+0000 7f7e86a47640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e800d0100 con 0x7f7e800d0b90 2024-09-19T08:36:59.836 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.835+0000 7f7e86a47640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f7e8006d360 con 0x7f7e8006db60 2024-09-19T08:36:59.836 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.835+0000 7f7e7ffff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f7e8015e6d0 0x7f7e800d1f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:57048/0 (socket says 172.21.15.117:57048) 2024-09-19T08:36:59.836 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.835+0000 7f7e7ffff640 1 -- 172.21.15.117:0/2591883594 learned_addr learned my addr 172.21.15.117:0/2591883594 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:36:59.836 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.835+0000 7f7e84fe4640 1 --2- 172.21.15.117:0/2591883594 >> v2:172.21.15.146:3300/0 conn(0x7f7e8006db60 0x7f7e8006dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:59.836 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.836+0000 7f7e7effd640 1 -- 172.21.15.117:0/2591883594 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3944225576 0 0) 0x7f7e800cfe20 con 0x7f7e8015e6d0 2024-09-19T08:36:59.836 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.836+0000 7f7e84fe4640 1 -- 172.21.15.117:0/2591883594 >> v1:172.21.15.146:6789/0 conn(0x7f7e800d0b90 legacy=0x7f7e800d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:59.836 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.836+0000 7f7e84fe4640 1 -- 172.21.15.117:0/2591883594 >> v1:172.21.15.117:6789/0 conn(0x7f7e8015e6d0 legacy=0x7f7e800d1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:59.836 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.836+0000 7f7e84fe4640 1 -- 172.21.15.117:0/2591883594 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8006e530 con 0x7f7e8006db60 2024-09-19T08:36:59.837 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.836+0000 7f7e84fe4640 1 --2- 172.21.15.117:0/2591883594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8006db60 0x7f7e8006dff0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009d90 tx=0x7f7e7802a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e2668abdeaaa64c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:59.837 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.837+0000 7f7e7effd640 1 -- 172.21.15.117:0/2591883594 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78007540 con 0x7f7e8006db60 2024-09-19T08:36:59.837 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.837+0000 7f7e7effd640 1 -- 172.21.15.117:0/2591883594 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e780076e0 con 0x7f7e8006db60 2024-09-19T08:36:59.838 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.837+0000 7f7e7effd640 1 -- 172.21.15.117:0/2591883594 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78007ab0 con 0x7f7e8006db60 2024-09-19T08:36:59.838 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.837+0000 7f7e86a47640 1 -- 172.21.15.117:0/2591883594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8006db60 msgr2=0x7f7e8006dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:59.838 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.837+0000 7f7e86a47640 1 --2- 172.21.15.117:0/2591883594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8006db60 0x7f7e8006dff0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009d90 tx=0x7f7e7802a6a0 comp rx=0 tx=0).stop 2024-09-19T08:36:59.838 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.837+0000 7f7e86a47640 1 -- 172.21.15.117:0/2591883594 shutdown_connections 2024-09-19T08:36:59.838 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.837+0000 7f7e86a47640 1 --2- 172.21.15.117:0/2591883594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8006db60 0x7f7e8006dff0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:59.838 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.837+0000 7f7e86a47640 1 -- 172.21.15.117:0/2591883594 >> 172.21.15.117:0/2591883594 conn(0x7f7e8009d790 msgr2=0x7f7e8008c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:36:59.838 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.837+0000 7f7e86a47640 1 -- 172.21.15.117:0/2591883594 shutdown_connections 2024-09-19T08:36:59.838 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.837+0000 7f7e86a47640 1 -- 172.21.15.117:0/2591883594 wait complete. 2024-09-19T08:36:59.838 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.839+0000 7f7e86a47640 1 Processor -- start 2024-09-19T08:36:59.839 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.839+0000 7f7e86a47640 1 -- start start 2024-09-19T08:36:59.840 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.840+0000 7f7e86a47640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e8006db60 0x7f7e8015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:59.840 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.840+0000 7f7e86a47640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e800d0b90 0x7f7e801574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:59.840 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.840+0000 7f7e86a47640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e8015e6d0 0x7f7e800a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:59.840 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.840+0000 7f7e86a47640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7e800cf4a0 con 0x7f7e8006db60 2024-09-19T08:36:59.840 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.840+0000 7f7e86a47640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7e800cf320 con 0x7f7e800d0b90 2024-09-19T08:36:59.840 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.840+0000 7f7e86a47640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f7e800cf620 con 0x7f7e8015e6d0 2024-09-19T08:36:59.840 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.840+0000 7f7e7ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e8006db60 0x7f7e8015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:59.840 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.840+0000 7f7e84fe4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e8015e6d0 0x7f7e800a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:59.840 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.840+0000 7f7e7f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e800d0b90 0x7f7e801574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:59.840 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.840+0000 7f7e84fe4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e8015e6d0 0x7f7e800a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.117:35902/0 (socket says 172.21.15.117:35902) 2024-09-19T08:36:59.840 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.840+0000 7f7e84fe4640 1 -- 172.21.15.117:0/3490047578 learned_addr learned my addr 172.21.15.117:0/3490047578 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:36:59.841 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.840+0000 7f7e7f7fe640 1 -- 172.21.15.117:0/3490047578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e8015e6d0 msgr2=0x7f7e800a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:59.841 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.840+0000 7f7e7f7fe640 1 --2- 172.21.15.117:0/3490047578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e8015e6d0 0x7f7e800a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:59.842 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.840+0000 7f7e7f7fe640 1 -- 172.21.15.117:0/3490047578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e8006db60 msgr2=0x7f7e8015dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:36:59.842 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.840+0000 7f7e7f7fe640 1 --2- 172.21.15.117:0/3490047578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e8006db60 0x7f7e8015dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:36:59.842 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.840+0000 7f7e7f7fe640 1 -- 172.21.15.117:0/3490047578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8015f880 con 0x7f7e800d0b90 2024-09-19T08:36:59.842 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.840+0000 7f7e7ffff640 1 --2- 172.21.15.117:0/3490047578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e8006db60 0x7f7e8015dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:36:59.842 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.840+0000 7f7e84fe4640 1 --2- 172.21.15.117:0/3490047578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e8015e6d0 0x7f7e800a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:36:59.842 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.840+0000 7f7e7f7fe640 1 --2- 172.21.15.117:0/3490047578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e800d0b90 0x7f7e801574d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400c550 tx=0x7f7e7400ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:59.842 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.841+0000 7f7e7cff9640 1 -- 172.21.15.117:0/3490047578 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74017070 con 0x7f7e800d0b90 2024-09-19T08:36:59.842 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.841+0000 7f7e7cff9640 1 -- 172.21.15.117:0/3490047578 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e74005480 con 0x7f7e800d0b90 2024-09-19T08:36:59.842 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.841+0000 7f7e86a47640 1 -- 172.21.15.117:0/3490047578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e800a1670 con 0x7f7e800d0b90 2024-09-19T08:36:59.842 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.841+0000 7f7e7cff9640 1 -- 172.21.15.117:0/3490047578 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74003880 con 0x7f7e800d0b90 2024-09-19T08:36:59.842 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.841+0000 7f7e86a47640 1 -- 172.21.15.117:0/3490047578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e800cc850 con 0x7f7e800d0b90 2024-09-19T08:36:59.843 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.842+0000 7f7e86a47640 1 -- 172.21.15.117:0/3490047578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e800cfa40 con 0x7f7e800d0b90 2024-09-19T08:36:59.843 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.843+0000 7f7e7cff9640 1 -- 172.21.15.117:0/3490047578 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) ==== 90790+0+0 (secure 0 0 0) 0x7f7e7401a070 con 0x7f7e800d0b90 2024-09-19T08:36:59.843 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.843+0000 7f7e7cff9640 1 --2- 172.21.15.117:0/3490047578 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7e6c06c220 0x7f7e6c06e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:36:59.843 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.843+0000 7f7e7cff9640 1 -- 172.21.15.117:0/3490047578 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2231+0+0 (secure 0 0 0) 0x7f7e74089920 con 0x7f7e800d0b90 2024-09-19T08:36:59.844 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.843+0000 7f7e7ffff640 1 --2- 172.21.15.117:0/3490047578 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7e6c06c220 0x7f7e6c06e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:36:59.844 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.844+0000 7f7e7ffff640 1 --2- 172.21.15.117:0/3490047578 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7e6c06c220 0x7f7e6c06e6e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7e70000f60 tx=0x7f7e70007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:36:59.847 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:36:59.848+0000 7f7e7cff9640 1 -- 172.21.15.117:0/3490047578 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7e74058940 con 0x7f7e800d0b90 2024-09-19T08:37:00.032 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:00.032+0000 7f7e86a47640 1 -- 172.21.15.117:0/3490047578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e8006cc60 con 0x7f7e800d0b90 2024-09-19T08:37:00.082 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:00.082+0000 7f7e7cff9640 1 -- 172.21.15.117:0/3490047578 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7058 (secure 0 0 0) 0x7f7e7405cc40 con 0x7f7e800d0b90 2024-09-19T08:37:00.083 INFO:teuthology.misc.health.smithi117.stdout: 2024-09-19T08:37:00.083 INFO:teuthology.misc.health.smithi117.stdout:{"epoch":13,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:36:58.848477+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:37:00.084 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:00.084+0000 7f7e86a47640 1 -- 172.21.15.117:0/3490047578 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7e6c06c220 msgr2=0x7f7e6c06e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:00.084 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:00.084+0000 7f7e86a47640 1 --2- 172.21.15.117:0/3490047578 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7e6c06c220 0x7f7e6c06e6e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7e70000f60 tx=0x7f7e70007e40 comp rx=0 tx=0).stop 2024-09-19T08:37:00.085 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:00.084+0000 7f7e86a47640 1 -- 172.21.15.117:0/3490047578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e800d0b90 msgr2=0x7f7e801574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:00.085 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:00.084+0000 7f7e86a47640 1 --2- 172.21.15.117:0/3490047578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e800d0b90 0x7f7e801574d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400c550 tx=0x7f7e7400ca10 comp rx=0 tx=0).stop 2024-09-19T08:37:00.085 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:00.084+0000 7f7e86a47640 1 -- 172.21.15.117:0/3490047578 shutdown_connections 2024-09-19T08:37:00.085 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:00.084+0000 7f7e86a47640 1 --2- 172.21.15.117:0/3490047578 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7e6c06c220 0x7f7e6c06e6e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:00.085 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:00.084+0000 7f7e86a47640 1 --2- 172.21.15.117:0/3490047578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e8015e6d0 0x7f7e800a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:00.085 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:00.084+0000 7f7e86a47640 1 --2- 172.21.15.117:0/3490047578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e800d0b90 0x7f7e801574d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:00.085 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:00.084+0000 7f7e86a47640 1 --2- 172.21.15.117:0/3490047578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e8006db60 0x7f7e8015dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:00.085 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:00.084+0000 7f7e86a47640 1 -- 172.21.15.117:0/3490047578 >> 172.21.15.117:0/3490047578 conn(0x7f7e8009d790 msgr2=0x7f7e8008c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:00.085 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:00.084+0000 7f7e86a47640 1 -- 172.21.15.117:0/3490047578 shutdown_connections 2024-09-19T08:37:00.089 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:00.084+0000 7f7e86a47640 1 -- 172.21.15.117:0/3490047578 wait complete. 2024-09-19T08:37:00.094 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-19T08:37:00.513 INFO:tasks.ceph.osd.5.smithi146.stderr:2024-09-19T08:37:00.512+0000 7f65c264b640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T08:37:00.523 INFO:tasks.ceph.osd.5.smithi146.stderr:2024-09-19T08:37:00.523+0000 7f65ba46b640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:37:00.539 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-19T08:37:00.538+0000 7f60cfdcd640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T08:37:00.554 INFO:tasks.ceph.osd.6.smithi146.stderr:2024-09-19T08:37:00.553+0000 7f60c73d9640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:37:00.555 INFO:tasks.ceph.osd.4.smithi146.stderr:2024-09-19T08:37:00.554+0000 7f9289926640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T08:37:00.564 INFO:tasks.ceph.osd.4.smithi146.stderr:2024-09-19T08:37:00.564+0000 7f9281746640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:37:00.750 INFO:tasks.ceph.osd.0.smithi117.stderr:2024-09-19T08:37:00.749+0000 7f1f4b7cd640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T08:37:00.771 INFO:tasks.ceph.osd.0.smithi117.stderr:2024-09-19T08:37:00.771+0000 7f1f435ed640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:37:00.933 INFO:tasks.ceph.osd.2.smithi117.stderr:2024-09-19T08:37:00.933+0000 7fd56bb63640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T08:37:00.938 INFO:tasks.ceph.osd.3.smithi117.stderr:2024-09-19T08:37:00.939+0000 7fc93dff9640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T08:37:00.942 INFO:tasks.ceph.osd.2.smithi117.stderr:2024-09-19T08:37:00.943+0000 7fd563983640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:37:00.953 INFO:tasks.ceph.osd.3.smithi117.stderr:2024-09-19T08:37:00.954+0000 7fc935e19640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:37:00.960 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-09-19T08:37:00.960+0000 7feb402fe640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T08:37:00.971 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-09-19T08:37:00.972+0000 7feb3811e640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:37:05.716 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T08:37:05.719 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T08:37:06.901 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T08:37:07.001 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.001+0000 7f6cfc7c4640 1 Processor -- start 2024-09-19T08:37:07.001 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.001+0000 7f6cfc7c4640 1 -- start start 2024-09-19T08:37:07.002 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.002+0000 7f6cfc7c4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6cf415e5b0 0x7f6cf40ced80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:07.003 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.002+0000 7f6cfc7c4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf41626a0 0x7f6cf40d1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:07.003 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.002+0000 7f6cfc7c4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf40cf2c0 con 0x7f6cf40d0e00 2024-09-19T08:37:07.003 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.002+0000 7f6cfc7c4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6cf40d17b0 con 0x7f6cf415e5b0 2024-09-19T08:37:07.003 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.002+0000 7f6cfc7c4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f6cf4162c50 con 0x7f6cf41626a0 2024-09-19T08:37:07.003 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.002+0000 7f6cfa560640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6cf415e5b0 0x7f6cf40ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:07.003 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.002+0000 7f6cfa560640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6cf415e5b0 0x7f6cf40ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44670/0 (socket says 172.21.15.117:44670) 2024-09-19T08:37:07.003 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.002+0000 7f6cf9d5f640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f6cf40d0e00 0x7f6cf4161f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:59052/0 (socket says 172.21.15.117:59052) 2024-09-19T08:37:07.003 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.002+0000 7f6cfa560640 1 -- 172.21.15.117:0/4012479350 learned_addr learned my addr 172.21.15.117:0/4012479350 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:07.003 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.003+0000 7f6cfad61640 1 --2- 172.21.15.117:0/4012479350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf41626a0 0x7f6cf40d1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:07.003 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.003+0000 7f6cfa560640 1 -- 172.21.15.117:0/4012479350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf41626a0 msgr2=0x7f6cf40d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:07.003 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.003+0000 7f6cfa560640 1 --2- 172.21.15.117:0/4012479350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf41626a0 0x7f6cf40d1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.004 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.003+0000 7f6cfa560640 1 -- 172.21.15.117:0/4012479350 >> v1:172.21.15.117:6789/0 conn(0x7f6cf40d0e00 legacy=0x7f6cf4161f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:07.004 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.003+0000 7f6cfa560640 1 -- 172.21.15.117:0/4012479350 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf406cf30 con 0x7f6cf415e5b0 2024-09-19T08:37:07.005 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.003+0000 7f6cfa560640 1 --2- 172.21.15.117:0/4012479350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cf415e5b0 0x7f6cf40ced80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009870 tx=0x7f6cf002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3264bcd49dc009ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:07.005 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.003+0000 7f6cf955e640 1 -- 172.21.15.117:0/4012479350 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0037070 con 0x7f6cf415e5b0 2024-09-19T08:37:07.005 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.004+0000 7f6cf955e640 1 -- 172.21.15.117:0/4012479350 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf0032440 con 0x7f6cf415e5b0 2024-09-19T08:37:07.005 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.004+0000 7f6cf955e640 1 -- 172.21.15.117:0/4012479350 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0032810 con 0x7f6cf415e5b0 2024-09-19T08:37:07.005 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.004+0000 7f6cfc7c4640 1 -- 172.21.15.117:0/4012479350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cf415e5b0 msgr2=0x7f6cf40ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:07.005 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.004+0000 7f6cfc7c4640 1 --2- 172.21.15.117:0/4012479350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cf415e5b0 0x7f6cf40ced80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009870 tx=0x7f6cf002a270 comp rx=0 tx=0).stop 2024-09-19T08:37:07.005 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.004+0000 7f6cfc7c4640 1 -- 172.21.15.117:0/4012479350 shutdown_connections 2024-09-19T08:37:07.006 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.004+0000 7f6cfc7c4640 1 --2- 172.21.15.117:0/4012479350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf41626a0 0x7f6cf40d1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.006 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.004+0000 7f6cfc7c4640 1 --2- 172.21.15.117:0/4012479350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cf415e5b0 0x7f6cf40ced80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.006 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.004+0000 7f6cfc7c4640 1 -- 172.21.15.117:0/4012479350 >> 172.21.15.117:0/4012479350 conn(0x7f6cf409d770 msgr2=0x7f6cf408c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:07.006 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.004+0000 7f6cfc7c4640 1 -- 172.21.15.117:0/4012479350 shutdown_connections 2024-09-19T08:37:07.006 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.004+0000 7f6cfc7c4640 1 -- 172.21.15.117:0/4012479350 wait complete. 2024-09-19T08:37:07.006 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.005+0000 7f6cfc7c4640 1 Processor -- start 2024-09-19T08:37:07.006 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.005+0000 7f6cfc7c4640 1 -- start start 2024-09-19T08:37:07.008 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.006+0000 7f6cfc7c4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cf40d0e00 0x7f6cf40b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:07.008 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.006+0000 7f6cfc7c4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf415e5b0 0x7f6cf415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:07.008 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.006+0000 7f6cfc7c4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cf41626a0 0x7f6cf415d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:07.008 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.006+0000 7f6cfc7c4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf406da10 con 0x7f6cf40d0e00 2024-09-19T08:37:07.008 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.006+0000 7f6cfc7c4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf406d4f0 con 0x7f6cf41626a0 2024-09-19T08:37:07.009 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.006+0000 7f6cfc7c4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f6cf406db90 con 0x7f6cf415e5b0 2024-09-19T08:37:07.009 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.006+0000 7f6cfa560640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cf40d0e00 0x7f6cf40b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:07.009 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.006+0000 7f6cfa560640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cf40d0e00 0x7f6cf40b7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44676/0 (socket says 172.21.15.117:44676) 2024-09-19T08:37:07.009 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.006+0000 7f6cfa560640 1 -- 172.21.15.117:0/2126875607 learned_addr learned my addr 172.21.15.117:0/2126875607 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:07.009 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.006+0000 7f6cf9d5f640 1 --2- 172.21.15.117:0/2126875607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf415e5b0 0x7f6cf415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:07.009 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.006+0000 7f6cfad61640 1 --2- 172.21.15.117:0/2126875607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cf41626a0 0x7f6cf415d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:07.009 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.006+0000 7f6cfa560640 1 -- 172.21.15.117:0/2126875607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf415e5b0 msgr2=0x7f6cf415c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:07.009 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.006+0000 7f6cfa560640 1 --2- 172.21.15.117:0/2126875607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf415e5b0 0x7f6cf415c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.009 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.007+0000 7f6cfa560640 1 -- 172.21.15.117:0/2126875607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cf41626a0 msgr2=0x7f6cf415d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:07.009 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.007+0000 7f6cfa560640 1 --2- 172.21.15.117:0/2126875607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cf41626a0 0x7f6cf415d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.009 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.007+0000 7f6cfa560640 1 -- 172.21.15.117:0/2126875607 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf40ba1c0 con 0x7f6cf40d0e00 2024-09-19T08:37:07.009 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.007+0000 7f6cfa560640 1 --2- 172.21.15.117:0/2126875607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cf40d0e00 0x7f6cf40b7f30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0000c00 tx=0x7f6cf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:07.009 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.007+0000 7f6ceaffd640 1 -- 172.21.15.117:0/2126875607 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0041020 con 0x7f6cf40d0e00 2024-09-19T08:37:07.010 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.007+0000 7f6ceaffd640 1 -- 172.21.15.117:0/2126875607 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf00306c0 con 0x7f6cf40d0e00 2024-09-19T08:37:07.010 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.007+0000 7f6cfc7c4640 1 -- 172.21.15.117:0/2126875607 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf40b9120 con 0x7f6cf40d0e00 2024-09-19T08:37:07.010 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.007+0000 7f6ceaffd640 1 -- 172.21.15.117:0/2126875607 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0037040 con 0x7f6cf40d0e00 2024-09-19T08:37:07.010 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.007+0000 7f6cfc7c4640 1 -- 172.21.15.117:0/2126875607 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf40b99c0 con 0x7f6cf40d0e00 2024-09-19T08:37:07.010 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.008+0000 7f6cfc7c4640 1 -- 172.21.15.117:0/2126875607 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cf40ced80 con 0x7f6cf40d0e00 2024-09-19T08:37:07.010 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.008+0000 7f6ceaffd640 1 -- 172.21.15.117:0/2126875607 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6cf0044020 con 0x7f6cf40d0e00 2024-09-19T08:37:07.011 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.009+0000 7f6ceaffd640 1 --2- 172.21.15.117:0/2126875607 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6cd806c2e0 0x7f6cd806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:07.011 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.009+0000 7f6ceaffd640 1 -- 172.21.15.117:0/2126875607 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f6cf00ab810 con 0x7f6cf40d0e00 2024-09-19T08:37:07.011 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.009+0000 7f6cf9d5f640 1 --2- 172.21.15.117:0/2126875607 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6cd806c2e0 0x7f6cd806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:07.011 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.009+0000 7f6cf9d5f640 1 --2- 172.21.15.117:0/2126875607 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6cd806c2e0 0x7f6cd806e7a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4161700 tx=0x7f6ce4007e20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:07.013 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.013+0000 7f6ceaffd640 1 -- 172.21.15.117:0/2126875607 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6cf004b030 con 0x7f6cf40d0e00 2024-09-19T08:37:07.181 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.181+0000 7f6cfc7c4640 1 -- 172.21.15.117:0/2126875607 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6cf40c7c70 con 0x7f6cf40d0e00 2024-09-19T08:37:07.181 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.182+0000 7f6ceaffd640 1 -- 172.21.15.117:0/2126875607 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12944 (secure 0 0 0) 0x7f6cf007a2d0 con 0x7f6cf40d0e00 2024-09-19T08:37:07.181 INFO:teuthology.misc.health.smithi117.stdout: 2024-09-19T08:37:07.182 INFO:teuthology.misc.health.smithi117.stdout:{"epoch":18,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:37:04.534550+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:37:07.184 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.184+0000 7f6cfc7c4640 1 -- 172.21.15.117:0/2126875607 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6cd806c2e0 msgr2=0x7f6cd806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:07.184 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.184+0000 7f6cfc7c4640 1 --2- 172.21.15.117:0/2126875607 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6cd806c2e0 0x7f6cd806e7a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4161700 tx=0x7f6ce4007e20 comp rx=0 tx=0).stop 2024-09-19T08:37:07.184 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.184+0000 7f6cfc7c4640 1 -- 172.21.15.117:0/2126875607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cf40d0e00 msgr2=0x7f6cf40b7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:07.184 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.184+0000 7f6cfc7c4640 1 --2- 172.21.15.117:0/2126875607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cf40d0e00 0x7f6cf40b7f30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0000c00 tx=0x7f6cf00046c0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.184 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.184+0000 7f6cfc7c4640 1 -- 172.21.15.117:0/2126875607 shutdown_connections 2024-09-19T08:37:07.185 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.184+0000 7f6cfc7c4640 1 --2- 172.21.15.117:0/2126875607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cf41626a0 0x7f6cf415d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.185 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.184+0000 7f6cfc7c4640 1 --2- 172.21.15.117:0/2126875607 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6cd806c2e0 0x7f6cd806e7a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.185 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.184+0000 7f6cfc7c4640 1 --2- 172.21.15.117:0/2126875607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf415e5b0 0x7f6cf415c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.185 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.184+0000 7f6cfc7c4640 1 --2- 172.21.15.117:0/2126875607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cf40d0e00 0x7f6cf40b7f30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.185 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.184+0000 7f6cfc7c4640 1 -- 172.21.15.117:0/2126875607 >> 172.21.15.117:0/2126875607 conn(0x7f6cf409d770 msgr2=0x7f6cf40b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:07.185 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.184+0000 7f6cfc7c4640 1 -- 172.21.15.117:0/2126875607 shutdown_connections 2024-09-19T08:37:07.185 INFO:teuthology.misc.health.smithi117.stderr:2024-09-19T08:37:07.184+0000 7f6cfc7c4640 1 -- 172.21.15.117:0/2126875607 wait complete. 2024-09-19T08:37:07.193 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-19T08:37:07.193 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-19T08:37:07.193 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T08:37:07.194 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T08:37:07.196 INFO:tasks.ceph.mds.a:Started 2024-09-19T08:37:07.196 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T08:37:07.196 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T08:37:07.198 INFO:tasks.ceph.mds.c:Started 2024-09-19T08:37:07.198 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T08:37:07.198 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T08:37:07.201 INFO:tasks.ceph.mds.b:Started 2024-09-19T08:37:07.201 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T08:37:07.201 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T08:37:07.203 INFO:tasks.ceph.mds.d:Started 2024-09-19T08:37:07.204 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-19T08:37:07.204 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:37:07.269 INFO:tasks.ceph.mds.a.smithi117.stdout:starting mds.a at 2024-09-19T08:37:07.270 INFO:tasks.ceph.mds.c.smithi117.stdout:starting mds.c at 2024-09-19T08:37:07.287 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2024-09-19T08:37:07.287 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2024-09-19T08:37:07.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.307+0000 7f8702053640 1 Processor -- start 2024-09-19T08:37:07.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.307+0000 7f8702053640 1 -- start start 2024-09-19T08:37:07.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.308+0000 7f8702053640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86fc141470 0x7f86fc141b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:07.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.308+0000 7f8702053640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f86fc0d2840 0x7f86fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:07.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.308+0000 7f8702053640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86fc161f10 con 0x7f86fc06ce70 2024-09-19T08:37:07.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.308+0000 7f8702053640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f86fc06d840 con 0x7f86fc141470 2024-09-19T08:37:07.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.308+0000 7f8702053640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f86fc141850 con 0x7f86fc0d2840 2024-09-19T08:37:07.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.308+0000 7f86fb7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86fc141470 0x7f86fc141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:07.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.308+0000 7f86fb7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86fc141470 0x7f86fc141b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44718/0 (socket says 172.21.15.117:44718) 2024-09-19T08:37:07.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.308+0000 7f86fb7fe640 1 -- 172.21.15.117:0/1688014055 learned_addr learned my addr 172.21.15.117:0/1688014055 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:07.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.309+0000 7f86fbfff640 1 --2- 172.21.15.117:0/1688014055 >> v2:172.21.15.146:3300/0 conn(0x7f86fc0d2840 0x7f86fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:07.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.309+0000 7f86fb7fe640 1 -- 172.21.15.117:0/1688014055 >> v2:172.21.15.146:3300/0 conn(0x7f86fc0d2840 msgr2=0x7f86fc06d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:07.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.309+0000 7f86fb7fe640 1 --2- 172.21.15.117:0/1688014055 >> v2:172.21.15.146:3300/0 conn(0x7f86fc0d2840 0x7f86fc06d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.309+0000 7f86fb7fe640 1 -- 172.21.15.117:0/1688014055 >> v1:172.21.15.146:6789/0 conn(0x7f86fc06ce70 legacy=0x7f86fc0d2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:07.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.309+0000 7f86fb7fe640 1 -- 172.21.15.117:0/1688014055 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86fc1621b0 con 0x7f86fc141470 2024-09-19T08:37:07.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.309+0000 7f86fb7fe640 1 --2- 172.21.15.117:0/1688014055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86fc141470 0x7f86fc141b70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f86fc071930 tx=0x7f86f002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6783c5665a1bf3e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:07.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.309+0000 7f86fa7fc640 1 -- 172.21.15.117:0/1688014055 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f0037070 con 0x7f86fc141470 2024-09-19T08:37:07.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.309+0000 7f86fa7fc640 1 -- 172.21.15.117:0/1688014055 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f0032440 con 0x7f86fc141470 2024-09-19T08:37:07.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.309+0000 7f86fa7fc640 1 -- 172.21.15.117:0/1688014055 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f0032810 con 0x7f86fc141470 2024-09-19T08:37:07.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.310+0000 7f8702053640 1 -- 172.21.15.117:0/1688014055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86fc141470 msgr2=0x7f86fc141b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:07.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.310+0000 7f8702053640 1 --2- 172.21.15.117:0/1688014055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86fc141470 0x7f86fc141b70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f86fc071930 tx=0x7f86f002a180 comp rx=0 tx=0).stop 2024-09-19T08:37:07.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.310+0000 7f8702053640 1 -- 172.21.15.117:0/1688014055 shutdown_connections 2024-09-19T08:37:07.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.310+0000 7f8702053640 1 --2- 172.21.15.117:0/1688014055 >> v2:172.21.15.146:3300/0 conn(0x7f86fc0d2840 0x7f86fc06d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.310+0000 7f8702053640 1 --2- 172.21.15.117:0/1688014055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86fc141470 0x7f86fc141b70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.310+0000 7f8702053640 1 -- 172.21.15.117:0/1688014055 >> 172.21.15.117:0/1688014055 conn(0x7f86fc0b4040 msgr2=0x7f86fc0b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:07.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.310+0000 7f8702053640 1 -- 172.21.15.117:0/1688014055 shutdown_connections 2024-09-19T08:37:07.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.310+0000 7f8702053640 1 -- 172.21.15.117:0/1688014055 wait complete. 2024-09-19T08:37:07.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.311+0000 7f8702053640 1 Processor -- start 2024-09-19T08:37:07.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.311+0000 7f8702053640 1 -- start start 2024-09-19T08:37:07.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.312+0000 7f8702053640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86fc06ce70 0x7f86fc1f7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:07.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.312+0000 7f8702053640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86fc0d2840 0x7f86fc147840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:07.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.312+0000 7f8702053640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86fc141470 0x7f86fc15dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:07.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.312+0000 7f8702053640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc162a50 con 0x7f86fc0d2840 2024-09-19T08:37:07.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.312+0000 7f8702053640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc162770 con 0x7f86fc141470 2024-09-19T08:37:07.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.312+0000 7f8702053640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f86fc162d30 con 0x7f86fc06ce70 2024-09-19T08:37:07.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.312+0000 7f86faffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86fc0d2840 0x7f86fc147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:07.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.312+0000 7f86faffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86fc0d2840 0x7f86fc147840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44728/0 (socket says 172.21.15.117:44728) 2024-09-19T08:37:07.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.312+0000 7f86faffd640 1 -- 172.21.15.117:0/161384161 learned_addr learned my addr 172.21.15.117:0/161384161 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:07.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.312+0000 7f86fbfff640 1 --2- 172.21.15.117:0/161384161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86fc141470 0x7f86fc15dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:07.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.312+0000 7f86faffd640 1 -- 172.21.15.117:0/161384161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86fc06ce70 msgr2=0x7f86fc1f7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:07.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.312+0000 7f86fb7fe640 1 --2- 172.21.15.117:0/161384161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86fc06ce70 0x7f86fc1f7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:07.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.312+0000 7f86faffd640 1 --2- 172.21.15.117:0/161384161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86fc06ce70 0x7f86fc1f7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.313+0000 7f86faffd640 1 -- 172.21.15.117:0/161384161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86fc141470 msgr2=0x7f86fc15dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:07.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.313+0000 7f86faffd640 1 --2- 172.21.15.117:0/161384161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86fc141470 0x7f86fc15dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.313+0000 7f86faffd640 1 -- 172.21.15.117:0/161384161 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86fc1f7b10 con 0x7f86fc0d2840 2024-09-19T08:37:07.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.313+0000 7f86fb7fe640 1 --2- 172.21.15.117:0/161384161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86fc06ce70 0x7f86fc1f7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:07.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.313+0000 7f86faffd640 1 --2- 172.21.15.117:0/161384161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86fc0d2840 0x7f86fc147840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00c410 tx=0x7f86ec00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:07.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.313+0000 7f86e3fff640 1 -- 172.21.15.117:0/161384161 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec017070 con 0x7f86fc0d2840 2024-09-19T08:37:07.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.313+0000 7f86e3fff640 1 -- 172.21.15.117:0/161384161 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86ec0035f0 con 0x7f86fc0d2840 2024-09-19T08:37:07.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.313+0000 7f8702053640 1 -- 172.21.15.117:0/161384161 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86fc1f7df0 con 0x7f86fc0d2840 2024-09-19T08:37:07.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.313+0000 7f86e3fff640 1 -- 172.21.15.117:0/161384161 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec003a20 con 0x7f86fc0d2840 2024-09-19T08:37:07.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.313+0000 7f8702053640 1 -- 172.21.15.117:0/161384161 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86fc0b7eb0 con 0x7f86fc0d2840 2024-09-19T08:37:07.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.314+0000 7f8702053640 1 -- 172.21.15.117:0/161384161 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86fc06d300 con 0x7f86fc0d2840 2024-09-19T08:37:07.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.314+0000 7f86e3fff640 1 -- 172.21.15.117:0/161384161 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f86ec01a070 con 0x7f86fc0d2840 2024-09-19T08:37:07.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.315+0000 7f86e3fff640 1 --2- 172.21.15.117:0/161384161 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f86e806c2b0 0x7f86e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:07.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.315+0000 7f86e3fff640 1 -- 172.21.15.117:0/161384161 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f86ec08a5c0 con 0x7f86fc0d2840 2024-09-19T08:37:07.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.315+0000 7f86fb7fe640 1 --2- 172.21.15.117:0/161384161 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f86e806c2b0 0x7f86e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:07.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.315+0000 7f86fb7fe640 1 --2- 172.21.15.117:0/161384161 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f86e806c2b0 0x7f86e806e770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f86f0034000 tx=0x7f86f002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:07.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.319+0000 7f86e3fff640 1 -- 172.21.15.117:0/161384161 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f86ec059080 con 0x7f86fc0d2840 2024-09-19T08:37:07.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.517+0000 7f8702053640 1 -- 172.21.15.117:0/161384161 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86fc15f5e0 con 0x7f86fc0d2840 2024-09-19T08:37:07.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.517+0000 7f86e3fff640 1 -- 172.21.15.117:0/161384161 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7f86ec058980 con 0x7f86fc0d2840 2024-09-19T08:37:07.518 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:07.518 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":2,"btime":"2024-09-19T08:37:07:274852+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2592540396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2592540396},{"type":"v1","addr":"172.21.15.117:6833","nonce":2592540396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T08:37:07.518 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 2 2024-09-19T08:37:07.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.519+0000 7f8702053640 1 -- 172.21.15.117:0/161384161 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f86e806c2b0 msgr2=0x7f86e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:07.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.519+0000 7f8702053640 1 --2- 172.21.15.117:0/161384161 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f86e806c2b0 0x7f86e806e770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f86f0034000 tx=0x7f86f002e000 comp rx=0 tx=0).stop 2024-09-19T08:37:07.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.519+0000 7f8702053640 1 -- 172.21.15.117:0/161384161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86fc0d2840 msgr2=0x7f86fc147840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:07.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.519+0000 7f8702053640 1 --2- 172.21.15.117:0/161384161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86fc0d2840 0x7f86fc147840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00c410 tx=0x7f86ec00c8d0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.519+0000 7f8702053640 1 -- 172.21.15.117:0/161384161 shutdown_connections 2024-09-19T08:37:07.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.519+0000 7f8702053640 1 --2- 172.21.15.117:0/161384161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86fc141470 0x7f86fc15dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.519+0000 7f8702053640 1 --2- 172.21.15.117:0/161384161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86fc0d2840 0x7f86fc147840 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.519+0000 7f8702053640 1 --2- 172.21.15.117:0/161384161 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f86e806c2b0 0x7f86e806e770 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.519+0000 7f8702053640 1 --2- 172.21.15.117:0/161384161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86fc06ce70 0x7f86fc1f7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:07.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.519+0000 7f8702053640 1 -- 172.21.15.117:0/161384161 >> 172.21.15.117:0/161384161 conn(0x7f86fc0b4040 msgr2=0x7f86fc06ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:07.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.519+0000 7f8702053640 1 -- 172.21.15.117:0/161384161 shutdown_connections 2024-09-19T08:37:07.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:07.519+0000 7f8702053640 1 -- 172.21.15.117:0/161384161 wait complete. 2024-09-19T08:37:09.531 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:37:09.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.642+0000 7f9a5ceb7640 1 Processor -- start 2024-09-19T08:37:09.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.642+0000 7f9a5ceb7640 1 -- start start 2024-09-19T08:37:09.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.643+0000 7f9a5ceb7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9a5815e2a0 0x7f9a5806d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:09.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.643+0000 7f9a5ceb7640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9a5815e680 0x7f9a580cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:09.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.643+0000 7f9a5ceb7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5806d960 0x7f9a580d0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:09.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.643+0000 7f9a5ceb7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9a580d1880 con 0x7f9a5815e2a0 2024-09-19T08:37:09.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.643+0000 7f9a5ceb7640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f9a580d1b60 con 0x7f9a5815e680 2024-09-19T08:37:09.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.643+0000 7f9a5ceb7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f9a580cf2d0 con 0x7f9a5806d960 2024-09-19T08:37:09.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.643+0000 7f9a5659c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9a5815e2a0 0x7f9a5806d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:09.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.643+0000 7f9a5659c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9a5815e2a0 0x7f9a5806d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44732/0 (socket says 172.21.15.117:44732) 2024-09-19T08:37:09.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.643+0000 7f9a5659c640 1 -- 172.21.15.117:0/2900504527 learned_addr learned my addr 172.21.15.117:0/2900504527 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:09.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.643+0000 7f9a56d9d640 1 --2- 172.21.15.117:0/2900504527 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5806d960 0x7f9a580d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:09.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.643+0000 7f9a4ffff640 1 --2- 172.21.15.117:0/2900504527 >> v2:172.21.15.146:3300/0 conn(0x7f9a5815e680 0x7f9a580cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:09.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.643+0000 7f9a5659c640 1 -- 172.21.15.117:0/2900504527 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5806d960 msgr2=0x7f9a580d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:09.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.643+0000 7f9a5659c640 1 --2- 172.21.15.117:0/2900504527 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5806d960 0x7f9a580d0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.643+0000 7f9a5659c640 1 -- 172.21.15.117:0/2900504527 >> v2:172.21.15.146:3300/0 conn(0x7f9a5815e680 msgr2=0x7f9a580cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:09.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.643+0000 7f9a5659c640 1 --2- 172.21.15.117:0/2900504527 >> v2:172.21.15.146:3300/0 conn(0x7f9a5815e680 0x7f9a580cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.643+0000 7f9a5659c640 1 -- 172.21.15.117:0/2900504527 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a580cf5b0 con 0x7f9a5815e2a0 2024-09-19T08:37:09.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.644+0000 7f9a5659c640 1 --2- 172.21.15.117:0/2900504527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a5815e2a0 0x7f9a5806d420 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9a580a22a0 tx=0x7f9a4802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d529e5300e673b04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:09.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.644+0000 7f9a55d9b640 1 -- 172.21.15.117:0/2900504527 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a48037070 con 0x7f9a5815e2a0 2024-09-19T08:37:09.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.644+0000 7f9a55d9b640 1 -- 172.21.15.117:0/2900504527 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a48032440 con 0x7f9a5815e2a0 2024-09-19T08:37:09.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.644+0000 7f9a55d9b640 1 -- 172.21.15.117:0/2900504527 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a48032810 con 0x7f9a5815e2a0 2024-09-19T08:37:09.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.644+0000 7f9a5ceb7640 1 -- 172.21.15.117:0/2900504527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a5815e2a0 msgr2=0x7f9a5806d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:09.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.644+0000 7f9a5ceb7640 1 --2- 172.21.15.117:0/2900504527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a5815e2a0 0x7f9a5806d420 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9a580a22a0 tx=0x7f9a4802a1e0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.645+0000 7f9a5ceb7640 1 -- 172.21.15.117:0/2900504527 shutdown_connections 2024-09-19T08:37:09.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.645+0000 7f9a5ceb7640 1 --2- 172.21.15.117:0/2900504527 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5806d960 0x7f9a580d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.645+0000 7f9a5ceb7640 1 --2- 172.21.15.117:0/2900504527 >> v2:172.21.15.146:3300/0 conn(0x7f9a5815e680 0x7f9a580cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.645+0000 7f9a5ceb7640 1 --2- 172.21.15.117:0/2900504527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a5815e2a0 0x7f9a5806d420 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.645+0000 7f9a5ceb7640 1 -- 172.21.15.117:0/2900504527 >> 172.21.15.117:0/2900504527 conn(0x7f9a5809d760 msgr2=0x7f9a5808bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:09.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.645+0000 7f9a5ceb7640 1 -- 172.21.15.117:0/2900504527 shutdown_connections 2024-09-19T08:37:09.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.645+0000 7f9a5ceb7640 1 -- 172.21.15.117:0/2900504527 wait complete. 2024-09-19T08:37:09.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.646+0000 7f9a5ceb7640 1 Processor -- start 2024-09-19T08:37:09.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.646+0000 7f9a5ceb7640 1 -- start start 2024-09-19T08:37:09.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a5ceb7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a5806d960 0x7f9a5814c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:09.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a5ceb7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5815e2a0 0x7f9a58159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:09.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a5ceb7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a5815e680 0x7f9a581f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:09.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a5ceb7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9a580d44f0 con 0x7f9a5806d960 2024-09-19T08:37:09.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a5ceb7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9a580d4370 con 0x7f9a5815e680 2024-09-19T08:37:09.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a5ceb7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f9a580d4670 con 0x7f9a5815e2a0 2024-09-19T08:37:09.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a5659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a5806d960 0x7f9a5814c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:09.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a5659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a5806d960 0x7f9a5814c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44740/0 (socket says 172.21.15.117:44740) 2024-09-19T08:37:09.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a5659c640 1 -- 172.21.15.117:0/3205203681 learned_addr learned my addr 172.21.15.117:0/3205203681 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:09.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a56d9d640 1 --2- 172.21.15.117:0/3205203681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a5815e680 0x7f9a581f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:09.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a4ffff640 1 --2- 172.21.15.117:0/3205203681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5815e2a0 0x7f9a58159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:09.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a5659c640 1 -- 172.21.15.117:0/3205203681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5815e2a0 msgr2=0x7f9a58159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:09.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a5659c640 1 --2- 172.21.15.117:0/3205203681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5815e2a0 0x7f9a58159960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a5659c640 1 -- 172.21.15.117:0/3205203681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a5815e680 msgr2=0x7f9a581f5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:09.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a5659c640 1 --2- 172.21.15.117:0/3205203681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a5815e680 0x7f9a581f5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a5659c640 1 -- 172.21.15.117:0/3205203681 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a581588c0 con 0x7f9a5806d960 2024-09-19T08:37:09.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a4ffff640 1 --2- 172.21.15.117:0/3205203681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5815e2a0 0x7f9a58159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:09.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a5659c640 1 --2- 172.21.15.117:0/3205203681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a5806d960 0x7f9a5814c440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9a480097c0 tx=0x7f9a480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:09.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a4effd640 1 -- 172.21.15.117:0/3205203681 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a48041020 con 0x7f9a5806d960 2024-09-19T08:37:09.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a4effd640 1 -- 172.21.15.117:0/3205203681 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a480306c0 con 0x7f9a5806d960 2024-09-19T08:37:09.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a4effd640 1 -- 172.21.15.117:0/3205203681 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a48037040 con 0x7f9a5806d960 2024-09-19T08:37:09.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.647+0000 7f9a5ceb7640 1 -- 172.21.15.117:0/3205203681 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a58158ba0 con 0x7f9a5806d960 2024-09-19T08:37:09.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.648+0000 7f9a5ceb7640 1 -- 172.21.15.117:0/3205203681 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a58159160 con 0x7f9a5806d960 2024-09-19T08:37:09.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.648+0000 7f9a5ceb7640 1 -- 172.21.15.117:0/3205203681 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a5806d420 con 0x7f9a5806d960 2024-09-19T08:37:09.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.649+0000 7f9a4effd640 1 -- 172.21.15.117:0/3205203681 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9a48044020 con 0x7f9a5806d960 2024-09-19T08:37:09.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.649+0000 7f9a4effd640 1 --2- 172.21.15.117:0/3205203681 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9a3806c2b0 0x7f9a3806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:09.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.649+0000 7f9a4effd640 1 -- 172.21.15.117:0/3205203681 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f9a480ab890 con 0x7f9a5806d960 2024-09-19T08:37:09.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.650+0000 7f9a4ffff640 1 --2- 172.21.15.117:0/3205203681 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9a3806c2b0 0x7f9a3806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:09.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.650+0000 7f9a4ffff640 1 --2- 172.21.15.117:0/3205203681 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9a3806c2b0 0x7f9a3806e770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9a40006fd0 tx=0x7f9a40008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:09.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.654+0000 7f9a4effd640 1 -- 172.21.15.117:0/3205203681 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9a4804b030 con 0x7f9a5806d960 2024-09-19T08:37:09.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.856+0000 7f9a5ceb7640 1 -- 172.21.15.117:0/3205203681 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a580d0650 con 0x7f9a5806d960 2024-09-19T08:37:09.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.856+0000 7f9a4effd640 1 -- 172.21.15.117:0/3205203681 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3918 (secure 0 0 0) 0x7f9a4807a3e0 con 0x7f9a5806d960 2024-09-19T08:37:09.856 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:09.856 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":3,"btime":"2024-09-19T08:37:08:275841+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2592540396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2592540396},{"type":"v1","addr":"172.21.15.117:6833","nonce":2592540396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3561335184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3561335184},{"type":"v1","addr":"172.21.15.117:6835","nonce":3561335184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/2623207604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2623207604},{"type":"v1","addr":"172.21.15.146:6837","nonce":2623207604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2942334805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2942334805},{"type":"v1","addr":"172.21.15.146:6836","nonce":2942334805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T08:37:09.857 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 3 2024-09-19T08:37:09.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.858+0000 7f9a5ceb7640 1 -- 172.21.15.117:0/3205203681 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9a3806c2b0 msgr2=0x7f9a3806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:09.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.858+0000 7f9a5ceb7640 1 --2- 172.21.15.117:0/3205203681 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9a3806c2b0 0x7f9a3806e770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9a40006fd0 tx=0x7f9a40008040 comp rx=0 tx=0).stop 2024-09-19T08:37:09.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.858+0000 7f9a5ceb7640 1 -- 172.21.15.117:0/3205203681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a5806d960 msgr2=0x7f9a5814c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:09.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.858+0000 7f9a5ceb7640 1 --2- 172.21.15.117:0/3205203681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a5806d960 0x7f9a5814c440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9a480097c0 tx=0x7f9a480046c0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.858+0000 7f9a5ceb7640 1 -- 172.21.15.117:0/3205203681 shutdown_connections 2024-09-19T08:37:09.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.858+0000 7f9a5ceb7640 1 --2- 172.21.15.117:0/3205203681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a5815e680 0x7f9a581f5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.858+0000 7f9a5ceb7640 1 --2- 172.21.15.117:0/3205203681 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9a3806c2b0 0x7f9a3806e770 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.859+0000 7f9a5ceb7640 1 --2- 172.21.15.117:0/3205203681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a5815e2a0 0x7f9a58159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.859+0000 7f9a5ceb7640 1 --2- 172.21.15.117:0/3205203681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a5806d960 0x7f9a5814c440 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.859+0000 7f9a5ceb7640 1 -- 172.21.15.117:0/3205203681 >> 172.21.15.117:0/3205203681 conn(0x7f9a5809d760 msgr2=0x7f9a580d2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:09.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.859+0000 7f9a5ceb7640 1 -- 172.21.15.117:0/3205203681 shutdown_connections 2024-09-19T08:37:09.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.859+0000 7f9a5ceb7640 1 -- 172.21.15.117:0/3205203681 wait complete. 2024-09-19T08:37:09.869 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T08:37:09.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.967+0000 7f8acc7f6640 1 Processor -- start 2024-09-19T08:37:09.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.967+0000 7f8acc7f6640 1 -- start start 2024-09-19T08:37:09.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.968+0000 7f8acc7f6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8ac40d21f0 0x7f8ac40d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:09.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.968+0000 7f8acc7f6640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ac4072590 0x7f8ac406d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:09.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.968+0000 7f8acc7f6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ac40d2b10 con 0x7f8ac4143a60 2024-09-19T08:37:09.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.968+0000 7f8acc7f6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8ac4141750 con 0x7f8ac40d21f0 2024-09-19T08:37:09.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.968+0000 7f8acc7f6640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f8ac41620b0 con 0x7f8ac4072590 2024-09-19T08:37:09.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.968+0000 7f8aca592640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8ac40d21f0 0x7f8ac40d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:09.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.968+0000 7f8acad93640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f8ac4143a60 0x7f8ac4143f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:59076/0 (socket says 172.21.15.117:59076) 2024-09-19T08:37:09.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.969+0000 7f8acad93640 1 -- 172.21.15.117:0/3759924102 learned_addr learned my addr 172.21.15.117:0/3759924102 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:09.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.969+0000 7f8aca592640 1 -- 172.21.15.117:0/3759924102 >> v2:172.21.15.146:3300/0 conn(0x7f8ac4072590 msgr2=0x7f8ac406d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:09.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.969+0000 7f8aca592640 1 --2- 172.21.15.117:0/3759924102 >> v2:172.21.15.146:3300/0 conn(0x7f8ac4072590 0x7f8ac406d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.969+0000 7f8aca592640 1 -- 172.21.15.117:0/3759924102 >> v1:172.21.15.117:6789/0 conn(0x7f8ac4143a60 legacy=0x7f8ac4143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:09.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.969+0000 7f8ac9590640 1 -- 172.21.15.117:0/3759924102 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2868710481 0 0) 0x7f8ac40d2b10 con 0x7f8ac4143a60 2024-09-19T08:37:09.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.969+0000 7f8aca592640 1 -- 172.21.15.117:0/3759924102 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac4162370 con 0x7f8ac40d21f0 2024-09-19T08:37:09.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.969+0000 7f8aca592640 1 --2- 172.21.15.117:0/3759924102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ac40d21f0 0x7f8ac40d25d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40b8490 tx=0x7f8abc02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786ef53e179361b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:09.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.970+0000 7f8ac9590640 1 -- 172.21.15.117:0/3759924102 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc007740 con 0x7f8ac40d21f0 2024-09-19T08:37:09.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.970+0000 7f8ac9590640 1 -- 172.21.15.117:0/3759924102 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8abc0078e0 con 0x7f8ac40d21f0 2024-09-19T08:37:09.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.970+0000 7f8ac9590640 1 -- 172.21.15.117:0/3759924102 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc007cb0 con 0x7f8ac40d21f0 2024-09-19T08:37:09.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.970+0000 7f8acc7f6640 1 -- 172.21.15.117:0/3759924102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ac40d21f0 msgr2=0x7f8ac40d25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:09.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.970+0000 7f8acc7f6640 1 --2- 172.21.15.117:0/3759924102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ac40d21f0 0x7f8ac40d25d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40b8490 tx=0x7f8abc02a5f0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.970+0000 7f8acc7f6640 1 -- 172.21.15.117:0/3759924102 shutdown_connections 2024-09-19T08:37:09.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.970+0000 7f8acc7f6640 1 --2- 172.21.15.117:0/3759924102 >> v2:172.21.15.146:3300/0 conn(0x7f8ac4072590 0x7f8ac406d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.970+0000 7f8acc7f6640 1 --2- 172.21.15.117:0/3759924102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ac40d21f0 0x7f8ac40d25d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.970+0000 7f8acc7f6640 1 -- 172.21.15.117:0/3759924102 >> 172.21.15.117:0/3759924102 conn(0x7f8ac40b3ed0 msgr2=0x7f8ac40b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:09.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.970+0000 7f8acc7f6640 1 -- 172.21.15.117:0/3759924102 shutdown_connections 2024-09-19T08:37:09.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.970+0000 7f8acc7f6640 1 -- 172.21.15.117:0/3759924102 wait complete. 2024-09-19T08:37:09.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.971+0000 7f8acc7f6640 1 Processor -- start 2024-09-19T08:37:09.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.971+0000 7f8acc7f6640 1 -- start start 2024-09-19T08:37:09.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.972+0000 7f8acc7f6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ac4072590 0x7f8ac40b70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:09.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.972+0000 7f8acc7f6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ac40d21f0 0x7f8ac4140be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:09.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.972+0000 7f8acc7f6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ac4143a60 0x7f8ac415ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:09.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.972+0000 7f8acc7f6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac4162c10 con 0x7f8ac4072590 2024-09-19T08:37:09.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.972+0000 7f8acc7f6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac4162930 con 0x7f8ac4143a60 2024-09-19T08:37:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.972+0000 7f8acc7f6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac406d620 con 0x7f8ac40d21f0 2024-09-19T08:37:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.972+0000 7f8aca592640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ac4072590 0x7f8ac40b70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.972+0000 7f8aca592640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ac4072590 0x7f8ac40b70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44758/0 (socket says 172.21.15.117:44758) 2024-09-19T08:37:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.972+0000 7f8aca592640 1 -- 172.21.15.117:0/496806862 learned_addr learned my addr 172.21.15.117:0/496806862 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.972+0000 7f8acad93640 1 --2- 172.21.15.117:0/496806862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ac4143a60 0x7f8ac415ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.972+0000 7f8ac9d91640 1 --2- 172.21.15.117:0/496806862 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ac40d21f0 0x7f8ac4140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.972+0000 7f8aca592640 1 -- 172.21.15.117:0/496806862 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ac40d21f0 msgr2=0x7f8ac4140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.972+0000 7f8aca592640 1 --2- 172.21.15.117:0/496806862 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ac40d21f0 0x7f8ac4140be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.972+0000 7f8aca592640 1 -- 172.21.15.117:0/496806862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ac4143a60 msgr2=0x7f8ac415ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.972+0000 7f8aca592640 1 --2- 172.21.15.117:0/496806862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ac4143a60 0x7f8ac415ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.973+0000 7f8aca592640 1 -- 172.21.15.117:0/496806862 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac40b75e0 con 0x7f8ac4072590 2024-09-19T08:37:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.973+0000 7f8aca592640 1 --2- 172.21.15.117:0/496806862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ac4072590 0x7f8ac40b70a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009e80 tx=0x7f8abc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.973+0000 7f8abaffd640 1 -- 172.21.15.117:0/496806862 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc040070 con 0x7f8ac4072590 2024-09-19T08:37:09.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.973+0000 7f8abaffd640 1 -- 172.21.15.117:0/496806862 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8abc031d00 con 0x7f8ac4072590 2024-09-19T08:37:09.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.973+0000 7f8acc7f6640 1 -- 172.21.15.117:0/496806862 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac40b7880 con 0x7f8ac4072590 2024-09-19T08:37:09.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.973+0000 7f8abaffd640 1 -- 172.21.15.117:0/496806862 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc045680 con 0x7f8ac4072590 2024-09-19T08:37:09.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.973+0000 7f8acc7f6640 1 -- 172.21.15.117:0/496806862 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac40b7e40 con 0x7f8ac4072590 2024-09-19T08:37:09.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.974+0000 7f8acc7f6640 1 -- 172.21.15.117:0/496806862 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ac4158c30 con 0x7f8ac4072590 2024-09-19T08:37:09.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.974+0000 7f8abaffd640 1 -- 172.21.15.117:0/496806862 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8abc039040 con 0x7f8ac4072590 2024-09-19T08:37:09.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.975+0000 7f8abaffd640 1 --2- 172.21.15.117:0/496806862 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f8aa806c2e0 0x7f8aa806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:09.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.975+0000 7f8abaffd640 1 -- 172.21.15.117:0/496806862 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f8abc0acb00 con 0x7f8ac4072590 2024-09-19T08:37:09.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.975+0000 7f8ac9d91640 1 --2- 172.21.15.117:0/496806862 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f8aa806c2e0 0x7f8aa806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:09.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.975+0000 7f8ac9d91640 1 --2- 172.21.15.117:0/496806862 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f8aa806c2e0 0x7f8aa806e7a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8ac41f76a0 tx=0x7f8ab4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:09.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:09.979+0000 7f8abaffd640 1 -- 172.21.15.117:0/496806862 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8abc07b770 con 0x7f8ac4072590 2024-09-19T08:37:10.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.147+0000 7f8acc7f6640 1 -- 172.21.15.117:0/496806862 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8ac40690c0 con 0x7f8ac4072590 2024-09-19T08:37:10.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.148+0000 7f8abaffd640 1 -- 172.21.15.117:0/496806862 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f8abc07b070 con 0x7f8ac4072590 2024-09-19T08:37:10.148 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:10.148 INFO:teuthology.orchestra.run.smithi117.stdout:[ 2024-09-19T08:37:10.148 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:37:10.148 INFO:teuthology.orchestra.run.smithi117.stdout: "poolnum": 1, 2024-09-19T08:37:10.148 INFO:teuthology.orchestra.run.smithi117.stdout: "poolname": ".mgr" 2024-09-19T08:37:10.148 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:37:10.148 INFO:teuthology.orchestra.run.smithi117.stdout:] 2024-09-19T08:37:10.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.150+0000 7f8acc7f6640 1 -- 172.21.15.117:0/496806862 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f8aa806c2e0 msgr2=0x7f8aa806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:10.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.150+0000 7f8acc7f6640 1 --2- 172.21.15.117:0/496806862 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f8aa806c2e0 0x7f8aa806e7a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8ac41f76a0 tx=0x7f8ab4008040 comp rx=0 tx=0).stop 2024-09-19T08:37:10.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.150+0000 7f8acc7f6640 1 -- 172.21.15.117:0/496806862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ac4072590 msgr2=0x7f8ac40b70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:10.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.150+0000 7f8acc7f6640 1 --2- 172.21.15.117:0/496806862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ac4072590 0x7f8ac40b70a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009e80 tx=0x7f8abc004a40 comp rx=0 tx=0).stop 2024-09-19T08:37:10.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.150+0000 7f8acc7f6640 1 -- 172.21.15.117:0/496806862 shutdown_connections 2024-09-19T08:37:10.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.150+0000 7f8acc7f6640 1 --2- 172.21.15.117:0/496806862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ac4143a60 0x7f8ac415ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:10.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.150+0000 7f8acc7f6640 1 --2- 172.21.15.117:0/496806862 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f8aa806c2e0 0x7f8aa806e7a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:10.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.150+0000 7f8acc7f6640 1 --2- 172.21.15.117:0/496806862 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ac40d21f0 0x7f8ac4140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:10.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.150+0000 7f8acc7f6640 1 --2- 172.21.15.117:0/496806862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ac4072590 0x7f8ac40b70a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:10.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.150+0000 7f8acc7f6640 1 -- 172.21.15.117:0/496806862 >> 172.21.15.117:0/496806862 conn(0x7f8ac40b3ed0 msgr2=0x7f8ac40b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:10.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.150+0000 7f8acc7f6640 1 -- 172.21.15.117:0/496806862 shutdown_connections 2024-09-19T08:37:10.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.150+0000 7f8acc7f6640 1 -- 172.21.15.117:0/496806862 wait complete. 2024-09-19T08:37:10.160 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T08:37:10.160 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T08:37:10.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.262+0000 7fdf120e4640 1 Processor -- start 2024-09-19T08:37:10.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.262+0000 7fdf120e4640 1 -- start start 2024-09-19T08:37:10.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.263+0000 7fdf120e4640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdf0c0d2750 0x7fdf0c13f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:10.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.263+0000 7fdf120e4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0c072250 0x7fdf0c0cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:10.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.263+0000 7fdf120e4640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf0c13fda0 con 0x7fdf0c072690 2024-09-19T08:37:10.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.263+0000 7fdf120e4640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fdf0c145bd0 con 0x7fdf0c0d2750 2024-09-19T08:37:10.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.263+0000 7fdf120e4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fdf0c1427e0 con 0x7fdf0c072250 2024-09-19T08:37:10.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.263+0000 7fdf0b7fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdf0c0d2750 0x7fdf0c13f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:10.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.264+0000 7fdf0b7fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdf0c0d2750 0x7fdf0c13f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.117:46186/0 (socket says 172.21.15.117:46186) 2024-09-19T08:37:10.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.264+0000 7fdf0affd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0c072250 0x7fdf0c0cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:10.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.264+0000 7fdf0b7fe640 1 -- 172.21.15.117:0/1972975222 learned_addr learned my addr 172.21.15.117:0/1972975222 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:10.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.264+0000 7fdf0bfff640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdf0c072690 0x7fdf0c160010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.117:33736/0 (socket says 172.21.15.117:33736) 2024-09-19T08:37:10.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.264+0000 7fdf0b7fe640 1 -- 172.21.15.117:0/1972975222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0c072250 msgr2=0x7fdf0c0cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:10.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.264+0000 7fdf0b7fe640 1 --2- 172.21.15.117:0/1972975222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0c072250 0x7fdf0c0cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:10.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.264+0000 7fdf0b7fe640 1 -- 172.21.15.117:0/1972975222 >> v1:172.21.15.146:6789/0 conn(0x7fdf0c072690 legacy=0x7fdf0c160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:10.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.264+0000 7fdf0b7fe640 1 -- 172.21.15.117:0/1972975222 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0c0d2b30 con 0x7fdf0c0d2750 2024-09-19T08:37:10.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.265+0000 7fdf0b7fe640 1 --2- 172.21.15.117:0/1972975222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf0c0d2750 0x7fdf0c13f860 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdefc009870 tx=0x7fdefc02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8073969bc77d6ac0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:10.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.265+0000 7fdf0a7fc640 1 -- 172.21.15.117:0/1972975222 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdefc037070 con 0x7fdf0c0d2750 2024-09-19T08:37:10.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.265+0000 7fdf0a7fc640 1 -- 172.21.15.117:0/1972975222 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdefc032440 con 0x7fdf0c0d2750 2024-09-19T08:37:10.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.265+0000 7fdf0a7fc640 1 -- 172.21.15.117:0/1972975222 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdefc032810 con 0x7fdf0c0d2750 2024-09-19T08:37:10.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.265+0000 7fdf120e4640 1 -- 172.21.15.117:0/1972975222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf0c0d2750 msgr2=0x7fdf0c13f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:10.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.265+0000 7fdf120e4640 1 --2- 172.21.15.117:0/1972975222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf0c0d2750 0x7fdf0c13f860 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdefc009870 tx=0x7fdefc02a1c0 comp rx=0 tx=0).stop 2024-09-19T08:37:10.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.265+0000 7fdf120e4640 1 -- 172.21.15.117:0/1972975222 shutdown_connections 2024-09-19T08:37:10.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.265+0000 7fdf120e4640 1 --2- 172.21.15.117:0/1972975222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0c072250 0x7fdf0c0cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:10.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.265+0000 7fdf120e4640 1 --2- 172.21.15.117:0/1972975222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf0c0d2750 0x7fdf0c13f860 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:10.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.265+0000 7fdf120e4640 1 -- 172.21.15.117:0/1972975222 >> 172.21.15.117:0/1972975222 conn(0x7fdf0c0b4040 msgr2=0x7fdf0c0b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:10.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.265+0000 7fdf120e4640 1 -- 172.21.15.117:0/1972975222 shutdown_connections 2024-09-19T08:37:10.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.265+0000 7fdf120e4640 1 -- 172.21.15.117:0/1972975222 wait complete. 2024-09-19T08:37:10.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.266+0000 7fdf120e4640 1 Processor -- start 2024-09-19T08:37:10.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.267+0000 7fdf120e4640 1 -- start start 2024-09-19T08:37:10.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.267+0000 7fdf120e4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0c072250 0x7fdf0c159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:10.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.267+0000 7fdf120e4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf0c072690 0x7fdf0c13ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:10.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.267+0000 7fdf120e4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf0c0d2750 0x7fdf0c0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:10.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.267+0000 7fdf120e4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0c142220 con 0x7fdf0c0d2750 2024-09-19T08:37:10.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.267+0000 7fdf120e4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0c141f40 con 0x7fdf0c072690 2024-09-19T08:37:10.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.267+0000 7fdf120e4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fdf0c142500 con 0x7fdf0c072250 2024-09-19T08:37:10.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.267+0000 7fdf0bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf0c0d2750 0x7fdf0c0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:10.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.267+0000 7fdf0bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf0c0d2750 0x7fdf0c0b77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44772/0 (socket says 172.21.15.117:44772) 2024-09-19T08:37:10.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.268+0000 7fdf0bfff640 1 -- 172.21.15.117:0/2127015275 learned_addr learned my addr 172.21.15.117:0/2127015275 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:10.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.268+0000 7fdf0affd640 1 --2- 172.21.15.117:0/2127015275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf0c072690 0x7fdf0c13ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:10.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.268+0000 7fdf0b7fe640 1 --2- 172.21.15.117:0/2127015275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0c072250 0x7fdf0c159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:10.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.268+0000 7fdf0bfff640 1 -- 172.21.15.117:0/2127015275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0c072250 msgr2=0x7fdf0c159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:10.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.268+0000 7fdf0bfff640 1 --2- 172.21.15.117:0/2127015275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0c072250 0x7fdf0c159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:10.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.268+0000 7fdf0bfff640 1 -- 172.21.15.117:0/2127015275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf0c072690 msgr2=0x7fdf0c13ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:10.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.268+0000 7fdf0bfff640 1 --2- 172.21.15.117:0/2127015275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf0c072690 0x7fdf0c13ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:10.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.268+0000 7fdf0bfff640 1 -- 172.21.15.117:0/2127015275 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0c0cbbd0 con 0x7fdf0c0d2750 2024-09-19T08:37:10.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.268+0000 7fdf0bfff640 1 --2- 172.21.15.117:0/2127015275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf0c0d2750 0x7fdf0c0b77e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400c760 tx=0x7fdf0400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:10.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.268+0000 7fdef3fff640 1 -- 172.21.15.117:0/2127015275 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf04017070 con 0x7fdf0c0d2750 2024-09-19T08:37:10.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.268+0000 7fdef3fff640 1 -- 172.21.15.117:0/2127015275 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf0400a640 con 0x7fdf0c0d2750 2024-09-19T08:37:10.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.268+0000 7fdf120e4640 1 -- 172.21.15.117:0/2127015275 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf0c0b5300 con 0x7fdf0c0d2750 2024-09-19T08:37:10.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.268+0000 7fdef3fff640 1 -- 172.21.15.117:0/2127015275 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0400a9f0 con 0x7fdf0c0d2750 2024-09-19T08:37:10.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.268+0000 7fdf120e4640 1 -- 172.21.15.117:0/2127015275 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf0c0b58c0 con 0x7fdf0c0d2750 2024-09-19T08:37:10.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.269+0000 7fdf120e4640 1 -- 172.21.15.117:0/2127015275 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf0c0756e0 con 0x7fdf0c0d2750 2024-09-19T08:37:10.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.269+0000 7fdef3fff640 1 -- 172.21.15.117:0/2127015275 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdf0401a070 con 0x7fdf0c0d2750 2024-09-19T08:37:10.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.270+0000 7fdef3fff640 1 --2- 172.21.15.117:0/2127015275 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fdef806c2b0 0x7fdef806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:10.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.270+0000 7fdef3fff640 1 -- 172.21.15.117:0/2127015275 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fdf0408a590 con 0x7fdf0c0d2750 2024-09-19T08:37:10.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.270+0000 7fdf0b7fe640 1 --2- 172.21.15.117:0/2127015275 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fdef806c2b0 0x7fdef806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:10.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.271+0000 7fdf0b7fe640 1 --2- 172.21.15.117:0/2127015275 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fdef806c2b0 0x7fdef806e770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdefc034000 tx=0x7fdefc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:10.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.274+0000 7fdef3fff640 1 -- 172.21.15.117:0/2127015275 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fdf0c0756e0 con 0x7fdf0c0d2750 2024-09-19T08:37:10.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:10.444+0000 7fdf120e4640 1 -- 172.21.15.117:0/2127015275 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fdf0c0b1a30 con 0x7fdf0c0d2750 2024-09-19T08:37:11.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.291+0000 7fdef3fff640 1 -- 172.21.15.117:0/2127015275 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7fdf0c0b1a30 con 0x7fdf0c0d2750 2024-09-19T08:37:11.291 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'cephfs_metadata' created 2024-09-19T08:37:11.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.293+0000 7fdf120e4640 1 -- 172.21.15.117:0/2127015275 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fdef806c2b0 msgr2=0x7fdef806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:11.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.293+0000 7fdf120e4640 1 --2- 172.21.15.117:0/2127015275 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fdef806c2b0 0x7fdef806e770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdefc034000 tx=0x7fdefc02e000 comp rx=0 tx=0).stop 2024-09-19T08:37:11.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.293+0000 7fdf120e4640 1 -- 172.21.15.117:0/2127015275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf0c0d2750 msgr2=0x7fdf0c0b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:11.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.293+0000 7fdf120e4640 1 --2- 172.21.15.117:0/2127015275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf0c0d2750 0x7fdf0c0b77e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400c760 tx=0x7fdf0400cc20 comp rx=0 tx=0).stop 2024-09-19T08:37:11.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.293+0000 7fdf120e4640 1 -- 172.21.15.117:0/2127015275 shutdown_connections 2024-09-19T08:37:11.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.294+0000 7fdf120e4640 1 --2- 172.21.15.117:0/2127015275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf0c0d2750 0x7fdf0c0b77e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:11.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.294+0000 7fdf120e4640 1 --2- 172.21.15.117:0/2127015275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf0c072690 0x7fdf0c13ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:11.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.294+0000 7fdf120e4640 1 --2- 172.21.15.117:0/2127015275 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fdef806c2b0 0x7fdef806e770 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:11.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.294+0000 7fdf120e4640 1 --2- 172.21.15.117:0/2127015275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0c072250 0x7fdf0c159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:11.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.294+0000 7fdf120e4640 1 -- 172.21.15.117:0/2127015275 >> 172.21.15.117:0/2127015275 conn(0x7fdf0c0b4040 msgr2=0x7fdf0c1407e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:11.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.294+0000 7fdf120e4640 1 -- 172.21.15.117:0/2127015275 shutdown_connections 2024-09-19T08:37:11.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.294+0000 7fdf120e4640 1 -- 172.21.15.117:0/2127015275 wait complete. 2024-09-19T08:37:11.311 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-19T08:37:11.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.420+0000 7f62c402e640 1 Processor -- start 2024-09-19T08:37:11.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.421+0000 7f62c402e640 1 -- start start 2024-09-19T08:37:11.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.421+0000 7f62c402e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f62bc15c0d0 0x7f62bc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:11.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.421+0000 7f62c402e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62bc0af770 0x7f62bc06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:11.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.421+0000 7f62c402e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62bc073770 con 0x7f62bc0cd590 2024-09-19T08:37:11.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.421+0000 7f62c402e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f62bc0b5120 con 0x7f62bc15c0d0 2024-09-19T08:37:11.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.421+0000 7f62c402e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f62bc0b65c0 con 0x7f62bc0af770 2024-09-19T08:37:11.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c25cb640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f62bc0cd590 0x7f62bc15fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:59088/0 (socket says 172.21.15.117:59088) 2024-09-19T08:37:11.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c25cb640 1 -- 172.21.15.117:0/168894264 learned_addr learned my addr 172.21.15.117:0/168894264 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:11.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c15c9640 1 --2- 172.21.15.117:0/168894264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62bc0af770 0x7f62bc06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:11.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c1dca640 1 --2- 172.21.15.117:0/168894264 >> v2:172.21.15.146:3300/0 conn(0x7f62bc15c0d0 0x7f62bc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:11.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c0dc8640 1 -- 172.21.15.117:0/168894264 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 825940151 0 0) 0x7f62bc073770 con 0x7f62bc0cd590 2024-09-19T08:37:11.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c0dc8640 1 -- 172.21.15.117:0/168894264 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62a8003520 con 0x7f62bc0cd590 2024-09-19T08:37:11.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c0dc8640 1 -- 172.21.15.117:0/168894264 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4027631986 0 0) 0x7f62a8003520 con 0x7f62bc0cd590 2024-09-19T08:37:11.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c0dc8640 1 -- 172.21.15.117:0/168894264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62bc0af770 msgr2=0x7f62bc06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:11.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c0dc8640 1 --2- 172.21.15.117:0/168894264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62bc0af770 0x7f62bc06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:11.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c0dc8640 1 -- 172.21.15.117:0/168894264 >> v2:172.21.15.146:3300/0 conn(0x7f62bc15c0d0 msgr2=0x7f62bc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:11.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c0dc8640 1 --2- 172.21.15.117:0/168894264 >> v2:172.21.15.146:3300/0 conn(0x7f62bc15c0d0 0x7f62bc06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:11.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c0dc8640 1 -- 172.21.15.117:0/168894264 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62bc15c4b0 con 0x7f62bc0cd590 2024-09-19T08:37:11.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c0dc8640 1 -- 172.21.15.117:0/168894264 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f62b40019f0 con 0x7f62bc0cd590 2024-09-19T08:37:11.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c0dc8640 1 -- 172.21.15.117:0/168894264 >> v1:172.21.15.117:6789/0 conn(0x7f62bc0cd590 legacy=0x7f62bc15fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:11.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c0dc8640 1 --2- 172.21.15.117:0/168894264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62bc0af770 0x7f62a80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:11.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c0dc8640 1 --2- 172.21.15.117:0/168894264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a8003f30 0x7f62a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:11.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c0dc8640 1 --2- 172.21.15.117:0/168894264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62a8004d40 0x7f62a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:11.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c0dc8640 1 -- 172.21.15.117:0/168894264 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f62bc0b65c0 con 0x7f62a8004d40 2024-09-19T08:37:11.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c0dc8640 1 -- 172.21.15.117:0/168894264 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f62a800b9c0 con 0x7f62a8003f30 2024-09-19T08:37:11.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c0dc8640 1 -- 172.21.15.117:0/168894264 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f62a800bb90 con 0x7f62bc0af770 2024-09-19T08:37:11.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c25cb640 1 --2- 172.21.15.117:0/168894264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62a8004d40 0x7f62a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:11.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c1dca640 1 --2- 172.21.15.117:0/168894264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62bc0af770 0x7f62a80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:11.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.422+0000 7f62c15c9640 1 --2- 172.21.15.117:0/168894264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a8003f30 0x7f62a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:11.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.423+0000 7f62c25cb640 1 -- 172.21.15.117:0/168894264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62bc0af770 msgr2=0x7f62a80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:11.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.423+0000 7f62c25cb640 1 --2- 172.21.15.117:0/168894264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62bc0af770 0x7f62a80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:11.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.423+0000 7f62c25cb640 1 -- 172.21.15.117:0/168894264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a8003f30 msgr2=0x7f62a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:11.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.423+0000 7f62c25cb640 1 --2- 172.21.15.117:0/168894264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a8003f30 0x7f62a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:11.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.423+0000 7f62c25cb640 1 -- 172.21.15.117:0/168894264 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a8003520 con 0x7f62a8004d40 2024-09-19T08:37:11.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.423+0000 7f62c25cb640 1 --2- 172.21.15.117:0/168894264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62a8004d40 0x7f62a80051c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f62b400a8b0 tx=0x7f62a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67fee2c67dbad3cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:11.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.423+0000 7f62c0dc8640 1 -- 172.21.15.117:0/168894264 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b400a4a0 con 0x7f62a8004d40 2024-09-19T08:37:11.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.423+0000 7f62c0dc8640 1 -- 172.21.15.117:0/168894264 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62b402f070 con 0x7f62a8004d40 2024-09-19T08:37:11.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.423+0000 7f62c0dc8640 1 -- 172.21.15.117:0/168894264 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b402bcf0 con 0x7f62a8004d40 2024-09-19T08:37:11.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.424+0000 7f62c402e640 1 -- 172.21.15.117:0/168894264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62a8004d40 msgr2=0x7f62a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:11.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.424+0000 7f62c402e640 1 --2- 172.21.15.117:0/168894264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62a8004d40 0x7f62a80051c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f62b400a8b0 tx=0x7f62a8005830 comp rx=0 tx=0).stop 2024-09-19T08:37:11.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.424+0000 7f62c25cb640 1 -- 172.21.15.117:0/168894264 reap_dead start 2024-09-19T08:37:11.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.424+0000 7f62c402e640 1 -- 172.21.15.117:0/168894264 shutdown_connections 2024-09-19T08:37:11.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.424+0000 7f62c402e640 1 -- 172.21.15.117:0/168894264 >> 172.21.15.117:0/168894264 conn(0x7f62bc0b67c0 msgr2=0x7f62bc0b2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:11.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.424+0000 7f62c402e640 1 -- 172.21.15.117:0/168894264 shutdown_connections 2024-09-19T08:37:11.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.424+0000 7f62c402e640 1 -- 172.21.15.117:0/168894264 wait complete. 2024-09-19T08:37:11.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.425+0000 7f62c402e640 1 Processor -- start 2024-09-19T08:37:11.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.425+0000 7f62c402e640 1 -- start start 2024-09-19T08:37:11.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.426+0000 7f62c402e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a8004d40 0x7f62bc155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:11.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.426+0000 7f62c402e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62bc151aa0 0x7f62bc148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:11.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.426+0000 7f62c402e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62bc152790 0x7f62bc152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:11.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.426+0000 7f62c402e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f62bc0b6320 con 0x7f62bc152790 2024-09-19T08:37:11.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.426+0000 7f62c402e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f62bc09ab90 con 0x7f62a8004d40 2024-09-19T08:37:11.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.426+0000 7f62c402e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f62bc0b3570 con 0x7f62bc151aa0 2024-09-19T08:37:11.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.426+0000 7f62c25cb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62bc152790 0x7f62bc152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:11.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.426+0000 7f62c25cb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62bc152790 0x7f62bc152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44800/0 (socket says 172.21.15.117:44800) 2024-09-19T08:37:11.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.426+0000 7f62c25cb640 1 -- 172.21.15.117:0/2695956038 learned_addr learned my addr 172.21.15.117:0/2695956038 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:11.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.426+0000 7f62c15c9640 1 --2- 172.21.15.117:0/2695956038 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62bc151aa0 0x7f62bc148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:11.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.426+0000 7f62c1dca640 1 --2- 172.21.15.117:0/2695956038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a8004d40 0x7f62bc155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:11.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.427+0000 7f62c25cb640 1 -- 172.21.15.117:0/2695956038 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62bc151aa0 msgr2=0x7f62bc148970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:11.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.427+0000 7f62c25cb640 1 --2- 172.21.15.117:0/2695956038 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62bc151aa0 0x7f62bc148970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:11.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.427+0000 7f62c25cb640 1 -- 172.21.15.117:0/2695956038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a8004d40 msgr2=0x7f62bc155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:11.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.427+0000 7f62c25cb640 1 --2- 172.21.15.117:0/2695956038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a8004d40 0x7f62bc155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:11.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.427+0000 7f62c25cb640 1 -- 172.21.15.117:0/2695956038 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62bc0cfe90 con 0x7f62bc152790 2024-09-19T08:37:11.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.427+0000 7f62c25cb640 1 --2- 172.21.15.117:0/2695956038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62bc152790 0x7f62bc152c10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f62b4000f80 tx=0x7f62bc09ab00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:11.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.427+0000 7f62b27fc640 1 -- 172.21.15.117:0/2695956038 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b4044070 con 0x7f62bc152790 2024-09-19T08:37:11.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.427+0000 7f62b27fc640 1 -- 172.21.15.117:0/2695956038 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62b4034470 con 0x7f62bc152790 2024-09-19T08:37:11.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.427+0000 7f62b27fc640 1 -- 172.21.15.117:0/2695956038 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b400a4a0 con 0x7f62bc152790 2024-09-19T08:37:11.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.427+0000 7f62c402e640 1 -- 172.21.15.117:0/2695956038 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62bc0d0170 con 0x7f62bc152790 2024-09-19T08:37:11.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.427+0000 7f62c402e640 1 -- 172.21.15.117:0/2695956038 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62bc0d0730 con 0x7f62bc152790 2024-09-19T08:37:11.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.428+0000 7f62c402e640 1 -- 172.21.15.117:0/2695956038 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62bc0b5320 con 0x7f62bc152790 2024-09-19T08:37:11.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.428+0000 7f62b27fc640 1 -- 172.21.15.117:0/2695956038 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f62b4047070 con 0x7f62bc152790 2024-09-19T08:37:11.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.429+0000 7f62b27fc640 1 --2- 172.21.15.117:0/2695956038 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f62a006c2e0 0x7f62a006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:11.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.429+0000 7f62b27fc640 1 -- 172.21.15.117:0/2695956038 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f62b40aaf90 con 0x7f62bc152790 2024-09-19T08:37:11.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.429+0000 7f62c1dca640 1 --2- 172.21.15.117:0/2695956038 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f62a006c2e0 0x7f62a006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:11.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.430+0000 7f62c1dca640 1 --2- 172.21.15.117:0/2695956038 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f62a006c2e0 0x7f62a006e7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f62b8009c40 tx=0x7f62b8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:11.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.433+0000 7f62b27fc640 1 -- 172.21.15.117:0/2695956038 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f62b4079980 con 0x7f62bc152790 2024-09-19T08:37:11.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:11.600+0000 7f62c402e640 1 -- 172.21.15.117:0/2695956038 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f62bc155bb0 con 0x7f62bc152790 2024-09-19T08:37:12.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.298+0000 7f62b27fc640 1 -- 172.21.15.117:0/2695956038 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) ==== 171+0+0 (secure 0 0 0) 0x7f62b4079280 con 0x7f62bc152790 2024-09-19T08:37:12.298 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'cephfs_data' created 2024-09-19T08:37:12.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.300+0000 7f62c402e640 1 -- 172.21.15.117:0/2695956038 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f62a006c2e0 msgr2=0x7f62a006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:12.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.300+0000 7f62c402e640 1 --2- 172.21.15.117:0/2695956038 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f62a006c2e0 0x7f62a006e7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f62b8009c40 tx=0x7f62b8009190 comp rx=0 tx=0).stop 2024-09-19T08:37:12.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.300+0000 7f62c402e640 1 -- 172.21.15.117:0/2695956038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62bc152790 msgr2=0x7f62bc152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:12.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.300+0000 7f62c402e640 1 --2- 172.21.15.117:0/2695956038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62bc152790 0x7f62bc152c10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f62b4000f80 tx=0x7f62bc09ab00 comp rx=0 tx=0).stop 2024-09-19T08:37:12.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.300+0000 7f62c402e640 1 -- 172.21.15.117:0/2695956038 shutdown_connections 2024-09-19T08:37:12.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.300+0000 7f62c402e640 1 --2- 172.21.15.117:0/2695956038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62bc152790 0x7f62bc152c10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:12.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.300+0000 7f62c402e640 1 --2- 172.21.15.117:0/2695956038 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f62a006c2e0 0x7f62a006e7a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:12.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.300+0000 7f62c402e640 1 --2- 172.21.15.117:0/2695956038 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62bc151aa0 0x7f62bc148970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:12.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.300+0000 7f62c402e640 1 --2- 172.21.15.117:0/2695956038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a8004d40 0x7f62bc155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:12.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.300+0000 7f62c402e640 1 -- 172.21.15.117:0/2695956038 >> 172.21.15.117:0/2695956038 conn(0x7f62bc0b67c0 msgr2=0x7f62bc158ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:12.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.300+0000 7f62c402e640 1 -- 172.21.15.117:0/2695956038 shutdown_connections 2024-09-19T08:37:12.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.300+0000 7f62c402e640 1 -- 172.21.15.117:0/2695956038 wait complete. 2024-09-19T08:37:12.325 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T08:37:12.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.426+0000 7f1e43e8b640 1 Processor -- start 2024-09-19T08:37:12.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.427+0000 7f1e43e8b640 1 -- start start 2024-09-19T08:37:12.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.427+0000 7f1e43e8b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1e3c141470 0x7f1e3c141b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:12.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.427+0000 7f1e43e8b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e3c06ce70 0x7f1e3c06d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:12.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.427+0000 7f1e43e8b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1e3c0d2130 0x7f1e3c0d2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:12.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.427+0000 7f1e43e8b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1e3c06d810 con 0x7f1e3c141470 2024-09-19T08:37:12.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.427+0000 7f1e43e8b640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f1e3c0d2ac0 con 0x7f1e3c0d2130 2024-09-19T08:37:12.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.427+0000 7f1e43e8b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f1e3c161f10 con 0x7f1e3c06ce70 2024-09-19T08:37:12.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.427+0000 7f1e41c27640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1e3c141470 0x7f1e3c141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:12.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.428+0000 7f1e41c27640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1e3c141470 0x7f1e3c141b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44808/0 (socket says 172.21.15.117:44808) 2024-09-19T08:37:12.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.428+0000 7f1e41c27640 1 -- 172.21.15.117:0/1795355096 learned_addr learned my addr 172.21.15.117:0/1795355096 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:12.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.428+0000 7f1e41426640 1 --2- 172.21.15.117:0/1795355096 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e3c06ce70 0x7f1e3c06d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:12.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.428+0000 7f1e42428640 1 --2- 172.21.15.117:0/1795355096 >> v2:172.21.15.146:3300/0 conn(0x7f1e3c0d2130 0x7f1e3c0d2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:12.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.428+0000 7f1e41c27640 1 -- 172.21.15.117:0/1795355096 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e3c06ce70 msgr2=0x7f1e3c06d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:12.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.428+0000 7f1e41c27640 1 --2- 172.21.15.117:0/1795355096 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e3c06ce70 0x7f1e3c06d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:12.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.428+0000 7f1e41c27640 1 -- 172.21.15.117:0/1795355096 >> v2:172.21.15.146:3300/0 conn(0x7f1e3c0d2130 msgr2=0x7f1e3c0d2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:12.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.428+0000 7f1e41c27640 1 --2- 172.21.15.117:0/1795355096 >> v2:172.21.15.146:3300/0 conn(0x7f1e3c0d2130 0x7f1e3c0d2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:12.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.428+0000 7f1e41c27640 1 -- 172.21.15.117:0/1795355096 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e3c141850 con 0x7f1e3c141470 2024-09-19T08:37:12.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.428+0000 7f1e41c27640 1 --2- 172.21.15.117:0/1795355096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c141470 0x7f1e3c141b70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c073e70 tx=0x7f1e2c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71084e5decae574 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:12.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.429+0000 7f1e40c25640 1 -- 172.21.15.117:0/1795355096 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c036070 con 0x7f1e3c141470 2024-09-19T08:37:12.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.429+0000 7f1e40c25640 1 -- 172.21.15.117:0/1795355096 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e2c031600 con 0x7f1e3c141470 2024-09-19T08:37:12.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.429+0000 7f1e40c25640 1 -- 172.21.15.117:0/1795355096 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0319d0 con 0x7f1e3c141470 2024-09-19T08:37:12.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.429+0000 7f1e43e8b640 1 -- 172.21.15.117:0/1795355096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c141470 msgr2=0x7f1e3c141b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:12.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.429+0000 7f1e43e8b640 1 --2- 172.21.15.117:0/1795355096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c141470 0x7f1e3c141b70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c073e70 tx=0x7f1e2c02a6a0 comp rx=0 tx=0).stop 2024-09-19T08:37:12.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.429+0000 7f1e43e8b640 1 -- 172.21.15.117:0/1795355096 shutdown_connections 2024-09-19T08:37:12.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.429+0000 7f1e43e8b640 1 --2- 172.21.15.117:0/1795355096 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e3c06ce70 0x7f1e3c06d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:12.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.429+0000 7f1e43e8b640 1 --2- 172.21.15.117:0/1795355096 >> v2:172.21.15.146:3300/0 conn(0x7f1e3c0d2130 0x7f1e3c0d2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:12.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.429+0000 7f1e43e8b640 1 --2- 172.21.15.117:0/1795355096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c141470 0x7f1e3c141b70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:12.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.429+0000 7f1e43e8b640 1 -- 172.21.15.117:0/1795355096 >> 172.21.15.117:0/1795355096 conn(0x7f1e3c0b4040 msgr2=0x7f1e3c0b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:12.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.429+0000 7f1e43e8b640 1 -- 172.21.15.117:0/1795355096 shutdown_connections 2024-09-19T08:37:12.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.429+0000 7f1e43e8b640 1 -- 172.21.15.117:0/1795355096 wait complete. 2024-09-19T08:37:12.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.430+0000 7f1e43e8b640 1 Processor -- start 2024-09-19T08:37:12.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.431+0000 7f1e43e8b640 1 -- start start 2024-09-19T08:37:12.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.431+0000 7f1e43e8b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e3c06ce70 0x7f1e3c15dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:12.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.431+0000 7f1e43e8b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e3c0d2130 0x7f1e3c0d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:12.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.431+0000 7f1e43e8b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c141470 0x7f1e3c0d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:12.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.431+0000 7f1e43e8b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3c162770 con 0x7f1e3c141470 2024-09-19T08:37:12.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.431+0000 7f1e43e8b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3c162490 con 0x7f1e3c0d2130 2024-09-19T08:37:12.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.431+0000 7f1e43e8b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f1e3c162a50 con 0x7f1e3c06ce70 2024-09-19T08:37:12.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.431+0000 7f1e42428640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c141470 0x7f1e3c0d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:12.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.431+0000 7f1e42428640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c141470 0x7f1e3c0d1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44814/0 (socket says 172.21.15.117:44814) 2024-09-19T08:37:12.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.431+0000 7f1e42428640 1 -- 172.21.15.117:0/454239153 learned_addr learned my addr 172.21.15.117:0/454239153 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:12.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.431+0000 7f1e41426640 1 --2- 172.21.15.117:0/454239153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e3c0d2130 0x7f1e3c0d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:12.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.432+0000 7f1e41c27640 1 --2- 172.21.15.117:0/454239153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e3c06ce70 0x7f1e3c15dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:12.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.432+0000 7f1e42428640 1 -- 172.21.15.117:0/454239153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e3c06ce70 msgr2=0x7f1e3c15dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:12.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.432+0000 7f1e42428640 1 --2- 172.21.15.117:0/454239153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e3c06ce70 0x7f1e3c15dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:12.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.432+0000 7f1e42428640 1 -- 172.21.15.117:0/454239153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e3c0d2130 msgr2=0x7f1e3c0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:12.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.432+0000 7f1e42428640 1 --2- 172.21.15.117:0/454239153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e3c0d2130 0x7f1e3c0d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:12.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.432+0000 7f1e42428640 1 -- 172.21.15.117:0/454239153 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e3c0b5160 con 0x7f1e3c141470 2024-09-19T08:37:12.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.432+0000 7f1e42428640 1 --2- 172.21.15.117:0/454239153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c141470 0x7f1e3c0d1ae0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400d800 tx=0x7f1e3400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:12.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.432+0000 7f1e3a7fc640 1 -- 172.21.15.117:0/454239153 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3400b660 con 0x7f1e3c141470 2024-09-19T08:37:12.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.432+0000 7f1e3a7fc640 1 -- 172.21.15.117:0/454239153 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e34019070 con 0x7f1e3c141470 2024-09-19T08:37:12.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.432+0000 7f1e43e8b640 1 -- 172.21.15.117:0/454239153 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e3c15e0e0 con 0x7f1e3c141470 2024-09-19T08:37:12.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.432+0000 7f1e3a7fc640 1 -- 172.21.15.117:0/454239153 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3400ba60 con 0x7f1e3c141470 2024-09-19T08:37:12.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.432+0000 7f1e43e8b640 1 -- 172.21.15.117:0/454239153 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e3c0b56e0 con 0x7f1e3c141470 2024-09-19T08:37:12.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.433+0000 7f1e43e8b640 1 -- 172.21.15.117:0/454239153 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e3c162d30 con 0x7f1e3c141470 2024-09-19T08:37:12.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.433+0000 7f1e3a7fc640 1 -- 172.21.15.117:0/454239153 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1e3400bc00 con 0x7f1e3c141470 2024-09-19T08:37:12.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.434+0000 7f1e3a7fc640 1 --2- 172.21.15.117:0/454239153 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1e2806c2b0 0x7f1e2806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:12.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.434+0000 7f1e3a7fc640 1 -- 172.21.15.117:0/454239153 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f1e3408b720 con 0x7f1e3c141470 2024-09-19T08:37:12.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.434+0000 7f1e41c27640 1 --2- 172.21.15.117:0/454239153 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1e2806c2b0 0x7f1e2806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:12.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.435+0000 7f1e41c27640 1 --2- 172.21.15.117:0/454239153 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1e2806c2b0 0x7f1e2806e770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c033000 tx=0x7f1e2c009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:12.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.438+0000 7f1e3a7fc640 1 -- 172.21.15.117:0/454239153 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1e34059ef0 con 0x7f1e3c141470 2024-09-19T08:37:12.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:12.638+0000 7f1e43e8b640 1 -- 172.21.15.117:0/454239153 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1e3c0ae970 con 0x7f1e3c141470 2024-09-19T08:37:13.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.300+0000 7f1e3a7fc640 1 -- 172.21.15.117:0/454239153 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f1e340600c0 con 0x7f1e3c141470 2024-09-19T08:37:13.300 INFO:teuthology.orchestra.run.smithi117.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T08:37:13.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.302+0000 7f1e43e8b640 1 -- 172.21.15.117:0/454239153 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1e2806c2b0 msgr2=0x7f1e2806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:13.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.302+0000 7f1e43e8b640 1 --2- 172.21.15.117:0/454239153 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1e2806c2b0 0x7f1e2806e770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c033000 tx=0x7f1e2c009000 comp rx=0 tx=0).stop 2024-09-19T08:37:13.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.302+0000 7f1e43e8b640 1 -- 172.21.15.117:0/454239153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c141470 msgr2=0x7f1e3c0d1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:13.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.302+0000 7f1e43e8b640 1 --2- 172.21.15.117:0/454239153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c141470 0x7f1e3c0d1ae0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400d800 tx=0x7f1e3400dcc0 comp rx=0 tx=0).stop 2024-09-19T08:37:13.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.304+0000 7f1e43e8b640 1 -- 172.21.15.117:0/454239153 shutdown_connections 2024-09-19T08:37:13.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.304+0000 7f1e43e8b640 1 --2- 172.21.15.117:0/454239153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c141470 0x7f1e3c0d1ae0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:13.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.304+0000 7f1e43e8b640 1 --2- 172.21.15.117:0/454239153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e3c0d2130 0x7f1e3c0d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:13.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.304+0000 7f1e43e8b640 1 --2- 172.21.15.117:0/454239153 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1e2806c2b0 0x7f1e2806e770 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:13.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.304+0000 7f1e43e8b640 1 --2- 172.21.15.117:0/454239153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e3c06ce70 0x7f1e3c15dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:13.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.304+0000 7f1e43e8b640 1 -- 172.21.15.117:0/454239153 >> 172.21.15.117:0/454239153 conn(0x7f1e3c0b4040 msgr2=0x7f1e3c0b2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:13.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.304+0000 7f1e43e8b640 1 -- 172.21.15.117:0/454239153 shutdown_connections 2024-09-19T08:37:13.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.304+0000 7f1e43e8b640 1 -- 172.21.15.117:0/454239153 wait complete. 2024-09-19T08:37:13.334 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-19T08:37:13.334 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-19T08:37:13.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.437+0000 7fab0f877640 1 Processor -- start 2024-09-19T08:37:13.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.438+0000 7fab0f877640 1 -- start start 2024-09-19T08:37:13.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.438+0000 7fab0f877640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fab08161d90 0x7fab080cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:13.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.438+0000 7fab0f877640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab0806c990 con 0x7fab081619b0 2024-09-19T08:37:13.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.438+0000 7fab0f877640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab080cec10 con 0x7fab080b0a80 2024-09-19T08:37:13.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.438+0000 7fab0f877640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fab080ce930 con 0x7fab08161d90 2024-09-19T08:37:13.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.438+0000 7fab0de14640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fab08161d90 0x7fab080cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:13.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.438+0000 7fab0d613640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fab081619b0 0x7fab080d0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:59100/0 (socket says 172.21.15.117:59100) 2024-09-19T08:37:13.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.439+0000 7fab0d613640 1 -- 172.21.15.117:0/750125326 learned_addr learned my addr 172.21.15.117:0/750125326 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:13.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.439+0000 7fab0de14640 1 -- 172.21.15.117:0/750125326 >> v1:172.21.15.146:6789/0 conn(0x7fab080b0a80 legacy=0x7fab080cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:13.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.439+0000 7fab0de14640 1 -- 172.21.15.117:0/750125326 >> v1:172.21.15.117:6789/0 conn(0x7fab081619b0 legacy=0x7fab080d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:13.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.439+0000 7fab0de14640 1 -- 172.21.15.117:0/750125326 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab080b0540 con 0x7fab08161d90 2024-09-19T08:37:13.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.439+0000 7faafffff640 1 -- 172.21.15.117:0/750125326 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4272849997 0 0) 0x7fab0806c990 con 0x7fab081619b0 2024-09-19T08:37:13.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.439+0000 7fab0de14640 1 --2- 172.21.15.117:0/750125326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab08161d90 0x7fab080cc3e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fab00009d90 tx=0x7fab0002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ab25b5e5c661f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:13.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.440+0000 7faafffff640 1 -- 172.21.15.117:0/750125326 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab00007740 con 0x7fab08161d90 2024-09-19T08:37:13.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.440+0000 7faafffff640 1 -- 172.21.15.117:0/750125326 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab000078e0 con 0x7fab08161d90 2024-09-19T08:37:13.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.440+0000 7faafffff640 1 -- 172.21.15.117:0/750125326 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab00007cb0 con 0x7fab08161d90 2024-09-19T08:37:13.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.440+0000 7fab0f877640 1 -- 172.21.15.117:0/750125326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab08161d90 msgr2=0x7fab080cc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:13.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.440+0000 7fab0f877640 1 --2- 172.21.15.117:0/750125326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab08161d90 0x7fab080cc3e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fab00009d90 tx=0x7fab0002a6a0 comp rx=0 tx=0).stop 2024-09-19T08:37:13.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.440+0000 7fab0f877640 1 -- 172.21.15.117:0/750125326 shutdown_connections 2024-09-19T08:37:13.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.440+0000 7fab0f877640 1 --2- 172.21.15.117:0/750125326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab08161d90 0x7fab080cc3e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:13.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.440+0000 7fab0f877640 1 -- 172.21.15.117:0/750125326 >> 172.21.15.117:0/750125326 conn(0x7fab0809a9f0 msgr2=0x7fab080b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:13.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.440+0000 7fab0f877640 1 -- 172.21.15.117:0/750125326 shutdown_connections 2024-09-19T08:37:13.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.440+0000 7fab0f877640 1 -- 172.21.15.117:0/750125326 wait complete. 2024-09-19T08:37:13.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.441+0000 7fab0f877640 1 Processor -- start 2024-09-19T08:37:13.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.441+0000 7fab0f877640 1 -- start start 2024-09-19T08:37:13.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.442+0000 7fab0f877640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab080b0a80 0x7fab081f4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:13.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.442+0000 7fab0f877640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab081619b0 0x7fab080c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:13.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.442+0000 7fab0f877640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab08161d90 0x7fab081f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:13.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.442+0000 7fab0f877640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fab080cd330 con 0x7fab080b0a80 2024-09-19T08:37:13.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.442+0000 7fab0f877640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fab0806c620 con 0x7fab08161d90 2024-09-19T08:37:13.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.442+0000 7fab0f877640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fab080cd4b0 con 0x7fab081619b0 2024-09-19T08:37:13.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.442+0000 7fab0d613640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab080b0a80 0x7fab081f4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:13.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.442+0000 7fab0d613640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab080b0a80 0x7fab081f4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44836/0 (socket says 172.21.15.117:44836) 2024-09-19T08:37:13.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.442+0000 7fab0d613640 1 -- 172.21.15.117:0/401969244 learned_addr learned my addr 172.21.15.117:0/401969244 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:13.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.442+0000 7fab0d613640 1 -- 172.21.15.117:0/401969244 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab081619b0 msgr2=0x7fab080c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:13.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.442+0000 7fab0d613640 1 --2- 172.21.15.117:0/401969244 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab081619b0 0x7fab080c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:13.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.442+0000 7fab0d613640 1 -- 172.21.15.117:0/401969244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab08161d90 msgr2=0x7fab081f80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:13.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.442+0000 7fab0d613640 1 --2- 172.21.15.117:0/401969244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab08161d90 0x7fab081f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:13.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.442+0000 7fab0d613640 1 -- 172.21.15.117:0/401969244 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab081f4760 con 0x7fab080b0a80 2024-09-19T08:37:13.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.443+0000 7fab0d613640 1 --2- 172.21.15.117:0/401969244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab080b0a80 0x7fab081f4150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fab0400c4d0 tx=0x7fab0400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:13.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.443+0000 7faafdffb640 1 -- 172.21.15.117:0/401969244 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab04018070 con 0x7fab080b0a80 2024-09-19T08:37:13.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.443+0000 7faafdffb640 1 -- 172.21.15.117:0/401969244 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab04007500 con 0x7fab080b0a80 2024-09-19T08:37:13.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.443+0000 7fab0f877640 1 -- 172.21.15.117:0/401969244 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab081f4d20 con 0x7fab080b0a80 2024-09-19T08:37:13.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.443+0000 7faafdffb640 1 -- 172.21.15.117:0/401969244 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab04004a20 con 0x7fab080b0a80 2024-09-19T08:37:13.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.443+0000 7fab0f877640 1 -- 172.21.15.117:0/401969244 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab080c8470 con 0x7fab080b0a80 2024-09-19T08:37:13.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.444+0000 7fab0f877640 1 -- 172.21.15.117:0/401969244 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab081f86a0 con 0x7fab080b0a80 2024-09-19T08:37:13.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.444+0000 7faafdffb640 1 -- 172.21.15.117:0/401969244 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fab0401b070 con 0x7fab080b0a80 2024-09-19T08:37:13.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.445+0000 7faafdffb640 1 --2- 172.21.15.117:0/401969244 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faaec06c2b0 0x7faaec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:13.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.445+0000 7faafdffb640 1 -- 172.21.15.117:0/401969244 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fab0408a720 con 0x7fab080b0a80 2024-09-19T08:37:13.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.445+0000 7fab0ce12640 1 --2- 172.21.15.117:0/401969244 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faaec06c2b0 0x7faaec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:13.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.445+0000 7fab0ce12640 1 --2- 172.21.15.117:0/401969244 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faaec06c2b0 0x7faaec06e770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fab081f4690 tx=0x7faaf8007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:13.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.448+0000 7faafdffb640 1 -- 172.21.15.117:0/401969244 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fab04058f20 con 0x7fab080b0a80 2024-09-19T08:37:13.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:13.620+0000 7fab0f877640 1 -- 172.21.15.117:0/401969244 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fab080c8640 con 0x7fab080b0a80 2024-09-19T08:37:14.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.313+0000 7faafdffb640 1 -- 172.21.15.117:0/401969244 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) ==== 157+0+0 (secure 0 0 0) 0x7fab04058820 con 0x7fab080b0a80 2024-09-19T08:37:14.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.316+0000 7fab0f877640 1 -- 172.21.15.117:0/401969244 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faaec06c2b0 msgr2=0x7faaec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:14.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.316+0000 7fab0f877640 1 --2- 172.21.15.117:0/401969244 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faaec06c2b0 0x7faaec06e770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fab081f4690 tx=0x7faaf8007990 comp rx=0 tx=0).stop 2024-09-19T08:37:14.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.316+0000 7fab0f877640 1 -- 172.21.15.117:0/401969244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab080b0a80 msgr2=0x7fab081f4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:14.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.316+0000 7fab0f877640 1 --2- 172.21.15.117:0/401969244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab080b0a80 0x7fab081f4150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fab0400c4d0 tx=0x7fab0400c990 comp rx=0 tx=0).stop 2024-09-19T08:37:14.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.316+0000 7fab0f877640 1 -- 172.21.15.117:0/401969244 shutdown_connections 2024-09-19T08:37:14.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.316+0000 7fab0f877640 1 --2- 172.21.15.117:0/401969244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab08161d90 0x7fab081f80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:14.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.316+0000 7fab0f877640 1 --2- 172.21.15.117:0/401969244 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faaec06c2b0 0x7faaec06e770 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:14.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.316+0000 7fab0f877640 1 --2- 172.21.15.117:0/401969244 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab081619b0 0x7fab080c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:14.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.316+0000 7fab0f877640 1 --2- 172.21.15.117:0/401969244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab080b0a80 0x7fab081f4150 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:14.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.316+0000 7fab0f877640 1 -- 172.21.15.117:0/401969244 >> 172.21.15.117:0/401969244 conn(0x7fab0809a9f0 msgr2=0x7fab080cc720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:14.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.316+0000 7fab0f877640 1 -- 172.21.15.117:0/401969244 shutdown_connections 2024-09-19T08:37:14.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.316+0000 7fab0f877640 1 -- 172.21.15.117:0/401969244 wait complete. 2024-09-19T08:37:14.330 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T08:37:14.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.437+0000 7fc7fac3c640 1 Processor -- start 2024-09-19T08:37:14.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.437+0000 7fc7fac3c640 1 -- start start 2024-09-19T08:37:14.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.438+0000 7fc7fac3c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7f406cd20 0x7fc7f40b4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:14.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.438+0000 7fc7fac3c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc7f40b4570 0x7fc7f415e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:14.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.438+0000 7fc7fac3c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7f406d390 con 0x7fc7f41470f0 2024-09-19T08:37:14.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.438+0000 7fc7fac3c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc7f40b49e0 con 0x7fc7f40b4570 2024-09-19T08:37:14.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.438+0000 7fc7fac3c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fc7f406d160 con 0x7fc7f406cd20 2024-09-19T08:37:14.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.438+0000 7fc7f91d9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc7f40b4570 0x7fc7f415e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:14.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.438+0000 7fc7f91d9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc7f40b4570 0x7fc7f415e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54048/0 (socket says 172.21.15.117:54048) 2024-09-19T08:37:14.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.438+0000 7fc7f89d8640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fc7f41470f0 0x7fc7f4147a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:35756/0 (socket says 172.21.15.117:35756) 2024-09-19T08:37:14.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.438+0000 7fc7f91d9640 1 -- 172.21.15.117:0/3194471106 learned_addr learned my addr 172.21.15.117:0/3194471106 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:14.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.439+0000 7fc7ebfff640 1 --2- 172.21.15.117:0/3194471106 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7f406cd20 0x7fc7f40b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:14.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.439+0000 7fc7f91d9640 1 -- 172.21.15.117:0/3194471106 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7f406cd20 msgr2=0x7fc7f40b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:14.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.439+0000 7fc7f91d9640 1 --2- 172.21.15.117:0/3194471106 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7f406cd20 0x7fc7f40b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:14.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.439+0000 7fc7f91d9640 1 -- 172.21.15.117:0/3194471106 >> v1:172.21.15.117:6789/0 conn(0x7fc7f41470f0 legacy=0x7fc7f4147a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:14.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.439+0000 7fc7f91d9640 1 -- 172.21.15.117:0/3194471106 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f406d670 con 0x7fc7f40b4570 2024-09-19T08:37:14.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.439+0000 7fc7eb7fe640 1 -- 172.21.15.117:0/3194471106 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3133208943 0 0) 0x7fc7f406d390 con 0x7fc7f41470f0 2024-09-19T08:37:14.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.439+0000 7fc7f91d9640 1 --2- 172.21.15.117:0/3194471106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f40b4570 0x7fc7f415e890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec009e50 tx=0x7fc7ec02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29a85855304136 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:14.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.439+0000 7fc7eb7fe640 1 -- 172.21.15.117:0/3194471106 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec036070 con 0x7fc7f40b4570 2024-09-19T08:37:14.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.439+0000 7fc7eb7fe640 1 -- 172.21.15.117:0/3194471106 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ec031600 con 0x7fc7f40b4570 2024-09-19T08:37:14.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.439+0000 7fc7eb7fe640 1 -- 172.21.15.117:0/3194471106 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec0319d0 con 0x7fc7f40b4570 2024-09-19T08:37:14.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.440+0000 7fc7fac3c640 1 -- 172.21.15.117:0/3194471106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f40b4570 msgr2=0x7fc7f415e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:14.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.440+0000 7fc7fac3c640 1 --2- 172.21.15.117:0/3194471106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f40b4570 0x7fc7f415e890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec009e50 tx=0x7fc7ec02a710 comp rx=0 tx=0).stop 2024-09-19T08:37:14.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.440+0000 7fc7fac3c640 1 -- 172.21.15.117:0/3194471106 shutdown_connections 2024-09-19T08:37:14.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.440+0000 7fc7fac3c640 1 --2- 172.21.15.117:0/3194471106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f40b4570 0x7fc7f415e890 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:14.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.440+0000 7fc7fac3c640 1 --2- 172.21.15.117:0/3194471106 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7f406cd20 0x7fc7f40b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:14.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.440+0000 7fc7fac3c640 1 -- 172.21.15.117:0/3194471106 >> 172.21.15.117:0/3194471106 conn(0x7fc7f4067950 msgr2=0x7fc7f4067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:14.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.440+0000 7fc7fac3c640 1 -- 172.21.15.117:0/3194471106 shutdown_connections 2024-09-19T08:37:14.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.440+0000 7fc7fac3c640 1 -- 172.21.15.117:0/3194471106 wait complete. 2024-09-19T08:37:14.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.441+0000 7fc7fac3c640 1 Processor -- start 2024-09-19T08:37:14.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.441+0000 7fc7fac3c640 1 -- start start 2024-09-19T08:37:14.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.442+0000 7fc7fac3c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f406cd20 0x7fc7f40d0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:14.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.442+0000 7fc7fac3c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7f40b4570 0x7fc7f40ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:14.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.442+0000 7fc7fac3c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7f41470f0 0x7fc7f40cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:14.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.442+0000 7fc7fac3c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f406df10 con 0x7fc7f406cd20 2024-09-19T08:37:14.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.442+0000 7fc7fac3c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f406dc30 con 0x7fc7f41470f0 2024-09-19T08:37:14.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.442+0000 7fc7fac3c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fc7f41474d0 con 0x7fc7f40b4570 2024-09-19T08:37:14.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.442+0000 7fc7f89d8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f406cd20 0x7fc7f40d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:14.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.442+0000 7fc7f89d8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f406cd20 0x7fc7f40d0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54062/0 (socket says 172.21.15.117:54062) 2024-09-19T08:37:14.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.442+0000 7fc7f89d8640 1 -- 172.21.15.117:0/4204288318 learned_addr learned my addr 172.21.15.117:0/4204288318 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:14.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.442+0000 7fc7ebfff640 1 --2- 172.21.15.117:0/4204288318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7f40b4570 0x7fc7f40ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:14.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.442+0000 7fc7f91d9640 1 --2- 172.21.15.117:0/4204288318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7f41470f0 0x7fc7f40cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:14.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.443+0000 7fc7f89d8640 1 -- 172.21.15.117:0/4204288318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7f40b4570 msgr2=0x7fc7f40ceaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:14.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.443+0000 7fc7f89d8640 1 --2- 172.21.15.117:0/4204288318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7f40b4570 0x7fc7f40ceaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:14.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.443+0000 7fc7f89d8640 1 -- 172.21.15.117:0/4204288318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7f41470f0 msgr2=0x7fc7f40cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:14.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.443+0000 7fc7f89d8640 1 --2- 172.21.15.117:0/4204288318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7f41470f0 0x7fc7f40cdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:14.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.443+0000 7fc7f89d8640 1 -- 172.21.15.117:0/4204288318 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f40cf030 con 0x7fc7f406cd20 2024-09-19T08:37:14.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.443+0000 7fc7ebfff640 1 --2- 172.21.15.117:0/4204288318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7f40b4570 0x7fc7f40ceaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:14.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.443+0000 7fc7f89d8640 1 --2- 172.21.15.117:0/4204288318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f406cd20 0x7fc7f40d0370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000c430 tx=0x7fc7f000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:14.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.443+0000 7fc7e97fa640 1 -- 172.21.15.117:0/4204288318 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f00074e0 con 0x7fc7f406cd20 2024-09-19T08:37:14.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.443+0000 7fc7e97fa640 1 -- 172.21.15.117:0/4204288318 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f00047e0 con 0x7fc7f406cd20 2024-09-19T08:37:14.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.443+0000 7fc7fac3c640 1 -- 172.21.15.117:0/4204288318 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f40cf2d0 con 0x7fc7f406cd20 2024-09-19T08:37:14.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.443+0000 7fc7e97fa640 1 -- 172.21.15.117:0/4204288318 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f0004bd0 con 0x7fc7f406cd20 2024-09-19T08:37:14.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.443+0000 7fc7fac3c640 1 -- 172.21.15.117:0/4204288318 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f40cf890 con 0x7fc7f406cd20 2024-09-19T08:37:14.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.444+0000 7fc7fac3c640 1 -- 172.21.15.117:0/4204288318 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f40b4030 con 0x7fc7f406cd20 2024-09-19T08:37:14.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.444+0000 7fc7e97fa640 1 -- 172.21.15.117:0/4204288318 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc7f0011070 con 0x7fc7f406cd20 2024-09-19T08:37:14.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.445+0000 7fc7e97fa640 1 --2- 172.21.15.117:0/4204288318 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc7e006c2b0 0x7fc7e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:14.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.445+0000 7fc7e97fa640 1 -- 172.21.15.117:0/4204288318 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6007+0+0 (secure 0 0 0) 0x7fc7f008b1c0 con 0x7fc7f406cd20 2024-09-19T08:37:14.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.445+0000 7fc7ebfff640 1 --2- 172.21.15.117:0/4204288318 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc7e006c2b0 0x7fc7e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:14.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.446+0000 7fc7ebfff640 1 --2- 172.21.15.117:0/4204288318 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc7e006c2b0 0x7fc7e006e770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40d0b40 tx=0x7fc7e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:14.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.449+0000 7fc7e97fa640 1 -- 172.21.15.117:0/4204288318 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc7f000e280 con 0x7fc7f406cd20 2024-09-19T08:37:14.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:14.619+0000 7fc7fac3c640 1 -- 172.21.15.117:0/4204288318 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc7f40d2710 con 0x7fc7f406cd20 2024-09-19T08:37:16.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.326+0000 7fc7e97fa640 1 -- 172.21.15.117:0/4204288318 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) ==== 228+0+0 (secure 0 0 0) 0x7fc7f0059800 con 0x7fc7f406cd20 2024-09-19T08:37:16.327 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'cephfs_data_ec' created 2024-09-19T08:37:16.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.330+0000 7fc7fac3c640 1 -- 172.21.15.117:0/4204288318 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc7e006c2b0 msgr2=0x7fc7e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:16.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.330+0000 7fc7fac3c640 1 --2- 172.21.15.117:0/4204288318 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc7e006c2b0 0x7fc7e006e770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40d0b40 tx=0x7fc7e4008040 comp rx=0 tx=0).stop 2024-09-19T08:37:16.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.330+0000 7fc7fac3c640 1 -- 172.21.15.117:0/4204288318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f406cd20 msgr2=0x7fc7f40d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:16.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.330+0000 7fc7fac3c640 1 --2- 172.21.15.117:0/4204288318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f406cd20 0x7fc7f40d0370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000c430 tx=0x7fc7f000c8f0 comp rx=0 tx=0).stop 2024-09-19T08:37:16.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.330+0000 7fc7fac3c640 1 -- 172.21.15.117:0/4204288318 shutdown_connections 2024-09-19T08:37:16.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.330+0000 7fc7fac3c640 1 --2- 172.21.15.117:0/4204288318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7f41470f0 0x7fc7f40cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:16.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.330+0000 7fc7fac3c640 1 --2- 172.21.15.117:0/4204288318 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc7e006c2b0 0x7fc7e006e770 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:16.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.330+0000 7fc7fac3c640 1 --2- 172.21.15.117:0/4204288318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7f40b4570 0x7fc7f40ceaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:16.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.330+0000 7fc7fac3c640 1 --2- 172.21.15.117:0/4204288318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f406cd20 0x7fc7f40d0370 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:16.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.330+0000 7fc7fac3c640 1 -- 172.21.15.117:0/4204288318 >> 172.21.15.117:0/4204288318 conn(0x7fc7f4067950 msgr2=0x7fc7f41456f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:16.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.330+0000 7fc7fac3c640 1 -- 172.21.15.117:0/4204288318 shutdown_connections 2024-09-19T08:37:16.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.331+0000 7fc7fac3c640 1 -- 172.21.15.117:0/4204288318 wait complete. 2024-09-19T08:37:16.350 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-19T08:37:16.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.456+0000 7f7aa59c0640 1 Processor -- start 2024-09-19T08:37:16.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.456+0000 7f7aa59c0640 1 -- start start 2024-09-19T08:37:16.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.457+0000 7f7aa59c0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7aa015c3c0 0x7f7aa00cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:16.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.457+0000 7f7aa59c0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7aa009b100 0x7f7aa00d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:16.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.457+0000 7f7aa59c0640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa00cd030 con 0x7f7aa00d0790 2024-09-19T08:37:16.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.457+0000 7f7aa59c0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7aa00cd310 con 0x7f7aa015c3c0 2024-09-19T08:37:16.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.457+0000 7f7aa59c0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f7aa00cd5f0 con 0x7f7aa009b100 2024-09-19T08:37:16.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.457+0000 7f7a9effd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7aa015c3c0 0x7f7aa00cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:16.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.457+0000 7f7a9effd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7aa015c3c0 0x7f7aa00cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54066/0 (socket says 172.21.15.117:54066) 2024-09-19T08:37:16.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.457+0000 7f7a9effd640 1 -- 172.21.15.117:0/4022249060 learned_addr learned my addr 172.21.15.117:0/4022249060 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:16.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.458+0000 7f7a9effd640 1 -- 172.21.15.117:0/4022249060 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7aa009b100 msgr2=0x7f7aa00d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:16.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.458+0000 7f7a9effd640 1 --2- 172.21.15.117:0/4022249060 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7aa009b100 0x7f7aa00d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:16.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.458+0000 7f7a9effd640 1 -- 172.21.15.117:0/4022249060 >> v1:172.21.15.146:6789/0 conn(0x7f7aa00d0790 legacy=0x7f7aa009a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:16.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.458+0000 7f7a9effd640 1 -- 172.21.15.117:0/4022249060 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa00cd8d0 con 0x7f7aa015c3c0 2024-09-19T08:37:16.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.458+0000 7f7a9effd640 1 --2- 172.21.15.117:0/4022249060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa015c3c0 0x7f7aa00cddf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7a90009e80 tx=0x7f7a9002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe323c692fab314 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:16.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.458+0000 7f7a9dffb640 1 -- 172.21.15.117:0/4022249060 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a90036070 con 0x7f7aa015c3c0 2024-09-19T08:37:16.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.458+0000 7f7a9dffb640 1 -- 172.21.15.117:0/4022249060 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a90031600 con 0x7f7aa015c3c0 2024-09-19T08:37:16.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.458+0000 7f7a9dffb640 1 -- 172.21.15.117:0/4022249060 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a900319d0 con 0x7f7aa015c3c0 2024-09-19T08:37:16.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.459+0000 7f7aa59c0640 1 -- 172.21.15.117:0/4022249060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa015c3c0 msgr2=0x7f7aa00cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:16.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.459+0000 7f7aa59c0640 1 --2- 172.21.15.117:0/4022249060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa015c3c0 0x7f7aa00cddf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7a90009e80 tx=0x7f7a9002a6f0 comp rx=0 tx=0).stop 2024-09-19T08:37:16.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.459+0000 7f7aa59c0640 1 -- 172.21.15.117:0/4022249060 shutdown_connections 2024-09-19T08:37:16.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.459+0000 7f7aa59c0640 1 --2- 172.21.15.117:0/4022249060 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7aa009b100 0x7f7aa00d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:16.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.459+0000 7f7aa59c0640 1 --2- 172.21.15.117:0/4022249060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa015c3c0 0x7f7aa00cddf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:16.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.459+0000 7f7aa59c0640 1 -- 172.21.15.117:0/4022249060 >> 172.21.15.117:0/4022249060 conn(0x7f7aa00b3ca0 msgr2=0x7f7aa00b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:16.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.459+0000 7f7aa59c0640 1 -- 172.21.15.117:0/4022249060 shutdown_connections 2024-09-19T08:37:16.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.459+0000 7f7aa59c0640 1 -- 172.21.15.117:0/4022249060 wait complete. 2024-09-19T08:37:16.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.460+0000 7f7aa59c0640 1 Processor -- start 2024-09-19T08:37:16.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.460+0000 7f7aa59c0640 1 -- start start 2024-09-19T08:37:16.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.461+0000 7f7aa59c0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7aa009b100 0x7f7aa00cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:16.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.461+0000 7f7aa59c0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa00d0790 0x7f7aa015e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:16.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.461+0000 7f7aa59c0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7aa015c3c0 0x7f7aa0153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:16.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.461+0000 7f7aa59c0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa009bd30 con 0x7f7aa00d0790 2024-09-19T08:37:16.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.461+0000 7f7aa59c0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa009bbb0 con 0x7f7aa009b100 2024-09-19T08:37:16.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.461+0000 7f7aa59c0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f7aa00ccc50 con 0x7f7aa015c3c0 2024-09-19T08:37:16.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.461+0000 7f7a9e7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa00d0790 0x7f7aa015e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:16.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.461+0000 7f7a9e7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa00d0790 0x7f7aa015e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54082/0 (socket says 172.21.15.117:54082) 2024-09-19T08:37:16.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.461+0000 7f7a9e7fc640 1 -- 172.21.15.117:0/1424111450 learned_addr learned my addr 172.21.15.117:0/1424111450 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:16.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.461+0000 7f7a9effd640 1 --2- 172.21.15.117:0/1424111450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7aa009b100 0x7f7aa00cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:16.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.461+0000 7f7a9e7fc640 1 -- 172.21.15.117:0/1424111450 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7aa015c3c0 msgr2=0x7f7aa0153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:16.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.461+0000 7f7a9e7fc640 1 --2- 172.21.15.117:0/1424111450 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7aa015c3c0 0x7f7aa0153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:16.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.461+0000 7f7a9e7fc640 1 -- 172.21.15.117:0/1424111450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7aa009b100 msgr2=0x7f7aa00cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:16.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.461+0000 7f7a9e7fc640 1 --2- 172.21.15.117:0/1424111450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7aa009b100 0x7f7aa00cb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:16.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.462+0000 7f7a9e7fc640 1 -- 172.21.15.117:0/1424111450 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa00cc070 con 0x7f7aa00d0790 2024-09-19T08:37:16.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.462+0000 7f7a9e7fc640 1 --2- 172.21.15.117:0/1424111450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa00d0790 0x7f7aa015e010 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400c410 tx=0x7f7a9400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:16.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.462+0000 7f7a87fff640 1 -- 172.21.15.117:0/1424111450 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a94017070 con 0x7f7aa00d0790 2024-09-19T08:37:16.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.462+0000 7f7a87fff640 1 -- 172.21.15.117:0/1424111450 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a940035f0 con 0x7f7aa00d0790 2024-09-19T08:37:16.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.462+0000 7f7aa59c0640 1 -- 172.21.15.117:0/1424111450 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa01f5a00 con 0x7f7aa00d0790 2024-09-19T08:37:16.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.462+0000 7f7a87fff640 1 -- 172.21.15.117:0/1424111450 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a940039e0 con 0x7f7aa00d0790 2024-09-19T08:37:16.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.462+0000 7f7aa59c0640 1 -- 172.21.15.117:0/1424111450 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa01f5fc0 con 0x7f7aa00d0790 2024-09-19T08:37:16.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.463+0000 7f7aa59c0640 1 -- 172.21.15.117:0/1424111450 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aa00cddf0 con 0x7f7aa00d0790 2024-09-19T08:37:16.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.463+0000 7f7a87fff640 1 -- 172.21.15.117:0/1424111450 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7a9401a070 con 0x7f7aa00d0790 2024-09-19T08:37:16.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.464+0000 7f7a87fff640 1 --2- 172.21.15.117:0/1424111450 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7a8c06c2b0 0x7f7a8c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:16.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.464+0000 7f7a87fff640 1 -- 172.21.15.117:0/1424111450 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f7a9408ac20 con 0x7f7aa00d0790 2024-09-19T08:37:16.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.464+0000 7f7a9effd640 1 --2- 172.21.15.117:0/1424111450 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7a8c06c2b0 0x7f7a8c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:16.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.465+0000 7f7a9effd640 1 --2- 172.21.15.117:0/1424111450 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7a8c06c2b0 0x7f7a8c06e770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7a90033000 tx=0x7f7a90009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:16.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.468+0000 7f7a87fff640 1 -- 172.21.15.117:0/1424111450 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7a94059070 con 0x7f7aa00d0790 2024-09-19T08:37:16.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:16.633+0000 7f7aa59c0640 1 -- 172.21.15.117:0/1424111450 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f7aa00b7210 con 0x7f7aa00d0790 2024-09-19T08:37:17.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.328+0000 7f7a87fff640 1 -- 172.21.15.117:0/1424111450 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) ==== 169+0+0 (secure 0 0 0) 0x7f7a94058970 con 0x7f7aa00d0790 2024-09-19T08:37:17.329 INFO:teuthology.orchestra.run.smithi117.stderr:set pool 4 allow_ec_overwrites to true 2024-09-19T08:37:17.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.330+0000 7f7aa59c0640 1 -- 172.21.15.117:0/1424111450 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7a8c06c2b0 msgr2=0x7f7a8c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:17.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.330+0000 7f7aa59c0640 1 --2- 172.21.15.117:0/1424111450 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7a8c06c2b0 0x7f7a8c06e770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7a90033000 tx=0x7f7a90009000 comp rx=0 tx=0).stop 2024-09-19T08:37:17.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.330+0000 7f7aa59c0640 1 -- 172.21.15.117:0/1424111450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa00d0790 msgr2=0x7f7aa015e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:17.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.330+0000 7f7aa59c0640 1 --2- 172.21.15.117:0/1424111450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa00d0790 0x7f7aa015e010 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400c410 tx=0x7f7a9400c8d0 comp rx=0 tx=0).stop 2024-09-19T08:37:17.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.331+0000 7f7aa59c0640 1 -- 172.21.15.117:0/1424111450 shutdown_connections 2024-09-19T08:37:17.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.331+0000 7f7aa59c0640 1 --2- 172.21.15.117:0/1424111450 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7a8c06c2b0 0x7f7a8c06e770 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:17.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.331+0000 7f7aa59c0640 1 --2- 172.21.15.117:0/1424111450 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7aa015c3c0 0x7f7aa0153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:17.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.331+0000 7f7aa59c0640 1 --2- 172.21.15.117:0/1424111450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa00d0790 0x7f7aa015e010 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:17.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.331+0000 7f7aa59c0640 1 --2- 172.21.15.117:0/1424111450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7aa009b100 0x7f7aa00cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:17.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.331+0000 7f7aa59c0640 1 -- 172.21.15.117:0/1424111450 >> 172.21.15.117:0/1424111450 conn(0x7f7aa00b3ca0 msgr2=0x7f7aa00b7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:17.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.331+0000 7f7aa59c0640 1 -- 172.21.15.117:0/1424111450 shutdown_connections 2024-09-19T08:37:17.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.331+0000 7f7aa59c0640 1 -- 172.21.15.117:0/1424111450 wait complete. 2024-09-19T08:37:17.352 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-19T08:37:17.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.455+0000 7f843d8e6640 1 Processor -- start 2024-09-19T08:37:17.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.455+0000 7f843d8e6640 1 -- start start 2024-09-19T08:37:17.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.456+0000 7f843d8e6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f843815f0d0 0x7f843815f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:17.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.456+0000 7f843d8e6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f84380d0070 0x7f84380d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:17.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.456+0000 7f843d8e6640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f84380d1940 0x7f84380d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:17.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.456+0000 7f843d8e6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f84380cf2b0 con 0x7f84380d0070 2024-09-19T08:37:17.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.456+0000 7f843d8e6640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f84380cf590 con 0x7f84380d1940 2024-09-19T08:37:17.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.456+0000 7f843d8e6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f84380cf870 con 0x7f843815f0d0 2024-09-19T08:37:17.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.456+0000 7f84367fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f84380d0070 0x7f84380d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:17.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.456+0000 7f84367fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f84380d0070 0x7f84380d1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54084/0 (socket says 172.21.15.117:54084) 2024-09-19T08:37:17.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.456+0000 7f84367fc640 1 -- 172.21.15.117:0/281410119 learned_addr learned my addr 172.21.15.117:0/281410119 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:17.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.456+0000 7f84367fc640 1 -- 172.21.15.117:0/281410119 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f843815f0d0 msgr2=0x7f843815f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:17.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.456+0000 7f84367fc640 1 --2- 172.21.15.117:0/281410119 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f843815f0d0 0x7f843815f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:17.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.456+0000 7f84367fc640 1 -- 172.21.15.117:0/281410119 >> v2:172.21.15.146:3300/0 conn(0x7f84380d1940 msgr2=0x7f84380d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:17.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.456+0000 7f84377fe640 1 --2- 172.21.15.117:0/281410119 >> v2:172.21.15.146:3300/0 conn(0x7f84380d1940 0x7f84380d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:17.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.456+0000 7f84367fc640 1 --2- 172.21.15.117:0/281410119 >> v2:172.21.15.146:3300/0 conn(0x7f84380d1940 0x7f84380d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:17.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.456+0000 7f84367fc640 1 -- 172.21.15.117:0/281410119 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84380cfb50 con 0x7f84380d0070 2024-09-19T08:37:17.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.457+0000 7f84367fc640 1 --2- 172.21.15.117:0/281410119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84380d0070 0x7f84380d1400 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8438161e80 tx=0x7f842c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87359be9847db14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:17.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.457+0000 7f8435ffb640 1 -- 172.21.15.117:0/281410119 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842c037070 con 0x7f84380d0070 2024-09-19T08:37:17.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.457+0000 7f8435ffb640 1 -- 172.21.15.117:0/281410119 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842c032440 con 0x7f84380d0070 2024-09-19T08:37:17.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.457+0000 7f8435ffb640 1 -- 172.21.15.117:0/281410119 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842c032810 con 0x7f84380d0070 2024-09-19T08:37:17.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.458+0000 7f843d8e6640 1 -- 172.21.15.117:0/281410119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84380d0070 msgr2=0x7f84380d1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:17.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.458+0000 7f843d8e6640 1 --2- 172.21.15.117:0/281410119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84380d0070 0x7f84380d1400 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8438161e80 tx=0x7f842c02a140 comp rx=0 tx=0).stop 2024-09-19T08:37:17.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.458+0000 7f843d8e6640 1 -- 172.21.15.117:0/281410119 shutdown_connections 2024-09-19T08:37:17.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.458+0000 7f843d8e6640 1 --2- 172.21.15.117:0/281410119 >> v2:172.21.15.146:3300/0 conn(0x7f84380d1940 0x7f84380d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:17.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.458+0000 7f843d8e6640 1 --2- 172.21.15.117:0/281410119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84380d0070 0x7f84380d1400 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:17.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.458+0000 7f843d8e6640 1 --2- 172.21.15.117:0/281410119 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f843815f0d0 0x7f843815f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:17.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.458+0000 7f843d8e6640 1 -- 172.21.15.117:0/281410119 >> 172.21.15.117:0/281410119 conn(0x7f843809d760 msgr2=0x7f843808bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:17.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.458+0000 7f843d8e6640 1 -- 172.21.15.117:0/281410119 shutdown_connections 2024-09-19T08:37:17.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.458+0000 7f843d8e6640 1 -- 172.21.15.117:0/281410119 wait complete. 2024-09-19T08:37:17.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.459+0000 7f843d8e6640 1 Processor -- start 2024-09-19T08:37:17.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.459+0000 7f843d8e6640 1 -- start start 2024-09-19T08:37:17.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.460+0000 7f843d8e6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84380d0070 0x7f84380b9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:17.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.460+0000 7f843d8e6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84380d1940 0x7f84380ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:17.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.460+0000 7f843d8e6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f843815f0d0 0x7f84380cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:17.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.460+0000 7f843d8e6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f84380d47f0 con 0x7f843815f0d0 2024-09-19T08:37:17.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.460+0000 7f843d8e6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f84380d4670 con 0x7f84380d1940 2024-09-19T08:37:17.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.460+0000 7f843d8e6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f84380d4970 con 0x7f84380d0070 2024-09-19T08:37:17.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.460+0000 7f84377fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f843815f0d0 0x7f84380cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:17.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.460+0000 7f84377fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f843815f0d0 0x7f84380cd4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54094/0 (socket says 172.21.15.117:54094) 2024-09-19T08:37:17.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.460+0000 7f84377fe640 1 -- 172.21.15.117:0/4037982911 learned_addr learned my addr 172.21.15.117:0/4037982911 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:17.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.460+0000 7f84367fc640 1 --2- 172.21.15.117:0/4037982911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84380d1940 0x7f84380ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:17.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.460+0000 7f8436ffd640 1 --2- 172.21.15.117:0/4037982911 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84380d0070 0x7f84380b9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:17.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.460+0000 7f84377fe640 1 -- 172.21.15.117:0/4037982911 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84380d0070 msgr2=0x7f84380b9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:17.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.460+0000 7f84377fe640 1 --2- 172.21.15.117:0/4037982911 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84380d0070 0x7f84380b9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:17.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.460+0000 7f84377fe640 1 -- 172.21.15.117:0/4037982911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84380d1940 msgr2=0x7f84380ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:17.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.460+0000 7f84377fe640 1 --2- 172.21.15.117:0/4037982911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84380d1940 0x7f84380ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:17.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.460+0000 7f84377fe640 1 -- 172.21.15.117:0/4037982911 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84380c7f90 con 0x7f843815f0d0 2024-09-19T08:37:17.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.461+0000 7f84377fe640 1 --2- 172.21.15.117:0/4037982911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f843815f0d0 0x7f84380cd4d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f843000cc00 tx=0x7f843000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:17.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.461+0000 7f841ffff640 1 -- 172.21.15.117:0/4037982911 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843000ce10 con 0x7f843815f0d0 2024-09-19T08:37:17.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.461+0000 7f841ffff640 1 -- 172.21.15.117:0/4037982911 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8430003990 con 0x7f843815f0d0 2024-09-19T08:37:17.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.461+0000 7f843d8e6640 1 -- 172.21.15.117:0/4037982911 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84380cdb00 con 0x7f843815f0d0 2024-09-19T08:37:17.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.461+0000 7f841ffff640 1 -- 172.21.15.117:0/4037982911 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8430003d60 con 0x7f843815f0d0 2024-09-19T08:37:17.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.461+0000 7f843d8e6640 1 -- 172.21.15.117:0/4037982911 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84380ce0c0 con 0x7f843815f0d0 2024-09-19T08:37:17.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.462+0000 7f843d8e6640 1 -- 172.21.15.117:0/4037982911 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84380ce400 con 0x7f843815f0d0 2024-09-19T08:37:17.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.462+0000 7f841ffff640 1 -- 172.21.15.117:0/4037982911 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8430004000 con 0x7f843815f0d0 2024-09-19T08:37:17.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.463+0000 7f841ffff640 1 --2- 172.21.15.117:0/4037982911 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f842406c2b0 0x7f842406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:17.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.463+0000 7f841ffff640 1 -- 172.21.15.117:0/4037982911 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7f843008bb20 con 0x7f843815f0d0 2024-09-19T08:37:17.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.463+0000 7f8436ffd640 1 --2- 172.21.15.117:0/4037982911 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f842406c2b0 0x7f842406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:17.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.464+0000 7f8436ffd640 1 --2- 172.21.15.117:0/4037982911 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f842406c2b0 0x7f842406e770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f84280098e0 tx=0x7f8428009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:17.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.467+0000 7f841ffff640 1 -- 172.21.15.117:0/4037982911 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8430014030 con 0x7f843815f0d0 2024-09-19T08:37:17.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:17.667+0000 7f843d8e6640 1 -- 172.21.15.117:0/4037982911 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f84380cb7b0 con 0x7f843815f0d0 2024-09-19T08:37:18.283 INFO:tasks.ceph.mds.b.smithi146.stderr:2024-09-19T08:37:18.283+0000 7fdaa0001640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T08:37:18.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.342+0000 7f841ffff640 1 -- 172.21.15.117:0/4037982911 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f8430059920 con 0x7f843815f0d0 2024-09-19T08:37:18.344 INFO:teuthology.orchestra.run.smithi117.stderr:added data pool 4 to fsmap 2024-09-19T08:37:18.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.346+0000 7f843d8e6640 1 -- 172.21.15.117:0/4037982911 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f842406c2b0 msgr2=0x7f842406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:18.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.346+0000 7f843d8e6640 1 --2- 172.21.15.117:0/4037982911 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f842406c2b0 0x7f842406e770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f84280098e0 tx=0x7f8428009060 comp rx=0 tx=0).stop 2024-09-19T08:37:18.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.346+0000 7f843d8e6640 1 -- 172.21.15.117:0/4037982911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f843815f0d0 msgr2=0x7f84380cd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:18.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.346+0000 7f843d8e6640 1 --2- 172.21.15.117:0/4037982911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f843815f0d0 0x7f84380cd4d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f843000cc00 tx=0x7f843000a5c0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.346+0000 7f843d8e6640 1 -- 172.21.15.117:0/4037982911 shutdown_connections 2024-09-19T08:37:18.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.346+0000 7f843d8e6640 1 --2- 172.21.15.117:0/4037982911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f843815f0d0 0x7f84380cd4d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.346+0000 7f843d8e6640 1 --2- 172.21.15.117:0/4037982911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84380d1940 0x7f84380ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.346+0000 7f843d8e6640 1 --2- 172.21.15.117:0/4037982911 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f842406c2b0 0x7f842406e770 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.346+0000 7f843d8e6640 1 --2- 172.21.15.117:0/4037982911 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84380d0070 0x7f84380b9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.346+0000 7f843d8e6640 1 -- 172.21.15.117:0/4037982911 >> 172.21.15.117:0/4037982911 conn(0x7f843809d760 msgr2=0x7f843808bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:18.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.346+0000 7f843d8e6640 1 -- 172.21.15.117:0/4037982911 shutdown_connections 2024-09-19T08:37:18.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.346+0000 7f843d8e6640 1 -- 172.21.15.117:0/4037982911 wait complete. 2024-09-19T08:37:18.358 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:37:18.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.456+0000 7fbe902c3640 1 Processor -- start 2024-09-19T08:37:18.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.456+0000 7fbe902c3640 1 -- start start 2024-09-19T08:37:18.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.457+0000 7fbe902c3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe88072590 0x7fbe8806d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:18.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.457+0000 7fbe902c3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe881620b0 con 0x7fbe880d21f0 2024-09-19T08:37:18.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.457+0000 7fbe902c3640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe88162370 con 0x7fbe88141ad0 2024-09-19T08:37:18.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.457+0000 7fbe902c3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fbe88141750 con 0x7fbe88072590 2024-09-19T08:37:18.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.457+0000 7fbe8e05f640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fbe880d21f0 0x7fbe880d25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:35758/0 (socket says 172.21.15.117:35758) 2024-09-19T08:37:18.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.457+0000 7fbe8e05f640 1 -- 172.21.15.117:0/3220329934 learned_addr learned my addr 172.21.15.117:0/3220329934 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:18.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.457+0000 7fbe8d85e640 1 --2- 172.21.15.117:0/3220329934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe88072590 0x7fbe8806d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:18.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.458+0000 7fbe8d05d640 1 -- 172.21.15.117:0/3220329934 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3144189027 0 0) 0x7fbe881620b0 con 0x7fbe880d21f0 2024-09-19T08:37:18.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.458+0000 7fbe8d05d640 1 -- 172.21.15.117:0/3220329934 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe74003520 con 0x7fbe880d21f0 2024-09-19T08:37:18.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.458+0000 7fbe8d85e640 1 -- 172.21.15.117:0/3220329934 >> v1:172.21.15.146:6789/0 conn(0x7fbe88141ad0 legacy=0x7fbe88141f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:18.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.458+0000 7fbe8d85e640 1 -- 172.21.15.117:0/3220329934 >> v1:172.21.15.117:6789/0 conn(0x7fbe880d21f0 legacy=0x7fbe880d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:18.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.458+0000 7fbe8d05d640 1 -- 172.21.15.117:0/3220329934 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 801393651 0 0) 0x7fbe74003520 con 0x7fbe880d21f0 2024-09-19T08:37:18.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.458+0000 7fbe8d85e640 1 -- 172.21.15.117:0/3220329934 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe88162650 con 0x7fbe88072590 2024-09-19T08:37:18.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.459+0000 7fbe8d85e640 1 --2- 172.21.15.117:0/3220329934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe88072590 0x7fbe8806d0e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbe780097d0 tx=0x7fbe7802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=168ea869856b03c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:18.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.459+0000 7fbe8d05d640 1 -- 172.21.15.117:0/3220329934 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe78037070 con 0x7fbe88072590 2024-09-19T08:37:18.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.459+0000 7fbe8d05d640 1 -- 172.21.15.117:0/3220329934 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe7802ab90 con 0x7fbe88072590 2024-09-19T08:37:18.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.459+0000 7fbe8d05d640 1 -- 172.21.15.117:0/3220329934 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe840019f0 con 0x7fbe88072590 2024-09-19T08:37:18.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.459+0000 7fbe902c3640 1 -- 172.21.15.117:0/3220329934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe88072590 msgr2=0x7fbe8806d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:18.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.459+0000 7fbe902c3640 1 --2- 172.21.15.117:0/3220329934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe88072590 0x7fbe8806d0e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbe780097d0 tx=0x7fbe7802a100 comp rx=0 tx=0).stop 2024-09-19T08:37:18.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.459+0000 7fbe902c3640 1 -- 172.21.15.117:0/3220329934 shutdown_connections 2024-09-19T08:37:18.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.459+0000 7fbe902c3640 1 --2- 172.21.15.117:0/3220329934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe88072590 0x7fbe8806d0e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.459+0000 7fbe902c3640 1 -- 172.21.15.117:0/3220329934 >> 172.21.15.117:0/3220329934 conn(0x7fbe880b3ed0 msgr2=0x7fbe880b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:18.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.459+0000 7fbe902c3640 1 -- 172.21.15.117:0/3220329934 shutdown_connections 2024-09-19T08:37:18.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.459+0000 7fbe902c3640 1 -- 172.21.15.117:0/3220329934 wait complete. 2024-09-19T08:37:18.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.460+0000 7fbe902c3640 1 Processor -- start 2024-09-19T08:37:18.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.460+0000 7fbe902c3640 1 -- start start 2024-09-19T08:37:18.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.461+0000 7fbe902c3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe88072590 0x7fbe88143a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:18.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.461+0000 7fbe902c3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe880d21f0 0x7fbe8815c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:18.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.461+0000 7fbe902c3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe88141ad0 0x7fbe880b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:18.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.461+0000 7fbe902c3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8806d620 con 0x7fbe88141ad0 2024-09-19T08:37:18.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.461+0000 7fbe902c3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbe88162c10 con 0x7fbe880d21f0 2024-09-19T08:37:18.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.461+0000 7fbe902c3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fbe8806d7a0 con 0x7fbe88072590 2024-09-19T08:37:18.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.461+0000 7fbe8e860640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe88141ad0 0x7fbe880b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:18.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.461+0000 7fbe8e860640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe88141ad0 0x7fbe880b7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54110/0 (socket says 172.21.15.117:54110) 2024-09-19T08:37:18.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.461+0000 7fbe8e860640 1 -- 172.21.15.117:0/3787135906 learned_addr learned my addr 172.21.15.117:0/3787135906 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:18.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.462+0000 7fbe8e05f640 1 --2- 172.21.15.117:0/3787135906 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe88072590 0x7fbe88143a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:18.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.462+0000 7fbe8d85e640 1 --2- 172.21.15.117:0/3787135906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe880d21f0 0x7fbe8815c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.462+0000 7fbe8e860640 1 -- 172.21.15.117:0/3787135906 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe88072590 msgr2=0x7fbe88143a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.462+0000 7fbe8e860640 1 --2- 172.21.15.117:0/3787135906 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe88072590 0x7fbe88143a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.462+0000 7fbe8e860640 1 -- 172.21.15.117:0/3787135906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe880d21f0 msgr2=0x7fbe8815c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.462+0000 7fbe8e860640 1 --2- 172.21.15.117:0/3787135906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe880d21f0 0x7fbe8815c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.462+0000 7fbe8e860640 1 -- 172.21.15.117:0/3787135906 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe881599f0 con 0x7fbe88141ad0 2024-09-19T08:37:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.462+0000 7fbe8e05f640 1 --2- 172.21.15.117:0/3787135906 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe88072590 0x7fbe88143a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.462+0000 7fbe8d85e640 1 --2- 172.21.15.117:0/3787135906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe880d21f0 0x7fbe8815c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.462+0000 7fbe8e860640 1 --2- 172.21.15.117:0/3787135906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe88141ad0 0x7fbe880b7140 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000c390 tx=0x7fbe8000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.462+0000 7fbe7effd640 1 -- 172.21.15.117:0/3787135906 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe80017070 con 0x7fbe88141ad0 2024-09-19T08:37:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.462+0000 7fbe7effd640 1 -- 172.21.15.117:0/3787135906 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe800052d0 con 0x7fbe88141ad0 2024-09-19T08:37:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.462+0000 7fbe902c3640 1 -- 172.21.15.117:0/3787135906 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe88159cd0 con 0x7fbe88141ad0 2024-09-19T08:37:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.462+0000 7fbe7effd640 1 -- 172.21.15.117:0/3787135906 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe80003810 con 0x7fbe88141ad0 2024-09-19T08:37:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.462+0000 7fbe902c3640 1 -- 172.21.15.117:0/3787135906 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe8815a290 con 0x7fbe88141ad0 2024-09-19T08:37:18.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.463+0000 7fbe902c3640 1 -- 172.21.15.117:0/3787135906 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe88158c30 con 0x7fbe88141ad0 2024-09-19T08:37:18.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.463+0000 7fbe7effd640 1 -- 172.21.15.117:0/3787135906 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbe8001a070 con 0x7fbe88141ad0 2024-09-19T08:37:18.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.464+0000 7fbe7effd640 1 --2- 172.21.15.117:0/3787135906 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbe6c06c2b0 0x7fbe6c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:18.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.464+0000 7fbe7effd640 1 -- 172.21.15.117:0/3787135906 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbe8008aa80 con 0x7fbe88141ad0 2024-09-19T08:37:18.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.464+0000 7fbe8e05f640 1 --2- 172.21.15.117:0/3787135906 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbe6c06c2b0 0x7fbe6c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:18.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.465+0000 7fbe8e05f640 1 --2- 172.21.15.117:0/3787135906 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbe6c06c2b0 0x7fbe6c06e770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbe84005c00 tx=0x7fbe84009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:18.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.469+0000 7fbe7effd640 1 -- 172.21.15.117:0/3787135906 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbe80058eb0 con 0x7fbe88141ad0 2024-09-19T08:37:18.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.671+0000 7fbe902c3640 1 -- 172.21.15.117:0/3787135906 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe880690c0 con 0x7fbe88141ad0 2024-09-19T08:37:18.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.671+0000 7fbe7effd640 1 -- 172.21.15.117:0/3787135906 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5231 (secure 0 0 0) 0x7fbe8005f080 con 0x7fbe88141ad0 2024-09-19T08:37:18.672 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:18.672 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":7,"btime":"2024-09-19T08:37:18:338976+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2592540396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2592540396},{"type":"v1","addr":"172.21.15.117:6833","nonce":2592540396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3561335184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3561335184},{"type":"v1","addr":"172.21.15.117:6835","nonce":3561335184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/2623207604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2623207604},{"type":"v1","addr":"172.21.15.146:6837","nonce":2623207604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:37:12.640173+0000","modified":"2024-09-19T08:37:17.670309+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6836/2942334805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2942334805},{"type":"v1","addr":"172.21.15.146:6836","nonce":2942334805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4303,"qdb_cluster":[4303]},"id":1}]} 2024-09-19T08:37:18.673 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 7 2024-09-19T08:37:18.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.673+0000 7fbe902c3640 1 -- 172.21.15.117:0/3787135906 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbe6c06c2b0 msgr2=0x7fbe6c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:18.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.673+0000 7fbe902c3640 1 --2- 172.21.15.117:0/3787135906 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbe6c06c2b0 0x7fbe6c06e770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbe84005c00 tx=0x7fbe84009040 comp rx=0 tx=0).stop 2024-09-19T08:37:18.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.673+0000 7fbe902c3640 1 -- 172.21.15.117:0/3787135906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe88141ad0 msgr2=0x7fbe880b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:18.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.673+0000 7fbe902c3640 1 --2- 172.21.15.117:0/3787135906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe88141ad0 0x7fbe880b7140 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000c390 tx=0x7fbe8000c850 comp rx=0 tx=0).stop 2024-09-19T08:37:18.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.673+0000 7fbe902c3640 1 -- 172.21.15.117:0/3787135906 shutdown_connections 2024-09-19T08:37:18.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.673+0000 7fbe902c3640 1 --2- 172.21.15.117:0/3787135906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbe88141ad0 0x7fbe880b7140 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.673+0000 7fbe902c3640 1 --2- 172.21.15.117:0/3787135906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe880d21f0 0x7fbe8815c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.673+0000 7fbe902c3640 1 --2- 172.21.15.117:0/3787135906 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbe6c06c2b0 0x7fbe6c06e770 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.673+0000 7fbe902c3640 1 --2- 172.21.15.117:0/3787135906 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe88072590 0x7fbe88143a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.673+0000 7fbe902c3640 1 -- 172.21.15.117:0/3787135906 >> 172.21.15.117:0/3787135906 conn(0x7fbe880b3ed0 msgr2=0x7fbe880b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:18.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.673+0000 7fbe902c3640 1 -- 172.21.15.117:0/3787135906 shutdown_connections 2024-09-19T08:37:18.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.673+0000 7fbe902c3640 1 -- 172.21.15.117:0/3787135906 wait complete. 2024-09-19T08:37:18.685 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:37:18.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.782+0000 7fbd9b549640 1 Processor -- start 2024-09-19T08:37:18.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.782+0000 7fbd9b549640 1 -- start start 2024-09-19T08:37:18.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.782+0000 7fbd9b549640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbd940cd040 0x7fbd941653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:18.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.782+0000 7fbd9b549640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd940b4540 con 0x7fbd9415a7b0 2024-09-19T08:37:18.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.782+0000 7fbd9b549640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd940cf9b0 con 0x7fbd940c5b00 2024-09-19T08:37:18.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.782+0000 7fbd9b549640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fbd940b4870 con 0x7fbd940cd040 2024-09-19T08:37:18.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd992e5640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fbd9415a7b0 0x7fbd940cde40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:35770/0 (socket says 172.21.15.117:35770) 2024-09-19T08:37:18.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd992e5640 1 -- 172.21.15.117:0/1033802567 learned_addr learned my addr 172.21.15.117:0/1033802567 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:18.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd93fff640 1 -- 172.21.15.117:0/1033802567 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3247338563 0 0) 0x7fbd940b4540 con 0x7fbd9415a7b0 2024-09-19T08:37:18.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd99ae6640 1 --2- 172.21.15.117:0/1033802567 >> v2:172.21.15.146:3300/0 conn(0x7fbd940cd040 0x7fbd941653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:18.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd93fff640 1 -- 172.21.15.117:0/1033802567 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd7c003520 con 0x7fbd9415a7b0 2024-09-19T08:37:18.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd93fff640 1 -- 172.21.15.117:0/1033802567 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 123022050 0 0) 0x7fbd7c003520 con 0x7fbd9415a7b0 2024-09-19T08:37:18.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd93fff640 1 -- 172.21.15.117:0/1033802567 >> v2:172.21.15.146:3300/0 conn(0x7fbd940cd040 msgr2=0x7fbd941653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:18.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd93fff640 1 --2- 172.21.15.117:0/1033802567 >> v2:172.21.15.146:3300/0 conn(0x7fbd940cd040 0x7fbd941653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd93fff640 1 -- 172.21.15.117:0/1033802567 >> v1:172.21.15.146:6789/0 conn(0x7fbd940c5b00 legacy=0x7fbd940cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:18.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd93fff640 1 -- 172.21.15.117:0/1033802567 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd940cfc90 con 0x7fbd9415a7b0 2024-09-19T08:37:18.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd93fff640 1 -- 172.21.15.117:0/1033802567 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7fbd8c001690 con 0x7fbd9415a7b0 2024-09-19T08:37:18.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd99ae6640 1 --2- 172.21.15.117:0/1033802567 >> v2:172.21.15.146:3300/0 conn(0x7fbd940cd040 0x7fbd941653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:18.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd93fff640 1 -- 172.21.15.117:0/1033802567 >> v1:172.21.15.117:6789/0 conn(0x7fbd9415a7b0 legacy=0x7fbd940cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:18.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd93fff640 1 --2- 172.21.15.117:0/1033802567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd7c0039b0 0x7fbd7c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:18.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd93fff640 1 --2- 172.21.15.117:0/1033802567 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd7c004800 0x7fbd7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:18.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd93fff640 1 --2- 172.21.15.117:0/1033802567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd7c0051c0 0x7fbd7c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:18.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd93fff640 1 -- 172.21.15.117:0/1033802567 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbd940b4870 con 0x7fbd7c0051c0 2024-09-19T08:37:18.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd93fff640 1 -- 172.21.15.117:0/1033802567 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7c00c110 con 0x7fbd7c0039b0 2024-09-19T08:37:18.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd93fff640 1 -- 172.21.15.117:0/1033802567 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fbd7c00c310 con 0x7fbd7c004800 2024-09-19T08:37:18.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd99ae6640 1 --2- 172.21.15.117:0/1033802567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd7c0051c0 0x7fbd7c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:18.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd992e5640 1 --2- 172.21.15.117:0/1033802567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd7c0039b0 0x7fbd7c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:18.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd98ae4640 1 --2- 172.21.15.117:0/1033802567 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd7c004800 0x7fbd7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:18.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd99ae6640 1 -- 172.21.15.117:0/1033802567 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd7c004800 msgr2=0x7fbd7c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:18.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd99ae6640 1 --2- 172.21.15.117:0/1033802567 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd7c004800 0x7fbd7c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd99ae6640 1 -- 172.21.15.117:0/1033802567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd7c0039b0 msgr2=0x7fbd7c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:18.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd99ae6640 1 --2- 172.21.15.117:0/1033802567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd7c0039b0 0x7fbd7c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd99ae6640 1 -- 172.21.15.117:0/1033802567 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7c003520 con 0x7fbd7c0051c0 2024-09-19T08:37:18.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.783+0000 7fbd98ae4640 1 --2- 172.21.15.117:0/1033802567 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd7c004800 0x7fbd7c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:18.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.784+0000 7fbd99ae6640 1 -- 172.21.15.117:0/1033802567 reap_dead start 2024-09-19T08:37:18.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.784+0000 7fbd99ae6640 1 --2- 172.21.15.117:0/1033802567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd7c0051c0 0x7fbd7c00b9c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbd840073b0 tx=0x7fbd7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7ac49c8419ab0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:18.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.784+0000 7fbd93fff640 1 -- 172.21.15.117:0/1033802567 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84009c80 con 0x7fbd7c0051c0 2024-09-19T08:37:18.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.784+0000 7fbd93fff640 1 -- 172.21.15.117:0/1033802567 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8402c650 con 0x7fbd7c0051c0 2024-09-19T08:37:18.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.784+0000 7fbd93fff640 1 -- 172.21.15.117:0/1033802567 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8402ca40 con 0x7fbd7c0051c0 2024-09-19T08:37:18.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.785+0000 7fbd9b549640 1 -- 172.21.15.117:0/1033802567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd7c0051c0 msgr2=0x7fbd7c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:18.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.785+0000 7fbd9b549640 1 --2- 172.21.15.117:0/1033802567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd7c0051c0 0x7fbd7c00b9c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbd840073b0 tx=0x7fbd7c005830 comp rx=0 tx=0).stop 2024-09-19T08:37:18.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.785+0000 7fbd9b549640 1 -- 172.21.15.117:0/1033802567 shutdown_connections 2024-09-19T08:37:18.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.785+0000 7fbd9b549640 1 --2- 172.21.15.117:0/1033802567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd7c0051c0 0x7fbd7c00b9c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.785+0000 7fbd9b549640 1 -- 172.21.15.117:0/1033802567 >> 172.21.15.117:0/1033802567 conn(0x7fbd9406bdf0 msgr2=0x7fbd9406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:18.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.785+0000 7fbd9b549640 1 -- 172.21.15.117:0/1033802567 shutdown_connections 2024-09-19T08:37:18.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.785+0000 7fbd9b549640 1 -- 172.21.15.117:0/1033802567 wait complete. 2024-09-19T08:37:18.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.786+0000 7fbd9b549640 1 Processor -- start 2024-09-19T08:37:18.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.786+0000 7fbd9b549640 1 -- start start 2024-09-19T08:37:18.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.787+0000 7fbd9b549640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd7c0051c0 0x7fbd94152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:18.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.787+0000 7fbd9b549640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd941519e0 0x7fbd940b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:18.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.787+0000 7fbd9b549640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd94151ed0 0x7fbd940b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:18.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.787+0000 7fbd9b549640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9415ab90 con 0x7fbd941519e0 2024-09-19T08:37:18.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.787+0000 7fbd9b549640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbd940c5f40 con 0x7fbd7c0051c0 2024-09-19T08:37:18.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.787+0000 7fbd9b549640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fbd940ca8c0 con 0x7fbd94151ed0 2024-09-19T08:37:18.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.787+0000 7fbd98ae4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd941519e0 0x7fbd940b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:18.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.787+0000 7fbd98ae4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd941519e0 0x7fbd940b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54132/0 (socket says 172.21.15.117:54132) 2024-09-19T08:37:18.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.787+0000 7fbd98ae4640 1 -- 172.21.15.117:0/360850708 learned_addr learned my addr 172.21.15.117:0/360850708 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:18.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.787+0000 7fbd98ae4640 1 -- 172.21.15.117:0/360850708 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd94151ed0 msgr2=0x7fbd940b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:18.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.787+0000 7fbd98ae4640 1 --2- 172.21.15.117:0/360850708 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd94151ed0 0x7fbd940b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.787+0000 7fbd98ae4640 1 -- 172.21.15.117:0/360850708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd7c0051c0 msgr2=0x7fbd94152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:18.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.787+0000 7fbd98ae4640 1 --2- 172.21.15.117:0/360850708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd7c0051c0 0x7fbd94152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.787+0000 7fbd98ae4640 1 -- 172.21.15.117:0/360850708 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd940adc20 con 0x7fbd941519e0 2024-09-19T08:37:18.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.787+0000 7fbd98ae4640 1 --2- 172.21.15.117:0/360850708 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd941519e0 0x7fbd940b0750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbd88000c00 tx=0x7fbd8800e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:18.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.787+0000 7fbd91ffb640 1 -- 172.21.15.117:0/360850708 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88019070 con 0x7fbd941519e0 2024-09-19T08:37:18.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.787+0000 7fbd91ffb640 1 -- 172.21.15.117:0/360850708 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd880052e0 con 0x7fbd941519e0 2024-09-19T08:37:18.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.787+0000 7fbd9b549640 1 -- 172.21.15.117:0/360850708 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd940af1f0 con 0x7fbd941519e0 2024-09-19T08:37:18.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.787+0000 7fbd91ffb640 1 -- 172.21.15.117:0/360850708 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88003830 con 0x7fbd941519e0 2024-09-19T08:37:18.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.788+0000 7fbd9b549640 1 -- 172.21.15.117:0/360850708 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd940ad8d0 con 0x7fbd941519e0 2024-09-19T08:37:18.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.789+0000 7fbd9b549640 1 -- 172.21.15.117:0/360850708 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd940cc930 con 0x7fbd941519e0 2024-09-19T08:37:18.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.789+0000 7fbd91ffb640 1 -- 172.21.15.117:0/360850708 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbd8801c070 con 0x7fbd941519e0 2024-09-19T08:37:18.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.790+0000 7fbd91ffb640 1 --2- 172.21.15.117:0/360850708 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbd8006c2e0 0x7fbd8006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:18.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.790+0000 7fbd91ffb640 1 -- 172.21.15.117:0/360850708 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbd8808ad20 con 0x7fbd941519e0 2024-09-19T08:37:18.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.790+0000 7fbd992e5640 1 --2- 172.21.15.117:0/360850708 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbd8006c2e0 0x7fbd8006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:18.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.790+0000 7fbd992e5640 1 --2- 172.21.15.117:0/360850708 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbd8006c2e0 0x7fbd8006e7a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c001050 tx=0x7fbd8c000fe0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:18.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.794+0000 7fbd91ffb640 1 -- 172.21.15.117:0/360850708 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbd88058b00 con 0x7fbd941519e0 2024-09-19T08:37:18.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.962+0000 7fbd9b549640 1 -- 172.21.15.117:0/360850708 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd940b0370 con 0x7fbd941519e0 2024-09-19T08:37:18.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.963+0000 7fbd91ffb640 1 -- 172.21.15.117:0/360850708 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18650 (secure 0 0 0) 0x7fbd8805ce00 con 0x7fbd941519e0 2024-09-19T08:37:18.964 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:18.964 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":26,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:37:17.670150+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:37:10.463000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:37:11.619440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:37:15.342435+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:37:18.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.965+0000 7fbd9b549640 1 -- 172.21.15.117:0/360850708 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbd8006c2e0 msgr2=0x7fbd8006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:18.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.965+0000 7fbd9b549640 1 --2- 172.21.15.117:0/360850708 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbd8006c2e0 0x7fbd8006e7a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c001050 tx=0x7fbd8c000fe0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.965+0000 7fbd9b549640 1 -- 172.21.15.117:0/360850708 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd941519e0 msgr2=0x7fbd940b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:18.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.965+0000 7fbd9b549640 1 --2- 172.21.15.117:0/360850708 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd941519e0 0x7fbd940b0750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbd88000c00 tx=0x7fbd8800e8f0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.965+0000 7fbd9b549640 1 -- 172.21.15.117:0/360850708 shutdown_connections 2024-09-19T08:37:18.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.965+0000 7fbd9b549640 1 --2- 172.21.15.117:0/360850708 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbd8006c2e0 0x7fbd8006e7a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.965+0000 7fbd9b549640 1 --2- 172.21.15.117:0/360850708 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd94151ed0 0x7fbd940b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.965+0000 7fbd9b549640 1 --2- 172.21.15.117:0/360850708 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd941519e0 0x7fbd940b0750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.965+0000 7fbd9b549640 1 --2- 172.21.15.117:0/360850708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd7c0051c0 0x7fbd94152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:18.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.965+0000 7fbd9b549640 1 -- 172.21.15.117:0/360850708 >> 172.21.15.117:0/360850708 conn(0x7fbd9406bdf0 msgr2=0x7fbd940cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:18.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.965+0000 7fbd9b549640 1 -- 172.21.15.117:0/360850708 shutdown_connections 2024-09-19T08:37:18.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:18.965+0000 7fbd9b549640 1 -- 172.21.15.117:0/360850708 wait complete. 2024-09-19T08:37:18.977 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:37:19.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.074+0000 7f848899f640 1 Processor -- start 2024-09-19T08:37:19.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.075+0000 7f848899f640 1 -- start start 2024-09-19T08:37:19.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.075+0000 7f848899f640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f84840d0bc0 0x7f84840c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.075+0000 7f848899f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f848415b500 con 0x7f848415b120 2024-09-19T08:37:19.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.075+0000 7f848899f640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f848406e940 con 0x7f848406f9e0 2024-09-19T08:37:19.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f848899f640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f848406ec20 con 0x7f84840d0bc0 2024-09-19T08:37:19.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f848259c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f848415b120 0x7f848406dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:35776/0 (socket says 172.21.15.117:35776) 2024-09-19T08:37:19.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f848259c640 1 -- 172.21.15.117:0/2228010500 learned_addr learned my addr 172.21.15.117:0/2228010500 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:19.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f848159a640 1 -- 172.21.15.117:0/2228010500 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 208281388 0 0) 0x7f848415b500 con 0x7f848415b120 2024-09-19T08:37:19.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f848159a640 1 -- 172.21.15.117:0/2228010500 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8470003520 con 0x7f848415b120 2024-09-19T08:37:19.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f8482d9d640 1 --2- 172.21.15.117:0/2228010500 >> v2:172.21.15.146:3300/0 conn(0x7f84840d0bc0 0x7f84840c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f848159a640 1 -- 172.21.15.117:0/2228010500 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2855073801 0 0) 0x7f8470003520 con 0x7f848415b120 2024-09-19T08:37:19.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f848159a640 1 -- 172.21.15.117:0/2228010500 >> v2:172.21.15.146:3300/0 conn(0x7f84840d0bc0 msgr2=0x7f84840c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:19.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f848159a640 1 --2- 172.21.15.117:0/2228010500 >> v2:172.21.15.146:3300/0 conn(0x7f84840d0bc0 0x7f84840c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f848159a640 1 -- 172.21.15.117:0/2228010500 >> v1:172.21.15.146:6789/0 conn(0x7f848406f9e0 legacy=0x7f84840d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:19.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f848159a640 1 -- 172.21.15.117:0/2228010500 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f848406ef00 con 0x7f848415b120 2024-09-19T08:37:19.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f848159a640 1 -- 172.21.15.117:0/2228010500 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f847c001670 con 0x7f848415b120 2024-09-19T08:37:19.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f848159a640 1 -- 172.21.15.117:0/2228010500 >> v1:172.21.15.117:6789/0 conn(0x7f848415b120 legacy=0x7f848406dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:19.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f848159a640 1 --2- 172.21.15.117:0/2228010500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84700039b0 0x7f8470003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f848159a640 1 --2- 172.21.15.117:0/2228010500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8470004800 0x7f8470004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f848159a640 1 --2- 172.21.15.117:0/2228010500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84700051c0 0x7f847000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f848159a640 1 -- 172.21.15.117:0/2228010500 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f848406ec20 con 0x7f84700039b0 2024-09-19T08:37:19.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f848159a640 1 -- 172.21.15.117:0/2228010500 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f847000c060 con 0x7f8470004800 2024-09-19T08:37:19.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f848159a640 1 -- 172.21.15.117:0/2228010500 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f847000c260 con 0x7f84700051c0 2024-09-19T08:37:19.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f848259c640 1 --2- 172.21.15.117:0/2228010500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84700039b0 0x7f8470003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f8481d9b640 1 --2- 172.21.15.117:0/2228010500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8470004800 0x7f8470004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.076+0000 7f8482d9d640 1 --2- 172.21.15.117:0/2228010500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84700051c0 0x7f847000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.077+0000 7f848259c640 1 -- 172.21.15.117:0/2228010500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84700051c0 msgr2=0x7f847000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:19.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.077+0000 7f848259c640 1 --2- 172.21.15.117:0/2228010500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84700051c0 0x7f847000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.077+0000 7f848259c640 1 -- 172.21.15.117:0/2228010500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8470004800 msgr2=0x7f8470004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:19.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.077+0000 7f848259c640 1 --2- 172.21.15.117:0/2228010500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8470004800 0x7f8470004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.077+0000 7f848259c640 1 -- 172.21.15.117:0/2228010500 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8470003520 con 0x7f84700039b0 2024-09-19T08:37:19.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.077+0000 7f8481d9b640 1 --2- 172.21.15.117:0/2228010500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8470004800 0x7f8470004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:19.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.077+0000 7f8482d9d640 1 --2- 172.21.15.117:0/2228010500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84700051c0 0x7f847000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:19.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.077+0000 7f8482d9d640 1 -- 172.21.15.117:0/2228010500 reap_dead start 2024-09-19T08:37:19.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.077+0000 7f848259c640 1 --2- 172.21.15.117:0/2228010500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84700039b0 0x7f8470003dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f847c00c240 tx=0x7f8470005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a65234542559fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:19.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.077+0000 7f848159a640 1 -- 172.21.15.117:0/2228010500 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847c007d10 con 0x7f84700039b0 2024-09-19T08:37:19.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.077+0000 7f848159a640 1 -- 172.21.15.117:0/2228010500 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f847c005ad0 con 0x7f84700039b0 2024-09-19T08:37:19.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.077+0000 7f848159a640 1 -- 172.21.15.117:0/2228010500 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847c007070 con 0x7f84700039b0 2024-09-19T08:37:19.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.078+0000 7f848899f640 1 -- 172.21.15.117:0/2228010500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84700039b0 msgr2=0x7f8470003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:19.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.078+0000 7f848899f640 1 --2- 172.21.15.117:0/2228010500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84700039b0 0x7f8470003dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f847c00c240 tx=0x7f8470005830 comp rx=0 tx=0).stop 2024-09-19T08:37:19.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.078+0000 7f848899f640 1 -- 172.21.15.117:0/2228010500 shutdown_connections 2024-09-19T08:37:19.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.078+0000 7f848899f640 1 --2- 172.21.15.117:0/2228010500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84700039b0 0x7f8470003dd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.078+0000 7f848899f640 1 -- 172.21.15.117:0/2228010500 >> 172.21.15.117:0/2228010500 conn(0x7f848406bdf0 msgr2=0x7f848406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:19.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.078+0000 7f848899f640 1 -- 172.21.15.117:0/2228010500 shutdown_connections 2024-09-19T08:37:19.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.078+0000 7f848899f640 1 -- 172.21.15.117:0/2228010500 wait complete. 2024-09-19T08:37:19.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.079+0000 7f848899f640 1 Processor -- start 2024-09-19T08:37:19.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.079+0000 7f848899f640 1 -- start start 2024-09-19T08:37:19.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.080+0000 7f848899f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84700039b0 0x7f848414b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.080+0000 7f848899f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84840c8130 0x7f84840b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.080+0000 7f848899f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84840c85b0 0x7f84840b2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.080+0000 7f848899f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f84840ce060 con 0x7f84840c8130 2024-09-19T08:37:19.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.080+0000 7f848899f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f848406f4c0 con 0x7f84700039b0 2024-09-19T08:37:19.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.080+0000 7f848899f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f84840d04b0 con 0x7f84840c85b0 2024-09-19T08:37:19.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.080+0000 7f8481d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84840c8130 0x7f84840b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.080+0000 7f8481d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84840c8130 0x7f84840b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54158/0 (socket says 172.21.15.117:54158) 2024-09-19T08:37:19.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.080+0000 7f8481d9b640 1 -- 172.21.15.117:0/2518536935 learned_addr learned my addr 172.21.15.117:0/2518536935 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:19.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.080+0000 7f848259c640 1 --2- 172.21.15.117:0/2518536935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84700039b0 0x7f848414b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.080+0000 7f8482d9d640 1 --2- 172.21.15.117:0/2518536935 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84840c85b0 0x7f84840b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.080+0000 7f8481d9b640 1 -- 172.21.15.117:0/2518536935 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84840c85b0 msgr2=0x7f84840b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:19.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.080+0000 7f8481d9b640 1 --2- 172.21.15.117:0/2518536935 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84840c85b0 0x7f84840b2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.080+0000 7f8481d9b640 1 -- 172.21.15.117:0/2518536935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84700039b0 msgr2=0x7f848414b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:19.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.080+0000 7f8481d9b640 1 --2- 172.21.15.117:0/2518536935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84700039b0 0x7f848414b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.080+0000 7f8481d9b640 1 -- 172.21.15.117:0/2518536935 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84840afe20 con 0x7f84840c8130 2024-09-19T08:37:19.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.080+0000 7f848259c640 1 --2- 172.21.15.117:0/2518536935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84700039b0 0x7f848414b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:19.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.081+0000 7f8481d9b640 1 --2- 172.21.15.117:0/2518536935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84840c8130 0x7f84840b1cf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f846c000c00 tx=0x7f846c00e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:19.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.081+0000 7f847affd640 1 -- 172.21.15.117:0/2518536935 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c019070 con 0x7f84840c8130 2024-09-19T08:37:19.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.081+0000 7f847affd640 1 -- 172.21.15.117:0/2518536935 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f846c0052e0 con 0x7f84840c8130 2024-09-19T08:37:19.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.081+0000 7f848899f640 1 -- 172.21.15.117:0/2518536935 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84840b0100 con 0x7f84840c8130 2024-09-19T08:37:19.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.081+0000 7f847affd640 1 -- 172.21.15.117:0/2518536935 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c003830 con 0x7f84840c8130 2024-09-19T08:37:19.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.081+0000 7f848899f640 1 -- 172.21.15.117:0/2518536935 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84840b06c0 con 0x7f84840c8130 2024-09-19T08:37:19.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.082+0000 7f848899f640 1 -- 172.21.15.117:0/2518536935 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84840d07e0 con 0x7f84840c8130 2024-09-19T08:37:19.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.082+0000 7f847affd640 1 -- 172.21.15.117:0/2518536935 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f846c01c070 con 0x7f84840c8130 2024-09-19T08:37:19.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.082+0000 7f847affd640 1 --2- 172.21.15.117:0/2518536935 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f846406c2b0 0x7f846406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.083+0000 7f847affd640 1 -- 172.21.15.117:0/2518536935 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f846c08ac80 con 0x7f84840c8130 2024-09-19T08:37:19.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.083+0000 7f848259c640 1 --2- 172.21.15.117:0/2518536935 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f846406c2b0 0x7f846406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.083+0000 7f848259c640 1 --2- 172.21.15.117:0/2518536935 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f846406c2b0 0x7f846406e770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f847c032000 tx=0x7f847c034040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:19.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.087+0000 7f847affd640 1 -- 172.21.15.117:0/2518536935 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f846c058af0 con 0x7f84840c8130 2024-09-19T08:37:19.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.252+0000 7f848899f640 1 -- 172.21.15.117:0/2518536935 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84840ad290 con 0x7f84840c8130 2024-09-19T08:37:19.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.254+0000 7f847affd640 1 -- 172.21.15.117:0/2518536935 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18650 (secure 0 0 0) 0x7f846c05cdf0 con 0x7f84840c8130 2024-09-19T08:37:19.254 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:19.254 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":26,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:37:17.670150+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:37:10.463000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:37:11.619440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:37:15.342435+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:37:19.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.256+0000 7f848899f640 1 -- 172.21.15.117:0/2518536935 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f846406c2b0 msgr2=0x7f846406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:19.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.256+0000 7f848899f640 1 --2- 172.21.15.117:0/2518536935 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f846406c2b0 0x7f846406e770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f847c032000 tx=0x7f847c034040 comp rx=0 tx=0).stop 2024-09-19T08:37:19.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.256+0000 7f848899f640 1 -- 172.21.15.117:0/2518536935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84840c8130 msgr2=0x7f84840b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:19.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.256+0000 7f848899f640 1 --2- 172.21.15.117:0/2518536935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84840c8130 0x7f84840b1cf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f846c000c00 tx=0x7f846c00e8f0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.256+0000 7f848899f640 1 -- 172.21.15.117:0/2518536935 shutdown_connections 2024-09-19T08:37:19.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.256+0000 7f848899f640 1 --2- 172.21.15.117:0/2518536935 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f846406c2b0 0x7f846406e770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.256+0000 7f848899f640 1 --2- 172.21.15.117:0/2518536935 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84840c85b0 0x7f84840b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.256+0000 7f848899f640 1 --2- 172.21.15.117:0/2518536935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84840c8130 0x7f84840b1cf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.256+0000 7f848899f640 1 --2- 172.21.15.117:0/2518536935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84700039b0 0x7f848414b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.256+0000 7f848899f640 1 -- 172.21.15.117:0/2518536935 >> 172.21.15.117:0/2518536935 conn(0x7f848406bdf0 msgr2=0x7f8484071ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:19.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.256+0000 7f848899f640 1 -- 172.21.15.117:0/2518536935 shutdown_connections 2024-09-19T08:37:19.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.256+0000 7f848899f640 1 -- 172.21.15.117:0/2518536935 wait complete. 2024-09-19T08:37:19.289 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:37:19.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.388+0000 7fa2721fd640 1 Processor -- start 2024-09-19T08:37:19.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.388+0000 7fa2721fd640 1 -- start start 2024-09-19T08:37:19.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.389+0000 7fa2721fd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa26c15fcb0 0x7fa26c0ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.389+0000 7fa2721fd640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa26c0cd120 0x7fa26c09b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.389+0000 7fa2721fd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa26c0d0560 con 0x7fa26c0cccd0 2024-09-19T08:37:19.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.389+0000 7fa2721fd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa26c0ceb10 con 0x7fa26c15fcb0 2024-09-19T08:37:19.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.389+0000 7fa2721fd640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fa26c0cffa0 con 0x7fa26c0cd120 2024-09-19T08:37:19.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.389+0000 7fa26b7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa26c15fcb0 0x7fa26c0ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.389+0000 7fa26affd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fa26c0cccd0 0x7fa26c160090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:35786/0 (socket says 172.21.15.117:35786) 2024-09-19T08:37:19.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.389+0000 7fa26affd640 1 -- 172.21.15.117:0/2416335958 learned_addr learned my addr 172.21.15.117:0/2416335958 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:19.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.389+0000 7fa26bfff640 1 --2- 172.21.15.117:0/2416335958 >> v2:172.21.15.146:3300/0 conn(0x7fa26c0cd120 0x7fa26c09b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.389+0000 7fa26b7fe640 1 -- 172.21.15.117:0/2416335958 >> v2:172.21.15.146:3300/0 conn(0x7fa26c0cd120 msgr2=0x7fa26c09b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:19.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.389+0000 7fa26b7fe640 1 --2- 172.21.15.117:0/2416335958 >> v2:172.21.15.146:3300/0 conn(0x7fa26c0cd120 0x7fa26c09b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.389+0000 7fa26b7fe640 1 -- 172.21.15.117:0/2416335958 >> v1:172.21.15.117:6789/0 conn(0x7fa26c0cccd0 legacy=0x7fa26c160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:19.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.389+0000 7fa26b7fe640 1 -- 172.21.15.117:0/2416335958 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa26c0d0280 con 0x7fa26c15fcb0 2024-09-19T08:37:19.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.389+0000 7fa26a7fc640 1 -- 172.21.15.117:0/2416335958 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3843199995 0 0) 0x7fa26c0d0560 con 0x7fa26c0cccd0 2024-09-19T08:37:19.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.390+0000 7fa26b7fe640 1 --2- 172.21.15.117:0/2416335958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa26c15fcb0 0x7fa26c0ce5d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0c5c90 tx=0x7fa25c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617c7d1b6202a70b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:19.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.390+0000 7fa26a7fc640 1 -- 172.21.15.117:0/2416335958 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c037070 con 0x7fa26c15fcb0 2024-09-19T08:37:19.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.390+0000 7fa26a7fc640 1 -- 172.21.15.117:0/2416335958 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa25c032440 con 0x7fa26c15fcb0 2024-09-19T08:37:19.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.390+0000 7fa26a7fc640 1 -- 172.21.15.117:0/2416335958 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c032810 con 0x7fa26c15fcb0 2024-09-19T08:37:19.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.390+0000 7fa2721fd640 1 -- 172.21.15.117:0/2416335958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa26c15fcb0 msgr2=0x7fa26c0ce5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:19.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.390+0000 7fa2721fd640 1 --2- 172.21.15.117:0/2416335958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa26c15fcb0 0x7fa26c0ce5d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0c5c90 tx=0x7fa25c02a1a0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.390+0000 7fa2721fd640 1 -- 172.21.15.117:0/2416335958 shutdown_connections 2024-09-19T08:37:19.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.390+0000 7fa2721fd640 1 --2- 172.21.15.117:0/2416335958 >> v2:172.21.15.146:3300/0 conn(0x7fa26c0cd120 0x7fa26c09b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.390+0000 7fa2721fd640 1 --2- 172.21.15.117:0/2416335958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa26c15fcb0 0x7fa26c0ce5d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.390+0000 7fa2721fd640 1 -- 172.21.15.117:0/2416335958 >> 172.21.15.117:0/2416335958 conn(0x7fa26c0d2230 msgr2=0x7fa26c0d2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:19.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.391+0000 7fa2721fd640 1 -- 172.21.15.117:0/2416335958 shutdown_connections 2024-09-19T08:37:19.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.391+0000 7fa2721fd640 1 -- 172.21.15.117:0/2416335958 wait complete. 2024-09-19T08:37:19.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.392+0000 7fa2721fd640 1 Processor -- start 2024-09-19T08:37:19.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.392+0000 7fa2721fd640 1 -- start start 2024-09-19T08:37:19.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.392+0000 7fa2721fd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa26c0cccd0 0x7fa26c1f4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.392+0000 7fa2721fd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa26c0cd120 0x7fa26c0b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.392+0000 7fa2721fd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa26c15fcb0 0x7fa26c0b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.393+0000 7fa2721fd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa26c15d550 con 0x7fa26c0cd120 2024-09-19T08:37:19.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.393+0000 7fa2721fd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa26c09ad70 con 0x7fa26c15fcb0 2024-09-19T08:37:19.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.393+0000 7fa2721fd640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fa26c1607a0 con 0x7fa26c0cccd0 2024-09-19T08:37:19.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.393+0000 7fa26affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa26c0cd120 0x7fa26c0b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.393+0000 7fa26affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa26c0cd120 0x7fa26c0b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54170/0 (socket says 172.21.15.117:54170) 2024-09-19T08:37:19.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.393+0000 7fa26affd640 1 -- 172.21.15.117:0/66983668 learned_addr learned my addr 172.21.15.117:0/66983668 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:19.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.393+0000 7fa26bfff640 1 --2- 172.21.15.117:0/66983668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa26c15fcb0 0x7fa26c0b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.393+0000 7fa26b7fe640 1 --2- 172.21.15.117:0/66983668 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa26c0cccd0 0x7fa26c1f4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.393+0000 7fa26affd640 1 -- 172.21.15.117:0/66983668 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa26c0cccd0 msgr2=0x7fa26c1f4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:19.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.393+0000 7fa26affd640 1 --2- 172.21.15.117:0/66983668 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa26c0cccd0 0x7fa26c1f4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.393+0000 7fa26affd640 1 -- 172.21.15.117:0/66983668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa26c15fcb0 msgr2=0x7fa26c0b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:19.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.393+0000 7fa26affd640 1 --2- 172.21.15.117:0/66983668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa26c15fcb0 0x7fa26c0b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.393+0000 7fa26affd640 1 -- 172.21.15.117:0/66983668 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa26c06ed10 con 0x7fa26c0cd120 2024-09-19T08:37:19.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.393+0000 7fa26affd640 1 --2- 172.21.15.117:0/66983668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa26c0cd120 0x7fa26c0b64e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa26000c4d0 tx=0x7fa26000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:19.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.393+0000 7fa253fff640 1 -- 172.21.15.117:0/66983668 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa260018070 con 0x7fa26c0cd120 2024-09-19T08:37:19.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.393+0000 7fa253fff640 1 -- 172.21.15.117:0/66983668 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa260007500 con 0x7fa26c0cd120 2024-09-19T08:37:19.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.393+0000 7fa2721fd640 1 -- 172.21.15.117:0/66983668 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa26c1f4980 con 0x7fa26c0cd120 2024-09-19T08:37:19.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.393+0000 7fa253fff640 1 -- 172.21.15.117:0/66983668 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa260004a20 con 0x7fa26c0cd120 2024-09-19T08:37:19.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.393+0000 7fa2721fd640 1 -- 172.21.15.117:0/66983668 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa26c1f4f40 con 0x7fa26c0cd120 2024-09-19T08:37:19.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.394+0000 7fa2721fd640 1 -- 172.21.15.117:0/66983668 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa26c160ab0 con 0x7fa26c0cd120 2024-09-19T08:37:19.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.395+0000 7fa253fff640 1 -- 172.21.15.117:0/66983668 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa26001b070 con 0x7fa26c0cd120 2024-09-19T08:37:19.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.395+0000 7fa253fff640 1 --2- 172.21.15.117:0/66983668 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa25806c2b0 0x7fa25806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.395+0000 7fa253fff640 1 -- 172.21.15.117:0/66983668 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa26008a980 con 0x7fa26c0cd120 2024-09-19T08:37:19.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.395+0000 7fa26b7fe640 1 --2- 172.21.15.117:0/66983668 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa25806c2b0 0x7fa25806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.396+0000 7fa26b7fe640 1 --2- 172.21.15.117:0/66983668 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa25806c2b0 0x7fa25806e770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa25c034000 tx=0x7fa25c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:19.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.399+0000 7fa253fff640 1 -- 172.21.15.117:0/66983668 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa2600587f0 con 0x7fa26c0cd120 2024-09-19T08:37:19.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.599+0000 7fa2721fd640 1 -- 172.21.15.117:0/66983668 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa26c0d2e90 con 0x7fa26c0cd120 2024-09-19T08:37:19.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.599+0000 7fa253fff640 1 -- 172.21.15.117:0/66983668 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5231 (secure 0 0 0) 0x7fa26005caf0 con 0x7fa26c0cd120 2024-09-19T08:37:19.599 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:19.599 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":7,"btime":"2024-09-19T08:37:18:338976+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2592540396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2592540396},{"type":"v1","addr":"172.21.15.117:6833","nonce":2592540396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3561335184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3561335184},{"type":"v1","addr":"172.21.15.117:6835","nonce":3561335184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/2623207604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2623207604},{"type":"v1","addr":"172.21.15.146:6837","nonce":2623207604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:37:12.640173+0000","modified":"2024-09-19T08:37:17.670309+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6836/2942334805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2942334805},{"type":"v1","addr":"172.21.15.146:6836","nonce":2942334805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4303,"qdb_cluster":[4303]},"id":1}]} 2024-09-19T08:37:19.600 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 7 2024-09-19T08:37:19.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.601+0000 7fa2721fd640 1 -- 172.21.15.117:0/66983668 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa25806c2b0 msgr2=0x7fa25806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:19.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.601+0000 7fa2721fd640 1 --2- 172.21.15.117:0/66983668 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa25806c2b0 0x7fa25806e770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa25c034000 tx=0x7fa25c02e000 comp rx=0 tx=0).stop 2024-09-19T08:37:19.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.601+0000 7fa2721fd640 1 -- 172.21.15.117:0/66983668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa26c0cd120 msgr2=0x7fa26c0b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:19.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.601+0000 7fa2721fd640 1 --2- 172.21.15.117:0/66983668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa26c0cd120 0x7fa26c0b64e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa26000c4d0 tx=0x7fa26000c990 comp rx=0 tx=0).stop 2024-09-19T08:37:19.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.601+0000 7fa2721fd640 1 -- 172.21.15.117:0/66983668 shutdown_connections 2024-09-19T08:37:19.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.601+0000 7fa2721fd640 1 --2- 172.21.15.117:0/66983668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa26c15fcb0 0x7fa26c0b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.601+0000 7fa2721fd640 1 --2- 172.21.15.117:0/66983668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa26c0cd120 0x7fa26c0b64e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.601+0000 7fa2721fd640 1 --2- 172.21.15.117:0/66983668 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa25806c2b0 0x7fa25806e770 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.601+0000 7fa2721fd640 1 --2- 172.21.15.117:0/66983668 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa26c0cccd0 0x7fa26c1f4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.601+0000 7fa2721fd640 1 -- 172.21.15.117:0/66983668 >> 172.21.15.117:0/66983668 conn(0x7fa26c0d2230 msgr2=0x7fa26c09b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:19.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.601+0000 7fa2721fd640 1 -- 172.21.15.117:0/66983668 shutdown_connections 2024-09-19T08:37:19.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.601+0000 7fa2721fd640 1 -- 172.21.15.117:0/66983668 wait complete. 2024-09-19T08:37:19.612 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:37:19.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.709+0000 7ff379af1640 1 Processor -- start 2024-09-19T08:37:19.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.709+0000 7ff379af1640 1 -- start start 2024-09-19T08:37:19.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.710+0000 7ff379af1640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff37415e2a0 0x7ff37406d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.710+0000 7ff379af1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3740d1880 con 0x7ff37406d960 2024-09-19T08:37:19.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.710+0000 7ff379af1640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3740d1b60 con 0x7ff37415e680 2024-09-19T08:37:19.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.710+0000 7ff379af1640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7ff3740cf2d0 con 0x7ff37415e2a0 2024-09-19T08:37:19.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.710+0000 7ff373fff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7ff37406d960 0x7ff3740d4370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:35798/0 (socket says 172.21.15.117:35798) 2024-09-19T08:37:19.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.710+0000 7ff373fff640 1 -- 172.21.15.117:0/1937406831 learned_addr learned my addr 172.21.15.117:0/1937406831 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:19.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3727fc640 1 -- 172.21.15.117:0/1937406831 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2207265937 0 0) 0x7ff3740d1880 con 0x7ff37406d960 2024-09-19T08:37:19.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3727fc640 1 -- 172.21.15.117:0/1937406831 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff35c003520 con 0x7ff37406d960 2024-09-19T08:37:19.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3737fe640 1 --2- 172.21.15.117:0/1937406831 >> v2:172.21.15.146:3300/0 conn(0x7ff37415e2a0 0x7ff37406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3727fc640 1 -- 172.21.15.117:0/1937406831 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1023865412 0 0) 0x7ff35c003520 con 0x7ff37406d960 2024-09-19T08:37:19.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3727fc640 1 -- 172.21.15.117:0/1937406831 >> v2:172.21.15.146:3300/0 conn(0x7ff37415e2a0 msgr2=0x7ff37406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:19.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3727fc640 1 --2- 172.21.15.117:0/1937406831 >> v2:172.21.15.146:3300/0 conn(0x7ff37415e2a0 0x7ff37406d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3727fc640 1 -- 172.21.15.117:0/1937406831 >> v1:172.21.15.146:6789/0 conn(0x7ff37415e680 legacy=0x7ff3740cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:19.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3727fc640 1 -- 172.21.15.117:0/1937406831 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3740cf5b0 con 0x7ff37406d960 2024-09-19T08:37:19.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3727fc640 1 -- 172.21.15.117:0/1937406831 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7ff36c001670 con 0x7ff37406d960 2024-09-19T08:37:19.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3727fc640 1 -- 172.21.15.117:0/1937406831 >> v1:172.21.15.117:6789/0 conn(0x7ff37406d960 legacy=0x7ff3740d4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:19.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3727fc640 1 --2- 172.21.15.117:0/1937406831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff35c0039b0 0x7ff35c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3727fc640 1 --2- 172.21.15.117:0/1937406831 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff35c004800 0x7ff35c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3727fc640 1 --2- 172.21.15.117:0/1937406831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff35c0051c0 0x7ff35c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3727fc640 1 -- 172.21.15.117:0/1937406831 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff3740cf2d0 con 0x7ff35c0039b0 2024-09-19T08:37:19.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3727fc640 1 -- 172.21.15.117:0/1937406831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c00c060 con 0x7ff35c0051c0 2024-09-19T08:37:19.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3727fc640 1 -- 172.21.15.117:0/1937406831 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7ff35c00c260 con 0x7ff35c004800 2024-09-19T08:37:19.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3737fe640 1 --2- 172.21.15.117:0/1937406831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff35c0039b0 0x7ff35c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff373fff640 1 --2- 172.21.15.117:0/1937406831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff35c0051c0 0x7ff35c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff372ffd640 1 --2- 172.21.15.117:0/1937406831 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff35c004800 0x7ff35c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3737fe640 1 -- 172.21.15.117:0/1937406831 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff35c004800 msgr2=0x7ff35c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:19.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3737fe640 1 --2- 172.21.15.117:0/1937406831 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff35c004800 0x7ff35c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3737fe640 1 -- 172.21.15.117:0/1937406831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff35c0051c0 msgr2=0x7ff35c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:19.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3737fe640 1 --2- 172.21.15.117:0/1937406831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff35c0051c0 0x7ff35c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff373fff640 1 -- 172.21.15.117:0/1937406831 reap_dead start 2024-09-19T08:37:19.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.711+0000 7ff3737fe640 1 -- 172.21.15.117:0/1937406831 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35c003520 con 0x7ff35c0039b0 2024-09-19T08:37:19.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.712+0000 7ff3737fe640 1 --2- 172.21.15.117:0/1937406831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff35c0039b0 0x7ff35c003dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff364009fc0 tx=0x7ff35c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23845b7cff519c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:19.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.712+0000 7ff3727fc640 1 -- 172.21.15.117:0/1937406831 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff364009c10 con 0x7ff35c0039b0 2024-09-19T08:37:19.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.712+0000 7ff3727fc640 1 -- 172.21.15.117:0/1937406831 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff364036070 con 0x7ff35c0039b0 2024-09-19T08:37:19.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.712+0000 7ff3727fc640 1 -- 172.21.15.117:0/1937406831 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff364031880 con 0x7ff35c0039b0 2024-09-19T08:37:19.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.713+0000 7ff379af1640 1 -- 172.21.15.117:0/1937406831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff35c0039b0 msgr2=0x7ff35c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:19.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.713+0000 7ff379af1640 1 --2- 172.21.15.117:0/1937406831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff35c0039b0 0x7ff35c003dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff364009fc0 tx=0x7ff35c005830 comp rx=0 tx=0).stop 2024-09-19T08:37:19.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.713+0000 7ff379af1640 1 -- 172.21.15.117:0/1937406831 shutdown_connections 2024-09-19T08:37:19.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.713+0000 7ff379af1640 1 --2- 172.21.15.117:0/1937406831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff35c0039b0 0x7ff35c003dd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.713+0000 7ff379af1640 1 -- 172.21.15.117:0/1937406831 >> 172.21.15.117:0/1937406831 conn(0x7ff37409d760 msgr2=0x7ff37408bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:19.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.713+0000 7ff379af1640 1 -- 172.21.15.117:0/1937406831 shutdown_connections 2024-09-19T08:37:19.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.713+0000 7ff379af1640 1 -- 172.21.15.117:0/1937406831 wait complete. 2024-09-19T08:37:19.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.714+0000 7ff379af1640 1 Processor -- start 2024-09-19T08:37:19.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.714+0000 7ff379af1640 1 -- start start 2024-09-19T08:37:19.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff379af1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff35c0039b0 0x7ff3741f4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff379af1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3741f72c0 0x7ff3740c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff379af1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff37415f340 0x7ff37415f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff379af1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff37406d5a0 con 0x7ff35c0039b0 2024-09-19T08:37:19.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff379af1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff37406d420 con 0x7ff37415f340 2024-09-19T08:37:19.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff379af1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7ff37406d720 con 0x7ff3741f72c0 2024-09-19T08:37:19.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff3737fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff35c0039b0 0x7ff3741f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff3737fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff35c0039b0 0x7ff3741f4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54190/0 (socket says 172.21.15.117:54190) 2024-09-19T08:37:19.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff3737fe640 1 -- 172.21.15.117:0/2683071749 learned_addr learned my addr 172.21.15.117:0/2683071749 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:19.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff373fff640 1 --2- 172.21.15.117:0/2683071749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff37415f340 0x7ff37415f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff372ffd640 1 --2- 172.21.15.117:0/2683071749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3741f72c0 0x7ff3740c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff3737fe640 1 -- 172.21.15.117:0/2683071749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3741f72c0 msgr2=0x7ff3740c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:19.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff3737fe640 1 --2- 172.21.15.117:0/2683071749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3741f72c0 0x7ff3740c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff3737fe640 1 -- 172.21.15.117:0/2683071749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff37415f340 msgr2=0x7ff37415f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:19.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff3737fe640 1 --2- 172.21.15.117:0/2683071749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff37415f340 0x7ff37415f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff3737fe640 1 -- 172.21.15.117:0/2683071749 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3740c9ba0 con 0x7ff35c0039b0 2024-09-19T08:37:19.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff372ffd640 1 --2- 172.21.15.117:0/2683071749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3741f72c0 0x7ff3740c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:19.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff3737fe640 1 --2- 172.21.15.117:0/2683071749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff35c0039b0 0x7ff3741f4410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff36400e230 tx=0x7ff364009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:19.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff35bfff640 1 -- 172.21.15.117:0/2683071749 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff364009c10 con 0x7ff35c0039b0 2024-09-19T08:37:19.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff35bfff640 1 -- 172.21.15.117:0/2683071749 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff364003990 con 0x7ff35c0039b0 2024-09-19T08:37:19.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff379af1640 1 -- 172.21.15.117:0/2683071749 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3740c9e80 con 0x7ff35c0039b0 2024-09-19T08:37:19.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff35bfff640 1 -- 172.21.15.117:0/2683071749 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff364003d60 con 0x7ff35c0039b0 2024-09-19T08:37:19.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.715+0000 7ff379af1640 1 -- 172.21.15.117:0/2683071749 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3740ca440 con 0x7ff35c0039b0 2024-09-19T08:37:19.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.717+0000 7ff379af1640 1 -- 172.21.15.117:0/2683071749 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3740d0c50 con 0x7ff35c0039b0 2024-09-19T08:37:19.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.717+0000 7ff35bfff640 1 -- 172.21.15.117:0/2683071749 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff364005d10 con 0x7ff35c0039b0 2024-09-19T08:37:19.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.717+0000 7ff35bfff640 1 --2- 172.21.15.117:0/2683071749 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff36006c2e0 0x7ff36006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:19.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.717+0000 7ff35bfff640 1 -- 172.21.15.117:0/2683071749 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff3640acad0 con 0x7ff35c0039b0 2024-09-19T08:37:19.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.718+0000 7ff372ffd640 1 --2- 172.21.15.117:0/2683071749 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff36006c2e0 0x7ff36006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:19.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.718+0000 7ff372ffd640 1 --2- 172.21.15.117:0/2683071749 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff36006c2e0 0x7ff36006e7a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff368000c00 tx=0x7ff368009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:19.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.722+0000 7ff35bfff640 1 -- 172.21.15.117:0/2683071749 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff36407b020 con 0x7ff35c0039b0 2024-09-19T08:37:19.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.891+0000 7ff379af1640 1 -- 172.21.15.117:0/2683071749 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff37406cf90 con 0x7ff35c0039b0 2024-09-19T08:37:19.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.892+0000 7ff35bfff640 1 -- 172.21.15.117:0/2683071749 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18650 (secure 0 0 0) 0x7ff36407a920 con 0x7ff35c0039b0 2024-09-19T08:37:19.892 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:19.892 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":26,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:37:17.670150+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:37:10.463000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:37:11.619440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:37:15.342435+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:37:19.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.894+0000 7ff379af1640 1 -- 172.21.15.117:0/2683071749 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff36006c2e0 msgr2=0x7ff36006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:19.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.894+0000 7ff379af1640 1 --2- 172.21.15.117:0/2683071749 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff36006c2e0 0x7ff36006e7a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff368000c00 tx=0x7ff368009040 comp rx=0 tx=0).stop 2024-09-19T08:37:19.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.894+0000 7ff379af1640 1 -- 172.21.15.117:0/2683071749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff35c0039b0 msgr2=0x7ff3741f4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:19.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.894+0000 7ff379af1640 1 --2- 172.21.15.117:0/2683071749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff35c0039b0 0x7ff3741f4410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff36400e230 tx=0x7ff364009750 comp rx=0 tx=0).stop 2024-09-19T08:37:19.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.894+0000 7ff379af1640 1 -- 172.21.15.117:0/2683071749 shutdown_connections 2024-09-19T08:37:19.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.894+0000 7ff379af1640 1 --2- 172.21.15.117:0/2683071749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff37415f340 0x7ff37415f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.894+0000 7ff379af1640 1 --2- 172.21.15.117:0/2683071749 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff36006c2e0 0x7ff36006e7a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.894+0000 7ff379af1640 1 --2- 172.21.15.117:0/2683071749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3741f72c0 0x7ff3740c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.894+0000 7ff379af1640 1 --2- 172.21.15.117:0/2683071749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff35c0039b0 0x7ff3741f4410 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:19.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.894+0000 7ff379af1640 1 -- 172.21.15.117:0/2683071749 >> 172.21.15.117:0/2683071749 conn(0x7ff37409d760 msgr2=0x7ff37415d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:19.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.894+0000 7ff379af1640 1 -- 172.21.15.117:0/2683071749 shutdown_connections 2024-09-19T08:37:19.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:19.894+0000 7ff379af1640 1 -- 172.21.15.117:0/2683071749 wait complete. 2024-09-19T08:37:20.307 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T08:37:12.640173+0000', 'modified': '2024-09-19T08:37:17.670309+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4303}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4303': {'gid': 4303, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6836/2942334805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 2942334805}, {'type': 'v1', 'addr': '172.21.15.146:6836', 'nonce': 2942334805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4303, 'qdb_cluster': [4303]} 2024-09-19T08:37:20.307 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T08:37:20.308 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-19T08:37:20.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.408+0000 7f6257bc4640 1 Processor -- start 2024-09-19T08:37:20.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.409+0000 7f6257bc4640 1 -- start start 2024-09-19T08:37:20.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.409+0000 7f6257bc4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62500d2750 0x7f625013f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.409+0000 7f6257bc4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f625013fda0 con 0x7f62500d04d0 2024-09-19T08:37:20.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.409+0000 7f6257bc4640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62500d2b30 con 0x7f6250072250 2024-09-19T08:37:20.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f6257bc4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f6250145bd0 con 0x7f62500d2750 2024-09-19T08:37:20.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f6256161640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f62500d04d0 0x7f6250160010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:35806/0 (socket says 172.21.15.117:35806) 2024-09-19T08:37:20.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f6256161640 1 -- 172.21.15.117:0/2112167345 learned_addr learned my addr 172.21.15.117:0/2112167345 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:20.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f625495e640 1 -- 172.21.15.117:0/2112167345 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 842015747 0 0) 0x7f625013fda0 con 0x7f62500d04d0 2024-09-19T08:37:20.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f6255960640 1 --2- 172.21.15.117:0/2112167345 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62500d2750 0x7f625013f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f625495e640 1 -- 172.21.15.117:0/2112167345 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f623c003520 con 0x7f62500d04d0 2024-09-19T08:37:20.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f625495e640 1 -- 172.21.15.117:0/2112167345 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 751834001 0 0) 0x7f623c003520 con 0x7f62500d04d0 2024-09-19T08:37:20.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f625495e640 1 -- 172.21.15.117:0/2112167345 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62500d2750 msgr2=0x7f625013f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:20.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f625495e640 1 --2- 172.21.15.117:0/2112167345 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62500d2750 0x7f625013f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f625495e640 1 -- 172.21.15.117:0/2112167345 >> v1:172.21.15.146:6789/0 conn(0x7f6250072250 legacy=0x7f62500cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:20.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f625495e640 1 -- 172.21.15.117:0/2112167345 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6250141c60 con 0x7f62500d04d0 2024-09-19T08:37:20.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f625495e640 1 -- 172.21.15.117:0/2112167345 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f6248001a10 con 0x7f62500d04d0 2024-09-19T08:37:20.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f625495e640 1 -- 172.21.15.117:0/2112167345 >> v1:172.21.15.117:6789/0 conn(0x7f62500d04d0 legacy=0x7f6250160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:20.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f625495e640 1 --2- 172.21.15.117:0/2112167345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f623c0039e0 0x7f623c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f625495e640 1 --2- 172.21.15.117:0/2112167345 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62500d2750 0x7f623c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f625495e640 1 --2- 172.21.15.117:0/2112167345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623c004d40 0x7f623c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f625495e640 1 -- 172.21.15.117:0/2112167345 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f623c00bac0 con 0x7f623c004d40 2024-09-19T08:37:20.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f625495e640 1 -- 172.21.15.117:0/2112167345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f623c00bc70 con 0x7f623c0039e0 2024-09-19T08:37:20.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f625495e640 1 -- 172.21.15.117:0/2112167345 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f623c00be70 con 0x7f62500d2750 2024-09-19T08:37:20.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f6256161640 1 --2- 172.21.15.117:0/2112167345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623c004d40 0x7f623c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f6255960640 1 --2- 172.21.15.117:0/2112167345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f623c0039e0 0x7f623c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.410+0000 7f625515f640 1 --2- 172.21.15.117:0/2112167345 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62500d2750 0x7f623c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.411+0000 7f6256161640 1 -- 172.21.15.117:0/2112167345 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62500d2750 msgr2=0x7f623c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:20.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.411+0000 7f6256161640 1 --2- 172.21.15.117:0/2112167345 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62500d2750 0x7f623c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.411+0000 7f6256161640 1 -- 172.21.15.117:0/2112167345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f623c0039e0 msgr2=0x7f623c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:20.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.411+0000 7f6256161640 1 --2- 172.21.15.117:0/2112167345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f623c0039e0 0x7f623c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.411+0000 7f6256161640 1 -- 172.21.15.117:0/2112167345 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623c003520 con 0x7f623c004d40 2024-09-19T08:37:20.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.411+0000 7f6256161640 1 --2- 172.21.15.117:0/2112167345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623c004d40 0x7f623c0051c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6250073e90 tx=0x7f623c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd331e3b19643c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:20.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.411+0000 7f625495e640 1 -- 172.21.15.117:0/2112167345 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624800a4a0 con 0x7f623c004d40 2024-09-19T08:37:20.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.411+0000 7f625495e640 1 -- 172.21.15.117:0/2112167345 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624802f070 con 0x7f623c004d40 2024-09-19T08:37:20.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.411+0000 7f625495e640 1 -- 172.21.15.117:0/2112167345 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624802bc50 con 0x7f623c004d40 2024-09-19T08:37:20.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.412+0000 7f6257bc4640 1 -- 172.21.15.117:0/2112167345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623c004d40 msgr2=0x7f623c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:20.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.412+0000 7f6257bc4640 1 --2- 172.21.15.117:0/2112167345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623c004d40 0x7f623c0051c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6250073e90 tx=0x7f623c005830 comp rx=0 tx=0).stop 2024-09-19T08:37:20.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.412+0000 7f6256161640 1 -- 172.21.15.117:0/2112167345 reap_dead start 2024-09-19T08:37:20.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.412+0000 7f6257bc4640 1 -- 172.21.15.117:0/2112167345 shutdown_connections 2024-09-19T08:37:20.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.412+0000 7f6257bc4640 1 -- 172.21.15.117:0/2112167345 >> 172.21.15.117:0/2112167345 conn(0x7f62500b4040 msgr2=0x7f62500b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:20.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.412+0000 7f6257bc4640 1 -- 172.21.15.117:0/2112167345 shutdown_connections 2024-09-19T08:37:20.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.412+0000 7f6257bc4640 1 -- 172.21.15.117:0/2112167345 wait complete. 2024-09-19T08:37:20.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.413+0000 7f6257bc4640 1 Processor -- start 2024-09-19T08:37:20.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.413+0000 7f6257bc4640 1 -- start start 2024-09-19T08:37:20.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.414+0000 7f6257bc4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623c004d40 0x7f62500b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.414+0000 7f6257bc4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62500b6ed0 0x7f625006e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.414+0000 7f6257bc4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f625006ead0 0x7f62500cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.414+0000 7f6257bc4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6250142220 con 0x7f623c004d40 2024-09-19T08:37:20.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.414+0000 7f6257bc4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f62501427e0 con 0x7f625006ead0 2024-09-19T08:37:20.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.414+0000 7f6257bc4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f6250142500 con 0x7f62500b6ed0 2024-09-19T08:37:20.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.414+0000 7f6255960640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623c004d40 0x7f62500b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.414+0000 7f6255960640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623c004d40 0x7f62500b27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54210/0 (socket says 172.21.15.117:54210) 2024-09-19T08:37:20.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.414+0000 7f6255960640 1 -- 172.21.15.117:0/1438982393 learned_addr learned my addr 172.21.15.117:0/1438982393 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:20.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.414+0000 7f6255960640 1 -- 172.21.15.117:0/1438982393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62500b6ed0 msgr2=0x7f625006e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:20.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.414+0000 7f6255960640 1 --2- 172.21.15.117:0/1438982393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62500b6ed0 0x7f625006e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.414+0000 7f6255960640 1 -- 172.21.15.117:0/1438982393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f625006ead0 msgr2=0x7f62500cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:20.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.414+0000 7f6256161640 1 --2- 172.21.15.117:0/1438982393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f625006ead0 0x7f62500cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.414+0000 7f6255960640 1 --2- 172.21.15.117:0/1438982393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f625006ead0 0x7f62500cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.414+0000 7f6255960640 1 -- 172.21.15.117:0/1438982393 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62500b7390 con 0x7f623c004d40 2024-09-19T08:37:20.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.414+0000 7f6256161640 1 --2- 172.21.15.117:0/1438982393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f625006ead0 0x7f62500cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:20.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.414+0000 7f6255960640 1 --2- 172.21.15.117:0/1438982393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623c004d40 0x7f62500b27e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f624c0119a0 tx=0x7f624c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:20.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.415+0000 7f62427fc640 1 -- 172.21.15.117:0/1438982393 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c00fa90 con 0x7f623c004d40 2024-09-19T08:37:20.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.415+0000 7f62427fc640 1 -- 172.21.15.117:0/1438982393 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624c00fc30 con 0x7f623c004d40 2024-09-19T08:37:20.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.415+0000 7f6257bc4640 1 -- 172.21.15.117:0/1438982393 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62500b7670 con 0x7f623c004d40 2024-09-19T08:37:20.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.415+0000 7f62427fc640 1 -- 172.21.15.117:0/1438982393 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c014440 con 0x7f623c004d40 2024-09-19T08:37:20.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.415+0000 7f6257bc4640 1 -- 172.21.15.117:0/1438982393 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62500b7c30 con 0x7f623c004d40 2024-09-19T08:37:20.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.416+0000 7f62427fc640 1 -- 172.21.15.117:0/1438982393 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f624c012040 con 0x7f623c004d40 2024-09-19T08:37:20.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.416+0000 7f62427fc640 1 --2- 172.21.15.117:0/1438982393 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f623406c2e0 0x7f623406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.417+0000 7f62427fc640 1 -- 172.21.15.117:0/1438982393 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f624c08bed0 con 0x7f623c004d40 2024-09-19T08:37:20.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.417+0000 7f625515f640 1 --2- 172.21.15.117:0/1438982393 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f623406c2e0 0x7f623406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.417+0000 7f625515f640 1 --2- 172.21.15.117:0/1438982393 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f623406c2e0 0x7f623406e7a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f62500b3c40 tx=0x7f6244009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:20.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.418+0000 7f625aa3a740 1 Processor -- start 2024-09-19T08:37:20.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.418+0000 7f625aa3a740 1 -- start start 2024-09-19T08:37:20.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.418+0000 7f625aa3a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5d02c0 0x555d2a615a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.418+0000 7f625aa3a740 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555d2a5cda80 0x555d2a5d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.418+0000 7f625aa3a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555d2a5d1a50 0x555d2a5ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.418+0000 7f625aa3a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555d2a532520 con 0x555d2a5d02c0 2024-09-19T08:37:20.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.418+0000 7f625aa3a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555d2a4da3e0 con 0x555d2a5d1a50 2024-09-19T08:37:20.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.418+0000 7f625aa3a740 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x555d2a52e4e0 con 0x555d2a5cda80 2024-09-19T08:37:20.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.418+0000 7f6255960640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5d02c0 0x555d2a615a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.418+0000 7f6255960640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5d02c0 0x555d2a615a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54218/0 (socket says 172.21.15.117:54218) 2024-09-19T08:37:20.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.418+0000 7f6255960640 1 -- 172.21.15.117:0/1667780624 learned_addr learned my addr 172.21.15.117:0/1667780624 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:20.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.418+0000 7f6256161640 1 --2- 172.21.15.117:0/1667780624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555d2a5d1a50 0x555d2a5ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.418+0000 7f625515f640 1 --2- 172.21.15.117:0/1667780624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555d2a5cda80 0x555d2a5d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.419+0000 7f6255960640 1 -- 172.21.15.117:0/1667780624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555d2a5cda80 msgr2=0x555d2a5d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:20.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.419+0000 7f6255960640 1 --2- 172.21.15.117:0/1667780624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555d2a5cda80 0x555d2a5d06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.419+0000 7f6255960640 1 -- 172.21.15.117:0/1667780624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555d2a5d1a50 msgr2=0x555d2a5ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:20.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.419+0000 7f6255960640 1 --2- 172.21.15.117:0/1667780624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555d2a5d1a50 0x555d2a5ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.419+0000 7f6255960640 1 -- 172.21.15.117:0/1667780624 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d2a4f52f0 con 0x555d2a5d02c0 2024-09-19T08:37:20.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.419+0000 7f6256161640 1 --2- 172.21.15.117:0/1667780624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555d2a5d1a50 0x555d2a5ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:20.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.419+0000 7f6255960640 1 --2- 172.21.15.117:0/1667780624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5d02c0 0x555d2a615a60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f624c011ff0 tx=0x7f624c05e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862476176efa7e6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:20.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.419+0000 7f62337fe640 1 -- 172.21.15.117:0/1667780624 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c056320 con 0x555d2a5d02c0 2024-09-19T08:37:20.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.419+0000 7f62337fe640 1 -- 172.21.15.117:0/1667780624 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624c059f10 con 0x555d2a5d02c0 2024-09-19T08:37:20.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.419+0000 7f62337fe640 1 -- 172.21.15.117:0/1667780624 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c062350 con 0x555d2a5d02c0 2024-09-19T08:37:20.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.419+0000 7f625aa3a740 1 -- 172.21.15.117:0/1667780624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5d02c0 msgr2=0x555d2a615a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:20.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.419+0000 7f625aa3a740 1 --2- 172.21.15.117:0/1667780624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5d02c0 0x555d2a615a60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f624c011ff0 tx=0x7f624c05e0f0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.420+0000 7f625aa3a740 1 -- 172.21.15.117:0/1667780624 shutdown_connections 2024-09-19T08:37:20.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.420+0000 7f625aa3a740 1 --2- 172.21.15.117:0/1667780624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555d2a5d1a50 0x555d2a5ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.420+0000 7f625aa3a740 1 --2- 172.21.15.117:0/1667780624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555d2a5cda80 0x555d2a5d06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.420+0000 7f625aa3a740 1 --2- 172.21.15.117:0/1667780624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5d02c0 0x555d2a615a60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.420+0000 7f625aa3a740 1 -- 172.21.15.117:0/1667780624 >> 172.21.15.117:0/1667780624 conn(0x555d2a5cca80 msgr2=0x555d2a614f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:20.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.420+0000 7f625aa3a740 1 -- 172.21.15.117:0/1667780624 shutdown_connections 2024-09-19T08:37:20.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.420+0000 7f625aa3a740 1 -- 172.21.15.117:0/1667780624 wait complete. 2024-09-19T08:37:20.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.420+0000 7f625aa3a740 1 -- start start 2024-09-19T08:37:20.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.420+0000 7f625aa3a740 1 Processor -- start 2024-09-19T08:37:20.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.421+0000 7f625aa3a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5d02c0 0x555d2a5f07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.421+0000 7f625aa3a740 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555d2a5d1a50 0x555d2a5eed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.421+0000 7f625aa3a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555d2a5ce820 0x555d2a5ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.421+0000 7f625aa3a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555d2a5cbf20 con 0x555d2a5d02c0 2024-09-19T08:37:20.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.421+0000 7f625aa3a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555d2a4bb450 con 0x555d2a5ce820 2024-09-19T08:37:20.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.421+0000 7f625aa3a740 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x555d2a616290 con 0x555d2a5d1a50 2024-09-19T08:37:20.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.421+0000 7f625aa3a740 10 client.0 _ll_register_callbacks cb 0x555d2a244ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:37:20.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.421+0000 7f6255960640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5d02c0 0x555d2a5f07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.421+0000 7f6255960640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5d02c0 0x555d2a5f07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54234/0 (socket says 172.21.15.117:54234) 2024-09-19T08:37:20.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.421+0000 7f6255960640 1 -- 172.21.15.117:0/3084849579 learned_addr learned my addr 172.21.15.117:0/3084849579 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:20.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.421+0000 7f6256161640 1 --2- 172.21.15.117:0/3084849579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555d2a5ce820 0x555d2a5ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.421+0000 7f625515f640 1 --2- 172.21.15.117:0/3084849579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555d2a5d1a50 0x555d2a5eed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.421+0000 7f6255960640 1 -- 172.21.15.117:0/3084849579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555d2a5d1a50 msgr2=0x555d2a5eed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:20.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.421+0000 7f6255960640 1 --2- 172.21.15.117:0/3084849579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555d2a5d1a50 0x555d2a5eed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.421+0000 7f6255960640 1 -- 172.21.15.117:0/3084849579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555d2a5ce820 msgr2=0x555d2a5ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:20.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.421+0000 7f6255960640 1 --2- 172.21.15.117:0/3084849579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555d2a5ce820 0x555d2a5ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.421+0000 7f6255960640 1 -- 172.21.15.117:0/3084849579 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d2a2452d0 con 0x555d2a5d02c0 2024-09-19T08:37:20.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.422+0000 7f6255960640 1 --2- 172.21.15.117:0/3084849579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5d02c0 0x555d2a5f07a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f624c0629a0 tx=0x7f624c016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38ba8d35dc5ccff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:20.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.422+0000 7f6230ff9640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-19T08:37:20.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.422+0000 7f6230ff9640 1 -- 172.21.15.117:0/3084849579 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c07d060 con 0x555d2a5d02c0 2024-09-19T08:37:20.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.422+0000 7f6230ff9640 1 -- 172.21.15.117:0/3084849579 <== mon.0 v2:172.21.15.117:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f624c062550 con 0x555d2a5d02c0 2024-09-19T08:37:20.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.422+0000 7f625aa3a740 1 -- 172.21.15.117:0/3084849579 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f624c059f10 con 0x555d2a5d02c0 2024-09-19T08:37:20.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.422+0000 7f6230ff9640 1 -- 172.21.15.117:0/3084849579 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f624c071e60 con 0x555d2a5d02c0 2024-09-19T08:37:20.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.422+0000 7f625aa3a740 10 client.4392 fetch_fsmap learned FSMap version 7 2024-09-19T08:37:20.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.422+0000 7f625aa3a740 1 -- 172.21.15.117:0/3084849579 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x555d2a30f6b0 con 0x555d2a5d02c0 2024-09-19T08:37:20.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.422+0000 7f6230ff9640 1 -- 172.21.15.117:0/3084849579 <== mon.0 v2:172.21.15.117:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624c059f10 con 0x555d2a5d02c0 2024-09-19T08:37:20.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.422+0000 7f6230ff9640 1 -- 172.21.15.117:0/3084849579 <== mon.0 v2:172.21.15.117:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f624c059100 con 0x555d2a5d02c0 2024-09-19T08:37:20.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.422+0000 7f625aa3a740 10 client.4392 fetch_fsmap finished waiting for FSMap version 7 2024-09-19T08:37:20.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.422+0000 7f625aa3a740 10 client.4392 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:37:20.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.422+0000 7f625aa3a740 20 client.4392 populate_metadata read hostname 'smithi117' 2024-09-19T08:37:20.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.422+0000 7f625aa3a740 1 --2- 172.21.15.117:0/3084849579 >> [v2:172.21.15.146:6834/2942334805,v1:172.21.15.146:6836/2942334805] conn(0x555d2a5f0170 0x555d2a6325d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.422+0000 7f625aa3a740 4 client.4392 mds_command: new command op to 4303 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:37:20.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.422+0000 7f625aa3a740 1 -- 172.21.15.117:0/3084849579 --> [v2:172.21.15.146:6834/2942334805,v1:172.21.15.146:6836/2942334805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d2a53fc50 con 0x555d2a5f0170 2024-09-19T08:37:20.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.422+0000 7f625515f640 1 --2- 172.21.15.117:0/3084849579 >> [v2:172.21.15.146:6834/2942334805,v1:172.21.15.146:6836/2942334805] conn(0x555d2a5f0170 0x555d2a6325d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.423+0000 7f625515f640 1 --2- 172.21.15.117:0/3084849579 >> [v2:172.21.15.146:6834/2942334805,v1:172.21.15.146:6836/2942334805] conn(0x555d2a5f0170 0x555d2a6325d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee1956b2cab46f1c server_cookie=c5bdfff2e2e86eeb in_seq=0 out_seq=0 2024-09-19T08:37:20.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.423+0000 7f6230ff9640 10 client.4392 ms_handle_connect on v2:172.21.15.146:6834/2942334805 2024-09-19T08:37:20.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.423+0000 7f6230ff9640 1 -- 172.21.15.117:0/3084849579 <== mds.0 v2:172.21.15.146:6834/2942334805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555d2a53fc50 con 0x555d2a5f0170 2024-09-19T08:37:20.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.423+0000 7f6230ff9640 10 client.4392 handle_command_reply: tid=0 2024-09-19T08:37:20.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.423+0000 7f625aa3a740 1 client.4392 shutdown 2024-09-19T08:37:20.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.424+0000 7f625aa3a740 1 -- 172.21.15.117:0/3084849579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5d02c0 msgr2=0x555d2a5f07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:20.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.424+0000 7f625aa3a740 1 --2- 172.21.15.117:0/3084849579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5d02c0 0x555d2a5f07a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f624c0629a0 tx=0x7f624c016040 comp rx=0 tx=0).stop 2024-09-19T08:37:20.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.424+0000 7f625aa3a740 1 -- 172.21.15.117:0/3084849579 shutdown_connections 2024-09-19T08:37:20.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.424+0000 7f625aa3a740 1 --2- 172.21.15.117:0/3084849579 >> [v2:172.21.15.146:6834/2942334805,v1:172.21.15.146:6836/2942334805] conn(0x555d2a5f0170 0x555d2a6325d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.424+0000 7f625aa3a740 1 --2- 172.21.15.117:0/3084849579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555d2a5ce820 0x555d2a5ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.424+0000 7f625aa3a740 1 --2- 172.21.15.117:0/3084849579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555d2a5d1a50 0x555d2a5eed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.424+0000 7f625aa3a740 1 --2- 172.21.15.117:0/3084849579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5d02c0 0x555d2a5f07a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.424+0000 7f6230ff9640 0 client.4392 ms_handle_reset on v2:172.21.15.146:6834/2942334805 2024-09-19T08:37:20.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.424+0000 7f625aa3a740 1 -- 172.21.15.117:0/3084849579 >> 172.21.15.117:0/3084849579 conn(0x555d2a5cda80 msgr2=0x555d2a612ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:20.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.424+0000 7f625aa3a740 1 -- 172.21.15.117:0/3084849579 shutdown_connections 2024-09-19T08:37:20.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.424+0000 7f625aa3a740 1 -- 172.21.15.117:0/3084849579 wait complete. 2024-09-19T08:37:20.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.424+0000 7f625aa3a740 20 client.4392 trim_cache size 0 max 16384 2024-09-19T08:37:20.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.441+0000 7f625aa3a740 1 Processor -- start 2024-09-19T08:37:20.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.441+0000 7f625aa3a740 1 -- start start 2024-09-19T08:37:20.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.442+0000 7f625aa3a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5ce820 0x555d2a5f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.442+0000 7f625aa3a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555d2a5d02c0 0x555d2a5ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.442+0000 7f625aa3a740 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555d2a5d1a50 0x555d2a612ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.442+0000 7f625aa3a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6250201590 con 0x555d2a5ce820 2024-09-19T08:37:20.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.442+0000 7f625aa3a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f62500cb4c0 con 0x555d2a5d02c0 2024-09-19T08:37:20.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.442+0000 7f625aa3a740 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f6250200f40 con 0x555d2a5d1a50 2024-09-19T08:37:20.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.442+0000 7f6255960640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5ce820 0x555d2a5f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.442+0000 7f6255960640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5ce820 0x555d2a5f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54250/0 (socket says 172.21.15.117:54250) 2024-09-19T08:37:20.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.442+0000 7f6255960640 1 -- 172.21.15.117:0/4286900796 learned_addr learned my addr 172.21.15.117:0/4286900796 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:20.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.442+0000 7f6255960640 1 -- 172.21.15.117:0/4286900796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555d2a5d1a50 msgr2=0x555d2a612ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:20.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.442+0000 7f6255960640 1 --2- 172.21.15.117:0/4286900796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555d2a5d1a50 0x555d2a612ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.442+0000 7f6255960640 1 -- 172.21.15.117:0/4286900796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555d2a5d02c0 msgr2=0x555d2a5ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:20.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.442+0000 7f6255960640 1 --2- 172.21.15.117:0/4286900796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555d2a5d02c0 0x555d2a5ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.442+0000 7f6255960640 1 -- 172.21.15.117:0/4286900796 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d2a616a90 con 0x555d2a5ce820 2024-09-19T08:37:20.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.443+0000 7f6255960640 1 --2- 172.21.15.117:0/4286900796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5ce820 0x555d2a5f1890 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f624c056110 tx=0x7f624c089000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14095b2a9495649 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:20.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.443+0000 7f6232ffd640 1 -- 172.21.15.117:0/4286900796 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c07d070 con 0x555d2a5ce820 2024-09-19T08:37:20.445 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.443+0000 7f6232ffd640 1 -- 172.21.15.117:0/4286900796 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624c059f10 con 0x555d2a5ce820 2024-09-19T08:37:20.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.443+0000 7f6232ffd640 1 -- 172.21.15.117:0/4286900796 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c0604e0 con 0x555d2a5ce820 2024-09-19T08:37:20.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.443+0000 7f625aa3a740 1 -- 172.21.15.117:0/4286900796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5ce820 msgr2=0x555d2a5f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:20.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.443+0000 7f625aa3a740 1 --2- 172.21.15.117:0/4286900796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5ce820 0x555d2a5f1890 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f624c056110 tx=0x7f624c089000 comp rx=0 tx=0).stop 2024-09-19T08:37:20.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.443+0000 7f625aa3a740 1 -- 172.21.15.117:0/4286900796 shutdown_connections 2024-09-19T08:37:20.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.443+0000 7f625aa3a740 1 --2- 172.21.15.117:0/4286900796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555d2a5d1a50 0x555d2a612ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.443+0000 7f625aa3a740 1 --2- 172.21.15.117:0/4286900796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555d2a5d02c0 0x555d2a5ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.443+0000 7f625aa3a740 1 --2- 172.21.15.117:0/4286900796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5ce820 0x555d2a5f1890 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.443+0000 7f625aa3a740 1 -- 172.21.15.117:0/4286900796 >> 172.21.15.117:0/4286900796 conn(0x555d2a5cda80 msgr2=0x555d2a5f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:20.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.443+0000 7f625aa3a740 1 -- 172.21.15.117:0/4286900796 shutdown_connections 2024-09-19T08:37:20.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.443+0000 7f625aa3a740 1 -- 172.21.15.117:0/4286900796 wait complete. 2024-09-19T08:37:20.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.444+0000 7f625aa3a740 1 -- start start 2024-09-19T08:37:20.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.444+0000 7f625aa3a740 1 Processor -- start 2024-09-19T08:37:20.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f625aa3a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5ce820 0x555d2a610e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f625aa3a740 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555d2a5d02c0 0x555d2a62dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f625aa3a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555d2a5d1a50 0x555d2a5f0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f625aa3a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555d2a5cbf20 con 0x555d2a5ce820 2024-09-19T08:37:20.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f625aa3a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555d2a616290 con 0x555d2a5d1a50 2024-09-19T08:37:20.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f625aa3a740 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x555d2a4bb450 con 0x555d2a5d02c0 2024-09-19T08:37:20.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f625aa3a740 10 client.0 _ll_register_callbacks cb 0x7f624c059d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:37:20.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f6255960640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5ce820 0x555d2a610e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f6255960640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5ce820 0x555d2a610e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54258/0 (socket says 172.21.15.117:54258) 2024-09-19T08:37:20.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f6255960640 1 -- 172.21.15.117:0/2437140177 learned_addr learned my addr 172.21.15.117:0/2437140177 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:20.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f625515f640 1 --2- 172.21.15.117:0/2437140177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555d2a5d02c0 0x555d2a62dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f6256161640 1 --2- 172.21.15.117:0/2437140177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555d2a5d1a50 0x555d2a5f0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f6255960640 1 -- 172.21.15.117:0/2437140177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555d2a5d02c0 msgr2=0x555d2a62dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:20.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f6255960640 1 --2- 172.21.15.117:0/2437140177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555d2a5d02c0 0x555d2a62dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f6255960640 1 -- 172.21.15.117:0/2437140177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555d2a5d1a50 msgr2=0x555d2a5f0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:20.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f6255960640 1 --2- 172.21.15.117:0/2437140177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555d2a5d1a50 0x555d2a5f0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f6255960640 1 -- 172.21.15.117:0/2437140177 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d2a696600 con 0x555d2a5ce820 2024-09-19T08:37:20.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f6256161640 1 --2- 172.21.15.117:0/2437140177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555d2a5d1a50 0x555d2a5f0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:20.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f6255960640 1 --2- 172.21.15.117:0/2437140177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5ce820 0x555d2a610e80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f624c056630 tx=0x7f624c056050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9da784344b4bdf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:20.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f6230ff9640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-19T08:37:20.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f6230ff9640 1 -- 172.21.15.117:0/2437140177 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c07d070 con 0x555d2a5ce820 2024-09-19T08:37:20.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f6230ff9640 1 -- 172.21.15.117:0/2437140177 <== mon.0 v2:172.21.15.117:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f624c01edf0 con 0x555d2a5ce820 2024-09-19T08:37:20.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f625aa3a740 1 -- 172.21.15.117:0/2437140177 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f624c059f10 con 0x555d2a5ce820 2024-09-19T08:37:20.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f6230ff9640 1 -- 172.21.15.117:0/2437140177 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f624c068050 con 0x555d2a5ce820 2024-09-19T08:37:20.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f625aa3a740 10 client.4398 fetch_fsmap learned FSMap version 7 2024-09-19T08:37:20.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.445+0000 7f625aa3a740 1 -- 172.21.15.117:0/2437140177 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x555d2a696600 con 0x555d2a5ce820 2024-09-19T08:37:20.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.446+0000 7f6230ff9640 1 -- 172.21.15.117:0/2437140177 <== mon.0 v2:172.21.15.117:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624c059f10 con 0x555d2a5ce820 2024-09-19T08:37:20.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.446+0000 7f6230ff9640 1 -- 172.21.15.117:0/2437140177 <== mon.0 v2:172.21.15.117:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f624c06b020 con 0x555d2a5ce820 2024-09-19T08:37:20.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.446+0000 7f625aa3a740 10 client.4398 fetch_fsmap finished waiting for FSMap version 7 2024-09-19T08:37:20.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.446+0000 7f625aa3a740 10 client.4398 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:37:20.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.446+0000 7f625aa3a740 20 client.4398 populate_metadata read hostname 'smithi117' 2024-09-19T08:37:20.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.446+0000 7f625aa3a740 1 --2- 172.21.15.117:0/2437140177 >> [v2:172.21.15.146:6834/2942334805,v1:172.21.15.146:6836/2942334805] conn(0x555d2a693080 0x555d2a693460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.446+0000 7f625aa3a740 4 client.4398 mds_command: new command op to 4303 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:37:20.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.446+0000 7f625aa3a740 1 -- 172.21.15.117:0/2437140177 --> [v2:172.21.15.146:6834/2942334805,v1:172.21.15.146:6836/2942334805] -- command(tid 0: {"prefix": "status"}) -- 0x555d2a539fa0 con 0x555d2a693080 2024-09-19T08:37:20.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.446+0000 7f625515f640 1 --2- 172.21.15.117:0/2437140177 >> [v2:172.21.15.146:6834/2942334805,v1:172.21.15.146:6836/2942334805] conn(0x555d2a693080 0x555d2a693460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.446+0000 7f6230ff9640 10 client.4398 ms_handle_connect on v2:172.21.15.146:6834/2942334805 2024-09-19T08:37:20.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.446+0000 7f625515f640 1 --2- 172.21.15.117:0/2437140177 >> [v2:172.21.15.146:6834/2942334805,v1:172.21.15.146:6836/2942334805] conn(0x555d2a693080 0x555d2a693460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b8aa32e2794b751 server_cookie=222f266482472cea in_seq=0 out_seq=0 2024-09-19T08:37:20.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.446+0000 7f6230ff9640 1 -- 172.21.15.117:0/2437140177 <== mds.0 v2:172.21.15.146:6834/2942334805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x555d2a539fa0 con 0x555d2a693080 2024-09-19T08:37:20.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.446+0000 7f6230ff9640 10 client.4398 handle_command_reply: tid=0 2024-09-19T08:37:20.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f625aa3a740 1 client.4398 shutdown 2024-09-19T08:37:20.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f625aa3a740 1 -- 172.21.15.117:0/2437140177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5ce820 msgr2=0x555d2a610e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:20.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f625aa3a740 1 --2- 172.21.15.117:0/2437140177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5ce820 0x555d2a610e80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f624c056630 tx=0x7f624c056050 comp rx=0 tx=0).stop 2024-09-19T08:37:20.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f625aa3a740 1 -- 172.21.15.117:0/2437140177 shutdown_connections 2024-09-19T08:37:20.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f625aa3a740 1 --2- 172.21.15.117:0/2437140177 >> [v2:172.21.15.146:6834/2942334805,v1:172.21.15.146:6836/2942334805] conn(0x555d2a693080 0x555d2a693460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f625aa3a740 1 --2- 172.21.15.117:0/2437140177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555d2a5d1a50 0x555d2a5f0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f6230ff9640 0 client.4398 ms_handle_reset on v2:172.21.15.146:6834/2942334805 2024-09-19T08:37:20.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f625aa3a740 1 --2- 172.21.15.117:0/2437140177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555d2a5d02c0 0x555d2a62dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f625aa3a740 1 --2- 172.21.15.117:0/2437140177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555d2a5ce820 0x555d2a610e80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f625aa3a740 1 -- 172.21.15.117:0/2437140177 >> 172.21.15.117:0/2437140177 conn(0x555d2a5cda80 msgr2=0x555d2a5f1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:20.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f625aa3a740 1 -- 172.21.15.117:0/2437140177 shutdown_connections 2024-09-19T08:37:20.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f625aa3a740 1 -- 172.21.15.117:0/2437140177 wait complete. 2024-09-19T08:37:20.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f625aa3a740 20 client.4398 trim_cache size 0 max 16384 2024-09-19T08:37:20.457 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T08:37:20.457 INFO:teuthology.orchestra.run.smithi117.stdout: "cluster_fsid": "3be30853-f236-48ec-b905-15ecac86fc3f", 2024-09-19T08:37:20.457 INFO:teuthology.orchestra.run.smithi117.stdout: "whoami": 0, 2024-09-19T08:37:20.457 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 4303, 2024-09-19T08:37:20.458 INFO:teuthology.orchestra.run.smithi117.stdout: "want_state": "up:active", 2024-09-19T08:37:20.458 INFO:teuthology.orchestra.run.smithi117.stdout: "state": "up:active", 2024-09-19T08:37:20.458 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs", 2024-09-19T08:37:20.458 INFO:teuthology.orchestra.run.smithi117.stdout: "rank_uptime": 7.1458329139999996, 2024-09-19T08:37:20.458 INFO:teuthology.orchestra.run.smithi117.stdout: "mdsmap_epoch": 7, 2024-09-19T08:37:20.458 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_epoch": 26, 2024-09-19T08:37:20.458 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_epoch_barrier": 26, 2024-09-19T08:37:20.458 INFO:teuthology.orchestra.run.smithi117.stdout: "uptime": 13.157894773000001 2024-09-19T08:37:20.458 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T08:37:20.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f6257bc4640 1 -- 172.21.15.117:0/1438982393 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f623406c2e0 msgr2=0x7f623406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:20.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f6257bc4640 1 --2- 172.21.15.117:0/1438982393 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f623406c2e0 0x7f623406e7a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f62500b3c40 tx=0x7f6244009040 comp rx=0 tx=0).stop 2024-09-19T08:37:20.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f6257bc4640 1 -- 172.21.15.117:0/1438982393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623c004d40 msgr2=0x7f62500b27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:20.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f6257bc4640 1 --2- 172.21.15.117:0/1438982393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623c004d40 0x7f62500b27e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f624c0119a0 tx=0x7f624c011e60 comp rx=0 tx=0).stop 2024-09-19T08:37:20.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f6257bc4640 1 -- 172.21.15.117:0/1438982393 shutdown_connections 2024-09-19T08:37:20.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f6257bc4640 1 --2- 172.21.15.117:0/1438982393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f625006ead0 0x7f62500cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f6257bc4640 1 --2- 172.21.15.117:0/1438982393 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f623406c2e0 0x7f623406e7a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f6257bc4640 1 --2- 172.21.15.117:0/1438982393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62500b6ed0 0x7f625006e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f6257bc4640 1 --2- 172.21.15.117:0/1438982393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f623c004d40 0x7f62500b27e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f6257bc4640 1 -- 172.21.15.117:0/1438982393 >> 172.21.15.117:0/1438982393 conn(0x7f62500b4040 msgr2=0x7f62500cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:20.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f6257bc4640 1 -- 172.21.15.117:0/1438982393 shutdown_connections 2024-09-19T08:37:20.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.447+0000 7f6257bc4640 1 -- 172.21.15.117:0/1438982393 wait complete. 2024-09-19T08:37:20.461 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T08:37:20.461 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-19T08:37:20.461 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T08:37:20.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.559+0000 7fbd12267640 1 Processor -- start 2024-09-19T08:37:20.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.559+0000 7fbd12267640 1 -- start start 2024-09-19T08:37:20.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.560+0000 7fbd12267640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbd0c0d21f0 0x7fbd0c0d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.560+0000 7fbd12267640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd0c072590 0x7fbd0c06d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.560+0000 7fbd12267640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd0c0d2b10 con 0x7fbd0c143a60 2024-09-19T08:37:20.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.560+0000 7fbd12267640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fbd0c141750 con 0x7fbd0c0d21f0 2024-09-19T08:37:20.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.560+0000 7fbd12267640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fbd0c1620b0 con 0x7fbd0c072590 2024-09-19T08:37:20.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.560+0000 7fbd0bfff640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbd0c0d21f0 0x7fbd0c0d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.560+0000 7fbd0b7fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd0c072590 0x7fbd0c06d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.560+0000 7fbd10804640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbd0c143a60 0x7fbd0c143ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.117:44728/0 (socket says 172.21.15.117:44728) 2024-09-19T08:37:20.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.560+0000 7fbd10804640 1 -- 172.21.15.117:0/4022265625 learned_addr learned my addr 172.21.15.117:0/4022265625 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:20.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.561+0000 7fbd0affd640 1 -- 172.21.15.117:0/4022265625 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2758027854 0 0) 0x7fbd0c0d2b10 con 0x7fbd0c143a60 2024-09-19T08:37:20.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.561+0000 7fbd0affd640 1 -- 172.21.15.117:0/4022265625 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcf4003520 con 0x7fbd0c143a60 2024-09-19T08:37:20.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.561+0000 7fbd0b7fe640 1 -- 172.21.15.117:0/4022265625 >> v2:172.21.15.146:3300/0 conn(0x7fbd0c0d21f0 msgr2=0x7fbd0c0d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:20.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.561+0000 7fbd0b7fe640 1 --2- 172.21.15.117:0/4022265625 >> v2:172.21.15.146:3300/0 conn(0x7fbd0c0d21f0 0x7fbd0c0d25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.561+0000 7fbd0b7fe640 1 -- 172.21.15.117:0/4022265625 >> v1:172.21.15.146:6789/0 conn(0x7fbd0c143a60 legacy=0x7fbd0c143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:20.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.561+0000 7fbd0b7fe640 1 -- 172.21.15.117:0/4022265625 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd0c162370 con 0x7fbd0c072590 2024-09-19T08:37:20.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.561+0000 7fbd0b7fe640 1 --2- 172.21.15.117:0/4022265625 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd0c072590 0x7fbd0c06d0e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbd000097a0 tx=0x7fbd0002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98118593ec6dc04f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:20.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.562+0000 7fbd0affd640 1 -- 172.21.15.117:0/4022265625 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd00037070 con 0x7fbd0c072590 2024-09-19T08:37:20.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.562+0000 7fbd0affd640 1 -- 172.21.15.117:0/4022265625 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd0002ae50 con 0x7fbd0c072590 2024-09-19T08:37:20.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.562+0000 7fbd0affd640 1 -- 172.21.15.117:0/4022265625 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd00032640 con 0x7fbd0c072590 2024-09-19T08:37:20.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.562+0000 7fbd12267640 1 -- 172.21.15.117:0/4022265625 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd0c072590 msgr2=0x7fbd0c06d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:20.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.562+0000 7fbd12267640 1 --2- 172.21.15.117:0/4022265625 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd0c072590 0x7fbd0c06d0e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbd000097a0 tx=0x7fbd0002a100 comp rx=0 tx=0).stop 2024-09-19T08:37:20.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.562+0000 7fbd12267640 1 -- 172.21.15.117:0/4022265625 shutdown_connections 2024-09-19T08:37:20.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.562+0000 7fbd12267640 1 --2- 172.21.15.117:0/4022265625 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd0c072590 0x7fbd0c06d0e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.562+0000 7fbd12267640 1 --2- 172.21.15.117:0/4022265625 >> v2:172.21.15.146:3300/0 conn(0x7fbd0c0d21f0 0x7fbd0c0d25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.562+0000 7fbd12267640 1 -- 172.21.15.117:0/4022265625 >> 172.21.15.117:0/4022265625 conn(0x7fbd0c0b3ed0 msgr2=0x7fbd0c0b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:20.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.562+0000 7fbd12267640 1 -- 172.21.15.117:0/4022265625 shutdown_connections 2024-09-19T08:37:20.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.562+0000 7fbd12267640 1 -- 172.21.15.117:0/4022265625 wait complete. 2024-09-19T08:37:20.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.563+0000 7fbd12267640 1 Processor -- start 2024-09-19T08:37:20.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.563+0000 7fbd12267640 1 -- start start 2024-09-19T08:37:20.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.564+0000 7fbd12267640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd0c072590 0x7fbd0c133000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.564+0000 7fbd12267640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd0c0d21f0 0x7fbd0c1f7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.564+0000 7fbd12267640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd0c143a60 0x7fbd0c15b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.564+0000 7fbd12267640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c162c10 con 0x7fbd0c143a60 2024-09-19T08:37:20.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.564+0000 7fbd12267640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c162930 con 0x7fbd0c072590 2024-09-19T08:37:20.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.564+0000 7fbd12267640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fbd0c06d620 con 0x7fbd0c0d21f0 2024-09-19T08:37:20.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.564+0000 7fbd10804640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd0c143a60 0x7fbd0c15b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.564+0000 7fbd10804640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd0c143a60 0x7fbd0c15b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54260/0 (socket says 172.21.15.117:54260) 2024-09-19T08:37:20.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.564+0000 7fbd10804640 1 -- 172.21.15.117:0/3193929075 learned_addr learned my addr 172.21.15.117:0/3193929075 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:20.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.565+0000 7fbd0bfff640 1 --2- 172.21.15.117:0/3193929075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd0c072590 0x7fbd0c133000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.565+0000 7fbd0b7fe640 1 --2- 172.21.15.117:0/3193929075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd0c0d21f0 0x7fbd0c1f7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.565+0000 7fbd10804640 1 -- 172.21.15.117:0/3193929075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd0c0d21f0 msgr2=0x7fbd0c1f7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:20.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.565+0000 7fbd10804640 1 --2- 172.21.15.117:0/3193929075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd0c0d21f0 0x7fbd0c1f7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.565+0000 7fbd10804640 1 -- 172.21.15.117:0/3193929075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd0c072590 msgr2=0x7fbd0c133000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:20.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.565+0000 7fbd10804640 1 --2- 172.21.15.117:0/3193929075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd0c072590 0x7fbd0c133000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.565+0000 7fbd10804640 1 -- 172.21.15.117:0/3193929075 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd0c15e750 con 0x7fbd0c143a60 2024-09-19T08:37:20.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.565+0000 7fbd10804640 1 --2- 172.21.15.117:0/3193929075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd0c143a60 0x7fbd0c15b550 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd0400caa0 tx=0x7fbd0400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:20.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.565+0000 7fbd08ff9640 1 -- 172.21.15.117:0/3193929075 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd04017070 con 0x7fbd0c143a60 2024-09-19T08:37:20.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.565+0000 7fbd08ff9640 1 -- 172.21.15.117:0/3193929075 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd0400aba0 con 0x7fbd0c143a60 2024-09-19T08:37:20.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.565+0000 7fbd08ff9640 1 -- 172.21.15.117:0/3193929075 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd04012400 con 0x7fbd0c143a60 2024-09-19T08:37:20.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.565+0000 7fbd12267640 1 -- 172.21.15.117:0/3193929075 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd0c15ea30 con 0x7fbd0c143a60 2024-09-19T08:37:20.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.565+0000 7fbd12267640 1 -- 172.21.15.117:0/3193929075 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd0c15eff0 con 0x7fbd0c143a60 2024-09-19T08:37:20.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.566+0000 7fbd12267640 1 -- 172.21.15.117:0/3193929075 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd0c158c30 con 0x7fbd0c143a60 2024-09-19T08:37:20.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.566+0000 7fbd08ff9640 1 -- 172.21.15.117:0/3193929075 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbd0401a070 con 0x7fbd0c143a60 2024-09-19T08:37:20.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.567+0000 7fbd08ff9640 1 --2- 172.21.15.117:0/3193929075 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbcf806c2e0 0x7fbcf806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:20.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.567+0000 7fbd08ff9640 1 -- 172.21.15.117:0/3193929075 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbd0408b4b0 con 0x7fbd0c143a60 2024-09-19T08:37:20.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.567+0000 7fbd0bfff640 1 --2- 172.21.15.117:0/3193929075 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbcf806c2e0 0x7fbcf806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:20.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.568+0000 7fbd0bfff640 1 --2- 172.21.15.117:0/3193929075 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbcf806c2e0 0x7fbcf806e7a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc009ad0 tx=0x7fbcfc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:20.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.571+0000 7fbd08ff9640 1 -- 172.21.15.117:0/3193929075 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbd04059970 con 0x7fbd0c143a60 2024-09-19T08:37:20.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.772+0000 7fbd12267640 1 -- 172.21.15.117:0/3193929075 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbd0c0b3c40 con 0x7fbd0c143a60 2024-09-19T08:37:20.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.773+0000 7fbd08ff9640 1 -- 172.21.15.117:0/3193929075 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7fbd04059270 con 0x7fbd0c143a60 2024-09-19T08:37:20.773 INFO:teuthology.orchestra.run.smithi117.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T08:37:20.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.775+0000 7fbd12267640 1 -- 172.21.15.117:0/3193929075 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbcf806c2e0 msgr2=0x7fbcf806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:20.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.775+0000 7fbd12267640 1 --2- 172.21.15.117:0/3193929075 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbcf806c2e0 0x7fbcf806e7a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc009ad0 tx=0x7fbcfc008040 comp rx=0 tx=0).stop 2024-09-19T08:37:20.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.775+0000 7fbd12267640 1 -- 172.21.15.117:0/3193929075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd0c143a60 msgr2=0x7fbd0c15b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:20.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.775+0000 7fbd12267640 1 --2- 172.21.15.117:0/3193929075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd0c143a60 0x7fbd0c15b550 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd0400caa0 tx=0x7fbd0400cf60 comp rx=0 tx=0).stop 2024-09-19T08:37:20.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.775+0000 7fbd12267640 1 -- 172.21.15.117:0/3193929075 shutdown_connections 2024-09-19T08:37:20.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.775+0000 7fbd12267640 1 --2- 172.21.15.117:0/3193929075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd0c143a60 0x7fbd0c15b550 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.775+0000 7fbd12267640 1 --2- 172.21.15.117:0/3193929075 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbcf806c2e0 0x7fbcf806e7a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.775+0000 7fbd12267640 1 --2- 172.21.15.117:0/3193929075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd0c0d21f0 0x7fbd0c1f7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.775+0000 7fbd12267640 1 --2- 172.21.15.117:0/3193929075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd0c072590 0x7fbd0c133000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:20.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.775+0000 7fbd12267640 1 -- 172.21.15.117:0/3193929075 >> 172.21.15.117:0/3193929075 conn(0x7fbd0c0b3ed0 msgr2=0x7fbd0c0b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:20.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.775+0000 7fbd12267640 1 -- 172.21.15.117:0/3193929075 shutdown_connections 2024-09-19T08:37:20.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20.775+0000 7fbd12267640 1 -- 172.21.15.117:0/3193929075 wait complete. 2024-09-19T08:37:20.786 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T08:37:20.786 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T08:37:20.786 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2024-09-19T08:37:20.786 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-19T08:37:20.787 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-19T08:37:20.787 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T08:37:20.787 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T08:37:20.787 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T08:37:20.787 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-19T08:37:20.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:20.787 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2024-09-19T08:37:20.803 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T08:37:20.803 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T08:37:20.803 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T08:37:20.803 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:20.803 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-09-19T08:37:20.804 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:20.804 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:37:20.804 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:20.804 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2024-09-19T08:37:20.804 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:37:20.804 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:20.804 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2024-09-19T08:37:20.804 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:37:20.805 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:20.805 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T08:37:20.805 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:20.805 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T08:37:20.805 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42788sec preferred_lft 42788sec 2024-09-19T08:37:20.805 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link noprefixroute 2024-09-19T08:37:20.805 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:20.806 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T08:37:20.806 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:20.806 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-09-19T08:37:20.806 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add name ceph-brx type bridge 2024-09-19T08:37:20.806 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr flush dev ceph-brx 2024-09-19T08:37:20.806 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set ceph-brx up 2024-09-19T08:37:20.806 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T08:37:20.806 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-09-19T08:37:20.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:21.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:21.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:21.046 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T08:37:21.070 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-09-19T08:37:21.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:21.072 DEBUG:teuthology.orchestra.run.smithi117:> route 2024-09-19T08:37:21.141 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2024-09-19T08:37:21.141 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T08:37:21.141 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T08:37:21.141 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T08:37:21.141 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T08:37:21.142 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:21.142 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-09-19T08:37:21.142 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T08:37:21.142 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T08:37:21.142 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T08:37:21.142 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-09-19T08:37:21.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:21.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:21.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:21.443 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-09-19T08:37:21.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:21.459 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list-id 2024-09-19T08:37:21.515 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:21.515 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-09-19T08:37:21.515 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T08:37:21.515 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-19T08:37:21.516 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-09-19T08:37:21.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:21.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:21.633 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-19T08:37:21.634 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:21.634 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-09-19T08:37:21.634 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-19T08:37:21.634 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T08:37:21.634 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-19T08:37:21.634 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-19T08:37:21.634 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-19T08:37:21.634 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-09-19T08:37:21.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:21.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:21.803 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:21.803 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-09-19T08:37:21.803 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2024-09-19T08:37:21.803 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T08:37:21.803 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-09-19T08:37:21.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:21.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:21.881 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-19T08:37:21.881 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:37:21.881 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-19T08:37:21.896 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-19T08:37:21.897 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:37:21.897 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-19T08:37:21.952 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-09-19T08:37:22.017 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T08:37:22.072 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-09-19T08:37:22.073 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-09-19T08:37:22.073 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-09-19T08:37:22.073 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-09-19T08:37:22.073 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-09-19T08:37:22.073 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-09-19T08:37:22.073 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-09-19T08:37:22.073 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-09-19T08:37:22.073 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-09-19T08:37:22.073 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-09-19T08:37:22.073 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-09-19T08:37:22.073 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-09-19T08:37:22.074 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:37:22.074 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-09-19T08:37:22.074 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-09-19T08:37:22.074 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-09-19T08:37:22.074 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-09-19T08:37:22.074 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-09-19T08:37:22.074 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T08:37:22.074 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-09-19T08:37:22.074 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T08:37:22.074 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T08:37:22.074 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T08:37:22.074 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-09-19T08:37:22.074 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-09-19T08:37:22.075 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T08:37:22.075 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T08:37:22.075 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T08:37:22.075 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T08:37:22.075 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-09-19T08:37:22.075 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T08:37:22.075 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T08:37:22.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:22.076 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-09-19T08:37:22.132 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T08:37:22.132 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-19T08:37:22.174 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-09-19T08:37:22.199 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T08:37:22.254 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-09-19T08:37:22.254 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-09-19T08:37:22.255 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-09-19T08:37:22.255 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-09-19T08:37:22.255 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-09-19T08:37:22.255 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-09-19T08:37:22.255 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-09-19T08:37:22.255 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-09-19T08:37:22.255 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-09-19T08:37:22.255 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-09-19T08:37:22.255 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-09-19T08:37:22.255 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-09-19T08:37:22.256 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:37:22.256 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-09-19T08:37:22.256 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-09-19T08:37:22.256 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-09-19T08:37:22.256 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-09-19T08:37:22.256 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-09-19T08:37:22.256 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T08:37:22.256 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-09-19T08:37:22.256 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T08:37:22.256 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T08:37:22.256 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T08:37:22.256 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-09-19T08:37:22.256 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-09-19T08:37:22.257 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T08:37:22.257 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T08:37:22.257 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T08:37:22.257 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T08:37:22.257 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-09-19T08:37:22.257 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T08:37:22.257 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T08:37:22.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:22.257 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-09-19T08:37:22.287 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi117.stderr:2024-09-19T08:37:22.287+0000 7f2ede31e480 -1 init, newargv = 0x5638148a71e0 newargc=15 2024-09-19T08:37:22.287 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi117.stderr:ceph-fuse[43280]: starting ceph client 2024-09-19T08:37:22.293 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi117.stderr:ceph-fuse[43280]: starting fuse 2024-09-19T08:37:22.303 INFO:teuthology.orchestra.run.smithi117.stdout:41 2024-09-19T08:37:22.303 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-19T08:37:22.303 DEBUG:teuthology.orchestra.run.smithi117:> sudo stdin-killer -- python3 -c ' 2024-09-19T08:37:22.303 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2024-09-19T08:37:22.303 DEBUG:teuthology.orchestra.run.smithi117:> import re 2024-09-19T08:37:22.303 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-09-19T08:37:22.303 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2024-09-19T08:37:22.303 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:37:22.303 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2024-09-19T08:37:22.304 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-19T08:37:22.304 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2024-09-19T08:37:22.304 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-19T08:37:22.304 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:37:22.304 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2024-09-19T08:37:22.304 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2024-09-19T08:37:22.304 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2024-09-19T08:37:22.304 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2024-09-19T08:37:22.304 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:37:22.304 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2024-09-19T08:37:22.304 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T08:37:22.304 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T08:37:22.304 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T08:37:22.304 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2024-09-19T08:37:22.305 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2024-09-19T08:37:22.305 DEBUG:teuthology.orchestra.run.smithi117:> return f 2024-09-19T08:37:22.305 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T08:37:22.305 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:37:22.305 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.admin")) 2024-09-19T08:37:22.305 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-09-19T08:37:22.421 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.admin.43280.asok 2024-09-19T08:37:22.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:22.432 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43280.asok 2024-09-19T08:37:22.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:22.432 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43280.asok status 2024-09-19T08:37:22.565 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T08:37:22.565 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2024-09-19T08:37:22.565 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T08:37:22.565 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:37:22.565 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "admin", 2024-09-19T08:37:22.566 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2024-09-19T08:37:22.566 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-19T08:37:22.566 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "43280", 2024-09-19T08:37:22.566 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2024-09-19T08:37:22.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:37:22.566 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2024-09-19T08:37:22.566 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2024-09-19T08:37:22.566 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 4407, 2024-09-19T08:37:22.566 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2024-09-19T08:37:22.566 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2024-09-19T08:37:22.566 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2024-09-19T08:37:22.566 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 4407 2024-09-19T08:37:22.566 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:37:22.566 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-09-19T08:37:22.567 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-09-19T08:37:22.567 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-09-19T08:37:22.567 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2475092638 2024-09-19T08:37:22.567 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:37:22.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:37:22.567 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-09-19T08:37:22.567 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-09-19T08:37:22.567 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-09-19T08:37:22.567 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2475092638 2024-09-19T08:37:22.567 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:37:22.567 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.4407 192.168.0.1:0/2475092638", 2024-09-19T08:37:22.567 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/2475092638", 2024-09-19T08:37:22.567 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2024-09-19T08:37:22.567 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 7, 2024-09-19T08:37:22.568 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 26, 2024-09-19T08:37:22.568 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2024-09-19T08:37:22.568 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2024-09-19T08:37:22.568 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2024-09-19T08:37:22.568 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T08:37:22.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:22.573 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2024-09-19T08:37:22.574 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-19T08:37:22.589 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2024-09-19T08:37:22.589 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-19T08:37:22.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:22.590 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-19T08:37:22.657 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-19T08:37:22.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T08:37:22.768 INFO:teuthology.orchestra.run.smithi117.stdout:# file: . 2024-09-19T08:37:22.769 INFO:teuthology.orchestra.run.smithi117.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-19T08:37:22.769 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:22.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:22.774 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:37:22.774 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:37:22.791 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T08:37:22.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.930+0000 7fb0bc2dd640 1 Processor -- start 2024-09-19T08:37:22.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.930+0000 7fb0bc2dd640 1 -- start start 2024-09-19T08:37:22.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.931+0000 7fb0bc2dd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb0b40b47c0 0x7fb0b4162c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:22.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.931+0000 7fb0bc2dd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b40d05e0 con 0x7fb0b409a9f0 2024-09-19T08:37:22.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.931+0000 7fb0bc2dd640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b40d08c0 con 0x7fb0b4161af0 2024-09-19T08:37:22.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.931+0000 7fb0bc2dd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b40d03b0 con 0x7fb0b40b47c0 2024-09-19T08:37:22.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.931+0000 7fb0b9878640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb0b40b47c0 0x7fb0b4162c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:22.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.931+0000 7fb0ba87a640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fb0b409a9f0 0x7fb0b40cc800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:35822/0 (socket says 172.21.15.117:35822) 2024-09-19T08:37:22.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.931+0000 7fb0ba87a640 1 -- 172.21.15.117:0/4080617217 learned_addr learned my addr 172.21.15.117:0/4080617217 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:22.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.931+0000 7fb0b9878640 1 -- 172.21.15.117:0/4080617217 >> v1:172.21.15.146:6789/0 conn(0x7fb0b4161af0 legacy=0x7fb0b40d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:22.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.931+0000 7fb0b9878640 1 -- 172.21.15.117:0/4080617217 >> v1:172.21.15.117:6789/0 conn(0x7fb0b409a9f0 legacy=0x7fb0b40cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:22.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.931+0000 7fb0b9878640 1 -- 172.21.15.117:0/4080617217 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b40d0ba0 con 0x7fb0b40b47c0 2024-09-19T08:37:22.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.931+0000 7fb0b9077640 1 -- 172.21.15.117:0/4080617217 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 406313677 0 0) 0x7fb0b40d05e0 con 0x7fb0b409a9f0 2024-09-19T08:37:22.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.932+0000 7fb0b9878640 1 --2- 172.21.15.117:0/4080617217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0b40b47c0 0x7fb0b4162c10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40097a0 tx=0x7fb0a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b31841632e91625 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:22.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.932+0000 7fb0b9077640 1 -- 172.21.15.117:0/4080617217 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4037070 con 0x7fb0b40b47c0 2024-09-19T08:37:22.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.932+0000 7fb0b9077640 1 -- 172.21.15.117:0/4080617217 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0a4032440 con 0x7fb0b40b47c0 2024-09-19T08:37:22.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.932+0000 7fb0b9077640 1 -- 172.21.15.117:0/4080617217 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4032810 con 0x7fb0b40b47c0 2024-09-19T08:37:22.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.933+0000 7fb0bc2dd640 1 -- 172.21.15.117:0/4080617217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0b40b47c0 msgr2=0x7fb0b4162c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:22.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.933+0000 7fb0bc2dd640 1 --2- 172.21.15.117:0/4080617217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0b40b47c0 0x7fb0b4162c10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40097a0 tx=0x7fb0a402a270 comp rx=0 tx=0).stop 2024-09-19T08:37:22.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.933+0000 7fb0bc2dd640 1 -- 172.21.15.117:0/4080617217 shutdown_connections 2024-09-19T08:37:22.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.933+0000 7fb0bc2dd640 1 --2- 172.21.15.117:0/4080617217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0b40b47c0 0x7fb0b4162c10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:22.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.933+0000 7fb0bc2dd640 1 -- 172.21.15.117:0/4080617217 >> 172.21.15.117:0/4080617217 conn(0x7fb0b40b3ca0 msgr2=0x7fb0b40b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:22.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.933+0000 7fb0bc2dd640 1 -- 172.21.15.117:0/4080617217 shutdown_connections 2024-09-19T08:37:22.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.933+0000 7fb0bc2dd640 1 -- 172.21.15.117:0/4080617217 wait complete. 2024-09-19T08:37:22.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.934+0000 7fb0bc2dd640 1 Processor -- start 2024-09-19T08:37:22.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.934+0000 7fb0bc2dd640 1 -- start start 2024-09-19T08:37:22.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0bc2dd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b409a9f0 0x7fb0b40b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:22.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0bc2dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0b40b47c0 0x7fb0b409f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:22.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0bc2dd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0b4161af0 0x7fb0b409fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:22.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0bc2dd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b40d1160 con 0x7fb0b40b47c0 2024-09-19T08:37:22.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0bc2dd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b4163150 con 0x7fb0b409a9f0 2024-09-19T08:37:22.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0bc2dd640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b4161ed0 con 0x7fb0b4161af0 2024-09-19T08:37:22.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0b9878640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0b40b47c0 0x7fb0b409f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:22.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0b9878640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0b40b47c0 0x7fb0b409f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54274/0 (socket says 172.21.15.117:54274) 2024-09-19T08:37:22.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0b9878640 1 -- 172.21.15.117:0/243413949 learned_addr learned my addr 172.21.15.117:0/243413949 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:22.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0ba079640 1 --2- 172.21.15.117:0/243413949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b409a9f0 0x7fb0b40b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:22.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0ba87a640 1 --2- 172.21.15.117:0/243413949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0b4161af0 0x7fb0b409fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:22.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0b9878640 1 -- 172.21.15.117:0/243413949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0b4161af0 msgr2=0x7fb0b409fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:22.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0b9878640 1 --2- 172.21.15.117:0/243413949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0b4161af0 0x7fb0b409fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:22.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0b9878640 1 -- 172.21.15.117:0/243413949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b409a9f0 msgr2=0x7fb0b40b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:22.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0b9878640 1 --2- 172.21.15.117:0/243413949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b409a9f0 0x7fb0b40b62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:22.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0b9878640 1 -- 172.21.15.117:0/243413949 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b40b6c20 con 0x7fb0b40b47c0 2024-09-19T08:37:22.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0ba87a640 1 --2- 172.21.15.117:0/243413949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0b4161af0 0x7fb0b409fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:22.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0b9878640 1 --2- 172.21.15.117:0/243413949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0b40b47c0 0x7fb0b409f5f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40097a0 tx=0x7fb0a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:22.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0aaffd640 1 -- 172.21.15.117:0/243413949 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4041070 con 0x7fb0b40b47c0 2024-09-19T08:37:22.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0aaffd640 1 -- 172.21.15.117:0/243413949 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0a403c870 con 0x7fb0b40b47c0 2024-09-19T08:37:22.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0bc2dd640 1 -- 172.21.15.117:0/243413949 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0b40b6f00 con 0x7fb0b40b47c0 2024-09-19T08:37:22.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0aaffd640 1 -- 172.21.15.117:0/243413949 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4037040 con 0x7fb0b40b47c0 2024-09-19T08:37:22.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.935+0000 7fb0bc2dd640 1 -- 172.21.15.117:0/243413949 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0b40b74c0 con 0x7fb0b40b47c0 2024-09-19T08:37:22.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.936+0000 7fb0bc2dd640 1 -- 172.21.15.117:0/243413949 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0b4162c10 con 0x7fb0b40b47c0 2024-09-19T08:37:22.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.937+0000 7fb0aaffd640 1 -- 172.21.15.117:0/243413949 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb0a4044070 con 0x7fb0b40b47c0 2024-09-19T08:37:22.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.937+0000 7fb0aaffd640 1 --2- 172.21.15.117:0/243413949 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb09806c2b0 0x7fb09806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:22.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.937+0000 7fb0aaffd640 1 -- 172.21.15.117:0/243413949 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb0a40ac280 con 0x7fb0b40b47c0 2024-09-19T08:37:22.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.938+0000 7fb0ba079640 1 --2- 172.21.15.117:0/243413949 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb09806c2b0 0x7fb09806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:22.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.938+0000 7fb0ba079640 1 --2- 172.21.15.117:0/243413949 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb09806c2b0 0x7fb09806e770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0004f60 tx=0x7fb0b0007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:22.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:22.941+0000 7fb0aaffd640 1 -- 172.21.15.117:0/243413949 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb0a407a180 con 0x7fb0b40b47c0 2024-09-19T08:37:23.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.121+0000 7fb0bc2dd640 1 -- 172.21.15.117:0/243413949 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb0b4157d30 con 0x7fb0b40b47c0 2024-09-19T08:37:23.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.121+0000 7fb0aaffd640 1 -- 172.21.15.117:0/243413949 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fb0a407e480 con 0x7fb0b40b47c0 2024-09-19T08:37:23.121 INFO:teuthology.orchestra.run.smithi117.stderr:listed 0 entries 2024-09-19T08:37:23.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.123+0000 7fb0bc2dd640 1 -- 172.21.15.117:0/243413949 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb09806c2b0 msgr2=0x7fb09806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:23.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.123+0000 7fb0bc2dd640 1 --2- 172.21.15.117:0/243413949 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb09806c2b0 0x7fb09806e770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0004f60 tx=0x7fb0b0007e30 comp rx=0 tx=0).stop 2024-09-19T08:37:23.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.123+0000 7fb0bc2dd640 1 -- 172.21.15.117:0/243413949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0b40b47c0 msgr2=0x7fb0b409f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:23.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.123+0000 7fb0bc2dd640 1 --2- 172.21.15.117:0/243413949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0b40b47c0 0x7fb0b409f5f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40097a0 tx=0x7fb0a40046c0 comp rx=0 tx=0).stop 2024-09-19T08:37:23.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.123+0000 7fb0bc2dd640 1 -- 172.21.15.117:0/243413949 shutdown_connections 2024-09-19T08:37:23.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.123+0000 7fb0bc2dd640 1 --2- 172.21.15.117:0/243413949 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb09806c2b0 0x7fb09806e770 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:23.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.123+0000 7fb0bc2dd640 1 --2- 172.21.15.117:0/243413949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0b4161af0 0x7fb0b409fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:23.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.123+0000 7fb0bc2dd640 1 --2- 172.21.15.117:0/243413949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0b40b47c0 0x7fb0b409f5f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:23.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.123+0000 7fb0bc2dd640 1 --2- 172.21.15.117:0/243413949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b409a9f0 0x7fb0b40b62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:23.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.123+0000 7fb0bc2dd640 1 -- 172.21.15.117:0/243413949 >> 172.21.15.117:0/243413949 conn(0x7fb0b40b3ca0 msgr2=0x7fb0b406ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:23.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.123+0000 7fb0bc2dd640 1 -- 172.21.15.117:0/243413949 shutdown_connections 2024-09-19T08:37:23.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.123+0000 7fb0bc2dd640 1 -- 172.21.15.117:0/243413949 wait complete. 2024-09-19T08:37:23.133 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:37:23.133 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:37:23.150 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T08:37:23.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.290+0000 7f8fc2a27640 1 Processor -- start 2024-09-19T08:37:23.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.290+0000 7f8fc2a27640 1 -- start start 2024-09-19T08:37:23.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.291+0000 7f8fc2a27640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8fbc0ae270 0x7f8fbc06c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:23.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.291+0000 7f8fc2a27640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8fbc0cf680 0x7f8fbc0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:23.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.291+0000 7f8fc2a27640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fbc0cfda0 con 0x7f8fbc15c270 2024-09-19T08:37:23.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.291+0000 7f8fc2a27640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f8fbc0ccf80 con 0x7f8fbc0cf680 2024-09-19T08:37:23.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.291+0000 7f8fc2a27640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f8fbc0cd260 con 0x7f8fbc0ae270 2024-09-19T08:37:23.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.291+0000 7f8fc0fc4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8fbc0cf680 0x7f8fbc0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:23.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.291+0000 7f8fbbfff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f8fbc15c270 0x7f8fbc0cef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:35830/0 (socket says 172.21.15.117:35830) 2024-09-19T08:37:23.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.291+0000 7f8fbbfff640 1 -- 172.21.15.117:0/3652021038 learned_addr learned my addr 172.21.15.117:0/3652021038 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:23.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.291+0000 7f8fbb7fe640 1 --2- 172.21.15.117:0/3652021038 >> v2:172.21.15.146:3300/0 conn(0x7f8fbc0ae270 0x7f8fbc06c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:23.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.292+0000 7f8fc0fc4640 1 -- 172.21.15.117:0/3652021038 >> v2:172.21.15.146:3300/0 conn(0x7f8fbc0ae270 msgr2=0x7f8fbc06c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:23.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.292+0000 7f8fc0fc4640 1 --2- 172.21.15.117:0/3652021038 >> v2:172.21.15.146:3300/0 conn(0x7f8fbc0ae270 0x7f8fbc06c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:23.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.292+0000 7f8fc0fc4640 1 -- 172.21.15.117:0/3652021038 >> v1:172.21.15.117:6789/0 conn(0x7f8fbc15c270 legacy=0x7f8fbc0cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:23.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.292+0000 7f8fc0fc4640 1 -- 172.21.15.117:0/3652021038 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fbc0cd540 con 0x7f8fbc0cf680 2024-09-19T08:37:23.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.292+0000 7f8fbaffd640 1 -- 172.21.15.117:0/3652021038 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2102431079 0 0) 0x7f8fac001110 con 0x7f8fbc15c270 2024-09-19T08:37:23.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.292+0000 7f8fc0fc4640 1 --2- 172.21.15.117:0/3652021038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fbc0cf680 0x7f8fbc0cdd40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0cc070 tx=0x7f8fb402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2551eca035c4efd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:23.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.292+0000 7f8fbaffd640 1 -- 172.21.15.117:0/3652021038 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4007740 con 0x7f8fbc0cf680 2024-09-19T08:37:23.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.292+0000 7f8fbaffd640 1 -- 172.21.15.117:0/3652021038 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb40078e0 con 0x7f8fbc0cf680 2024-09-19T08:37:23.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.292+0000 7f8fbaffd640 1 -- 172.21.15.117:0/3652021038 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4007cb0 con 0x7f8fbc0cf680 2024-09-19T08:37:23.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.293+0000 7f8fc2a27640 1 -- 172.21.15.117:0/3652021038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fbc0cf680 msgr2=0x7f8fbc0cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:23.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.293+0000 7f8fc2a27640 1 --2- 172.21.15.117:0/3652021038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fbc0cf680 0x7f8fbc0cdd40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0cc070 tx=0x7f8fb402a5f0 comp rx=0 tx=0).stop 2024-09-19T08:37:23.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.293+0000 7f8fc2a27640 1 -- 172.21.15.117:0/3652021038 shutdown_connections 2024-09-19T08:37:23.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.293+0000 7f8fc2a27640 1 --2- 172.21.15.117:0/3652021038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fbc0cf680 0x7f8fbc0cdd40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:23.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.293+0000 7f8fc2a27640 1 --2- 172.21.15.117:0/3652021038 >> v2:172.21.15.146:3300/0 conn(0x7f8fbc0ae270 0x7f8fbc06c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:23.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.293+0000 7f8fc2a27640 1 -- 172.21.15.117:0/3652021038 >> 172.21.15.117:0/3652021038 conn(0x7f8fbc09a9f0 msgr2=0x7f8fbc0b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:23.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.293+0000 7f8fc2a27640 1 -- 172.21.15.117:0/3652021038 shutdown_connections 2024-09-19T08:37:23.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.293+0000 7f8fc2a27640 1 -- 172.21.15.117:0/3652021038 wait complete. 2024-09-19T08:37:23.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.294+0000 7f8fc2a27640 1 Processor -- start 2024-09-19T08:37:23.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.294+0000 7f8fc2a27640 1 -- start start 2024-09-19T08:37:23.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.295+0000 7f8fc2a27640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fbc0ae270 0x7f8fbc0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:23.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.295+0000 7f8fc2a27640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8fbc0cf680 0x7f8fbc152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:23.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.295+0000 7f8fc2a27640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fbc15c270 0x7f8fbc0d1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:23.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.295+0000 7f8fc2a27640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc15c7d0 con 0x7f8fbc0ae270 2024-09-19T08:37:23.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.295+0000 7f8fc2a27640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc15c650 con 0x7f8fbc15c270 2024-09-19T08:37:23.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.295+0000 7f8fc2a27640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f8fbc0ccba0 con 0x7f8fbc0cf680 2024-09-19T08:37:23.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.295+0000 7f8fbbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fbc0ae270 0x7f8fbc0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:23.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.295+0000 7f8fbbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fbc0ae270 0x7f8fbc0ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54290/0 (socket says 172.21.15.117:54290) 2024-09-19T08:37:23.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.295+0000 7f8fbbfff640 1 -- 172.21.15.117:0/77711226 learned_addr learned my addr 172.21.15.117:0/77711226 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:23.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.295+0000 7f8fc0fc4640 1 --2- 172.21.15.117:0/77711226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fbc15c270 0x7f8fbc0d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:23.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.295+0000 7f8fbb7fe640 1 --2- 172.21.15.117:0/77711226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8fbc0cf680 0x7f8fbc152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:23.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.295+0000 7f8fbbfff640 1 -- 172.21.15.117:0/77711226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8fbc0cf680 msgr2=0x7f8fbc152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:23.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.295+0000 7f8fbbfff640 1 --2- 172.21.15.117:0/77711226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8fbc0cf680 0x7f8fbc152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:23.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.296+0000 7f8fbbfff640 1 -- 172.21.15.117:0/77711226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fbc15c270 msgr2=0x7f8fbc0d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:23.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.296+0000 7f8fbbfff640 1 --2- 172.21.15.117:0/77711226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fbc15c270 0x7f8fbc0d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:23.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.296+0000 7f8fbbfff640 1 -- 172.21.15.117:0/77711226 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fbc159760 con 0x7f8fbc0ae270 2024-09-19T08:37:23.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.296+0000 7f8fbbfff640 1 --2- 172.21.15.117:0/77711226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fbc0ae270 0x7f8fbc0ca460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00c7b0 tx=0x7f8fac00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:23.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.296+0000 7f8fb8ff9640 1 -- 172.21.15.117:0/77711226 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac018070 con 0x7f8fbc0ae270 2024-09-19T08:37:23.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.296+0000 7f8fb8ff9640 1 -- 172.21.15.117:0/77711226 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fac0072d0 con 0x7f8fbc0ae270 2024-09-19T08:37:23.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.296+0000 7f8fc2a27640 1 -- 172.21.15.117:0/77711226 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fbc159a40 con 0x7f8fbc0ae270 2024-09-19T08:37:23.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.296+0000 7f8fb8ff9640 1 -- 172.21.15.117:0/77711226 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac0047e0 con 0x7f8fbc0ae270 2024-09-19T08:37:23.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.296+0000 7f8fc2a27640 1 -- 172.21.15.117:0/77711226 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fbc0ca9a0 con 0x7f8fbc0ae270 2024-09-19T08:37:23.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.297+0000 7f8fc2a27640 1 -- 172.21.15.117:0/77711226 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fbc0b36a0 con 0x7f8fbc0ae270 2024-09-19T08:37:23.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.297+0000 7f8fb8ff9640 1 -- 172.21.15.117:0/77711226 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8fac01b070 con 0x7f8fbc0ae270 2024-09-19T08:37:23.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.298+0000 7f8fb8ff9640 1 --2- 172.21.15.117:0/77711226 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f8fa806c2b0 0x7f8fa806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:23.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.298+0000 7f8fb8ff9640 1 -- 172.21.15.117:0/77711226 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8fac08aa60 con 0x7f8fbc0ae270 2024-09-19T08:37:23.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.298+0000 7f8fbb7fe640 1 --2- 172.21.15.117:0/77711226 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f8fa806c2b0 0x7f8fa806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:23.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.298+0000 7f8fbb7fe640 1 --2- 172.21.15.117:0/77711226 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f8fa806c2b0 0x7f8fa806e770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0c7a40 tx=0x7f8fb0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:23.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.302+0000 7f8fb8ff9640 1 -- 172.21.15.117:0/77711226 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8fbc0cfda0 con 0x7f8fbc0ae270 2024-09-19T08:37:23.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.485+0000 7f8fc2a27640 1 -- 172.21.15.117:0/77711226 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8fbc159c10 con 0x7f8fbc0ae270 2024-09-19T08:37:23.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.485+0000 7f8fb8ff9640 1 -- 172.21.15.117:0/77711226 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f8fac058f20 con 0x7f8fbc0ae270 2024-09-19T08:37:23.485 INFO:teuthology.orchestra.run.smithi117.stderr:listed 0 entries 2024-09-19T08:37:23.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.487+0000 7f8fc2a27640 1 -- 172.21.15.117:0/77711226 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f8fa806c2b0 msgr2=0x7f8fa806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:23.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.487+0000 7f8fc2a27640 1 --2- 172.21.15.117:0/77711226 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f8fa806c2b0 0x7f8fa806e770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0c7a40 tx=0x7f8fb0008040 comp rx=0 tx=0).stop 2024-09-19T08:37:23.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.487+0000 7f8fc2a27640 1 -- 172.21.15.117:0/77711226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fbc0ae270 msgr2=0x7f8fbc0ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:23.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.487+0000 7f8fc2a27640 1 --2- 172.21.15.117:0/77711226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fbc0ae270 0x7f8fbc0ca460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00c7b0 tx=0x7f8fac00cc70 comp rx=0 tx=0).stop 2024-09-19T08:37:23.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.487+0000 7f8fc2a27640 1 -- 172.21.15.117:0/77711226 shutdown_connections 2024-09-19T08:37:23.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.487+0000 7f8fc2a27640 1 --2- 172.21.15.117:0/77711226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fbc15c270 0x7f8fbc0d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:23.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.487+0000 7f8fc2a27640 1 --2- 172.21.15.117:0/77711226 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f8fa806c2b0 0x7f8fa806e770 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:23.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.487+0000 7f8fc2a27640 1 --2- 172.21.15.117:0/77711226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8fbc0cf680 0x7f8fbc152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:23.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.487+0000 7f8fc2a27640 1 --2- 172.21.15.117:0/77711226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fbc0ae270 0x7f8fbc0ca460 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:23.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.487+0000 7f8fc2a27640 1 -- 172.21.15.117:0/77711226 >> 172.21.15.117:0/77711226 conn(0x7f8fbc09a9f0 msgr2=0x7f8fbc0b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:23.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.487+0000 7f8fc2a27640 1 -- 172.21.15.117:0/77711226 shutdown_connections 2024-09-19T08:37:23.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:23.487+0000 7f8fc2a27640 1 -- 172.21.15.117:0/77711226 wait complete. 2024-09-19T08:37:23.498 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2024-09-19T08:37:23.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:23.498 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-19T08:37:23.521 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi117.stderr:ceph-fuse[43280]: fuse finished with error 0 and tester_r 0 2024-09-19T08:37:23.523 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:37:29.625 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T08:37:29.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:29.625 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-19T08:37:29.731 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:37:29.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.841+0000 7f25a95c4640 1 Processor -- start 2024-09-19T08:37:29.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.841+0000 7f25a95c4640 1 -- start start 2024-09-19T08:37:29.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.842+0000 7f25a95c4640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f25a40d0070 0x7f25a415f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:29.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.842+0000 7f25a95c4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25a40d1b10 con 0x7f25a415f0d0 2024-09-19T08:37:29.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.842+0000 7f25a95c4640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25a40cf2b0 con 0x7f25a40d4130 2024-09-19T08:37:29.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.842+0000 7f25a95c4640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f25a40cf590 con 0x7f25a40d0070 2024-09-19T08:37:29.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.842+0000 7f25a2ffd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f25a415f0d0 0x7f25a40d1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:33608/0 (socket says 172.21.15.117:33608) 2024-09-19T08:37:29.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.842+0000 7f25a2ffd640 1 -- 172.21.15.117:0/661989616 learned_addr learned my addr 172.21.15.117:0/661989616 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:29.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.842+0000 7f25a27fc640 1 --2- 172.21.15.117:0/661989616 >> v2:172.21.15.146:3300/0 conn(0x7f25a40d0070 0x7f25a415f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:29.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.842+0000 7f25a1ffb640 1 -- 172.21.15.117:0/661989616 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 730083917 0 0) 0x7f25a40d1b10 con 0x7f25a415f0d0 2024-09-19T08:37:29.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.842+0000 7f25a1ffb640 1 -- 172.21.15.117:0/661989616 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f258c003520 con 0x7f25a415f0d0 2024-09-19T08:37:29.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.842+0000 7f25a1ffb640 1 -- 172.21.15.117:0/661989616 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 611286829 0 0) 0x7f25a40cf2b0 con 0x7f25a40d4130 2024-09-19T08:37:29.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.842+0000 7f25a1ffb640 1 -- 172.21.15.117:0/661989616 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25a40d1b10 con 0x7f25a40d4130 2024-09-19T08:37:29.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.842+0000 7f25a27fc640 1 -- 172.21.15.117:0/661989616 >> v1:172.21.15.146:6789/0 conn(0x7f25a40d4130 legacy=0x7f25a40d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:29.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.842+0000 7f25a27fc640 1 -- 172.21.15.117:0/661989616 >> v1:172.21.15.117:6789/0 conn(0x7f25a415f0d0 legacy=0x7f25a40d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:29.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.842+0000 7f25a27fc640 1 -- 172.21.15.117:0/661989616 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a40cf870 con 0x7f25a40d0070 2024-09-19T08:37:29.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.843+0000 7f25a27fc640 1 --2- 172.21.15.117:0/661989616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a40d0070 0x7f25a415f4b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f25980097a0 tx=0x7f259802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=385f3666845cea40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:29.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.843+0000 7f25a1ffb640 1 -- 172.21.15.117:0/661989616 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2598037070 con 0x7f25a40d0070 2024-09-19T08:37:29.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.843+0000 7f25a1ffb640 1 -- 172.21.15.117:0/661989616 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2598032440 con 0x7f25a40d0070 2024-09-19T08:37:29.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.843+0000 7f25a1ffb640 1 -- 172.21.15.117:0/661989616 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259802ae60 con 0x7f25a40d0070 2024-09-19T08:37:29.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.844+0000 7f25a95c4640 1 -- 172.21.15.117:0/661989616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a40d0070 msgr2=0x7f25a415f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:29.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.844+0000 7f25a95c4640 1 --2- 172.21.15.117:0/661989616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a40d0070 0x7f25a415f4b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f25980097a0 tx=0x7f259802a110 comp rx=0 tx=0).stop 2024-09-19T08:37:29.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.844+0000 7f25a95c4640 1 -- 172.21.15.117:0/661989616 shutdown_connections 2024-09-19T08:37:29.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.844+0000 7f25a95c4640 1 --2- 172.21.15.117:0/661989616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a40d0070 0x7f25a415f4b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:29.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.844+0000 7f25a95c4640 1 -- 172.21.15.117:0/661989616 >> 172.21.15.117:0/661989616 conn(0x7f25a409d760 msgr2=0x7f25a408bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:29.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.844+0000 7f25a95c4640 1 -- 172.21.15.117:0/661989616 shutdown_connections 2024-09-19T08:37:29.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.844+0000 7f25a95c4640 1 -- 172.21.15.117:0/661989616 wait complete. 2024-09-19T08:37:29.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.845+0000 7f25a95c4640 1 Processor -- start 2024-09-19T08:37:29.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.845+0000 7f25a95c4640 1 -- start start 2024-09-19T08:37:29.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.846+0000 7f25a95c4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25a40d0070 0x7f25a40c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:29.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.846+0000 7f25a95c4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25a40d4130 0x7f25a415b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:29.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.846+0000 7f25a95c4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a415f0d0 0x7f25a40cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:29.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.846+0000 7f25a95c4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f25a40b2f70 con 0x7f25a40d4130 2024-09-19T08:37:29.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.846+0000 7f25a95c4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f25a40cef60 con 0x7f25a415f0d0 2024-09-19T08:37:29.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.846+0000 7f25a95c4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f25a40b30f0 con 0x7f25a40d0070 2024-09-19T08:37:29.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.846+0000 7f25a27fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25a40d4130 0x7f25a415b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:29.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.846+0000 7f25a27fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25a40d4130 0x7f25a415b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33854/0 (socket says 172.21.15.117:33854) 2024-09-19T08:37:29.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.846+0000 7f25a27fc640 1 -- 172.21.15.117:0/1189307360 learned_addr learned my addr 172.21.15.117:0/1189307360 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:29.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.846+0000 7f25a37fe640 1 --2- 172.21.15.117:0/1189307360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a415f0d0 0x7f25a40cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:29.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.846+0000 7f25a2ffd640 1 --2- 172.21.15.117:0/1189307360 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25a40d0070 0x7f25a40c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:29.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.847+0000 7f25a27fc640 1 -- 172.21.15.117:0/1189307360 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25a40d0070 msgr2=0x7f25a40c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:29.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.847+0000 7f25a27fc640 1 --2- 172.21.15.117:0/1189307360 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25a40d0070 0x7f25a40c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:29.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.847+0000 7f25a27fc640 1 -- 172.21.15.117:0/1189307360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a415f0d0 msgr2=0x7f25a40cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:29.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.847+0000 7f25a27fc640 1 --2- 172.21.15.117:0/1189307360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a415f0d0 0x7f25a40cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:29.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.847+0000 7f25a27fc640 1 -- 172.21.15.117:0/1189307360 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a415c2d0 con 0x7f25a40d4130 2024-09-19T08:37:29.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.847+0000 7f25a2ffd640 1 --2- 172.21.15.117:0/1189307360 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25a40d0070 0x7f25a40c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:29.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.847+0000 7f25a27fc640 1 --2- 172.21.15.117:0/1189307360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25a40d4130 0x7f25a415b980 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f25980098c0 tx=0x7f25980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:29.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.847+0000 7f258b7fe640 1 -- 172.21.15.117:0/1189307360 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2598041030 con 0x7f25a40d4130 2024-09-19T08:37:29.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.847+0000 7f258b7fe640 1 -- 172.21.15.117:0/1189307360 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f259803d4e0 con 0x7f25a40d4130 2024-09-19T08:37:29.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.847+0000 7f258b7fe640 1 -- 172.21.15.117:0/1189307360 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2598037040 con 0x7f25a40d4130 2024-09-19T08:37:29.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.847+0000 7f25a95c4640 1 -- 172.21.15.117:0/1189307360 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a40cdff0 con 0x7f25a40d4130 2024-09-19T08:37:29.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.847+0000 7f25a95c4640 1 -- 172.21.15.117:0/1189307360 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a40ce5b0 con 0x7f25a40d4130 2024-09-19T08:37:29.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.848+0000 7f25a95c4640 1 -- 172.21.15.117:0/1189307360 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25a415f4b0 con 0x7f25a40d4130 2024-09-19T08:37:29.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.848+0000 7f258b7fe640 1 -- 172.21.15.117:0/1189307360 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2598044070 con 0x7f25a40d4130 2024-09-19T08:37:29.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.849+0000 7f258b7fe640 1 --2- 172.21.15.117:0/1189307360 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f259006c2b0 0x7f259006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:29.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.849+0000 7f258b7fe640 1 -- 172.21.15.117:0/1189307360 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f25980abd90 con 0x7f25a40d4130 2024-09-19T08:37:29.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.849+0000 7f25a2ffd640 1 --2- 172.21.15.117:0/1189307360 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f259006c2b0 0x7f259006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:29.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.850+0000 7f25a2ffd640 1 --2- 172.21.15.117:0/1189307360 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f259006c2b0 0x7f259006e770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2594007fd0 tx=0x7f2594009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:29.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:29.853+0000 7f258b7fe640 1 -- 172.21.15.117:0/1189307360 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f259807a2f0 con 0x7f25a40d4130 2024-09-19T08:37:30.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.019+0000 7f25a95c4640 1 -- 172.21.15.117:0/1189307360 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25a406cf30 con 0x7f25a40d4130 2024-09-19T08:37:30.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.021+0000 7f258b7fe640 1 -- 172.21.15.117:0/1189307360 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18650 (secure 0 0 0) 0x7f2598079bf0 con 0x7f25a40d4130 2024-09-19T08:37:30.021 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:30.021 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":26,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:37:17.670150+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:37:10.463000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:37:11.619440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:37:15.342435+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:37:30.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.023+0000 7f25a95c4640 1 -- 172.21.15.117:0/1189307360 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f259006c2b0 msgr2=0x7f259006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:30.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.023+0000 7f25a95c4640 1 --2- 172.21.15.117:0/1189307360 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f259006c2b0 0x7f259006e770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2594007fd0 tx=0x7f2594009040 comp rx=0 tx=0).stop 2024-09-19T08:37:30.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.023+0000 7f25a95c4640 1 -- 172.21.15.117:0/1189307360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25a40d4130 msgr2=0x7f25a415b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:30.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.023+0000 7f25a95c4640 1 --2- 172.21.15.117:0/1189307360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25a40d4130 0x7f25a415b980 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f25980098c0 tx=0x7f25980046c0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.023+0000 7f25a95c4640 1 -- 172.21.15.117:0/1189307360 shutdown_connections 2024-09-19T08:37:30.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.023+0000 7f25a95c4640 1 --2- 172.21.15.117:0/1189307360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a415f0d0 0x7f25a40cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.023+0000 7f25a95c4640 1 --2- 172.21.15.117:0/1189307360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25a40d4130 0x7f25a415b980 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.023+0000 7f25a95c4640 1 --2- 172.21.15.117:0/1189307360 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f259006c2b0 0x7f259006e770 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.023+0000 7f25a95c4640 1 --2- 172.21.15.117:0/1189307360 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25a40d0070 0x7f25a40c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.023+0000 7f25a95c4640 1 -- 172.21.15.117:0/1189307360 >> 172.21.15.117:0/1189307360 conn(0x7f25a409d760 msgr2=0x7f25a406e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:30.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.023+0000 7f25a95c4640 1 -- 172.21.15.117:0/1189307360 shutdown_connections 2024-09-19T08:37:30.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.023+0000 7f25a95c4640 1 -- 172.21.15.117:0/1189307360 wait complete. 2024-09-19T08:37:30.035 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:37:30.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.133+0000 7fec9fe77640 1 Processor -- start 2024-09-19T08:37:30.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.134+0000 7fec9fe77640 1 -- start start 2024-09-19T08:37:30.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.134+0000 7fec9fe77640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec9806cd20 0x7fec9806d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:30.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.135+0000 7fec9fe77640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fec98161eb0 0x7fec981622f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:30.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.135+0000 7fec9fe77640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fec98143a20 0x7fec98143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:30.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.135+0000 7fec9fe77640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fec98162e50 con 0x7fec98161eb0 2024-09-19T08:37:30.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.135+0000 7fec9fe77640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fec98142150 con 0x7fec98143a20 2024-09-19T08:37:30.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.135+0000 7fec9fe77640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fec9806d640 con 0x7fec9806cd20 2024-09-19T08:37:30.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.135+0000 7fec9d412640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fec98161eb0 0x7fec981622f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:30.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.135+0000 7fec9d412640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fec98161eb0 0x7fec981622f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33866/0 (socket says 172.21.15.117:33866) 2024-09-19T08:37:30.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.135+0000 7fec9d412640 1 -- 172.21.15.117:0/4071872125 learned_addr learned my addr 172.21.15.117:0/4071872125 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:30.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.135+0000 7fec9dc13640 1 --2- 172.21.15.117:0/4071872125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec9806cd20 0x7fec9806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:30.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.135+0000 7fec9e414640 1 --2- 172.21.15.117:0/4071872125 >> v2:172.21.15.146:3300/0 conn(0x7fec98143a20 0x7fec98143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:30.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.135+0000 7fec9d412640 1 -- 172.21.15.117:0/4071872125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec9806cd20 msgr2=0x7fec9806d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:30.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.135+0000 7fec9d412640 1 --2- 172.21.15.117:0/4071872125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec9806cd20 0x7fec9806d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.135+0000 7fec9d412640 1 -- 172.21.15.117:0/4071872125 >> v2:172.21.15.146:3300/0 conn(0x7fec98143a20 msgr2=0x7fec98143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:30.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.135+0000 7fec9d412640 1 --2- 172.21.15.117:0/4071872125 >> v2:172.21.15.146:3300/0 conn(0x7fec98143a20 0x7fec98143ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.135+0000 7fec9d412640 1 -- 172.21.15.117:0/4071872125 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec98162b70 con 0x7fec98161eb0 2024-09-19T08:37:30.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.135+0000 7fec9e414640 1 --2- 172.21.15.117:0/4071872125 >> v2:172.21.15.146:3300/0 conn(0x7fec98143a20 0x7fec98143ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:30.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.135+0000 7fec9dc13640 1 --2- 172.21.15.117:0/4071872125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec9806cd20 0x7fec9806d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:30.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.136+0000 7fec9d412640 1 --2- 172.21.15.117:0/4071872125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec98161eb0 0x7fec981622f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fec980d32b0 tx=0x7fec8c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ae891c529e473e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:30.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.136+0000 7fec9cc11640 1 -- 172.21.15.117:0/4071872125 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c037070 con 0x7fec98161eb0 2024-09-19T08:37:30.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.136+0000 7fec9cc11640 1 -- 172.21.15.117:0/4071872125 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec8c032440 con 0x7fec98161eb0 2024-09-19T08:37:30.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.136+0000 7fec9cc11640 1 -- 172.21.15.117:0/4071872125 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c032810 con 0x7fec98161eb0 2024-09-19T08:37:30.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.136+0000 7fec9fe77640 1 -- 172.21.15.117:0/4071872125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec98161eb0 msgr2=0x7fec981622f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:30.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.136+0000 7fec9fe77640 1 --2- 172.21.15.117:0/4071872125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec98161eb0 0x7fec981622f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fec980d32b0 tx=0x7fec8c02a140 comp rx=0 tx=0).stop 2024-09-19T08:37:30.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.136+0000 7fec9fe77640 1 -- 172.21.15.117:0/4071872125 shutdown_connections 2024-09-19T08:37:30.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.136+0000 7fec9fe77640 1 --2- 172.21.15.117:0/4071872125 >> v2:172.21.15.146:3300/0 conn(0x7fec98143a20 0x7fec98143ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.136+0000 7fec9fe77640 1 --2- 172.21.15.117:0/4071872125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec98161eb0 0x7fec981622f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.136+0000 7fec9fe77640 1 --2- 172.21.15.117:0/4071872125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec9806cd20 0x7fec9806d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.136+0000 7fec9fe77640 1 -- 172.21.15.117:0/4071872125 >> 172.21.15.117:0/4071872125 conn(0x7fec980b3ed0 msgr2=0x7fec980b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:30.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.136+0000 7fec9fe77640 1 -- 172.21.15.117:0/4071872125 shutdown_connections 2024-09-19T08:37:30.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.136+0000 7fec9fe77640 1 -- 172.21.15.117:0/4071872125 wait complete. 2024-09-19T08:37:30.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.138+0000 7fec9fe77640 1 Processor -- start 2024-09-19T08:37:30.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.138+0000 7fec9fe77640 1 -- start start 2024-09-19T08:37:30.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.138+0000 7fec9fe77640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec9806cd20 0x7fec980cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:30.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.138+0000 7fec9fe77640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec98143a20 0x7fec981602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:30.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.138+0000 7fec9fe77640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec98161eb0 0x7fec981e86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:30.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.138+0000 7fec9fe77640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fec98162830 con 0x7fec98161eb0 2024-09-19T08:37:30.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.138+0000 7fec9fe77640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fec98141de0 con 0x7fec9806cd20 2024-09-19T08:37:30.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.138+0000 7fec9fe77640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fec98141600 con 0x7fec98143a20 2024-09-19T08:37:30.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.138+0000 7fec9e414640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec98161eb0 0x7fec981e86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:30.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.138+0000 7fec9e414640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec98161eb0 0x7fec981e86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33874/0 (socket says 172.21.15.117:33874) 2024-09-19T08:37:30.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.138+0000 7fec9e414640 1 -- 172.21.15.117:0/3989840920 learned_addr learned my addr 172.21.15.117:0/3989840920 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:30.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.139+0000 7fec9dc13640 1 --2- 172.21.15.117:0/3989840920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec9806cd20 0x7fec980cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:30.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.139+0000 7fec9d412640 1 --2- 172.21.15.117:0/3989840920 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec98143a20 0x7fec981602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:30.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.139+0000 7fec9e414640 1 -- 172.21.15.117:0/3989840920 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec98143a20 msgr2=0x7fec981602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:30.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.139+0000 7fec9e414640 1 --2- 172.21.15.117:0/3989840920 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec98143a20 0x7fec981602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.139+0000 7fec9e414640 1 -- 172.21.15.117:0/3989840920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec9806cd20 msgr2=0x7fec980cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:30.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.139+0000 7fec9e414640 1 --2- 172.21.15.117:0/3989840920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec9806cd20 0x7fec980cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.139+0000 7fec9e414640 1 -- 172.21.15.117:0/3989840920 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec980ca3e0 con 0x7fec98161eb0 2024-09-19T08:37:30.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.139+0000 7fec9d412640 1 --2- 172.21.15.117:0/3989840920 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec98143a20 0x7fec981602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:30.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.139+0000 7fec9dc13640 1 --2- 172.21.15.117:0/3989840920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec9806cd20 0x7fec980cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:30.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.139+0000 7fec9e414640 1 --2- 172.21.15.117:0/3989840920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec98161eb0 0x7fec981e86c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fec90007e70 tx=0x7fec9000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:30.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.139+0000 7fec8a7fc640 1 -- 172.21.15.117:0/3989840920 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9001a070 con 0x7fec98161eb0 2024-09-19T08:37:30.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.139+0000 7fec8a7fc640 1 -- 172.21.15.117:0/3989840920 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec90003bb0 con 0x7fec98161eb0 2024-09-19T08:37:30.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.139+0000 7fec9fe77640 1 -- 172.21.15.117:0/3989840920 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec980ca6c0 con 0x7fec98161eb0 2024-09-19T08:37:30.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.139+0000 7fec8a7fc640 1 -- 172.21.15.117:0/3989840920 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec90004030 con 0x7fec98161eb0 2024-09-19T08:37:30.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.139+0000 7fec9fe77640 1 -- 172.21.15.117:0/3989840920 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec980cac80 con 0x7fec98161eb0 2024-09-19T08:37:30.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.140+0000 7fec9fe77640 1 -- 172.21.15.117:0/3989840920 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec9806d100 con 0x7fec98161eb0 2024-09-19T08:37:30.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.140+0000 7fec8a7fc640 1 -- 172.21.15.117:0/3989840920 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fec9001d070 con 0x7fec98161eb0 2024-09-19T08:37:30.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.141+0000 7fec8a7fc640 1 --2- 172.21.15.117:0/3989840920 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fec7c06c2b0 0x7fec7c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:30.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.141+0000 7fec8a7fc640 1 -- 172.21.15.117:0/3989840920 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fec9008b9a0 con 0x7fec98161eb0 2024-09-19T08:37:30.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.141+0000 7fec9dc13640 1 --2- 172.21.15.117:0/3989840920 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fec7c06c2b0 0x7fec7c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:30.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.142+0000 7fec9dc13640 1 --2- 172.21.15.117:0/3989840920 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fec7c06c2b0 0x7fec7c06e770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fec9400ba50 tx=0x7fec94008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:30.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.145+0000 7fec8a7fc640 1 -- 172.21.15.117:0/3989840920 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fec90010070 con 0x7fec98161eb0 2024-09-19T08:37:30.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.310+0000 7fec9fe77640 1 -- 172.21.15.117:0/3989840920 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec98072220 con 0x7fec98161eb0 2024-09-19T08:37:30.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.311+0000 7fec8a7fc640 1 -- 172.21.15.117:0/3989840920 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18650 (secure 0 0 0) 0x7fec90059e60 con 0x7fec98161eb0 2024-09-19T08:37:30.311 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:30.312 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":26,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:37:17.670150+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:37:10.463000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:37:11.619440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:37:15.342435+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:37:30.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.313+0000 7fec9fe77640 1 -- 172.21.15.117:0/3989840920 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fec7c06c2b0 msgr2=0x7fec7c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:30.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.313+0000 7fec9fe77640 1 --2- 172.21.15.117:0/3989840920 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fec7c06c2b0 0x7fec7c06e770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fec9400ba50 tx=0x7fec94008040 comp rx=0 tx=0).stop 2024-09-19T08:37:30.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.313+0000 7fec9fe77640 1 -- 172.21.15.117:0/3989840920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec98161eb0 msgr2=0x7fec981e86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:30.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.313+0000 7fec9fe77640 1 --2- 172.21.15.117:0/3989840920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec98161eb0 0x7fec981e86c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fec90007e70 tx=0x7fec9000d4a0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.313+0000 7fec9fe77640 1 -- 172.21.15.117:0/3989840920 shutdown_connections 2024-09-19T08:37:30.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.313+0000 7fec9fe77640 1 --2- 172.21.15.117:0/3989840920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec98161eb0 0x7fec981e86c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.313+0000 7fec9fe77640 1 --2- 172.21.15.117:0/3989840920 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fec7c06c2b0 0x7fec7c06e770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.313+0000 7fec9fe77640 1 --2- 172.21.15.117:0/3989840920 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec98143a20 0x7fec981602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.313+0000 7fec9fe77640 1 --2- 172.21.15.117:0/3989840920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec9806cd20 0x7fec980cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.313+0000 7fec9fe77640 1 -- 172.21.15.117:0/3989840920 >> 172.21.15.117:0/3989840920 conn(0x7fec980b3ed0 msgr2=0x7fec98070720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:30.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.313+0000 7fec9fe77640 1 -- 172.21.15.117:0/3989840920 shutdown_connections 2024-09-19T08:37:30.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.313+0000 7fec9fe77640 1 -- 172.21.15.117:0/3989840920 wait complete. 2024-09-19T08:37:30.325 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T08:37:30.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.427+0000 7f97776e6640 1 Processor -- start 2024-09-19T08:37:30.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.428+0000 7f97776e6640 1 -- start start 2024-09-19T08:37:30.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.428+0000 7f97776e6640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9770072250 0x7f97700cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:30.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.428+0000 7f97776e6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97700d2b30 con 0x7f97700726c0 2024-09-19T08:37:30.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.428+0000 7f97776e6640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9770141c60 con 0x7f97700d2750 2024-09-19T08:37:30.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.428+0000 7f97776e6640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f9770145bd0 con 0x7f9770072250 2024-09-19T08:37:30.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9775c83640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f97700726c0 0x7f9770160010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:33610/0 (socket says 172.21.15.117:33610) 2024-09-19T08:37:30.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9775c83640 1 -- 172.21.15.117:0/189410088 learned_addr learned my addr 172.21.15.117:0/189410088 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:30.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9774c81640 1 --2- 172.21.15.117:0/189410088 >> v2:172.21.15.146:3300/0 conn(0x7f9770072250 0x7f97700cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:30.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9767fff640 1 -- 172.21.15.117:0/189410088 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 325000116 0 0) 0x7f97700d2b30 con 0x7f97700726c0 2024-09-19T08:37:30.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9767fff640 1 -- 172.21.15.117:0/189410088 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f975c003520 con 0x7f97700726c0 2024-09-19T08:37:30.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9767fff640 1 -- 172.21.15.117:0/189410088 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1927898340 0 0) 0x7f9770141c60 con 0x7f97700d2750 2024-09-19T08:37:30.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9767fff640 1 -- 172.21.15.117:0/189410088 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97700d2b30 con 0x7f97700d2750 2024-09-19T08:37:30.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9767fff640 1 -- 172.21.15.117:0/189410088 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2356684642 0 0) 0x7f975c003520 con 0x7f97700726c0 2024-09-19T08:37:30.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9767fff640 1 -- 172.21.15.117:0/189410088 >> v2:172.21.15.146:3300/0 conn(0x7f9770072250 msgr2=0x7f97700cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:30.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9767fff640 1 --2- 172.21.15.117:0/189410088 >> v2:172.21.15.146:3300/0 conn(0x7f9770072250 0x7f97700cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9767fff640 1 -- 172.21.15.117:0/189410088 >> v1:172.21.15.146:6789/0 conn(0x7f97700d2750 legacy=0x7f977013f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:30.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9767fff640 1 -- 172.21.15.117:0/189410088 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9770141f40 con 0x7f97700726c0 2024-09-19T08:37:30.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9767fff640 1 -- 172.21.15.117:0/189410088 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f97680019f0 con 0x7f97700726c0 2024-09-19T08:37:30.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9767fff640 1 -- 172.21.15.117:0/189410088 >> v1:172.21.15.117:6789/0 conn(0x7f97700726c0 legacy=0x7f9770160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:30.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9767fff640 1 --2- 172.21.15.117:0/189410088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f975c003b40 0x7f975c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:30.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9767fff640 1 --2- 172.21.15.117:0/189410088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f975c004800 0x7f975c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:30.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9767fff640 1 --2- 172.21.15.117:0/189410088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f975c0051c0 0x7f975c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:30.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9767fff640 1 -- 172.21.15.117:0/189410088 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f975c00c0c0 con 0x7f975c003b40 2024-09-19T08:37:30.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9767fff640 1 -- 172.21.15.117:0/189410088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f975c00c270 con 0x7f975c0051c0 2024-09-19T08:37:30.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9767fff640 1 -- 172.21.15.117:0/189410088 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f975c00c470 con 0x7f975c004800 2024-09-19T08:37:30.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9775482640 1 --2- 172.21.15.117:0/189410088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f975c003b40 0x7f975c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:30.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9775c83640 1 --2- 172.21.15.117:0/189410088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f975c0051c0 0x7f975c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:30.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.429+0000 7f9774c81640 1 --2- 172.21.15.117:0/189410088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f975c004800 0x7f975c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:30.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.430+0000 7f9775482640 1 -- 172.21.15.117:0/189410088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f975c004800 msgr2=0x7f975c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:30.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.430+0000 7f9775482640 1 --2- 172.21.15.117:0/189410088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f975c004800 0x7f975c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.430+0000 7f9775482640 1 -- 172.21.15.117:0/189410088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f975c0051c0 msgr2=0x7f975c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:30.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.430+0000 7f9775482640 1 --2- 172.21.15.117:0/189410088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f975c0051c0 0x7f975c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.430+0000 7f9775c83640 1 -- 172.21.15.117:0/189410088 reap_dead start 2024-09-19T08:37:30.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.430+0000 7f9775482640 1 -- 172.21.15.117:0/189410088 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975c003520 con 0x7f975c003b40 2024-09-19T08:37:30.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.430+0000 7f9775482640 1 --2- 172.21.15.117:0/189410088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f975c003b40 0x7f975c003f40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f976c0018d0 tx=0x7f975c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e93df0441f59cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:30.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.430+0000 7f9767fff640 1 -- 172.21.15.117:0/189410088 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c0014f0 con 0x7f975c003b40 2024-09-19T08:37:30.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.430+0000 7f9767fff640 1 -- 172.21.15.117:0/189410088 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f976c0052d0 con 0x7f975c003b40 2024-09-19T08:37:30.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.430+0000 7f9767fff640 1 -- 172.21.15.117:0/189410088 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c02ac70 con 0x7f975c003b40 2024-09-19T08:37:30.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.431+0000 7f97776e6640 1 -- 172.21.15.117:0/189410088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f975c003b40 msgr2=0x7f975c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:30.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.431+0000 7f97776e6640 1 --2- 172.21.15.117:0/189410088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f975c003b40 0x7f975c003f40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f976c0018d0 tx=0x7f975c005830 comp rx=0 tx=0).stop 2024-09-19T08:37:30.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.431+0000 7f97776e6640 1 -- 172.21.15.117:0/189410088 shutdown_connections 2024-09-19T08:37:30.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.431+0000 7f97776e6640 1 --2- 172.21.15.117:0/189410088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f975c003b40 0x7f975c003f40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.431+0000 7f97776e6640 1 -- 172.21.15.117:0/189410088 >> 172.21.15.117:0/189410088 conn(0x7f97700b4040 msgr2=0x7f97700b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:30.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.431+0000 7f97776e6640 1 -- 172.21.15.117:0/189410088 shutdown_connections 2024-09-19T08:37:30.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.431+0000 7f97776e6640 1 -- 172.21.15.117:0/189410088 wait complete. 2024-09-19T08:37:30.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.432+0000 7f97776e6640 1 Processor -- start 2024-09-19T08:37:30.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.432+0000 7f97776e6640 1 -- start start 2024-09-19T08:37:30.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.433+0000 7f97776e6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f975c003b40 0x7f97700b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:30.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.433+0000 7f97776e6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97700b7470 0x7f97700b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:30.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.433+0000 7f97776e6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9770142960 0x7f9770142de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:30.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.433+0000 7f97776e6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9770142500 con 0x7f9770142960 2024-09-19T08:37:30.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.433+0000 7f97776e6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f97701427e0 con 0x7f975c003b40 2024-09-19T08:37:30.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.433+0000 7f97776e6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f97701418b0 con 0x7f97700b7470 2024-09-19T08:37:30.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.433+0000 7f9775c83640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9770142960 0x7f9770142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:30.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.433+0000 7f9775c83640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9770142960 0x7f9770142de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33890/0 (socket says 172.21.15.117:33890) 2024-09-19T08:37:30.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.433+0000 7f9775c83640 1 -- 172.21.15.117:0/2129777844 learned_addr learned my addr 172.21.15.117:0/2129777844 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:30.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.433+0000 7f9775482640 1 --2- 172.21.15.117:0/2129777844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f975c003b40 0x7f97700b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:30.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.433+0000 7f9774c81640 1 --2- 172.21.15.117:0/2129777844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97700b7470 0x7f97700b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:30.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.433+0000 7f9775c83640 1 -- 172.21.15.117:0/2129777844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97700b7470 msgr2=0x7f97700b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:30.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.433+0000 7f9775c83640 1 --2- 172.21.15.117:0/2129777844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97700b7470 0x7f97700b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.433+0000 7f9775c83640 1 -- 172.21.15.117:0/2129777844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f975c003b40 msgr2=0x7f97700b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:30.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.433+0000 7f9775c83640 1 --2- 172.21.15.117:0/2129777844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f975c003b40 0x7f97700b62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:30.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.433+0000 7f9775c83640 1 -- 172.21.15.117:0/2129777844 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97700b5200 con 0x7f9770142960 2024-09-19T08:37:30.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.434+0000 7f9775c83640 1 --2- 172.21.15.117:0/2129777844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9770142960 0x7f9770142de0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9768001b60 tx=0x7f97680079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:30.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.434+0000 7f9765ffb640 1 -- 172.21.15.117:0/2129777844 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976800a9e0 con 0x7f9770142960 2024-09-19T08:37:30.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.434+0000 7f9765ffb640 1 -- 172.21.15.117:0/2129777844 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9768018070 con 0x7f9770142960 2024-09-19T08:37:30.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.434+0000 7f97776e6640 1 -- 172.21.15.117:0/2129777844 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97700b54e0 con 0x7f9770142960 2024-09-19T08:37:30.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.434+0000 7f9765ffb640 1 -- 172.21.15.117:0/2129777844 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976800adc0 con 0x7f9770142960 2024-09-19T08:37:30.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.434+0000 7f97776e6640 1 -- 172.21.15.117:0/2129777844 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97700b5aa0 con 0x7f9770142960 2024-09-19T08:37:30.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.435+0000 7f97776e6640 1 -- 172.21.15.117:0/2129777844 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f977013f860 con 0x7f9770142960 2024-09-19T08:37:30.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.435+0000 7f9765ffb640 1 -- 172.21.15.117:0/2129777844 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f976801d460 con 0x7f9770142960 2024-09-19T08:37:30.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.436+0000 7f9765ffb640 1 --2- 172.21.15.117:0/2129777844 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f975406c2b0 0x7f975406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:30.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.436+0000 7f9765ffb640 1 -- 172.21.15.117:0/2129777844 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f976808baa0 con 0x7f9770142960 2024-09-19T08:37:30.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.436+0000 7f9775482640 1 --2- 172.21.15.117:0/2129777844 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f975406c2b0 0x7f975406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:30.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.436+0000 7f9775482640 1 --2- 172.21.15.117:0/2129777844 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f975406c2b0 0x7f975406e770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f976c032000 tx=0x7f976c009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:30.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.440+0000 7f9765ffb640 1 -- 172.21.15.117:0/2129777844 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9768059ed0 con 0x7f9770142960 2024-09-19T08:37:30.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:30.641+0000 7f97776e6640 1 -- 172.21.15.117:0/2129777844 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f97700cdd70 con 0x7f9770142960 2024-09-19T08:37:31.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.381+0000 7f9765ffb640 1 -- 172.21.15.117:0/2129777844 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f97680597d0 con 0x7f9770142960 2024-09-19T08:37:31.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.383+0000 7f97776e6640 1 -- 172.21.15.117:0/2129777844 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f975406c2b0 msgr2=0x7f975406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:31.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.383+0000 7f97776e6640 1 --2- 172.21.15.117:0/2129777844 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f975406c2b0 0x7f975406e770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f976c032000 tx=0x7f976c009030 comp rx=0 tx=0).stop 2024-09-19T08:37:31.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.383+0000 7f97776e6640 1 -- 172.21.15.117:0/2129777844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9770142960 msgr2=0x7f9770142de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:31.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.383+0000 7f97776e6640 1 --2- 172.21.15.117:0/2129777844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9770142960 0x7f9770142de0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9768001b60 tx=0x7f97680079d0 comp rx=0 tx=0).stop 2024-09-19T08:37:31.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.383+0000 7f97776e6640 1 -- 172.21.15.117:0/2129777844 shutdown_connections 2024-09-19T08:37:31.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.383+0000 7f97776e6640 1 --2- 172.21.15.117:0/2129777844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9770142960 0x7f9770142de0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:31.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.383+0000 7f97776e6640 1 --2- 172.21.15.117:0/2129777844 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f975406c2b0 0x7f975406e770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:31.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.383+0000 7f97776e6640 1 --2- 172.21.15.117:0/2129777844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97700b7470 0x7f97700b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:31.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.383+0000 7f97776e6640 1 --2- 172.21.15.117:0/2129777844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f975c003b40 0x7f97700b62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:31.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.383+0000 7f97776e6640 1 -- 172.21.15.117:0/2129777844 >> 172.21.15.117:0/2129777844 conn(0x7f97700b4040 msgr2=0x7f97700cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:31.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.383+0000 7f97776e6640 1 -- 172.21.15.117:0/2129777844 shutdown_connections 2024-09-19T08:37:31.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.383+0000 7f97776e6640 1 -- 172.21.15.117:0/2129777844 wait complete. 2024-09-19T08:37:31.395 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-19T08:37:31.395 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T08:37:31.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.499+0000 7fa45312c640 1 Processor -- start 2024-09-19T08:37:31.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.499+0000 7fa45312c640 1 -- start start 2024-09-19T08:37:31.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.500+0000 7fa45312c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa44c141680 0x7fa44c0cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:31.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.500+0000 7fa45312c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa44c15d710 con 0x7fa44c142170 2024-09-19T08:37:31.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.500+0000 7fa45312c640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa44c15c950 con 0x7fa44c0d0370 2024-09-19T08:37:31.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.500+0000 7fa45312c640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fa44c0d07e0 con 0x7fa44c141680 2024-09-19T08:37:31.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.500+0000 7fa4516c9640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fa44c142170 0x7fa44c13f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:33618/0 (socket says 172.21.15.117:33618) 2024-09-19T08:37:31.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.500+0000 7fa4516c9640 1 -- 172.21.15.117:0/531262224 learned_addr learned my addr 172.21.15.117:0/531262224 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:31.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.500+0000 7fa44b7fe640 1 -- 172.21.15.117:0/531262224 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2141928902 0 0) 0x7fa44c15d710 con 0x7fa44c142170 2024-09-19T08:37:31.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.500+0000 7fa44b7fe640 1 -- 172.21.15.117:0/531262224 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa434003520 con 0x7fa44c142170 2024-09-19T08:37:31.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.500+0000 7fa450ec8640 1 --2- 172.21.15.117:0/531262224 >> v2:172.21.15.146:3300/0 conn(0x7fa44c141680 0x7fa44c0cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:31.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.501+0000 7fa44b7fe640 1 -- 172.21.15.117:0/531262224 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3121837136 0 0) 0x7fa434003520 con 0x7fa44c142170 2024-09-19T08:37:31.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.501+0000 7fa44b7fe640 1 -- 172.21.15.117:0/531262224 >> v2:172.21.15.146:3300/0 conn(0x7fa44c141680 msgr2=0x7fa44c0cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:31.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.501+0000 7fa44b7fe640 1 --2- 172.21.15.117:0/531262224 >> v2:172.21.15.146:3300/0 conn(0x7fa44c141680 0x7fa44c0cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:31.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.501+0000 7fa44b7fe640 1 -- 172.21.15.117:0/531262224 >> v1:172.21.15.146:6789/0 conn(0x7fa44c0d0370 legacy=0x7fa44c141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:31.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.501+0000 7fa44b7fe640 1 -- 172.21.15.117:0/531262224 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa44c15cc30 con 0x7fa44c142170 2024-09-19T08:37:31.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.501+0000 7fa44b7fe640 1 -- 172.21.15.117:0/531262224 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7fa444001670 con 0x7fa44c142170 2024-09-19T08:37:31.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.501+0000 7fa44b7fe640 1 -- 172.21.15.117:0/531262224 >> v1:172.21.15.117:6789/0 conn(0x7fa44c142170 legacy=0x7fa44c13f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:31.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.501+0000 7fa44b7fe640 1 --2- 172.21.15.117:0/531262224 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4340039b0 0x7fa434003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:31.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.501+0000 7fa44b7fe640 1 --2- 172.21.15.117:0/531262224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa434004800 0x7fa434004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:31.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.501+0000 7fa44b7fe640 1 --2- 172.21.15.117:0/531262224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4340051c0 0x7fa43400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:31.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.501+0000 7fa44b7fe640 1 -- 172.21.15.117:0/531262224 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c0d07e0 con 0x7fa4340051c0 2024-09-19T08:37:31.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.501+0000 7fa44b7fe640 1 -- 172.21.15.117:0/531262224 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa43400c060 con 0x7fa434004800 2024-09-19T08:37:31.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.501+0000 7fa44b7fe640 1 -- 172.21.15.117:0/531262224 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fa43400c260 con 0x7fa4340039b0 2024-09-19T08:37:31.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.501+0000 7fa4516c9640 1 --2- 172.21.15.117:0/531262224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4340051c0 0x7fa43400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:31.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.501+0000 7fa44bfff640 1 --2- 172.21.15.117:0/531262224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa434004800 0x7fa434004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:31.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.501+0000 7fa450ec8640 1 --2- 172.21.15.117:0/531262224 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4340039b0 0x7fa434003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:31.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.501+0000 7fa4516c9640 1 -- 172.21.15.117:0/531262224 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4340039b0 msgr2=0x7fa434003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:31.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.501+0000 7fa4516c9640 1 --2- 172.21.15.117:0/531262224 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4340039b0 0x7fa434003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:31.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.501+0000 7fa4516c9640 1 -- 172.21.15.117:0/531262224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa434004800 msgr2=0x7fa434004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:31.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.501+0000 7fa4516c9640 1 --2- 172.21.15.117:0/531262224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa434004800 0x7fa434004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:31.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.501+0000 7fa4516c9640 1 -- 172.21.15.117:0/531262224 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa434003520 con 0x7fa4340051c0 2024-09-19T08:37:31.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.502+0000 7fa4516c9640 1 -- 172.21.15.117:0/531262224 reap_dead start 2024-09-19T08:37:31.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.502+0000 7fa4516c9640 1 --2- 172.21.15.117:0/531262224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4340051c0 0x7fa43400b9c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa44400c240 tx=0x7fa434005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6f3e51e50ec82e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:31.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.502+0000 7fa44b7fe640 1 -- 172.21.15.117:0/531262224 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa444007d10 con 0x7fa4340051c0 2024-09-19T08:37:31.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.502+0000 7fa44b7fe640 1 -- 172.21.15.117:0/531262224 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa444005ad0 con 0x7fa4340051c0 2024-09-19T08:37:31.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.502+0000 7fa44b7fe640 1 -- 172.21.15.117:0/531262224 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa444007070 con 0x7fa4340051c0 2024-09-19T08:37:31.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.502+0000 7fa45312c640 1 -- 172.21.15.117:0/531262224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4340051c0 msgr2=0x7fa43400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:31.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.502+0000 7fa45312c640 1 --2- 172.21.15.117:0/531262224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4340051c0 0x7fa43400b9c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa44400c240 tx=0x7fa434005830 comp rx=0 tx=0).stop 2024-09-19T08:37:31.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.503+0000 7fa45312c640 1 -- 172.21.15.117:0/531262224 shutdown_connections 2024-09-19T08:37:31.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.503+0000 7fa45312c640 1 --2- 172.21.15.117:0/531262224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4340051c0 0x7fa43400b9c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:31.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.503+0000 7fa45312c640 1 -- 172.21.15.117:0/531262224 >> 172.21.15.117:0/531262224 conn(0x7fa44c0b3ed0 msgr2=0x7fa44c0b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:31.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.503+0000 7fa45312c640 1 -- 172.21.15.117:0/531262224 shutdown_connections 2024-09-19T08:37:31.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.503+0000 7fa45312c640 1 -- 172.21.15.117:0/531262224 wait complete. 2024-09-19T08:37:31.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.504+0000 7fa45312c640 1 Processor -- start 2024-09-19T08:37:31.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.504+0000 7fa45312c640 1 -- start start 2024-09-19T08:37:31.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa45312c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4340051c0 0x7fa44c13ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:31.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa45312c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa44c158e70 0x7fa44c1592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:31.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa45312c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa44c1e5540 0x7fa44c1e59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:31.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa45312c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c15d1f0 con 0x7fa44c1e5540 2024-09-19T08:37:31.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa45312c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c15c6f0 con 0x7fa4340051c0 2024-09-19T08:37:31.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa45312c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fa44c142570 con 0x7fa44c158e70 2024-09-19T08:37:31.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa4516c9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa44c1e5540 0x7fa44c1e59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:31.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa4516c9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa44c1e5540 0x7fa44c1e59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33914/0 (socket says 172.21.15.117:33914) 2024-09-19T08:37:31.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa4516c9640 1 -- 172.21.15.117:0/2533954676 learned_addr learned my addr 172.21.15.117:0/2533954676 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:31.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa44bfff640 1 --2- 172.21.15.117:0/2533954676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa44c158e70 0x7fa44c1592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:31.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa450ec8640 1 --2- 172.21.15.117:0/2533954676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4340051c0 0x7fa44c13ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:31.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa4516c9640 1 -- 172.21.15.117:0/2533954676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa44c158e70 msgr2=0x7fa44c1592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:31.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa4516c9640 1 --2- 172.21.15.117:0/2533954676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa44c158e70 0x7fa44c1592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:31.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa4516c9640 1 -- 172.21.15.117:0/2533954676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4340051c0 msgr2=0x7fa44c13ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:31.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa4516c9640 1 --2- 172.21.15.117:0/2533954676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4340051c0 0x7fa44c13ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:31.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa4516c9640 1 -- 172.21.15.117:0/2533954676 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa44c13f190 con 0x7fa44c1e5540 2024-09-19T08:37:31.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa4516c9640 1 --2- 172.21.15.117:0/2533954676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa44c1e5540 0x7fa44c1e59c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa44402ae20 tx=0x7fa44c15ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:31.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa4497fa640 1 -- 172.21.15.117:0/2533954676 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa444007d10 con 0x7fa44c1e5540 2024-09-19T08:37:31.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa4497fa640 1 -- 172.21.15.117:0/2533954676 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa444042070 con 0x7fa44c1e5540 2024-09-19T08:37:31.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa45312c640 1 -- 172.21.15.117:0/2533954676 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa44c1e5f00 con 0x7fa44c1e5540 2024-09-19T08:37:31.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa4497fa640 1 -- 172.21.15.117:0/2533954676 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa444007270 con 0x7fa44c1e5540 2024-09-19T08:37:31.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.505+0000 7fa45312c640 1 -- 172.21.15.117:0/2533954676 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa44c0b56c0 con 0x7fa44c1e5540 2024-09-19T08:37:31.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.506+0000 7fa45312c640 1 -- 172.21.15.117:0/2533954676 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa44c159830 con 0x7fa44c1e5540 2024-09-19T08:37:31.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.507+0000 7fa4497fa640 1 -- 172.21.15.117:0/2533954676 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa444007410 con 0x7fa44c1e5540 2024-09-19T08:37:31.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.507+0000 7fa4497fa640 1 --2- 172.21.15.117:0/2533954676 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa43806c2b0 0x7fa43806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:31.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.507+0000 7fa4497fa640 1 -- 172.21.15.117:0/2533954676 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa4440ab880 con 0x7fa44c1e5540 2024-09-19T08:37:31.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.507+0000 7fa450ec8640 1 --2- 172.21.15.117:0/2533954676 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa43806c2b0 0x7fa43806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:31.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.508+0000 7fa450ec8640 1 --2- 172.21.15.117:0/2533954676 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa43806c2b0 0x7fa43806e770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009b40 tx=0x7fa43c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:31.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.511+0000 7fa4497fa640 1 -- 172.21.15.117:0/2533954676 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa44c13f190 con 0x7fa44c1e5540 2024-09-19T08:37:31.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:31.710+0000 7fa45312c640 1 -- 172.21.15.117:0/2533954676 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa44c0690c0 con 0x7fa44c1e5540 2024-09-19T08:37:32.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.388+0000 7fa4497fa640 1 -- 172.21.15.117:0/2533954676 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7fa444079810 con 0x7fa44c1e5540 2024-09-19T08:37:32.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.390+0000 7fa45312c640 1 -- 172.21.15.117:0/2533954676 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa43806c2b0 msgr2=0x7fa43806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:32.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.390+0000 7fa45312c640 1 --2- 172.21.15.117:0/2533954676 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa43806c2b0 0x7fa43806e770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009b40 tx=0x7fa43c009190 comp rx=0 tx=0).stop 2024-09-19T08:37:32.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.390+0000 7fa45312c640 1 -- 172.21.15.117:0/2533954676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa44c1e5540 msgr2=0x7fa44c1e59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:32.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.390+0000 7fa45312c640 1 --2- 172.21.15.117:0/2533954676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa44c1e5540 0x7fa44c1e59c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa44402ae20 tx=0x7fa44c15ce00 comp rx=0 tx=0).stop 2024-09-19T08:37:32.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.390+0000 7fa45312c640 1 -- 172.21.15.117:0/2533954676 shutdown_connections 2024-09-19T08:37:32.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.390+0000 7fa45312c640 1 --2- 172.21.15.117:0/2533954676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa44c1e5540 0x7fa44c1e59c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:32.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.390+0000 7fa45312c640 1 --2- 172.21.15.117:0/2533954676 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa43806c2b0 0x7fa43806e770 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:32.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.390+0000 7fa45312c640 1 --2- 172.21.15.117:0/2533954676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa44c158e70 0x7fa44c1592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:32.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.390+0000 7fa45312c640 1 --2- 172.21.15.117:0/2533954676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4340051c0 0x7fa44c13ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:32.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.390+0000 7fa45312c640 1 -- 172.21.15.117:0/2533954676 >> 172.21.15.117:0/2533954676 conn(0x7fa44c0b3ed0 msgr2=0x7fa44c0d2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:32.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.390+0000 7fa45312c640 1 -- 172.21.15.117:0/2533954676 shutdown_connections 2024-09-19T08:37:32.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.390+0000 7fa45312c640 1 -- 172.21.15.117:0/2533954676 wait complete. 2024-09-19T08:37:32.403 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T08:37:32.403 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:37:32.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.503+0000 7f162c94b640 1 Processor -- start 2024-09-19T08:37:32.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.503+0000 7f162c94b640 1 -- start start 2024-09-19T08:37:32.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.504+0000 7f162c94b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1628072590 0x7f162806d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:32.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.504+0000 7f162c94b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1628141ad0 0x7f1628141f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:32.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.504+0000 7f162c94b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16281620b0 con 0x7f16280d21f0 2024-09-19T08:37:32.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.504+0000 7f162c94b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1628141750 con 0x7f1628072590 2024-09-19T08:37:32.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.504+0000 7f162c94b640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f1628162370 con 0x7f1628141ad0 2024-09-19T08:37:32.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.504+0000 7f161dd9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1628072590 0x7f162806d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:32.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.504+0000 7f161dd9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1628072590 0x7f162806d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33916/0 (socket says 172.21.15.117:33916) 2024-09-19T08:37:32.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.504+0000 7f161dd9b640 1 -- 172.21.15.117:0/2436608952 learned_addr learned my addr 172.21.15.117:0/2436608952 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:32.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.504+0000 7f161dd9b640 1 -- 172.21.15.117:0/2436608952 >> v2:172.21.15.146:3300/0 conn(0x7f1628141ad0 msgr2=0x7f1628141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:32.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.504+0000 7f1626d9d640 1 --2- 172.21.15.117:0/2436608952 >> v2:172.21.15.146:3300/0 conn(0x7f1628141ad0 0x7f1628141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:32.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.504+0000 7f161dd9b640 1 --2- 172.21.15.117:0/2436608952 >> v2:172.21.15.146:3300/0 conn(0x7f1628141ad0 0x7f1628141f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:32.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.504+0000 7f161dd9b640 1 -- 172.21.15.117:0/2436608952 >> v1:172.21.15.146:6789/0 conn(0x7f16280d21f0 legacy=0x7f16280d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:32.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.504+0000 7f161dd9b640 1 -- 172.21.15.117:0/2436608952 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1628162650 con 0x7f1628072590 2024-09-19T08:37:32.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.505+0000 7f161dd9b640 1 --2- 172.21.15.117:0/2436608952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1628072590 0x7f162806d0e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f16280b1df0 tx=0x7f161002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e4c4b038c7e927 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:32.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.505+0000 7f1625d9b640 1 -- 172.21.15.117:0/2436608952 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610037070 con 0x7f1628072590 2024-09-19T08:37:32.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.505+0000 7f1625d9b640 1 -- 172.21.15.117:0/2436608952 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1610032440 con 0x7f1628072590 2024-09-19T08:37:32.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.505+0000 7f1625d9b640 1 -- 172.21.15.117:0/2436608952 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610032810 con 0x7f1628072590 2024-09-19T08:37:32.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.505+0000 7f162c94b640 1 -- 172.21.15.117:0/2436608952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1628072590 msgr2=0x7f162806d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:32.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.505+0000 7f162c94b640 1 --2- 172.21.15.117:0/2436608952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1628072590 0x7f162806d0e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f16280b1df0 tx=0x7f161002a1a0 comp rx=0 tx=0).stop 2024-09-19T08:37:32.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.505+0000 7f162c94b640 1 -- 172.21.15.117:0/2436608952 shutdown_connections 2024-09-19T08:37:32.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.505+0000 7f162c94b640 1 --2- 172.21.15.117:0/2436608952 >> v2:172.21.15.146:3300/0 conn(0x7f1628141ad0 0x7f1628141f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:32.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.505+0000 7f162c94b640 1 --2- 172.21.15.117:0/2436608952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1628072590 0x7f162806d0e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:32.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.505+0000 7f162c94b640 1 -- 172.21.15.117:0/2436608952 >> 172.21.15.117:0/2436608952 conn(0x7f16280b3ed0 msgr2=0x7f16280b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:32.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.505+0000 7f162c94b640 1 -- 172.21.15.117:0/2436608952 shutdown_connections 2024-09-19T08:37:32.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.505+0000 7f162c94b640 1 -- 172.21.15.117:0/2436608952 wait complete. 2024-09-19T08:37:32.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.507+0000 7f162c94b640 1 Processor -- start 2024-09-19T08:37:32.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.507+0000 7f162c94b640 1 -- start start 2024-09-19T08:37:32.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f162c94b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1628072590 0x7f16280b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:32.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f162c94b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16280d21f0 0x7f16281f8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:32.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f162c94b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1628141ad0 0x7f162815c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:32.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f162c94b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f162806d620 con 0x7f1628141ad0 2024-09-19T08:37:32.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f162c94b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1628162c10 con 0x7f16280d21f0 2024-09-19T08:37:32.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f162c94b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f162806d7a0 con 0x7f1628072590 2024-09-19T08:37:32.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f1626d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1628141ad0 0x7f162815c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:32.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f1626d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1628141ad0 0x7f162815c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33920/0 (socket says 172.21.15.117:33920) 2024-09-19T08:37:32.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f1626d9d640 1 -- 172.21.15.117:0/4235796148 learned_addr learned my addr 172.21.15.117:0/4235796148 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:32.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f162659c640 1 --2- 172.21.15.117:0/4235796148 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1628072590 0x7f16280b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:32.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f161dd9b640 1 --2- 172.21.15.117:0/4235796148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16280d21f0 0x7f16281f8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:32.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f1626d9d640 1 -- 172.21.15.117:0/4235796148 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1628072590 msgr2=0x7f16280b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:32.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f1626d9d640 1 --2- 172.21.15.117:0/4235796148 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1628072590 0x7f16280b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:32.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f1626d9d640 1 -- 172.21.15.117:0/4235796148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16280d21f0 msgr2=0x7f16281f8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:32.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f1626d9d640 1 --2- 172.21.15.117:0/4235796148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16280d21f0 0x7f16281f8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:32.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f1626d9d640 1 -- 172.21.15.117:0/4235796148 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16280b8100 con 0x7f1628141ad0 2024-09-19T08:37:32.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f162659c640 1 --2- 172.21.15.117:0/4235796148 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1628072590 0x7f16280b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:32.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f161dd9b640 1 --2- 172.21.15.117:0/4235796148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16280d21f0 0x7f16281f8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:32.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f1626d9d640 1 --2- 172.21.15.117:0/4235796148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1628141ad0 0x7f162815c560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f162000cc60 tx=0x7f162000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:32.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f161f7fe640 1 -- 172.21.15.117:0/4235796148 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1620003990 con 0x7f1628141ad0 2024-09-19T08:37:32.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f161f7fe640 1 -- 172.21.15.117:0/4235796148 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1620003b30 con 0x7f1628141ad0 2024-09-19T08:37:32.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f162c94b640 1 -- 172.21.15.117:0/4235796148 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16281f88c0 con 0x7f1628141ad0 2024-09-19T08:37:32.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f161f7fe640 1 -- 172.21.15.117:0/4235796148 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1620004020 con 0x7f1628141ad0 2024-09-19T08:37:32.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.508+0000 7f162c94b640 1 -- 172.21.15.117:0/4235796148 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f162815eb70 con 0x7f1628141ad0 2024-09-19T08:37:32.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.510+0000 7f162c94b640 1 -- 172.21.15.117:0/4235796148 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1628158c30 con 0x7f1628141ad0 2024-09-19T08:37:32.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.510+0000 7f161f7fe640 1 -- 172.21.15.117:0/4235796148 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f16200041c0 con 0x7f1628141ad0 2024-09-19T08:37:32.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.510+0000 7f161f7fe640 1 --2- 172.21.15.117:0/4235796148 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f160806c2b0 0x7f160806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:32.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.510+0000 7f161f7fe640 1 -- 172.21.15.117:0/4235796148 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f162008bbe0 con 0x7f1628141ad0 2024-09-19T08:37:32.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.511+0000 7f162659c640 1 --2- 172.21.15.117:0/4235796148 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f160806c2b0 0x7f160806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:32.514 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.511+0000 7f162659c640 1 --2- 172.21.15.117:0/4235796148 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f160806c2b0 0x7f160806e770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1618003eb0 tx=0x7f1618009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:32.514 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.515+0000 7f161f7fe640 1 -- 172.21.15.117:0/4235796148 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1620014030 con 0x7f1628141ad0 2024-09-19T08:37:32.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.713+0000 7f162c94b640 1 -- 172.21.15.117:0/4235796148 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1628072290 con 0x7f1628141ad0 2024-09-19T08:37:32.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.714+0000 7f161f7fe640 1 -- 172.21.15.117:0/4235796148 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7f162005a0a0 con 0x7f1628141ad0 2024-09-19T08:37:32.714 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:32.714 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":9,"btime":"2024-09-19T08:37:32:382208+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2592540396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2592540396},{"type":"v1","addr":"172.21.15.117:6833","nonce":2592540396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3561335184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3561335184},{"type":"v1","addr":"172.21.15.117:6835","nonce":3561335184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/2623207604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2623207604},{"type":"v1","addr":"172.21.15.146:6837","nonce":2623207604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:37:12.640173+0000","modified":"2024-09-19T08:37:31.712060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6836/2942334805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2942334805},{"type":"v1","addr":"172.21.15.146:6836","nonce":2942334805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4303,"qdb_cluster":[4303]},"id":1}]} 2024-09-19T08:37:32.714 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 9 2024-09-19T08:37:32.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.716+0000 7f162c94b640 1 -- 172.21.15.117:0/4235796148 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f160806c2b0 msgr2=0x7f160806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:32.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.716+0000 7f162c94b640 1 --2- 172.21.15.117:0/4235796148 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f160806c2b0 0x7f160806e770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1618003eb0 tx=0x7f1618009040 comp rx=0 tx=0).stop 2024-09-19T08:37:32.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.716+0000 7f162c94b640 1 -- 172.21.15.117:0/4235796148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1628141ad0 msgr2=0x7f162815c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:32.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.716+0000 7f162c94b640 1 --2- 172.21.15.117:0/4235796148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1628141ad0 0x7f162815c560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f162000cc60 tx=0x7f162000a5c0 comp rx=0 tx=0).stop 2024-09-19T08:37:32.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.716+0000 7f162c94b640 1 -- 172.21.15.117:0/4235796148 shutdown_connections 2024-09-19T08:37:32.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.716+0000 7f162c94b640 1 --2- 172.21.15.117:0/4235796148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1628141ad0 0x7f162815c560 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:32.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.716+0000 7f162c94b640 1 --2- 172.21.15.117:0/4235796148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16280d21f0 0x7f16281f8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:32.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.716+0000 7f162c94b640 1 --2- 172.21.15.117:0/4235796148 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f160806c2b0 0x7f160806e770 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:32.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.716+0000 7f162c94b640 1 --2- 172.21.15.117:0/4235796148 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1628072590 0x7f16280b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:32.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.716+0000 7f162c94b640 1 -- 172.21.15.117:0/4235796148 >> 172.21.15.117:0/4235796148 conn(0x7f16280b3ed0 msgr2=0x7f1628142860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:32.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.716+0000 7f162c94b640 1 -- 172.21.15.117:0/4235796148 shutdown_connections 2024-09-19T08:37:32.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.716+0000 7f162c94b640 1 -- 172.21.15.117:0/4235796148 wait complete. 2024-09-19T08:37:32.727 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:37:32.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.825+0000 7f23a655f640 1 Processor -- start 2024-09-19T08:37:32.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.825+0000 7f23a655f640 1 -- start start 2024-09-19T08:37:32.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.826+0000 7f23a655f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a015e2a0 0x7f23a006d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:32.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.826+0000 7f23a655f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f23a006d960 0x7f23a00d4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:32.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.826+0000 7f23a655f640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23a00d1880 con 0x7f23a015e680 2024-09-19T08:37:32.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.826+0000 7f23a655f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f23a00d1b60 con 0x7f23a006d960 2024-09-19T08:37:32.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.826+0000 7f23a655f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f23a00cf2d0 con 0x7f23a015e2a0 2024-09-19T08:37:32.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.826+0000 7f23a4afc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f23a006d960 0x7f23a00d4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:32.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.826+0000 7f23a4afc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f23a006d960 0x7f23a00d4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33936/0 (socket says 172.21.15.117:33936) 2024-09-19T08:37:32.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.826+0000 7f23a4afc640 1 -- 172.21.15.117:0/297263497 learned_addr learned my addr 172.21.15.117:0/297263497 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:32.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.827+0000 7f239ffff640 1 --2- 172.21.15.117:0/297263497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a015e2a0 0x7f23a006d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:32.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.827+0000 7f23a4afc640 1 -- 172.21.15.117:0/297263497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a015e2a0 msgr2=0x7f23a006d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:32.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.827+0000 7f23a4afc640 1 --2- 172.21.15.117:0/297263497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a015e2a0 0x7f23a006d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:32.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.827+0000 7f23a4afc640 1 -- 172.21.15.117:0/297263497 >> v1:172.21.15.146:6789/0 conn(0x7f23a015e680 legacy=0x7f23a00cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:32.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.827+0000 7f23a4afc640 1 -- 172.21.15.117:0/297263497 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a00cf5b0 con 0x7f23a006d960 2024-09-19T08:37:32.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.827+0000 7f23a4afc640 1 --2- 172.21.15.117:0/297263497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23a006d960 0x7f23a00d4370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2398009e50 tx=0x7f239802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883dcffc834eabc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:32.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.827+0000 7f239effd640 1 -- 172.21.15.117:0/297263497 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398036070 con 0x7f23a006d960 2024-09-19T08:37:32.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.827+0000 7f239effd640 1 -- 172.21.15.117:0/297263497 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2398031600 con 0x7f23a006d960 2024-09-19T08:37:32.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.827+0000 7f239effd640 1 -- 172.21.15.117:0/297263497 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23980319d0 con 0x7f23a006d960 2024-09-19T08:37:32.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.828+0000 7f23a655f640 1 -- 172.21.15.117:0/297263497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23a006d960 msgr2=0x7f23a00d4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:32.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.828+0000 7f23a655f640 1 --2- 172.21.15.117:0/297263497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23a006d960 0x7f23a00d4370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2398009e50 tx=0x7f239802a710 comp rx=0 tx=0).stop 2024-09-19T08:37:32.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.828+0000 7f23a655f640 1 -- 172.21.15.117:0/297263497 shutdown_connections 2024-09-19T08:37:32.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.828+0000 7f23a655f640 1 --2- 172.21.15.117:0/297263497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23a006d960 0x7f23a00d4370 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:32.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.828+0000 7f23a655f640 1 --2- 172.21.15.117:0/297263497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a015e2a0 0x7f23a006d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:32.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.828+0000 7f23a655f640 1 -- 172.21.15.117:0/297263497 >> 172.21.15.117:0/297263497 conn(0x7f23a009d760 msgr2=0x7f23a008bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:32.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.828+0000 7f23a655f640 1 -- 172.21.15.117:0/297263497 shutdown_connections 2024-09-19T08:37:32.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.828+0000 7f23a655f640 1 -- 172.21.15.117:0/297263497 wait complete. 2024-09-19T08:37:32.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.829+0000 7f23a655f640 1 Processor -- start 2024-09-19T08:37:32.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.829+0000 7f23a655f640 1 -- start start 2024-09-19T08:37:32.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.830+0000 7f23a655f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23a006d960 0x7f23a00cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:32.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.830+0000 7f23a655f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a015e2a0 0x7f23a00b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:32.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.830+0000 7f23a655f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a015e680 0x7f23a0159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:32.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.830+0000 7f23a655f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f23a00d0360 con 0x7f23a006d960 2024-09-19T08:37:32.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.830+0000 7f23a655f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f23a00d01e0 con 0x7f23a015e680 2024-09-19T08:37:32.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.830+0000 7f23a655f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f23a00d48b0 con 0x7f23a015e2a0 2024-09-19T08:37:32.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.830+0000 7f239ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23a006d960 0x7f23a00cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:32.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.830+0000 7f239ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23a006d960 0x7f23a00cabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33948/0 (socket says 172.21.15.117:33948) 2024-09-19T08:37:32.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.830+0000 7f239ffff640 1 -- 172.21.15.117:0/1394749153 learned_addr learned my addr 172.21.15.117:0/1394749153 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:32.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.830+0000 7f239f7fe640 1 --2- 172.21.15.117:0/1394749153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a015e2a0 0x7f23a00b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:32.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.830+0000 7f23a4afc640 1 --2- 172.21.15.117:0/1394749153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a015e680 0x7f23a0159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:32.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.830+0000 7f239ffff640 1 -- 172.21.15.117:0/1394749153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a015e2a0 msgr2=0x7f23a00b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:32.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.830+0000 7f239ffff640 1 --2- 172.21.15.117:0/1394749153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a015e2a0 0x7f23a00b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:32.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.830+0000 7f239ffff640 1 -- 172.21.15.117:0/1394749153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a015e680 msgr2=0x7f23a0159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:32.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.830+0000 7f239ffff640 1 --2- 172.21.15.117:0/1394749153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a015e680 0x7f23a0159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:32.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.830+0000 7f239ffff640 1 -- 172.21.15.117:0/1394749153 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a00cb100 con 0x7f23a006d960 2024-09-19T08:37:32.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.830+0000 7f23a4afc640 1 --2- 172.21.15.117:0/1394749153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a015e680 0x7f23a0159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:32.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.831+0000 7f239ffff640 1 --2- 172.21.15.117:0/1394749153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23a006d960 0x7f23a00cabc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f239000d800 tx=0x7f239000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:32.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.831+0000 7f239cff9640 1 -- 172.21.15.117:0/1394749153 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239000b6c0 con 0x7f23a006d960 2024-09-19T08:37:32.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.831+0000 7f239cff9640 1 -- 172.21.15.117:0/1394749153 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2390019070 con 0x7f23a006d960 2024-09-19T08:37:32.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.831+0000 7f23a655f640 1 -- 172.21.15.117:0/1394749153 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a00b8340 con 0x7f23a006d960 2024-09-19T08:37:32.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.831+0000 7f239cff9640 1 -- 172.21.15.117:0/1394749153 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239000ba80 con 0x7f23a006d960 2024-09-19T08:37:32.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.831+0000 7f23a655f640 1 -- 172.21.15.117:0/1394749153 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a00b8900 con 0x7f23a006d960 2024-09-19T08:37:32.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.832+0000 7f23a655f640 1 -- 172.21.15.117:0/1394749153 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23a00d4370 con 0x7f23a006d960 2024-09-19T08:37:32.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.832+0000 7f239cff9640 1 -- 172.21.15.117:0/1394749153 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f239000bc20 con 0x7f23a006d960 2024-09-19T08:37:32.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.833+0000 7f239cff9640 1 --2- 172.21.15.117:0/1394749153 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f238c06c2b0 0x7f238c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:32.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.833+0000 7f239cff9640 1 -- 172.21.15.117:0/1394749153 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f239008bb00 con 0x7f23a006d960 2024-09-19T08:37:32.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.833+0000 7f239f7fe640 1 --2- 172.21.15.117:0/1394749153 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f238c06c2b0 0x7f238c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:32.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.833+0000 7f239f7fe640 1 --2- 172.21.15.117:0/1394749153 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f238c06c2b0 0x7f238c06e770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f23a00b5950 tx=0x7f2394009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:32.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:32.837+0000 7f239cff9640 1 -- 172.21.15.117:0/1394749153 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2390059fc0 con 0x7f23a006d960 2024-09-19T08:37:33.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.002+0000 7f23a655f640 1 -- 172.21.15.117:0/1394749153 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23a006cf90 con 0x7f23a006d960 2024-09-19T08:37:33.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.003+0000 7f239cff9640 1 -- 172.21.15.117:0/1394749153 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18650 (secure 0 0 0) 0x7f23900598c0 con 0x7f23a006d960 2024-09-19T08:37:33.003 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:33.004 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":26,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:37:17.670150+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:37:10.463000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:37:11.619440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:37:15.342435+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:37:33.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.005+0000 7f23a655f640 1 -- 172.21.15.117:0/1394749153 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f238c06c2b0 msgr2=0x7f238c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:33.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.005+0000 7f23a655f640 1 --2- 172.21.15.117:0/1394749153 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f238c06c2b0 0x7f238c06e770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f23a00b5950 tx=0x7f2394009040 comp rx=0 tx=0).stop 2024-09-19T08:37:33.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.005+0000 7f23a655f640 1 -- 172.21.15.117:0/1394749153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23a006d960 msgr2=0x7f23a00cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:33.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.005+0000 7f23a655f640 1 --2- 172.21.15.117:0/1394749153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23a006d960 0x7f23a00cabc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f239000d800 tx=0x7f239000dcc0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.005+0000 7f23a655f640 1 -- 172.21.15.117:0/1394749153 shutdown_connections 2024-09-19T08:37:33.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.005+0000 7f23a655f640 1 --2- 172.21.15.117:0/1394749153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a015e680 0x7f23a0159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.005+0000 7f23a655f640 1 --2- 172.21.15.117:0/1394749153 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f238c06c2b0 0x7f238c06e770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.005+0000 7f23a655f640 1 --2- 172.21.15.117:0/1394749153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a015e2a0 0x7f23a00b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.005+0000 7f23a655f640 1 --2- 172.21.15.117:0/1394749153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23a006d960 0x7f23a00cabc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.005+0000 7f23a655f640 1 -- 172.21.15.117:0/1394749153 >> 172.21.15.117:0/1394749153 conn(0x7f23a009d760 msgr2=0x7f23a015f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:33.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.005+0000 7f23a655f640 1 -- 172.21.15.117:0/1394749153 shutdown_connections 2024-09-19T08:37:33.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.005+0000 7f23a655f640 1 -- 172.21.15.117:0/1394749153 wait complete. 2024-09-19T08:37:33.017 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T08:37:33.017 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:37:33.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.115+0000 7fb78b20a640 1 Processor -- start 2024-09-19T08:37:33.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.115+0000 7fb78b20a640 1 -- start start 2024-09-19T08:37:33.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.116+0000 7fb78b20a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb78415e2a0 0x7fb78406d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:33.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.116+0000 7fb78b20a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb78406d960 0x7fb7840d4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:33.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.116+0000 7fb78b20a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7840d1880 con 0x7fb78415e680 2024-09-19T08:37:33.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.116+0000 7fb78b20a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb7840d1b60 con 0x7fb78406d960 2024-09-19T08:37:33.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.116+0000 7fb78b20a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fb7840cf2d0 con 0x7fb78415e2a0 2024-09-19T08:37:33.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.116+0000 7fb7897a7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb78406d960 0x7fb7840d4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:33.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.116+0000 7fb783fff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fb78415e680 0x7fb7840cfad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:33630/0 (socket says 172.21.15.117:33630) 2024-09-19T08:37:33.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.116+0000 7fb783fff640 1 -- 172.21.15.117:0/361535098 learned_addr learned my addr 172.21.15.117:0/361535098 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:33.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.117+0000 7fb788fa6640 1 --2- 172.21.15.117:0/361535098 >> v2:172.21.15.146:3300/0 conn(0x7fb78415e2a0 0x7fb78406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:33.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.117+0000 7fb7897a7640 1 -- 172.21.15.117:0/361535098 >> v2:172.21.15.146:3300/0 conn(0x7fb78415e2a0 msgr2=0x7fb78406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:33.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.117+0000 7fb7897a7640 1 --2- 172.21.15.117:0/361535098 >> v2:172.21.15.146:3300/0 conn(0x7fb78415e2a0 0x7fb78406d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.117+0000 7fb7897a7640 1 -- 172.21.15.117:0/361535098 >> v1:172.21.15.117:6789/0 conn(0x7fb78415e680 legacy=0x7fb7840cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:33.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.117+0000 7fb7897a7640 1 -- 172.21.15.117:0/361535098 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7840cf5b0 con 0x7fb78406d960 2024-09-19T08:37:33.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.117+0000 7fb7837fe640 1 -- 172.21.15.117:0/361535098 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4230105812 0 0) 0x7fb7840d1880 con 0x7fb78415e680 2024-09-19T08:37:33.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.117+0000 7fb788fa6640 1 --2- 172.21.15.117:0/361535098 >> v2:172.21.15.146:3300/0 conn(0x7fb78415e2a0 0x7fb78406d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:33.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.117+0000 7fb7897a7640 1 --2- 172.21.15.117:0/361535098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb78406d960 0x7fb7840d4370 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb7840b6fa0 tx=0x7fb77c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d81f4fe881625f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:33.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.117+0000 7fb7837fe640 1 -- 172.21.15.117:0/361535098 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c007740 con 0x7fb78406d960 2024-09-19T08:37:33.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.117+0000 7fb7837fe640 1 -- 172.21.15.117:0/361535098 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb77c0078e0 con 0x7fb78406d960 2024-09-19T08:37:33.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.117+0000 7fb7837fe640 1 -- 172.21.15.117:0/361535098 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c007cb0 con 0x7fb78406d960 2024-09-19T08:37:33.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.118+0000 7fb78b20a640 1 -- 172.21.15.117:0/361535098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb78406d960 msgr2=0x7fb7840d4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:33.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.118+0000 7fb78b20a640 1 --2- 172.21.15.117:0/361535098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb78406d960 0x7fb7840d4370 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb7840b6fa0 tx=0x7fb77c02a680 comp rx=0 tx=0).stop 2024-09-19T08:37:33.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.118+0000 7fb78b20a640 1 -- 172.21.15.117:0/361535098 shutdown_connections 2024-09-19T08:37:33.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.118+0000 7fb78b20a640 1 --2- 172.21.15.117:0/361535098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb78406d960 0x7fb7840d4370 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.118+0000 7fb78b20a640 1 --2- 172.21.15.117:0/361535098 >> v2:172.21.15.146:3300/0 conn(0x7fb78415e2a0 0x7fb78406d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.118+0000 7fb78b20a640 1 -- 172.21.15.117:0/361535098 >> 172.21.15.117:0/361535098 conn(0x7fb78409d760 msgr2=0x7fb78408bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:33.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.118+0000 7fb78b20a640 1 -- 172.21.15.117:0/361535098 shutdown_connections 2024-09-19T08:37:33.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.118+0000 7fb78b20a640 1 -- 172.21.15.117:0/361535098 wait complete. 2024-09-19T08:37:33.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.119+0000 7fb78b20a640 1 Processor -- start 2024-09-19T08:37:33.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.119+0000 7fb78b20a640 1 -- start start 2024-09-19T08:37:33.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.120+0000 7fb78b20a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb78406d960 0x7fb7840b8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:33.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.120+0000 7fb78b20a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb78415e2a0 0x7fb7840b99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:33.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.120+0000 7fb78b20a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78415e680 0x7fb7840ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:33.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.120+0000 7fb78b20a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb7840d0360 con 0x7fb78415e2a0 2024-09-19T08:37:33.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.120+0000 7fb78b20a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb7840d01e0 con 0x7fb78415e680 2024-09-19T08:37:33.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.120+0000 7fb78b20a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fb7840d48b0 con 0x7fb78406d960 2024-09-19T08:37:33.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.120+0000 7fb783fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb78415e2a0 0x7fb7840b99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:33.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.120+0000 7fb783fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb78415e2a0 0x7fb7840b99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33972/0 (socket says 172.21.15.117:33972) 2024-09-19T08:37:33.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.120+0000 7fb783fff640 1 -- 172.21.15.117:0/877579972 learned_addr learned my addr 172.21.15.117:0/877579972 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:33.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.120+0000 7fb788fa6640 1 --2- 172.21.15.117:0/877579972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb78406d960 0x7fb7840b8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:33.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.120+0000 7fb7897a7640 1 --2- 172.21.15.117:0/877579972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78415e680 0x7fb7840ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:33.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.120+0000 7fb783fff640 1 -- 172.21.15.117:0/877579972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb78406d960 msgr2=0x7fb7840b8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:33.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.120+0000 7fb783fff640 1 --2- 172.21.15.117:0/877579972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb78406d960 0x7fb7840b8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.120+0000 7fb783fff640 1 -- 172.21.15.117:0/877579972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78415e680 msgr2=0x7fb7840ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:33.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.120+0000 7fb783fff640 1 --2- 172.21.15.117:0/877579972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78415e680 0x7fb7840ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.120+0000 7fb783fff640 1 -- 172.21.15.117:0/877579972 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7840b8920 con 0x7fb78415e2a0 2024-09-19T08:37:33.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.120+0000 7fb788fa6640 1 --2- 172.21.15.117:0/877579972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb78406d960 0x7fb7840b8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:33.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.120+0000 7fb7897a7640 1 --2- 172.21.15.117:0/877579972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78415e680 0x7fb7840ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:33.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.121+0000 7fb783fff640 1 --2- 172.21.15.117:0/877579972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb78415e2a0 0x7fb7840b99c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb77800c410 tx=0x7fb77800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:33.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.121+0000 7fb7817fa640 1 -- 172.21.15.117:0/877579972 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7780074e0 con 0x7fb78415e2a0 2024-09-19T08:37:33.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.121+0000 7fb7817fa640 1 -- 172.21.15.117:0/877579972 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7780047e0 con 0x7fb78415e2a0 2024-09-19T08:37:33.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.121+0000 7fb7817fa640 1 -- 172.21.15.117:0/877579972 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb778004bd0 con 0x7fb78415e2a0 2024-09-19T08:37:33.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.121+0000 7fb78b20a640 1 -- 172.21.15.117:0/877579972 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7840b8c00 con 0x7fb78415e2a0 2024-09-19T08:37:33.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.121+0000 7fb78b20a640 1 -- 172.21.15.117:0/877579972 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7840b91c0 con 0x7fb78415e2a0 2024-09-19T08:37:33.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.122+0000 7fb78b20a640 1 -- 172.21.15.117:0/877579972 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7840d4c70 con 0x7fb78415e2a0 2024-09-19T08:37:33.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.122+0000 7fb7817fa640 1 -- 172.21.15.117:0/877579972 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb778011070 con 0x7fb78415e2a0 2024-09-19T08:37:33.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.122+0000 7fb7817fa640 1 --2- 172.21.15.117:0/877579972 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb77006c2b0 0x7fb77006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:33.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.123+0000 7fb7817fa640 1 -- 172.21.15.117:0/877579972 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb77808b410 con 0x7fb78415e2a0 2024-09-19T08:37:33.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.123+0000 7fb788fa6640 1 --2- 172.21.15.117:0/877579972 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb77006c2b0 0x7fb77006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:33.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.123+0000 7fb788fa6640 1 --2- 172.21.15.117:0/877579972 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb77006c2b0 0x7fb77006e770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb7840ce450 tx=0x7fb774008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:33.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.127+0000 7fb7817fa640 1 -- 172.21.15.117:0/877579972 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb778059840 con 0x7fb78415e2a0 2024-09-19T08:37:33.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.289+0000 7fb78b20a640 1 -- 172.21.15.117:0/877579972 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb7840c7c90 con 0x7fb77006c2b0 2024-09-19T08:37:33.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.298+0000 7fb7817fa640 1 -- 172.21.15.117:0/877579972 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332530 (secure 0 0 0) 0x7fb7840c7c90 con 0x7fb77006c2b0 2024-09-19T08:37:33.302 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:33.304 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-09-19T08:37:33.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.301+0000 7fb78b20a640 1 -- 172.21.15.117:0/877579972 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb77006c2b0 msgr2=0x7fb77006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:33.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.301+0000 7fb78b20a640 1 --2- 172.21.15.117:0/877579972 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb77006c2b0 0x7fb77006e770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb7840ce450 tx=0x7fb774008040 comp rx=0 tx=0).stop 2024-09-19T08:37:33.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.301+0000 7fb78b20a640 1 -- 172.21.15.117:0/877579972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb78415e2a0 msgr2=0x7fb7840b99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:33.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.301+0000 7fb78b20a640 1 --2- 172.21.15.117:0/877579972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb78415e2a0 0x7fb7840b99c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb77800c410 tx=0x7fb77800c8d0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.302+0000 7fb78b20a640 1 -- 172.21.15.117:0/877579972 shutdown_connections 2024-09-19T08:37:33.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.302+0000 7fb78b20a640 1 --2- 172.21.15.117:0/877579972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78415e680 0x7fb7840ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.302+0000 7fb78b20a640 1 --2- 172.21.15.117:0/877579972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb78415e2a0 0x7fb7840b99c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.302+0000 7fb78b20a640 1 --2- 172.21.15.117:0/877579972 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb77006c2b0 0x7fb77006e770 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.302+0000 7fb78b20a640 1 --2- 172.21.15.117:0/877579972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb78406d960 0x7fb7840b8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.302+0000 7fb78b20a640 1 -- 172.21.15.117:0/877579972 >> 172.21.15.117:0/877579972 conn(0x7fb78409d760 msgr2=0x7fb7840d3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:33.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.302+0000 7fb78b20a640 1 -- 172.21.15.117:0/877579972 shutdown_connections 2024-09-19T08:37:33.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.302+0000 7fb78b20a640 1 -- 172.21.15.117:0/877579972 wait complete. 2024-09-19T08:37:33.313 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-19T08:37:31.850180+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3416064,"data_stored":2034932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003161"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343917+0000","last_change":"2024-09-19T08:37:12.321838+0000","last_active":"2024-09-19T08:37:18.343917+0000","last_peered":"2024-09-19T08:37:18.343917+0000","last_clean":"2024-09-19T08:37:18.343917+0000","last_became_active":"2024-09-19T08:37:12.321488+0000","last_became_peered":"2024-09-19T08:37:12.321488+0000","last_unstale":"2024-09-19T08:37:18.343917+0000","last_undegraded":"2024-09-19T08:37:18.343917+0000","last_fullsized":"2024-09-19T08:37:18.343917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:04.303217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582954+0000","last_change":"2024-09-19T08:37:13.326422+0000","last_active":"2024-09-19T08:37:19.582954+0000","last_peered":"2024-09-19T08:37:19.582954+0000","last_clean":"2024-09-19T08:37:19.582954+0000","last_became_active":"2024-09-19T08:37:13.326165+0000","last_became_peered":"2024-09-19T08:37:13.326165+0000","last_unstale":"2024-09-19T08:37:19.582954+0000","last_undegraded":"2024-09-19T08:37:19.582954+0000","last_fullsized":"2024-09-19T08:37:19.582954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:37.846160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673419+0000","last_change":"2024-09-19T08:37:17.363683+0000","last_active":"2024-09-19T08:37:18.673419+0000","last_peered":"2024-09-19T08:37:18.673419+0000","last_clean":"2024-09-19T08:37:18.673419+0000","last_became_active":"2024-09-19T08:37:17.363290+0000","last_became_peered":"2024-09-19T08:37:17.363290+0000","last_unstale":"2024-09-19T08:37:18.673419+0000","last_undegraded":"2024-09-19T08:37:18.673419+0000","last_fullsized":"2024-09-19T08:37:18.673419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:42.065833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.583087+0000","last_change":"2024-09-19T08:37:12.322967+0000","last_active":"2024-09-19T08:37:19.583087+0000","last_peered":"2024-09-19T08:37:19.583087+0000","last_clean":"2024-09-19T08:37:19.583087+0000","last_became_active":"2024-09-19T08:37:12.322465+0000","last_became_peered":"2024-09-19T08:37:12.322465+0000","last_unstale":"2024-09-19T08:37:19.583087+0000","last_undegraded":"2024-09-19T08:37:19.583087+0000","last_fullsized":"2024-09-19T08:37:19.583087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:12.811398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582952+0000","last_change":"2024-09-19T08:37:13.331535+0000","last_active":"2024-09-19T08:37:19.582952+0000","last_peered":"2024-09-19T08:37:19.582952+0000","last_clean":"2024-09-19T08:37:19.582952+0000","last_became_active":"2024-09-19T08:37:13.331292+0000","last_became_peered":"2024-09-19T08:37:13.331292+0000","last_unstale":"2024-09-19T08:37:19.582952+0000","last_undegraded":"2024-09-19T08:37:19.582952+0000","last_fullsized":"2024-09-19T08:37:19.582952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:51.787710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773777+0000","last_change":"2024-09-19T08:37:17.349230+0000","last_active":"2024-09-19T08:37:19.773777+0000","last_peered":"2024-09-19T08:37:19.773777+0000","last_clean":"2024-09-19T08:37:19.773777+0000","last_became_active":"2024-09-19T08:37:17.348844+0000","last_became_peered":"2024-09-19T08:37:17.348844+0000","last_unstale":"2024-09-19T08:37:19.773777+0000","last_undegraded":"2024-09-19T08:37:19.773777+0000","last_fullsized":"2024-09-19T08:37:19.773777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:54.564614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774843+0000","last_change":"2024-09-19T08:37:12.318109+0000","last_active":"2024-09-19T08:37:19.774843+0000","last_peered":"2024-09-19T08:37:19.774843+0000","last_clean":"2024-09-19T08:37:19.774843+0000","last_became_active":"2024-09-19T08:37:12.316698+0000","last_became_peered":"2024-09-19T08:37:12.316698+0000","last_unstale":"2024-09-19T08:37:19.774843+0000","last_undegraded":"2024-09-19T08:37:19.774843+0000","last_fullsized":"2024-09-19T08:37:19.774843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:04.303217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774313+0000","last_change":"2024-09-19T08:37:13.323402+0000","last_active":"2024-09-19T08:37:19.774313+0000","last_peered":"2024-09-19T08:37:19.774313+0000","last_clean":"2024-09-19T08:37:19.774313+0000","last_became_active":"2024-09-19T08:37:13.322905+0000","last_became_peered":"2024-09-19T08:37:13.322905+0000","last_unstale":"2024-09-19T08:37:19.774313+0000","last_undegraded":"2024-09-19T08:37:19.774313+0000","last_fullsized":"2024-09-19T08:37:19.774313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:18.493336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775330+0000","last_change":"2024-09-19T08:37:17.357692+0000","last_active":"2024-09-19T08:37:19.775330+0000","last_peered":"2024-09-19T08:37:19.775330+0000","last_clean":"2024-09-19T08:37:19.775330+0000","last_became_active":"2024-09-19T08:37:17.357312+0000","last_became_peered":"2024-09-19T08:37:17.357312+0000","last_unstale":"2024-09-19T08:37:19.775330+0000","last_undegraded":"2024-09-19T08:37:19.775330+0000","last_fullsized":"2024-09-19T08:37:19.775330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:30.433955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775152+0000","last_change":"2024-09-19T08:37:12.316361+0000","last_active":"2024-09-19T08:37:19.775152+0000","last_peered":"2024-09-19T08:37:19.775152+0000","last_clean":"2024-09-19T08:37:19.775152+0000","last_became_active":"2024-09-19T08:37:12.315959+0000","last_became_peered":"2024-09-19T08:37:12.315959+0000","last_unstale":"2024-09-19T08:37:19.775152+0000","last_undegraded":"2024-09-19T08:37:19.775152+0000","last_fullsized":"2024-09-19T08:37:19.775152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:55.041313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342336+0000","last_change":"2024-09-19T08:37:13.321643+0000","last_active":"2024-09-19T08:37:18.342336+0000","last_peered":"2024-09-19T08:37:18.342336+0000","last_clean":"2024-09-19T08:37:18.342336+0000","last_became_active":"2024-09-19T08:37:13.321386+0000","last_became_peered":"2024-09-19T08:37:13.321386+0000","last_unstale":"2024-09-19T08:37:18.342336+0000","last_undegraded":"2024-09-19T08:37:18.342336+0000","last_fullsized":"2024-09-19T08:37:18.342336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:26:14.554195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774176+0000","last_change":"2024-09-19T08:37:17.353843+0000","last_active":"2024-09-19T08:37:19.774176+0000","last_peered":"2024-09-19T08:37:19.774176+0000","last_clean":"2024-09-19T08:37:19.774176+0000","last_became_active":"2024-09-19T08:37:17.352102+0000","last_became_peered":"2024-09-19T08:37:17.352102+0000","last_unstale":"2024-09-19T08:37:19.774176+0000","last_undegraded":"2024-09-19T08:37:19.774176+0000","last_fullsized":"2024-09-19T08:37:19.774176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:29.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341743+0000","last_change":"2024-09-19T08:37:13.320341+0000","last_active":"2024-09-19T08:37:18.341743+0000","last_peered":"2024-09-19T08:37:18.341743+0000","last_clean":"2024-09-19T08:37:18.341743+0000","last_became_active":"2024-09-19T08:37:13.319040+0000","last_became_peered":"2024-09-19T08:37:13.319040+0000","last_unstale":"2024-09-19T08:37:18.341743+0000","last_undegraded":"2024-09-19T08:37:18.341743+0000","last_fullsized":"2024-09-19T08:37:18.341743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:52.392022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342025+0000","last_change":"2024-09-19T08:37:12.323275+0000","last_active":"2024-09-19T08:37:18.342025+0000","last_peered":"2024-09-19T08:37:18.342025+0000","last_clean":"2024-09-19T08:37:18.342025+0000","last_became_active":"2024-09-19T08:37:12.322994+0000","last_became_peered":"2024-09-19T08:37:12.322994+0000","last_unstale":"2024-09-19T08:37:18.342025+0000","last_undegraded":"2024-09-19T08:37:18.342025+0000","last_fullsized":"2024-09-19T08:37:18.342025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:43.809060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342234+0000","last_change":"2024-09-19T08:37:17.356994+0000","last_active":"2024-09-19T08:37:18.342234+0000","last_peered":"2024-09-19T08:37:18.342234+0000","last_clean":"2024-09-19T08:37:18.342234+0000","last_became_active":"2024-09-19T08:37:17.356598+0000","last_became_peered":"2024-09-19T08:37:17.356598+0000","last_unstale":"2024-09-19T08:37:18.342234+0000","last_undegraded":"2024-09-19T08:37:18.342234+0000","last_fullsized":"2024-09-19T08:37:18.342234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:18.052908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673510+0000","last_change":"2024-09-19T08:37:13.326437+0000","last_active":"2024-09-19T08:37:18.673510+0000","last_peered":"2024-09-19T08:37:18.673510+0000","last_clean":"2024-09-19T08:37:18.673510+0000","last_became_active":"2024-09-19T08:37:13.326165+0000","last_became_peered":"2024-09-19T08:37:13.326165+0000","last_unstale":"2024-09-19T08:37:18.673510+0000","last_undegraded":"2024-09-19T08:37:18.673510+0000","last_fullsized":"2024-09-19T08:37:18.673510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:42.492725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550317+0000","last_change":"2024-09-19T08:37:12.321145+0000","last_active":"2024-09-19T08:37:19.550317+0000","last_peered":"2024-09-19T08:37:19.550317+0000","last_clean":"2024-09-19T08:37:19.550317+0000","last_became_active":"2024-09-19T08:37:12.320846+0000","last_became_peered":"2024-09-19T08:37:12.320846+0000","last_unstale":"2024-09-19T08:37:19.550317+0000","last_undegraded":"2024-09-19T08:37:19.550317+0000","last_fullsized":"2024-09-19T08:37:19.550317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:48.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774766+0000","last_change":"2024-09-19T08:37:17.355922+0000","last_active":"2024-09-19T08:37:19.774766+0000","last_peered":"2024-09-19T08:37:19.774766+0000","last_clean":"2024-09-19T08:37:19.774766+0000","last_became_active":"2024-09-19T08:37:17.355537+0000","last_became_peered":"2024-09-19T08:37:17.355537+0000","last_unstale":"2024-09-19T08:37:19.774766+0000","last_undegraded":"2024-09-19T08:37:19.774766+0000","last_fullsized":"2024-09-19T08:37:19.774766+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:25.565544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342913+0000","last_change":"2024-09-19T08:37:13.317754+0000","last_active":"2024-09-19T08:37:18.342913+0000","last_peered":"2024-09-19T08:37:18.342913+0000","last_clean":"2024-09-19T08:37:18.342913+0000","last_became_active":"2024-09-19T08:37:13.317483+0000","last_became_peered":"2024-09-19T08:37:13.317483+0000","last_unstale":"2024-09-19T08:37:18.342913+0000","last_undegraded":"2024-09-19T08:37:18.342913+0000","last_fullsized":"2024-09-19T08:37:18.342913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:34.222102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343157+0000","last_change":"2024-09-19T08:37:12.319094+0000","last_active":"2024-09-19T08:37:18.343157+0000","last_peered":"2024-09-19T08:37:18.343157+0000","last_clean":"2024-09-19T08:37:18.343157+0000","last_became_active":"2024-09-19T08:37:12.318782+0000","last_became_peered":"2024-09-19T08:37:12.318782+0000","last_unstale":"2024-09-19T08:37:18.343157+0000","last_undegraded":"2024-09-19T08:37:18.343157+0000","last_fullsized":"2024-09-19T08:37:18.343157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:08.631783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.674052+0000","last_change":"2024-09-19T08:37:17.362678+0000","last_active":"2024-09-19T08:37:18.674052+0000","last_peered":"2024-09-19T08:37:18.674052+0000","last_clean":"2024-09-19T08:37:18.674052+0000","last_became_active":"2024-09-19T08:37:17.362281+0000","last_became_peered":"2024-09-19T08:37:17.362281+0000","last_unstale":"2024-09-19T08:37:18.674052+0000","last_undegraded":"2024-09-19T08:37:18.674052+0000","last_fullsized":"2024-09-19T08:37:18.674052+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:37.134018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341605+0000","last_change":"2024-09-19T08:37:13.328741+0000","last_active":"2024-09-19T08:37:18.341605+0000","last_peered":"2024-09-19T08:37:18.341605+0000","last_clean":"2024-09-19T08:37:18.341605+0000","last_became_active":"2024-09-19T08:37:13.328156+0000","last_became_peered":"2024-09-19T08:37:13.328156+0000","last_unstale":"2024-09-19T08:37:18.341605+0000","last_undegraded":"2024-09-19T08:37:18.341605+0000","last_fullsized":"2024-09-19T08:37:18.341605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:21.534501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773822+0000","last_change":"2024-09-19T08:37:12.314762+0000","last_active":"2024-09-19T08:37:19.773822+0000","last_peered":"2024-09-19T08:37:19.773822+0000","last_clean":"2024-09-19T08:37:19.773822+0000","last_became_active":"2024-09-19T08:37:12.314471+0000","last_became_peered":"2024-09-19T08:37:12.314471+0000","last_unstale":"2024-09-19T08:37:19.773822+0000","last_undegraded":"2024-09-19T08:37:19.773822+0000","last_fullsized":"2024-09-19T08:37:19.773822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:08.631783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774584+0000","last_change":"2024-09-19T08:37:17.353677+0000","last_active":"2024-09-19T08:37:19.774584+0000","last_peered":"2024-09-19T08:37:19.774584+0000","last_clean":"2024-09-19T08:37:19.774584+0000","last_became_active":"2024-09-19T08:37:17.353311+0000","last_became_peered":"2024-09-19T08:37:17.353311+0000","last_unstale":"2024-09-19T08:37:19.774584+0000","last_undegraded":"2024-09-19T08:37:19.774584+0000","last_fullsized":"2024-09-19T08:37:19.774584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:55.818752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343663+0000","last_change":"2024-09-19T08:37:13.322046+0000","last_active":"2024-09-19T08:37:18.343663+0000","last_peered":"2024-09-19T08:37:18.343663+0000","last_clean":"2024-09-19T08:37:18.343663+0000","last_became_active":"2024-09-19T08:37:13.321632+0000","last_became_peered":"2024-09-19T08:37:13.321632+0000","last_unstale":"2024-09-19T08:37:18.343663+0000","last_undegraded":"2024-09-19T08:37:18.343663+0000","last_fullsized":"2024-09-19T08:37:18.343663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:31.517337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342528+0000","last_change":"2024-09-19T08:37:12.326667+0000","last_active":"2024-09-19T08:37:18.342528+0000","last_peered":"2024-09-19T08:37:18.342528+0000","last_clean":"2024-09-19T08:37:18.342528+0000","last_became_active":"2024-09-19T08:37:12.326400+0000","last_became_peered":"2024-09-19T08:37:12.326400+0000","last_unstale":"2024-09-19T08:37:18.342528+0000","last_undegraded":"2024-09-19T08:37:18.342528+0000","last_fullsized":"2024-09-19T08:37:18.342528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:17.484267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774094+0000","last_change":"2024-09-19T08:37:17.353015+0000","last_active":"2024-09-19T08:37:19.774094+0000","last_peered":"2024-09-19T08:37:19.774094+0000","last_clean":"2024-09-19T08:37:19.774094+0000","last_became_active":"2024-09-19T08:37:17.352080+0000","last_became_peered":"2024-09-19T08:37:17.352080+0000","last_unstale":"2024-09-19T08:37:19.774094+0000","last_undegraded":"2024-09-19T08:37:19.774094+0000","last_fullsized":"2024-09-19T08:37:19.774094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:25.374722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343778+0000","last_change":"2024-09-19T08:37:13.315155+0000","last_active":"2024-09-19T08:37:18.343778+0000","last_peered":"2024-09-19T08:37:18.343778+0000","last_clean":"2024-09-19T08:37:18.343778+0000","last_became_active":"2024-09-19T08:37:13.314853+0000","last_became_peered":"2024-09-19T08:37:13.314853+0000","last_unstale":"2024-09-19T08:37:18.343778+0000","last_undegraded":"2024-09-19T08:37:18.343778+0000","last_fullsized":"2024-09-19T08:37:18.343778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:57.125390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343814+0000","last_change":"2024-09-19T08:37:12.307577+0000","last_active":"2024-09-19T08:37:18.343814+0000","last_peered":"2024-09-19T08:37:18.343814+0000","last_clean":"2024-09-19T08:37:18.343814+0000","last_became_active":"2024-09-19T08:37:12.307011+0000","last_became_peered":"2024-09-19T08:37:12.307011+0000","last_unstale":"2024-09-19T08:37:18.343814+0000","last_undegraded":"2024-09-19T08:37:18.343814+0000","last_fullsized":"2024-09-19T08:37:18.343814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:12.811398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342993+0000","last_change":"2024-09-19T08:37:17.350495+0000","last_active":"2024-09-19T08:37:18.342993+0000","last_peered":"2024-09-19T08:37:18.342993+0000","last_clean":"2024-09-19T08:37:18.342993+0000","last_became_active":"2024-09-19T08:37:17.349314+0000","last_became_peered":"2024-09-19T08:37:17.349314+0000","last_unstale":"2024-09-19T08:37:18.342993+0000","last_undegraded":"2024-09-19T08:37:18.342993+0000","last_fullsized":"2024-09-19T08:37:18.342993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:30.433955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550444+0000","last_change":"2024-09-19T08:37:13.326384+0000","last_active":"2024-09-19T08:37:19.550444+0000","last_peered":"2024-09-19T08:37:19.550444+0000","last_clean":"2024-09-19T08:37:19.550444+0000","last_became_active":"2024-09-19T08:37:13.326109+0000","last_became_peered":"2024-09-19T08:37:13.326109+0000","last_unstale":"2024-09-19T08:37:19.550444+0000","last_undegraded":"2024-09-19T08:37:19.550444+0000","last_fullsized":"2024-09-19T08:37:19.550444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:39.528322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342580+0000","last_change":"2024-09-19T08:37:12.323115+0000","last_active":"2024-09-19T08:37:18.342580+0000","last_peered":"2024-09-19T08:37:18.342580+0000","last_clean":"2024-09-19T08:37:18.342580+0000","last_became_active":"2024-09-19T08:37:12.322685+0000","last_became_peered":"2024-09-19T08:37:12.322685+0000","last_unstale":"2024-09-19T08:37:18.342580+0000","last_undegraded":"2024-09-19T08:37:18.342580+0000","last_fullsized":"2024-09-19T08:37:18.342580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:44.440667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550017+0000","last_change":"2024-09-19T08:37:17.358072+0000","last_active":"2024-09-19T08:37:19.550017+0000","last_peered":"2024-09-19T08:37:19.550017+0000","last_clean":"2024-09-19T08:37:19.550017+0000","last_became_active":"2024-09-19T08:37:17.357595+0000","last_became_peered":"2024-09-19T08:37:17.357595+0000","last_unstale":"2024-09-19T08:37:19.550017+0000","last_undegraded":"2024-09-19T08:37:19.550017+0000","last_fullsized":"2024-09-19T08:37:19.550017+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:29.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775441+0000","last_change":"2024-09-19T08:37:13.319823+0000","last_active":"2024-09-19T08:37:19.775441+0000","last_peered":"2024-09-19T08:37:19.775441+0000","last_clean":"2024-09-19T08:37:19.775441+0000","last_became_active":"2024-09-19T08:37:13.319552+0000","last_became_peered":"2024-09-19T08:37:13.319552+0000","last_unstale":"2024-09-19T08:37:19.775441+0000","last_undegraded":"2024-09-19T08:37:19.775441+0000","last_fullsized":"2024-09-19T08:37:19.775441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:23.965109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582542+0000","last_change":"2024-09-19T08:37:12.320429+0000","last_active":"2024-09-19T08:37:19.582542+0000","last_peered":"2024-09-19T08:37:19.582542+0000","last_clean":"2024-09-19T08:37:19.582542+0000","last_became_active":"2024-09-19T08:37:12.320136+0000","last_became_peered":"2024-09-19T08:37:12.320136+0000","last_unstale":"2024-09-19T08:37:19.582542+0000","last_undegraded":"2024-09-19T08:37:19.582542+0000","last_fullsized":"2024-09-19T08:37:19.582542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:48.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.549893+0000","last_change":"2024-09-19T08:37:17.351017+0000","last_active":"2024-09-19T08:37:19.549893+0000","last_peered":"2024-09-19T08:37:19.549893+0000","last_clean":"2024-09-19T08:37:19.549893+0000","last_became_active":"2024-09-19T08:37:17.350612+0000","last_became_peered":"2024-09-19T08:37:17.350612+0000","last_unstale":"2024-09-19T08:37:19.549893+0000","last_undegraded":"2024-09-19T08:37:19.549893+0000","last_fullsized":"2024-09-19T08:37:19.549893+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:25.374722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774665+0000","last_change":"2024-09-19T08:37:13.322685+0000","last_active":"2024-09-19T08:37:19.774665+0000","last_peered":"2024-09-19T08:37:19.774665+0000","last_clean":"2024-09-19T08:37:19.774665+0000","last_became_active":"2024-09-19T08:37:13.322422+0000","last_became_peered":"2024-09-19T08:37:13.322422+0000","last_unstale":"2024-09-19T08:37:19.774665+0000","last_undegraded":"2024-09-19T08:37:19.774665+0000","last_fullsized":"2024-09-19T08:37:19.774665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:32.352238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341955+0000","last_change":"2024-09-19T08:37:12.321407+0000","last_active":"2024-09-19T08:37:18.341955+0000","last_peered":"2024-09-19T08:37:18.341955+0000","last_clean":"2024-09-19T08:37:18.341955+0000","last_became_active":"2024-09-19T08:37:12.321129+0000","last_became_peered":"2024-09-19T08:37:12.321129+0000","last_unstale":"2024-09-19T08:37:18.341955+0000","last_undegraded":"2024-09-19T08:37:18.341955+0000","last_fullsized":"2024-09-19T08:37:18.341955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:03.696329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550190+0000","last_change":"2024-09-19T08:37:17.358653+0000","last_active":"2024-09-19T08:37:19.550190+0000","last_peered":"2024-09-19T08:37:19.550190+0000","last_clean":"2024-09-19T08:37:19.550190+0000","last_became_active":"2024-09-19T08:37:17.357509+0000","last_became_peered":"2024-09-19T08:37:17.357509+0000","last_unstale":"2024-09-19T08:37:19.550190+0000","last_undegraded":"2024-09-19T08:37:19.550190+0000","last_fullsized":"2024-09-19T08:37:19.550190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:55.818752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582178+0000","last_change":"2024-09-19T08:37:13.327783+0000","last_active":"2024-09-19T08:37:19.582178+0000","last_peered":"2024-09-19T08:37:19.582178+0000","last_clean":"2024-09-19T08:37:19.582178+0000","last_became_active":"2024-09-19T08:37:13.327296+0000","last_became_peered":"2024-09-19T08:37:13.327296+0000","last_unstale":"2024-09-19T08:37:19.582178+0000","last_undegraded":"2024-09-19T08:37:19.582178+0000","last_fullsized":"2024-09-19T08:37:19.582178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:31.517337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673483+0000","last_change":"2024-09-19T08:37:12.318619+0000","last_active":"2024-09-19T08:37:18.673483+0000","last_peered":"2024-09-19T08:37:18.673483+0000","last_clean":"2024-09-19T08:37:18.673483+0000","last_became_active":"2024-09-19T08:37:12.318299+0000","last_became_peered":"2024-09-19T08:37:12.318299+0000","last_unstale":"2024-09-19T08:37:18.673483+0000","last_undegraded":"2024-09-19T08:37:18.673483+0000","last_fullsized":"2024-09-19T08:37:18.673483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:20.563149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550435+0000","last_change":"2024-09-19T08:37:17.353727+0000","last_active":"2024-09-19T08:37:19.550435+0000","last_peered":"2024-09-19T08:37:19.550435+0000","last_clean":"2024-09-19T08:37:19.550435+0000","last_became_active":"2024-09-19T08:37:17.353180+0000","last_became_peered":"2024-09-19T08:37:17.353180+0000","last_unstale":"2024-09-19T08:37:19.550435+0000","last_undegraded":"2024-09-19T08:37:19.550435+0000","last_fullsized":"2024-09-19T08:37:19.550435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:41.877203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.549807+0000","last_change":"2024-09-19T08:37:13.323403+0000","last_active":"2024-09-19T08:37:19.549807+0000","last_peered":"2024-09-19T08:37:19.549807+0000","last_clean":"2024-09-19T08:37:19.549807+0000","last_became_active":"2024-09-19T08:37:13.323125+0000","last_became_peered":"2024-09-19T08:37:13.323125+0000","last_unstale":"2024-09-19T08:37:19.549807+0000","last_undegraded":"2024-09-19T08:37:19.549807+0000","last_fullsized":"2024-09-19T08:37:19.549807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:04.705399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341725+0000","last_change":"2024-09-19T08:37:12.325472+0000","last_active":"2024-09-19T08:37:18.341725+0000","last_peered":"2024-09-19T08:37:18.341725+0000","last_clean":"2024-09-19T08:37:18.341725+0000","last_became_active":"2024-09-19T08:37:12.325213+0000","last_became_peered":"2024-09-19T08:37:12.325213+0000","last_unstale":"2024-09-19T08:37:18.341725+0000","last_undegraded":"2024-09-19T08:37:18.341725+0000","last_fullsized":"2024-09-19T08:37:18.341725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:55.041313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582821+0000","last_change":"2024-09-19T08:37:17.354723+0000","last_active":"2024-09-19T08:37:19.582821+0000","last_peered":"2024-09-19T08:37:19.582821+0000","last_clean":"2024-09-19T08:37:19.582821+0000","last_became_active":"2024-09-19T08:37:17.354349+0000","last_became_peered":"2024-09-19T08:37:17.354349+0000","last_unstale":"2024-09-19T08:37:19.582821+0000","last_undegraded":"2024-09-19T08:37:19.582821+0000","last_fullsized":"2024-09-19T08:37:19.582821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:26:18.585237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343346+0000","last_change":"2024-09-19T08:37:13.314451+0000","last_active":"2024-09-19T08:37:18.343346+0000","last_peered":"2024-09-19T08:37:18.343346+0000","last_clean":"2024-09-19T08:37:18.343346+0000","last_became_active":"2024-09-19T08:37:13.314082+0000","last_became_peered":"2024-09-19T08:37:13.314082+0000","last_unstale":"2024-09-19T08:37:18.343346+0000","last_undegraded":"2024-09-19T08:37:18.343346+0000","last_fullsized":"2024-09-19T08:37:18.343346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:39.528322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342148+0000","last_change":"2024-09-19T08:37:12.321328+0000","last_active":"2024-09-19T08:37:18.342148+0000","last_peered":"2024-09-19T08:37:18.342148+0000","last_clean":"2024-09-19T08:37:18.342148+0000","last_became_active":"2024-09-19T08:37:12.321069+0000","last_became_peered":"2024-09-19T08:37:12.321069+0000","last_unstale":"2024-09-19T08:37:18.342148+0000","last_undegraded":"2024-09-19T08:37:18.342148+0000","last_fullsized":"2024-09-19T08:37:18.342148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:22.956039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774403+0000","last_change":"2024-09-19T08:37:04.479071+0000","last_active":"2024-09-19T08:37:19.774403+0000","last_peered":"2024-09-19T08:37:19.774403+0000","last_clean":"2024-09-19T08:37:19.774403+0000","last_became_active":"2024-09-19T08:37:04.478199+0000","last_became_peered":"2024-09-19T08:37:04.478199+0000","last_unstale":"2024-09-19T08:37:19.774403+0000","last_undegraded":"2024-09-19T08:37:19.774403+0000","last_fullsized":"2024-09-19T08:37:19.774403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_clean_scrub_stamp":"2024-09-19T08:37:02.519738+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:32.963748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342489+0000","last_change":"2024-09-19T08:37:17.360235+0000","last_active":"2024-09-19T08:37:18.342489+0000","last_peered":"2024-09-19T08:37:18.342489+0000","last_clean":"2024-09-19T08:37:18.342489+0000","last_became_active":"2024-09-19T08:37:17.359875+0000","last_became_peered":"2024-09-19T08:37:17.359875+0000","last_unstale":"2024-09-19T08:37:18.342489+0000","last_undegraded":"2024-09-19T08:37:18.342489+0000","last_fullsized":"2024-09-19T08:37:18.342489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:02.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342407+0000","last_change":"2024-09-19T08:37:13.318739+0000","last_active":"2024-09-19T08:37:18.342407+0000","last_peered":"2024-09-19T08:37:18.342407+0000","last_clean":"2024-09-19T08:37:18.342407+0000","last_became_active":"2024-09-19T08:37:13.318487+0000","last_became_peered":"2024-09-19T08:37:13.318487+0000","last_unstale":"2024-09-19T08:37:18.342407+0000","last_undegraded":"2024-09-19T08:37:18.342407+0000","last_fullsized":"2024-09-19T08:37:18.342407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:50.571163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550463+0000","last_change":"2024-09-19T08:37:12.321017+0000","last_active":"2024-09-19T08:37:19.550463+0000","last_peered":"2024-09-19T08:37:19.550463+0000","last_clean":"2024-09-19T08:37:19.550463+0000","last_became_active":"2024-09-19T08:37:12.320498+0000","last_became_peered":"2024-09-19T08:37:12.320498+0000","last_unstale":"2024-09-19T08:37:19.550463+0000","last_undegraded":"2024-09-19T08:37:19.550463+0000","last_fullsized":"2024-09-19T08:37:19.550463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:37.272613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774252+0000","last_change":"2024-09-19T08:37:17.351391+0000","last_active":"2024-09-19T08:37:19.774252+0000","last_peered":"2024-09-19T08:37:19.774252+0000","last_clean":"2024-09-19T08:37:19.774252+0000","last_became_active":"2024-09-19T08:37:17.350957+0000","last_became_peered":"2024-09-19T08:37:17.350957+0000","last_unstale":"2024-09-19T08:37:19.774252+0000","last_undegraded":"2024-09-19T08:37:19.774252+0000","last_fullsized":"2024-09-19T08:37:19.774252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:36.383281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775081+0000","last_change":"2024-09-19T08:37:13.323759+0000","last_active":"2024-09-19T08:37:19.775081+0000","last_peered":"2024-09-19T08:37:19.775081+0000","last_clean":"2024-09-19T08:37:19.775081+0000","last_became_active":"2024-09-19T08:37:13.322021+0000","last_became_peered":"2024-09-19T08:37:13.322021+0000","last_unstale":"2024-09-19T08:37:19.775081+0000","last_undegraded":"2024-09-19T08:37:19.775081+0000","last_fullsized":"2024-09-19T08:37:19.775081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:26.402913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582801+0000","last_change":"2024-09-19T08:37:12.321535+0000","last_active":"2024-09-19T08:37:19.582801+0000","last_peered":"2024-09-19T08:37:19.582801+0000","last_clean":"2024-09-19T08:37:19.582801+0000","last_became_active":"2024-09-19T08:37:12.321158+0000","last_became_peered":"2024-09-19T08:37:12.321158+0000","last_unstale":"2024-09-19T08:37:19.582801+0000","last_undegraded":"2024-09-19T08:37:19.582801+0000","last_fullsized":"2024-09-19T08:37:19.582801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:08.631783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582645+0000","last_change":"2024-09-19T08:37:17.355898+0000","last_active":"2024-09-19T08:37:19.582645+0000","last_peered":"2024-09-19T08:37:19.582645+0000","last_clean":"2024-09-19T08:37:19.582645+0000","last_became_active":"2024-09-19T08:37:17.355518+0000","last_became_peered":"2024-09-19T08:37:17.355518+0000","last_unstale":"2024-09-19T08:37:19.582645+0000","last_undegraded":"2024-09-19T08:37:19.582645+0000","last_fullsized":"2024-09-19T08:37:19.582645+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:54.602206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775159+0000","last_change":"2024-09-19T08:37:13.317412+0000","last_active":"2024-09-19T08:37:19.775159+0000","last_peered":"2024-09-19T08:37:19.775159+0000","last_clean":"2024-09-19T08:37:19.775159+0000","last_became_active":"2024-09-19T08:37:13.317158+0000","last_became_peered":"2024-09-19T08:37:13.317158+0000","last_unstale":"2024-09-19T08:37:19.775159+0000","last_undegraded":"2024-09-19T08:37:19.775159+0000","last_fullsized":"2024-09-19T08:37:19.775159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:37.846160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343804+0000","last_change":"2024-09-19T08:37:12.318485+0000","last_active":"2024-09-19T08:37:18.343804+0000","last_peered":"2024-09-19T08:37:18.343804+0000","last_clean":"2024-09-19T08:37:18.343804+0000","last_became_active":"2024-09-19T08:37:12.318173+0000","last_became_peered":"2024-09-19T08:37:12.318173+0000","last_unstale":"2024-09-19T08:37:18.343804+0000","last_undegraded":"2024-09-19T08:37:18.343804+0000","last_fullsized":"2024-09-19T08:37:18.343804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:32.812065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341486+0000","last_change":"2024-09-19T08:37:17.351969+0000","last_active":"2024-09-19T08:37:18.341486+0000","last_peered":"2024-09-19T08:37:18.341486+0000","last_clean":"2024-09-19T08:37:18.341486+0000","last_became_active":"2024-09-19T08:37:17.351602+0000","last_became_peered":"2024-09-19T08:37:17.351602+0000","last_unstale":"2024-09-19T08:37:18.341486+0000","last_undegraded":"2024-09-19T08:37:18.341486+0000","last_fullsized":"2024-09-19T08:37:18.341486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:07.810509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774839+0000","last_change":"2024-09-19T08:37:13.316790+0000","last_active":"2024-09-19T08:37:19.774839+0000","last_peered":"2024-09-19T08:37:19.774839+0000","last_clean":"2024-09-19T08:37:19.774839+0000","last_became_active":"2024-09-19T08:37:13.315664+0000","last_became_peered":"2024-09-19T08:37:13.315664+0000","last_unstale":"2024-09-19T08:37:19.774839+0000","last_undegraded":"2024-09-19T08:37:19.774839+0000","last_fullsized":"2024-09-19T08:37:19.774839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:55.229727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775212+0000","last_change":"2024-09-19T08:37:12.322929+0000","last_active":"2024-09-19T08:37:19.775212+0000","last_peered":"2024-09-19T08:37:19.775212+0000","last_clean":"2024-09-19T08:37:19.775212+0000","last_became_active":"2024-09-19T08:37:12.322679+0000","last_became_peered":"2024-09-19T08:37:12.322679+0000","last_unstale":"2024-09-19T08:37:19.775212+0000","last_undegraded":"2024-09-19T08:37:19.775212+0000","last_fullsized":"2024-09-19T08:37:19.775212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:12.811398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775212+0000","last_change":"2024-09-19T08:37:17.356653+0000","last_active":"2024-09-19T08:37:19.775212+0000","last_peered":"2024-09-19T08:37:19.775212+0000","last_clean":"2024-09-19T08:37:19.775212+0000","last_became_active":"2024-09-19T08:37:17.356295+0000","last_became_peered":"2024-09-19T08:37:17.356295+0000","last_unstale":"2024-09-19T08:37:19.775212+0000","last_undegraded":"2024-09-19T08:37:19.775212+0000","last_fullsized":"2024-09-19T08:37:19.775212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:59.260769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341570+0000","last_change":"2024-09-19T08:37:13.328997+0000","last_active":"2024-09-19T08:37:18.341570+0000","last_peered":"2024-09-19T08:37:18.341570+0000","last_clean":"2024-09-19T08:37:18.341570+0000","last_became_active":"2024-09-19T08:37:13.328496+0000","last_became_peered":"2024-09-19T08:37:13.328496+0000","last_unstale":"2024-09-19T08:37:18.341570+0000","last_undegraded":"2024-09-19T08:37:18.341570+0000","last_fullsized":"2024-09-19T08:37:18.341570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:11.464991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343175+0000","last_change":"2024-09-19T08:37:12.316395+0000","last_active":"2024-09-19T08:37:18.343175+0000","last_peered":"2024-09-19T08:37:18.343175+0000","last_clean":"2024-09-19T08:37:18.343175+0000","last_became_active":"2024-09-19T08:37:12.315734+0000","last_became_peered":"2024-09-19T08:37:12.315734+0000","last_unstale":"2024-09-19T08:37:18.343175+0000","last_undegraded":"2024-09-19T08:37:18.343175+0000","last_fullsized":"2024-09-19T08:37:18.343175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:48.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582970+0000","last_change":"2024-09-19T08:37:17.351618+0000","last_active":"2024-09-19T08:37:19.582970+0000","last_peered":"2024-09-19T08:37:19.582970+0000","last_clean":"2024-09-19T08:37:19.582970+0000","last_became_active":"2024-09-19T08:37:17.351235+0000","last_became_peered":"2024-09-19T08:37:17.351235+0000","last_unstale":"2024-09-19T08:37:19.582970+0000","last_undegraded":"2024-09-19T08:37:19.582970+0000","last_fullsized":"2024-09-19T08:37:19.582970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:50.477160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774327+0000","last_change":"2024-09-19T08:37:13.328281+0000","last_active":"2024-09-19T08:37:19.774327+0000","last_peered":"2024-09-19T08:37:19.774327+0000","last_clean":"2024-09-19T08:37:19.774327+0000","last_became_active":"2024-09-19T08:37:13.327925+0000","last_became_peered":"2024-09-19T08:37:13.327925+0000","last_unstale":"2024-09-19T08:37:19.774327+0000","last_undegraded":"2024-09-19T08:37:19.774327+0000","last_fullsized":"2024-09-19T08:37:19.774327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:05.312287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775776+0000","last_change":"2024-09-19T08:37:12.321424+0000","last_active":"2024-09-19T08:37:19.775776+0000","last_peered":"2024-09-19T08:37:19.775776+0000","last_clean":"2024-09-19T08:37:19.775776+0000","last_became_active":"2024-09-19T08:37:12.321176+0000","last_became_peered":"2024-09-19T08:37:12.321176+0000","last_unstale":"2024-09-19T08:37:19.775776+0000","last_undegraded":"2024-09-19T08:37:19.775776+0000","last_fullsized":"2024-09-19T08:37:19.775776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:32.812065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.583004+0000","last_change":"2024-09-19T08:37:17.349545+0000","last_active":"2024-09-19T08:37:19.583004+0000","last_peered":"2024-09-19T08:37:19.583004+0000","last_clean":"2024-09-19T08:37:19.583004+0000","last_became_active":"2024-09-19T08:37:17.349192+0000","last_became_peered":"2024-09-19T08:37:17.349192+0000","last_unstale":"2024-09-19T08:37:19.583004+0000","last_undegraded":"2024-09-19T08:37:19.583004+0000","last_fullsized":"2024-09-19T08:37:19.583004+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:38.360015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341839+0000","last_change":"2024-09-19T08:37:13.322205+0000","last_active":"2024-09-19T08:37:18.341839+0000","last_peered":"2024-09-19T08:37:18.341839+0000","last_clean":"2024-09-19T08:37:18.341839+0000","last_became_active":"2024-09-19T08:37:13.321483+0000","last_became_peered":"2024-09-19T08:37:13.321483+0000","last_unstale":"2024-09-19T08:37:18.341839+0000","last_undegraded":"2024-09-19T08:37:18.341839+0000","last_fullsized":"2024-09-19T08:37:18.341839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:49.043269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341935+0000","last_change":"2024-09-19T08:37:12.325272+0000","last_active":"2024-09-19T08:37:18.341935+0000","last_peered":"2024-09-19T08:37:18.341935+0000","last_clean":"2024-09-19T08:37:18.341935+0000","last_became_active":"2024-09-19T08:37:12.325028+0000","last_became_peered":"2024-09-19T08:37:12.325028+0000","last_unstale":"2024-09-19T08:37:18.341935+0000","last_undegraded":"2024-09-19T08:37:18.341935+0000","last_fullsized":"2024-09-19T08:37:18.341935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:33.465602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550181+0000","last_change":"2024-09-19T08:37:17.355589+0000","last_active":"2024-09-19T08:37:19.550181+0000","last_peered":"2024-09-19T08:37:19.550181+0000","last_clean":"2024-09-19T08:37:19.550181+0000","last_became_active":"2024-09-19T08:37:17.353243+0000","last_became_peered":"2024-09-19T08:37:17.353243+0000","last_unstale":"2024-09-19T08:37:19.550181+0000","last_undegraded":"2024-09-19T08:37:19.550181+0000","last_fullsized":"2024-09-19T08:37:19.550181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:36.383281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550216+0000","last_change":"2024-09-19T08:37:13.325522+0000","last_active":"2024-09-19T08:37:19.550216+0000","last_peered":"2024-09-19T08:37:19.550216+0000","last_clean":"2024-09-19T08:37:19.550216+0000","last_became_active":"2024-09-19T08:37:13.324792+0000","last_became_peered":"2024-09-19T08:37:13.324792+0000","last_unstale":"2024-09-19T08:37:19.550216+0000","last_undegraded":"2024-09-19T08:37:19.550216+0000","last_fullsized":"2024-09-19T08:37:19.550216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:55.229727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673680+0000","last_change":"2024-09-19T08:37:12.322147+0000","last_active":"2024-09-19T08:37:18.673680+0000","last_peered":"2024-09-19T08:37:18.673680+0000","last_clean":"2024-09-19T08:37:18.673680+0000","last_became_active":"2024-09-19T08:37:12.321849+0000","last_became_peered":"2024-09-19T08:37:12.321849+0000","last_unstale":"2024-09-19T08:37:18.673680+0000","last_undegraded":"2024-09-19T08:37:18.673680+0000","last_fullsized":"2024-09-19T08:37:18.673680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:13.052644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342312+0000","last_change":"2024-09-19T08:37:17.359818+0000","last_active":"2024-09-19T08:37:18.342312+0000","last_peered":"2024-09-19T08:37:18.342312+0000","last_clean":"2024-09-19T08:37:18.342312+0000","last_became_active":"2024-09-19T08:37:17.359442+0000","last_became_peered":"2024-09-19T08:37:17.359442+0000","last_unstale":"2024-09-19T08:37:18.342312+0000","last_undegraded":"2024-09-19T08:37:18.342312+0000","last_fullsized":"2024-09-19T08:37:18.342312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:23.916499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774686+0000","last_change":"2024-09-19T08:37:13.320385+0000","last_active":"2024-09-19T08:37:19.774686+0000","last_peered":"2024-09-19T08:37:19.774686+0000","last_clean":"2024-09-19T08:37:19.774686+0000","last_became_active":"2024-09-19T08:37:13.320121+0000","last_became_peered":"2024-09-19T08:37:13.320121+0000","last_unstale":"2024-09-19T08:37:19.774686+0000","last_undegraded":"2024-09-19T08:37:19.774686+0000","last_fullsized":"2024-09-19T08:37:19.774686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:25.894361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:22.767373+0000","last_change":"2024-09-19T08:37:12.317329+0000","last_active":"2024-09-19T08:37:22.767373+0000","last_peered":"2024-09-19T08:37:22.767373+0000","last_clean":"2024-09-19T08:37:22.767373+0000","last_became_active":"2024-09-19T08:37:12.317062+0000","last_became_peered":"2024-09-19T08:37:12.317062+0000","last_unstale":"2024-09-19T08:37:22.767373+0000","last_undegraded":"2024-09-19T08:37:22.767373+0000","last_fullsized":"2024-09-19T08:37:22.767373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:05.334179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343234+0000","last_change":"2024-09-19T08:37:17.351632+0000","last_active":"2024-09-19T08:37:18.343234+0000","last_peered":"2024-09-19T08:37:18.343234+0000","last_clean":"2024-09-19T08:37:18.343234+0000","last_became_active":"2024-09-19T08:37:17.351246+0000","last_became_peered":"2024-09-19T08:37:17.351246+0000","last_unstale":"2024-09-19T08:37:18.343234+0000","last_undegraded":"2024-09-19T08:37:18.343234+0000","last_fullsized":"2024-09-19T08:37:18.343234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:15.496034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341958+0000","last_change":"2024-09-19T08:37:13.328541+0000","last_active":"2024-09-19T08:37:18.341958+0000","last_peered":"2024-09-19T08:37:18.341958+0000","last_clean":"2024-09-19T08:37:18.341958+0000","last_became_active":"2024-09-19T08:37:13.328285+0000","last_became_peered":"2024-09-19T08:37:13.328285+0000","last_unstale":"2024-09-19T08:37:18.341958+0000","last_undegraded":"2024-09-19T08:37:18.341958+0000","last_fullsized":"2024-09-19T08:37:18.341958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:13.920583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673858+0000","last_change":"2024-09-19T08:37:12.318230+0000","last_active":"2024-09-19T08:37:18.673858+0000","last_peered":"2024-09-19T08:37:18.673858+0000","last_clean":"2024-09-19T08:37:18.673858+0000","last_became_active":"2024-09-19T08:37:12.317739+0000","last_became_peered":"2024-09-19T08:37:12.317739+0000","last_unstale":"2024-09-19T08:37:18.673858+0000","last_undegraded":"2024-09-19T08:37:18.673858+0000","last_fullsized":"2024-09-19T08:37:18.673858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:50.275215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775001+0000","last_change":"2024-09-19T08:37:17.353397+0000","last_active":"2024-09-19T08:37:19.775001+0000","last_peered":"2024-09-19T08:37:19.775001+0000","last_clean":"2024-09-19T08:37:19.775001+0000","last_became_active":"2024-09-19T08:37:17.352532+0000","last_became_peered":"2024-09-19T08:37:17.352532+0000","last_unstale":"2024-09-19T08:37:19.775001+0000","last_undegraded":"2024-09-19T08:37:19.775001+0000","last_fullsized":"2024-09-19T08:37:19.775001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:41.877203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.583030+0000","last_change":"2024-09-19T08:37:13.330183+0000","last_active":"2024-09-19T08:37:19.583030+0000","last_peered":"2024-09-19T08:37:19.583030+0000","last_clean":"2024-09-19T08:37:19.583030+0000","last_became_active":"2024-09-19T08:37:13.329810+0000","last_became_peered":"2024-09-19T08:37:13.329810+0000","last_unstale":"2024-09-19T08:37:19.583030+0000","last_undegraded":"2024-09-19T08:37:19.583030+0000","last_fullsized":"2024-09-19T08:37:19.583030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:32.352238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775009+0000","last_change":"2024-09-19T08:37:12.318995+0000","last_active":"2024-09-19T08:37:19.775009+0000","last_peered":"2024-09-19T08:37:19.775009+0000","last_clean":"2024-09-19T08:37:19.775009+0000","last_became_active":"2024-09-19T08:37:12.318707+0000","last_became_peered":"2024-09-19T08:37:12.318707+0000","last_unstale":"2024-09-19T08:37:19.775009+0000","last_undegraded":"2024-09-19T08:37:19.775009+0000","last_fullsized":"2024-09-19T08:37:19.775009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:43.809060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673308+0000","last_change":"2024-09-19T08:37:17.363394+0000","last_active":"2024-09-19T08:37:18.673308+0000","last_peered":"2024-09-19T08:37:18.673308+0000","last_clean":"2024-09-19T08:37:18.673308+0000","last_became_active":"2024-09-19T08:37:17.362912+0000","last_became_peered":"2024-09-19T08:37:17.362912+0000","last_unstale":"2024-09-19T08:37:18.673308+0000","last_undegraded":"2024-09-19T08:37:18.673308+0000","last_fullsized":"2024-09-19T08:37:18.673308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:04.239525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774754+0000","last_change":"2024-09-19T08:37:13.324283+0000","last_active":"2024-09-19T08:37:19.774754+0000","last_peered":"2024-09-19T08:37:19.774754+0000","last_clean":"2024-09-19T08:37:19.774754+0000","last_became_active":"2024-09-19T08:37:13.323386+0000","last_became_peered":"2024-09-19T08:37:13.323386+0000","last_unstale":"2024-09-19T08:37:19.774754+0000","last_undegraded":"2024-09-19T08:37:19.774754+0000","last_fullsized":"2024-09-19T08:37:19.774754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:04.705399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774939+0000","last_change":"2024-09-19T08:37:12.320151+0000","last_active":"2024-09-19T08:37:19.774939+0000","last_peered":"2024-09-19T08:37:19.774939+0000","last_clean":"2024-09-19T08:37:19.774939+0000","last_became_active":"2024-09-19T08:37:12.319848+0000","last_became_peered":"2024-09-19T08:37:12.319848+0000","last_unstale":"2024-09-19T08:37:19.774939+0000","last_undegraded":"2024-09-19T08:37:19.774939+0000","last_fullsized":"2024-09-19T08:37:19.774939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:57.623546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343446+0000","last_change":"2024-09-19T08:37:17.354272+0000","last_active":"2024-09-19T08:37:18.343446+0000","last_peered":"2024-09-19T08:37:18.343446+0000","last_clean":"2024-09-19T08:37:18.343446+0000","last_became_active":"2024-09-19T08:37:17.353914+0000","last_became_peered":"2024-09-19T08:37:17.353914+0000","last_unstale":"2024-09-19T08:37:18.343446+0000","last_undegraded":"2024-09-19T08:37:18.343446+0000","last_fullsized":"2024-09-19T08:37:18.343446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:53.074312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343607+0000","last_change":"2024-09-19T08:37:17.353588+0000","last_active":"2024-09-19T08:37:18.343607+0000","last_peered":"2024-09-19T08:37:18.343607+0000","last_clean":"2024-09-19T08:37:18.343607+0000","last_became_active":"2024-09-19T08:37:17.353202+0000","last_became_peered":"2024-09-19T08:37:17.353202+0000","last_unstale":"2024-09-19T08:37:18.343607+0000","last_undegraded":"2024-09-19T08:37:18.343607+0000","last_fullsized":"2024-09-19T08:37:18.343607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:56.423064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343044+0000","last_change":"2024-09-19T08:37:13.310656+0000","last_active":"2024-09-19T08:37:18.343044+0000","last_peered":"2024-09-19T08:37:18.343044+0000","last_clean":"2024-09-19T08:37:18.343044+0000","last_became_active":"2024-09-19T08:37:13.310365+0000","last_became_peered":"2024-09-19T08:37:13.310365+0000","last_unstale":"2024-09-19T08:37:18.343044+0000","last_undegraded":"2024-09-19T08:37:18.343044+0000","last_fullsized":"2024-09-19T08:37:18.343044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:48:56.646247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341695+0000","last_change":"2024-09-19T08:37:12.316198+0000","last_active":"2024-09-19T08:37:18.341695+0000","last_peered":"2024-09-19T08:37:18.341695+0000","last_clean":"2024-09-19T08:37:18.341695+0000","last_became_active":"2024-09-19T08:37:12.315954+0000","last_became_peered":"2024-09-19T08:37:12.315954+0000","last_unstale":"2024-09-19T08:37:18.341695+0000","last_undegraded":"2024-09-19T08:37:18.341695+0000","last_fullsized":"2024-09-19T08:37:18.341695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:04.303217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342109+0000","last_change":"2024-09-19T08:37:17.354035+0000","last_active":"2024-09-19T08:37:18.342109+0000","last_peered":"2024-09-19T08:37:18.342109+0000","last_clean":"2024-09-19T08:37:18.342109+0000","last_became_active":"2024-09-19T08:37:17.353669+0000","last_became_peered":"2024-09-19T08:37:17.353669+0000","last_unstale":"2024-09-19T08:37:18.342109+0000","last_undegraded":"2024-09-19T08:37:18.342109+0000","last_fullsized":"2024-09-19T08:37:18.342109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:12.322596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582389+0000","last_change":"2024-09-19T08:37:13.327070+0000","last_active":"2024-09-19T08:37:19.582389+0000","last_peered":"2024-09-19T08:37:19.582389+0000","last_clean":"2024-09-19T08:37:19.582389+0000","last_became_active":"2024-09-19T08:37:13.326721+0000","last_became_peered":"2024-09-19T08:37:13.326721+0000","last_unstale":"2024-09-19T08:37:19.582389+0000","last_undegraded":"2024-09-19T08:37:19.582389+0000","last_fullsized":"2024-09-19T08:37:19.582389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:57.125390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.549850+0000","last_change":"2024-09-19T08:37:12.320362+0000","last_active":"2024-09-19T08:37:19.549850+0000","last_peered":"2024-09-19T08:37:19.549850+0000","last_clean":"2024-09-19T08:37:19.549850+0000","last_became_active":"2024-09-19T08:37:12.320047+0000","last_became_peered":"2024-09-19T08:37:12.320047+0000","last_unstale":"2024-09-19T08:37:19.549850+0000","last_undegraded":"2024-09-19T08:37:19.549850+0000","last_fullsized":"2024-09-19T08:37:19.549850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:57.623546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341855+0000","last_change":"2024-09-19T08:37:12.326611+0000","last_active":"2024-09-19T08:37:18.341855+0000","last_peered":"2024-09-19T08:37:18.341855+0000","last_clean":"2024-09-19T08:37:18.341855+0000","last_became_active":"2024-09-19T08:37:12.326341+0000","last_became_peered":"2024-09-19T08:37:12.326341+0000","last_unstale":"2024-09-19T08:37:18.341855+0000","last_undegraded":"2024-09-19T08:37:18.341855+0000","last_fullsized":"2024-09-19T08:37:18.341855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:54.220657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343192+0000","last_change":"2024-09-19T08:37:13.315454+0000","last_active":"2024-09-19T08:37:18.343192+0000","last_peered":"2024-09-19T08:37:18.343192+0000","last_clean":"2024-09-19T08:37:18.343192+0000","last_became_active":"2024-09-19T08:37:13.315193+0000","last_became_peered":"2024-09-19T08:37:13.315193+0000","last_unstale":"2024-09-19T08:37:18.343192+0000","last_undegraded":"2024-09-19T08:37:18.343192+0000","last_fullsized":"2024-09-19T08:37:18.343192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:02.012602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343557+0000","last_change":"2024-09-19T08:37:17.348944+0000","last_active":"2024-09-19T08:37:18.343557+0000","last_peered":"2024-09-19T08:37:18.343557+0000","last_clean":"2024-09-19T08:37:18.343557+0000","last_became_active":"2024-09-19T08:37:17.348484+0000","last_became_peered":"2024-09-19T08:37:17.348484+0000","last_unstale":"2024-09-19T08:37:18.343557+0000","last_undegraded":"2024-09-19T08:37:18.343557+0000","last_fullsized":"2024-09-19T08:37:18.343557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:28.217244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582715+0000","last_change":"2024-09-19T08:37:12.323262+0000","last_active":"2024-09-19T08:37:19.582715+0000","last_peered":"2024-09-19T08:37:19.582715+0000","last_clean":"2024-09-19T08:37:19.582715+0000","last_became_active":"2024-09-19T08:37:12.322964+0000","last_became_peered":"2024-09-19T08:37:12.322964+0000","last_unstale":"2024-09-19T08:37:19.582715+0000","last_undegraded":"2024-09-19T08:37:19.582715+0000","last_fullsized":"2024-09-19T08:37:19.582715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:32.812065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773888+0000","last_change":"2024-09-19T08:37:13.327280+0000","last_active":"2024-09-19T08:37:19.773888+0000","last_peered":"2024-09-19T08:37:19.773888+0000","last_clean":"2024-09-19T08:37:19.773888+0000","last_became_active":"2024-09-19T08:37:13.326915+0000","last_became_peered":"2024-09-19T08:37:13.326915+0000","last_unstale":"2024-09-19T08:37:19.773888+0000","last_undegraded":"2024-09-19T08:37:19.773888+0000","last_fullsized":"2024-09-19T08:37:19.773888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:56.050383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673780+0000","last_change":"2024-09-19T08:37:17.363011+0000","last_active":"2024-09-19T08:37:18.673780+0000","last_peered":"2024-09-19T08:37:18.673780+0000","last_clean":"2024-09-19T08:37:18.673780+0000","last_became_active":"2024-09-19T08:37:17.362538+0000","last_became_peered":"2024-09-19T08:37:17.362538+0000","last_unstale":"2024-09-19T08:37:18.673780+0000","last_undegraded":"2024-09-19T08:37:18.673780+0000","last_fullsized":"2024-09-19T08:37:18.673780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:29.539457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773951+0000","last_change":"2024-09-19T08:37:13.315209+0000","last_active":"2024-09-19T08:37:19.773951+0000","last_peered":"2024-09-19T08:37:19.773951+0000","last_clean":"2024-09-19T08:37:19.773951+0000","last_became_active":"2024-09-19T08:37:13.314934+0000","last_became_peered":"2024-09-19T08:37:13.314934+0000","last_unstale":"2024-09-19T08:37:19.773951+0000","last_undegraded":"2024-09-19T08:37:19.773951+0000","last_fullsized":"2024-09-19T08:37:19.773951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:44.818129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673338+0000","last_change":"2024-09-19T08:37:13.329355+0000","last_active":"2024-09-19T08:37:18.673338+0000","last_peered":"2024-09-19T08:37:18.673338+0000","last_clean":"2024-09-19T08:37:18.673338+0000","last_became_active":"2024-09-19T08:37:13.327464+0000","last_became_peered":"2024-09-19T08:37:13.327464+0000","last_unstale":"2024-09-19T08:37:18.673338+0000","last_undegraded":"2024-09-19T08:37:18.673338+0000","last_fullsized":"2024-09-19T08:37:18.673338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:44.058583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341765+0000","last_change":"2024-09-19T08:37:13.326479+0000","last_active":"2024-09-19T08:37:18.341765+0000","last_peered":"2024-09-19T08:37:18.341765+0000","last_clean":"2024-09-19T08:37:18.341765+0000","last_became_active":"2024-09-19T08:37:13.326229+0000","last_became_peered":"2024-09-19T08:37:13.326229+0000","last_unstale":"2024-09-19T08:37:18.341765+0000","last_undegraded":"2024-09-19T08:37:18.341765+0000","last_fullsized":"2024-09-19T08:37:18.341765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:24.186202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582555+0000","last_change":"2024-09-19T08:37:13.327921+0000","last_active":"2024-09-19T08:37:19.582555+0000","last_peered":"2024-09-19T08:37:19.582555+0000","last_clean":"2024-09-19T08:37:19.582555+0000","last_became_active":"2024-09-19T08:37:13.327515+0000","last_became_peered":"2024-09-19T08:37:13.327515+0000","last_unstale":"2024-09-19T08:37:19.582555+0000","last_undegraded":"2024-09-19T08:37:19.582555+0000","last_fullsized":"2024-09-19T08:37:19.582555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:21.343680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550330+0000","last_change":"2024-09-19T08:37:13.328457+0000","last_active":"2024-09-19T08:37:19.550330+0000","last_peered":"2024-09-19T08:37:19.550330+0000","last_clean":"2024-09-19T08:37:19.550330+0000","last_became_active":"2024-09-19T08:37:13.328201+0000","last_became_peered":"2024-09-19T08:37:13.328201+0000","last_unstale":"2024-09-19T08:37:19.550330+0000","last_undegraded":"2024-09-19T08:37:19.550330+0000","last_fullsized":"2024-09-19T08:37:19.550330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:02.904237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550219+0000","last_change":"2024-09-19T08:37:13.323713+0000","last_active":"2024-09-19T08:37:19.550219+0000","last_peered":"2024-09-19T08:37:19.550219+0000","last_clean":"2024-09-19T08:37:19.550219+0000","last_became_active":"2024-09-19T08:37:13.323292+0000","last_became_peered":"2024-09-19T08:37:13.323292+0000","last_unstale":"2024-09-19T08:37:19.550219+0000","last_undegraded":"2024-09-19T08:37:19.550219+0000","last_fullsized":"2024-09-19T08:37:19.550219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:48:56.646247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774671+0000","last_change":"2024-09-19T08:37:13.324782+0000","last_active":"2024-09-19T08:37:19.774671+0000","last_peered":"2024-09-19T08:37:19.774671+0000","last_clean":"2024-09-19T08:37:19.774671+0000","last_became_active":"2024-09-19T08:37:13.324279+0000","last_became_peered":"2024-09-19T08:37:13.324279+0000","last_unstale":"2024-09-19T08:37:19.774671+0000","last_undegraded":"2024-09-19T08:37:19.774671+0000","last_fullsized":"2024-09-19T08:37:19.774671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:34.474672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582804+0000","last_change":"2024-09-19T08:37:13.331655+0000","last_active":"2024-09-19T08:37:19.582804+0000","last_peered":"2024-09-19T08:37:19.582804+0000","last_clean":"2024-09-19T08:37:19.582804+0000","last_became_active":"2024-09-19T08:37:13.331359+0000","last_became_peered":"2024-09-19T08:37:13.331359+0000","last_unstale":"2024-09-19T08:37:19.582804+0000","last_undegraded":"2024-09-19T08:37:19.582804+0000","last_fullsized":"2024-09-19T08:37:19.582804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:50.533572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341602+0000","last_change":"2024-09-19T08:37:13.328905+0000","last_active":"2024-09-19T08:37:18.341602+0000","last_peered":"2024-09-19T08:37:18.341602+0000","last_clean":"2024-09-19T08:37:18.341602+0000","last_became_active":"2024-09-19T08:37:13.328643+0000","last_became_peered":"2024-09-19T08:37:13.328643+0000","last_unstale":"2024-09-19T08:37:18.341602+0000","last_undegraded":"2024-09-19T08:37:18.341602+0000","last_fullsized":"2024-09-19T08:37:18.341602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:26.402913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582337+0000","last_change":"2024-09-19T08:37:13.325377+0000","last_active":"2024-09-19T08:37:19.582337+0000","last_peered":"2024-09-19T08:37:19.582337+0000","last_clean":"2024-09-19T08:37:19.582337+0000","last_became_active":"2024-09-19T08:37:13.325101+0000","last_became_peered":"2024-09-19T08:37:13.325101+0000","last_unstale":"2024-09-19T08:37:19.582337+0000","last_undegraded":"2024-09-19T08:37:19.582337+0000","last_fullsized":"2024-09-19T08:37:19.582337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:02.012602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773794+0000","last_change":"2024-09-19T08:37:13.313455+0000","last_active":"2024-09-19T08:37:19.773794+0000","last_peered":"2024-09-19T08:37:19.773794+0000","last_clean":"2024-09-19T08:37:19.773794+0000","last_became_active":"2024-09-19T08:37:13.313182+0000","last_became_peered":"2024-09-19T08:37:13.313182+0000","last_unstale":"2024-09-19T08:37:19.773794+0000","last_undegraded":"2024-09-19T08:37:19.773794+0000","last_fullsized":"2024-09-19T08:37:19.773794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:44.818129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343055+0000","last_change":"2024-09-19T08:37:13.314765+0000","last_active":"2024-09-19T08:37:18.343055+0000","last_peered":"2024-09-19T08:37:18.343055+0000","last_clean":"2024-09-19T08:37:18.343055+0000","last_became_active":"2024-09-19T08:37:13.314484+0000","last_became_peered":"2024-09-19T08:37:13.314484+0000","last_unstale":"2024-09-19T08:37:18.343055+0000","last_undegraded":"2024-09-19T08:37:18.343055+0000","last_fullsized":"2024-09-19T08:37:18.343055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:28.398584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775044+0000","last_change":"2024-09-19T08:37:13.321255+0000","last_active":"2024-09-19T08:37:19.775044+0000","last_peered":"2024-09-19T08:37:19.775044+0000","last_clean":"2024-09-19T08:37:19.775044+0000","last_became_active":"2024-09-19T08:37:13.320944+0000","last_became_peered":"2024-09-19T08:37:13.320944+0000","last_unstale":"2024-09-19T08:37:19.775044+0000","last_undegraded":"2024-09-19T08:37:19.775044+0000","last_fullsized":"2024-09-19T08:37:19.775044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:11.464991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342493+0000","last_change":"2024-09-19T08:37:13.321006+0000","last_active":"2024-09-19T08:37:18.342493+0000","last_peered":"2024-09-19T08:37:18.342493+0000","last_clean":"2024-09-19T08:37:18.342493+0000","last_became_active":"2024-09-19T08:37:13.320729+0000","last_became_peered":"2024-09-19T08:37:13.320729+0000","last_unstale":"2024-09-19T08:37:18.342493+0000","last_undegraded":"2024-09-19T08:37:18.342493+0000","last_fullsized":"2024-09-19T08:37:18.342493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:46.446118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673984+0000","last_change":"2024-09-19T08:37:13.326249+0000","last_active":"2024-09-19T08:37:18.673984+0000","last_peered":"2024-09-19T08:37:18.673984+0000","last_clean":"2024-09-19T08:37:18.673984+0000","last_became_active":"2024-09-19T08:37:13.325965+0000","last_became_peered":"2024-09-19T08:37:13.325965+0000","last_unstale":"2024-09-19T08:37:18.673984+0000","last_undegraded":"2024-09-19T08:37:18.673984+0000","last_fullsized":"2024-09-19T08:37:18.673984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:11.539214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342514+0000","last_change":"2024-09-19T08:37:13.325289+0000","last_active":"2024-09-19T08:37:18.342514+0000","last_peered":"2024-09-19T08:37:18.342514+0000","last_clean":"2024-09-19T08:37:18.342514+0000","last_became_active":"2024-09-19T08:37:13.322947+0000","last_became_peered":"2024-09-19T08:37:13.322947+0000","last_unstale":"2024-09-19T08:37:18.342514+0000","last_undegraded":"2024-09-19T08:37:18.342514+0000","last_fullsized":"2024-09-19T08:37:18.342514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:34.328972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341594+0000","last_change":"2024-09-19T08:37:13.323040+0000","last_active":"2024-09-19T08:37:18.341594+0000","last_peered":"2024-09-19T08:37:18.341594+0000","last_clean":"2024-09-19T08:37:18.341594+0000","last_became_active":"2024-09-19T08:37:13.322427+0000","last_became_peered":"2024-09-19T08:37:13.322427+0000","last_unstale":"2024-09-19T08:37:18.341594+0000","last_undegraded":"2024-09-19T08:37:18.341594+0000","last_fullsized":"2024-09-19T08:37:18.341594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:37.846160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582190+0000","last_change":"2024-09-19T08:37:13.330628+0000","last_active":"2024-09-19T08:37:19.582190+0000","last_peered":"2024-09-19T08:37:19.582190+0000","last_clean":"2024-09-19T08:37:19.582190+0000","last_became_active":"2024-09-19T08:37:13.330355+0000","last_became_peered":"2024-09-19T08:37:13.330355+0000","last_unstale":"2024-09-19T08:37:19.582190+0000","last_undegraded":"2024-09-19T08:37:19.582190+0000","last_fullsized":"2024-09-19T08:37:19.582190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:28.398584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550079+0000","last_change":"2024-09-19T08:37:13.322548+0000","last_active":"2024-09-19T08:37:19.550079+0000","last_peered":"2024-09-19T08:37:19.550079+0000","last_clean":"2024-09-19T08:37:19.550079+0000","last_became_active":"2024-09-19T08:37:13.322265+0000","last_became_peered":"2024-09-19T08:37:13.322265+0000","last_unstale":"2024-09-19T08:37:19.550079+0000","last_undegraded":"2024-09-19T08:37:19.550079+0000","last_fullsized":"2024-09-19T08:37:19.550079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:34.474672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550129+0000","last_change":"2024-09-19T08:37:13.329206+0000","last_active":"2024-09-19T08:37:19.550129+0000","last_peered":"2024-09-19T08:37:19.550129+0000","last_clean":"2024-09-19T08:37:19.550129+0000","last_became_active":"2024-09-19T08:37:13.328945+0000","last_became_peered":"2024-09-19T08:37:13.328945+0000","last_unstale":"2024-09-19T08:37:19.550129+0000","last_undegraded":"2024-09-19T08:37:19.550129+0000","last_fullsized":"2024-09-19T08:37:19.550129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:45.449737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774990+0000","last_change":"2024-09-19T08:37:13.321724+0000","last_active":"2024-09-19T08:37:19.774990+0000","last_peered":"2024-09-19T08:37:19.774990+0000","last_clean":"2024-09-19T08:37:19.774990+0000","last_became_active":"2024-09-19T08:37:13.321487+0000","last_became_peered":"2024-09-19T08:37:13.321487+0000","last_unstale":"2024-09-19T08:37:19.774990+0000","last_undegraded":"2024-09-19T08:37:19.774990+0000","last_fullsized":"2024-09-19T08:37:19.774990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:57.125390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774604+0000","last_change":"2024-09-19T08:37:13.326611+0000","last_active":"2024-09-19T08:37:19.774604+0000","last_peered":"2024-09-19T08:37:19.774604+0000","last_clean":"2024-09-19T08:37:19.774604+0000","last_became_active":"2024-09-19T08:37:13.326227+0000","last_became_peered":"2024-09-19T08:37:13.326227+0000","last_unstale":"2024-09-19T08:37:19.774604+0000","last_undegraded":"2024-09-19T08:37:19.774604+0000","last_fullsized":"2024-09-19T08:37:19.774604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:50.533572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774816+0000","last_change":"2024-09-19T08:37:13.322510+0000","last_active":"2024-09-19T08:37:19.774816+0000","last_peered":"2024-09-19T08:37:19.774816+0000","last_clean":"2024-09-19T08:37:19.774816+0000","last_became_active":"2024-09-19T08:37:13.322203+0000","last_became_peered":"2024-09-19T08:37:13.322203+0000","last_unstale":"2024-09-19T08:37:19.774816+0000","last_undegraded":"2024-09-19T08:37:19.774816+0000","last_fullsized":"2024-09-19T08:37:19.774816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:21.343680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774839+0000","last_change":"2024-09-19T08:37:13.318910+0000","last_active":"2024-09-19T08:37:19.774839+0000","last_peered":"2024-09-19T08:37:19.774839+0000","last_clean":"2024-09-19T08:37:19.774839+0000","last_became_active":"2024-09-19T08:37:13.318573+0000","last_became_peered":"2024-09-19T08:37:13.318573+0000","last_unstale":"2024-09-19T08:37:19.774839+0000","last_undegraded":"2024-09-19T08:37:19.774839+0000","last_fullsized":"2024-09-19T08:37:19.774839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:23.965109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582167+0000","last_change":"2024-09-19T08:37:13.331372+0000","last_active":"2024-09-19T08:37:19.582167+0000","last_peered":"2024-09-19T08:37:19.582167+0000","last_clean":"2024-09-19T08:37:19.582167+0000","last_became_active":"2024-09-19T08:37:13.330730+0000","last_became_peered":"2024-09-19T08:37:13.330730+0000","last_unstale":"2024-09-19T08:37:19.582167+0000","last_undegraded":"2024-09-19T08:37:19.582167+0000","last_fullsized":"2024-09-19T08:37:19.582167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:34.222102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775688+0000","last_change":"2024-09-19T08:37:13.324940+0000","last_active":"2024-09-19T08:37:19.775688+0000","last_peered":"2024-09-19T08:37:19.775688+0000","last_clean":"2024-09-19T08:37:19.775688+0000","last_became_active":"2024-09-19T08:37:13.324666+0000","last_became_peered":"2024-09-19T08:37:13.324666+0000","last_unstale":"2024-09-19T08:37:19.775688+0000","last_undegraded":"2024-09-19T08:37:19.775688+0000","last_fullsized":"2024-09-19T08:37:19.775688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:31.517337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774270+0000","last_change":"2024-09-19T08:37:13.319325+0000","last_active":"2024-09-19T08:37:19.774270+0000","last_peered":"2024-09-19T08:37:19.774270+0000","last_clean":"2024-09-19T08:37:19.774270+0000","last_became_active":"2024-09-19T08:37:13.318999+0000","last_became_peered":"2024-09-19T08:37:13.318999+0000","last_unstale":"2024-09-19T08:37:19.774270+0000","last_undegraded":"2024-09-19T08:37:19.774270+0000","last_fullsized":"2024-09-19T08:37:19.774270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:56.050383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774520+0000","last_change":"2024-09-19T08:37:13.328264+0000","last_active":"2024-09-19T08:37:19.774520+0000","last_peered":"2024-09-19T08:37:19.774520+0000","last_clean":"2024-09-19T08:37:19.774520+0000","last_became_active":"2024-09-19T08:37:13.327999+0000","last_became_peered":"2024-09-19T08:37:13.327999+0000","last_unstale":"2024-09-19T08:37:19.774520+0000","last_undegraded":"2024-09-19T08:37:19.774520+0000","last_fullsized":"2024-09-19T08:37:19.774520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:34.222102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773805+0000","last_change":"2024-09-19T08:37:13.315873+0000","last_active":"2024-09-19T08:37:19.773805+0000","last_peered":"2024-09-19T08:37:19.773805+0000","last_clean":"2024-09-19T08:37:19.773805+0000","last_became_active":"2024-09-19T08:37:13.315587+0000","last_became_peered":"2024-09-19T08:37:13.315587+0000","last_unstale":"2024-09-19T08:37:19.773805+0000","last_undegraded":"2024-09-19T08:37:19.773805+0000","last_fullsized":"2024-09-19T08:37:19.773805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:18.493336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582687+0000","last_change":"2024-09-19T08:37:13.329601+0000","last_active":"2024-09-19T08:37:19.582687+0000","last_peered":"2024-09-19T08:37:19.582687+0000","last_clean":"2024-09-19T08:37:19.582687+0000","last_became_active":"2024-09-19T08:37:13.328264+0000","last_became_peered":"2024-09-19T08:37:13.328264+0000","last_unstale":"2024-09-19T08:37:19.582687+0000","last_undegraded":"2024-09-19T08:37:19.582687+0000","last_fullsized":"2024-09-19T08:37:19.582687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:26.402913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582754+0000","last_change":"2024-09-19T08:37:13.327064+0000","last_active":"2024-09-19T08:37:19.582754+0000","last_peered":"2024-09-19T08:37:19.582754+0000","last_clean":"2024-09-19T08:37:19.582754+0000","last_became_active":"2024-09-19T08:37:13.326770+0000","last_became_peered":"2024-09-19T08:37:13.326770+0000","last_unstale":"2024-09-19T08:37:19.582754+0000","last_undegraded":"2024-09-19T08:37:19.582754+0000","last_fullsized":"2024-09-19T08:37:19.582754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:25.894361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775126+0000","last_change":"2024-09-19T08:37:13.330656+0000","last_active":"2024-09-19T08:37:19.775126+0000","last_peered":"2024-09-19T08:37:19.775126+0000","last_clean":"2024-09-19T08:37:19.775126+0000","last_became_active":"2024-09-19T08:37:13.330120+0000","last_became_peered":"2024-09-19T08:37:13.330120+0000","last_unstale":"2024-09-19T08:37:19.775126+0000","last_undegraded":"2024-09-19T08:37:19.775126+0000","last_fullsized":"2024-09-19T08:37:19.775126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:51.787710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":105614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":696074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":696052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":105738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:37:33.320 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:37:33.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.452+0000 7f149167b640 1 Processor -- start 2024-09-19T08:37:33.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.452+0000 7f149167b640 1 -- start start 2024-09-19T08:37:33.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.453+0000 7f149167b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f148c0b00d0 0x7f148c0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:33.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.453+0000 7f149167b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c0b12d0 0x7f148c0ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:33.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.453+0000 7f149167b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f148c0afcb0 con 0x7f148c15b3a0 2024-09-19T08:37:33.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.453+0000 7f149167b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f148c0b6e50 con 0x7f148c0b00d0 2024-09-19T08:37:33.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.453+0000 7f149167b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f148c0b7130 con 0x7f148c0b12d0 2024-09-19T08:37:33.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.453+0000 7f148a7fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f148c0b00d0 0x7f148c0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:33.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.453+0000 7f148a7fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f148c0b00d0 0x7f148c0b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33978/0 (socket says 172.21.15.117:33978) 2024-09-19T08:37:33.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.453+0000 7f148a7fc640 1 -- 172.21.15.117:0/1577885572 learned_addr learned my addr 172.21.15.117:0/1577885572 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:33.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.453+0000 7f148b7fe640 1 --2- 172.21.15.117:0/1577885572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c0b12d0 0x7f148c0ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:33.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.453+0000 7f148a7fc640 1 -- 172.21.15.117:0/1577885572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c0b12d0 msgr2=0x7f148c0ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:33.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.453+0000 7f148a7fc640 1 --2- 172.21.15.117:0/1577885572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c0b12d0 0x7f148c0ae7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.453+0000 7f148a7fc640 1 -- 172.21.15.117:0/1577885572 >> v1:172.21.15.146:6789/0 conn(0x7f148c15b3a0 legacy=0x7f148c0b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:33.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.453+0000 7f148a7fc640 1 -- 172.21.15.117:0/1577885572 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148c0b4dd0 con 0x7f148c0b00d0 2024-09-19T08:37:33.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.454+0000 7f148a7fc640 1 --2- 172.21.15.117:0/1577885572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f148c0b00d0 0x7f148c0b0d90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1480009870 tx=0x7f148002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51a1bb595bc9982 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:33.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.454+0000 7f1489ffb640 1 -- 172.21.15.117:0/1577885572 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1480037070 con 0x7f148c0b00d0 2024-09-19T08:37:33.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.454+0000 7f1489ffb640 1 -- 172.21.15.117:0/1577885572 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1480032440 con 0x7f148c0b00d0 2024-09-19T08:37:33.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.454+0000 7f1489ffb640 1 -- 172.21.15.117:0/1577885572 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1480032810 con 0x7f148c0b00d0 2024-09-19T08:37:33.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.454+0000 7f149167b640 1 -- 172.21.15.117:0/1577885572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f148c0b00d0 msgr2=0x7f148c0b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:33.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.454+0000 7f149167b640 1 --2- 172.21.15.117:0/1577885572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f148c0b00d0 0x7f148c0b0d90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1480009870 tx=0x7f148002a180 comp rx=0 tx=0).stop 2024-09-19T08:37:33.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.454+0000 7f149167b640 1 -- 172.21.15.117:0/1577885572 shutdown_connections 2024-09-19T08:37:33.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.454+0000 7f149167b640 1 --2- 172.21.15.117:0/1577885572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c0b12d0 0x7f148c0ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.454+0000 7f149167b640 1 --2- 172.21.15.117:0/1577885572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f148c0b00d0 0x7f148c0b0d90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.454+0000 7f149167b640 1 -- 172.21.15.117:0/1577885572 >> 172.21.15.117:0/1577885572 conn(0x7f148c09a9f0 msgr2=0x7f148c0b6740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.455+0000 7f149167b640 1 -- 172.21.15.117:0/1577885572 shutdown_connections 2024-09-19T08:37:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.455+0000 7f149167b640 1 -- 172.21.15.117:0/1577885572 wait complete. 2024-09-19T08:37:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.456+0000 7f149167b640 1 Processor -- start 2024-09-19T08:37:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.456+0000 7f149167b640 1 -- start start 2024-09-19T08:37:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.456+0000 7f149167b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f148c0b00d0 0x7f148c14f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.456+0000 7f149167b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c0b12d0 0x7f148c141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.457+0000 7f149167b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f148c15b3a0 0x7f148c150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.457+0000 7f149167b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f148c0b18c0 con 0x7f148c15b3a0 2024-09-19T08:37:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.457+0000 7f149167b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f148c0b1740 con 0x7f148c0b00d0 2024-09-19T08:37:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.457+0000 7f149167b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f148c0b1a40 con 0x7f148c0b12d0 2024-09-19T08:37:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.457+0000 7f148b7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f148c15b3a0 0x7f148c150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.457+0000 7f148b7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f148c15b3a0 0x7f148c150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33984/0 (socket says 172.21.15.117:33984) 2024-09-19T08:37:33.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.457+0000 7f148b7fe640 1 -- 172.21.15.117:0/3616092890 learned_addr learned my addr 172.21.15.117:0/3616092890 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:33.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.457+0000 7f148a7fc640 1 --2- 172.21.15.117:0/3616092890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c0b12d0 0x7f148c141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:33.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.457+0000 7f148affd640 1 --2- 172.21.15.117:0/3616092890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f148c0b00d0 0x7f148c14f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:33.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.457+0000 7f148b7fe640 1 -- 172.21.15.117:0/3616092890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c0b12d0 msgr2=0x7f148c141be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:33.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.457+0000 7f148b7fe640 1 --2- 172.21.15.117:0/3616092890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c0b12d0 0x7f148c141be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.457+0000 7f148b7fe640 1 -- 172.21.15.117:0/3616092890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f148c0b00d0 msgr2=0x7f148c14f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:33.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.457+0000 7f148b7fe640 1 --2- 172.21.15.117:0/3616092890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f148c0b00d0 0x7f148c14f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.457+0000 7f148b7fe640 1 -- 172.21.15.117:0/3616092890 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148c151c30 con 0x7f148c15b3a0 2024-09-19T08:37:33.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.457+0000 7f148b7fe640 1 --2- 172.21.15.117:0/3616092890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f148c15b3a0 0x7f148c150dd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f147c00c820 tx=0x7f147c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:33.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.457+0000 7f14737fe640 1 -- 172.21.15.117:0/3616092890 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c015070 con 0x7f148c15b3a0 2024-09-19T08:37:33.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.457+0000 7f14737fe640 1 -- 172.21.15.117:0/3616092890 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f147c004020 con 0x7f148c15b3a0 2024-09-19T08:37:33.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.457+0000 7f14737fe640 1 -- 172.21.15.117:0/3616092890 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c004410 con 0x7f148c15b3a0 2024-09-19T08:37:33.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.457+0000 7f149167b640 1 -- 172.21.15.117:0/3616092890 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f148c14f820 con 0x7f148c15b3a0 2024-09-19T08:37:33.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.457+0000 7f149167b640 1 -- 172.21.15.117:0/3616092890 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f148c153260 con 0x7f148c15b3a0 2024-09-19T08:37:33.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.458+0000 7f149167b640 1 -- 172.21.15.117:0/3616092890 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f148c0af9f0 con 0x7f148c15b3a0 2024-09-19T08:37:33.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.459+0000 7f14737fe640 1 -- 172.21.15.117:0/3616092890 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f147c007830 con 0x7f148c15b3a0 2024-09-19T08:37:33.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.459+0000 7f14737fe640 1 --2- 172.21.15.117:0/3616092890 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f147806c2b0 0x7f147806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:33.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.459+0000 7f14737fe640 1 -- 172.21.15.117:0/3616092890 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f147c08b530 con 0x7f148c15b3a0 2024-09-19T08:37:33.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.459+0000 7f148affd640 1 --2- 172.21.15.117:0/3616092890 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f147806c2b0 0x7f147806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:33.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.460+0000 7f148affd640 1 --2- 172.21.15.117:0/3616092890 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f147806c2b0 0x7f147806e770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f148400b450 tx=0x7f148400d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:33.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.463+0000 7f14737fe640 1 -- 172.21.15.117:0/3616092890 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f147c059310 con 0x7f148c15b3a0 2024-09-19T08:37:33.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.626+0000 7f149167b640 1 -- 172.21.15.117:0/3616092890 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f148c06ebf0 con 0x7f147806c2b0 2024-09-19T08:37:33.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.634+0000 7f14737fe640 1 -- 172.21.15.117:0/3616092890 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332530 (secure 0 0 0) 0x7f148c06ebf0 con 0x7f147806c2b0 2024-09-19T08:37:33.637 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:33.639 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-09-19T08:37:33.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.637+0000 7f149167b640 1 -- 172.21.15.117:0/3616092890 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f147806c2b0 msgr2=0x7f147806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:33.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.637+0000 7f149167b640 1 --2- 172.21.15.117:0/3616092890 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f147806c2b0 0x7f147806e770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f148400b450 tx=0x7f148400d040 comp rx=0 tx=0).stop 2024-09-19T08:37:33.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.637+0000 7f149167b640 1 -- 172.21.15.117:0/3616092890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f148c15b3a0 msgr2=0x7f148c150dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:33.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.637+0000 7f149167b640 1 --2- 172.21.15.117:0/3616092890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f148c15b3a0 0x7f148c150dd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f147c00c820 tx=0x7f147c00cce0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.637+0000 7f149167b640 1 -- 172.21.15.117:0/3616092890 shutdown_connections 2024-09-19T08:37:33.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.637+0000 7f149167b640 1 --2- 172.21.15.117:0/3616092890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f148c15b3a0 0x7f148c150dd0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.637+0000 7f149167b640 1 --2- 172.21.15.117:0/3616092890 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f147806c2b0 0x7f147806e770 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.637+0000 7f149167b640 1 --2- 172.21.15.117:0/3616092890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148c0b12d0 0x7f148c141be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.637+0000 7f149167b640 1 --2- 172.21.15.117:0/3616092890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f148c0b00d0 0x7f148c14f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.637+0000 7f149167b640 1 -- 172.21.15.117:0/3616092890 >> 172.21.15.117:0/3616092890 conn(0x7f148c09a9f0 msgr2=0x7f148c0b4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:33.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.637+0000 7f149167b640 1 -- 172.21.15.117:0/3616092890 shutdown_connections 2024-09-19T08:37:33.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.637+0000 7f149167b640 1 -- 172.21.15.117:0/3616092890 wait complete. 2024-09-19T08:37:33.648 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-19T08:37:31.850180+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3416064,"data_stored":2034932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003161"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343917+0000","last_change":"2024-09-19T08:37:12.321838+0000","last_active":"2024-09-19T08:37:18.343917+0000","last_peered":"2024-09-19T08:37:18.343917+0000","last_clean":"2024-09-19T08:37:18.343917+0000","last_became_active":"2024-09-19T08:37:12.321488+0000","last_became_peered":"2024-09-19T08:37:12.321488+0000","last_unstale":"2024-09-19T08:37:18.343917+0000","last_undegraded":"2024-09-19T08:37:18.343917+0000","last_fullsized":"2024-09-19T08:37:18.343917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:04.303217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582954+0000","last_change":"2024-09-19T08:37:13.326422+0000","last_active":"2024-09-19T08:37:19.582954+0000","last_peered":"2024-09-19T08:37:19.582954+0000","last_clean":"2024-09-19T08:37:19.582954+0000","last_became_active":"2024-09-19T08:37:13.326165+0000","last_became_peered":"2024-09-19T08:37:13.326165+0000","last_unstale":"2024-09-19T08:37:19.582954+0000","last_undegraded":"2024-09-19T08:37:19.582954+0000","last_fullsized":"2024-09-19T08:37:19.582954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:37.846160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673419+0000","last_change":"2024-09-19T08:37:17.363683+0000","last_active":"2024-09-19T08:37:18.673419+0000","last_peered":"2024-09-19T08:37:18.673419+0000","last_clean":"2024-09-19T08:37:18.673419+0000","last_became_active":"2024-09-19T08:37:17.363290+0000","last_became_peered":"2024-09-19T08:37:17.363290+0000","last_unstale":"2024-09-19T08:37:18.673419+0000","last_undegraded":"2024-09-19T08:37:18.673419+0000","last_fullsized":"2024-09-19T08:37:18.673419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:42.065833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.583087+0000","last_change":"2024-09-19T08:37:12.322967+0000","last_active":"2024-09-19T08:37:19.583087+0000","last_peered":"2024-09-19T08:37:19.583087+0000","last_clean":"2024-09-19T08:37:19.583087+0000","last_became_active":"2024-09-19T08:37:12.322465+0000","last_became_peered":"2024-09-19T08:37:12.322465+0000","last_unstale":"2024-09-19T08:37:19.583087+0000","last_undegraded":"2024-09-19T08:37:19.583087+0000","last_fullsized":"2024-09-19T08:37:19.583087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:12.811398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582952+0000","last_change":"2024-09-19T08:37:13.331535+0000","last_active":"2024-09-19T08:37:19.582952+0000","last_peered":"2024-09-19T08:37:19.582952+0000","last_clean":"2024-09-19T08:37:19.582952+0000","last_became_active":"2024-09-19T08:37:13.331292+0000","last_became_peered":"2024-09-19T08:37:13.331292+0000","last_unstale":"2024-09-19T08:37:19.582952+0000","last_undegraded":"2024-09-19T08:37:19.582952+0000","last_fullsized":"2024-09-19T08:37:19.582952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:51.787710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773777+0000","last_change":"2024-09-19T08:37:17.349230+0000","last_active":"2024-09-19T08:37:19.773777+0000","last_peered":"2024-09-19T08:37:19.773777+0000","last_clean":"2024-09-19T08:37:19.773777+0000","last_became_active":"2024-09-19T08:37:17.348844+0000","last_became_peered":"2024-09-19T08:37:17.348844+0000","last_unstale":"2024-09-19T08:37:19.773777+0000","last_undegraded":"2024-09-19T08:37:19.773777+0000","last_fullsized":"2024-09-19T08:37:19.773777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:54.564614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774843+0000","last_change":"2024-09-19T08:37:12.318109+0000","last_active":"2024-09-19T08:37:19.774843+0000","last_peered":"2024-09-19T08:37:19.774843+0000","last_clean":"2024-09-19T08:37:19.774843+0000","last_became_active":"2024-09-19T08:37:12.316698+0000","last_became_peered":"2024-09-19T08:37:12.316698+0000","last_unstale":"2024-09-19T08:37:19.774843+0000","last_undegraded":"2024-09-19T08:37:19.774843+0000","last_fullsized":"2024-09-19T08:37:19.774843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:04.303217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774313+0000","last_change":"2024-09-19T08:37:13.323402+0000","last_active":"2024-09-19T08:37:19.774313+0000","last_peered":"2024-09-19T08:37:19.774313+0000","last_clean":"2024-09-19T08:37:19.774313+0000","last_became_active":"2024-09-19T08:37:13.322905+0000","last_became_peered":"2024-09-19T08:37:13.322905+0000","last_unstale":"2024-09-19T08:37:19.774313+0000","last_undegraded":"2024-09-19T08:37:19.774313+0000","last_fullsized":"2024-09-19T08:37:19.774313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:18.493336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775330+0000","last_change":"2024-09-19T08:37:17.357692+0000","last_active":"2024-09-19T08:37:19.775330+0000","last_peered":"2024-09-19T08:37:19.775330+0000","last_clean":"2024-09-19T08:37:19.775330+0000","last_became_active":"2024-09-19T08:37:17.357312+0000","last_became_peered":"2024-09-19T08:37:17.357312+0000","last_unstale":"2024-09-19T08:37:19.775330+0000","last_undegraded":"2024-09-19T08:37:19.775330+0000","last_fullsized":"2024-09-19T08:37:19.775330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:30.433955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775152+0000","last_change":"2024-09-19T08:37:12.316361+0000","last_active":"2024-09-19T08:37:19.775152+0000","last_peered":"2024-09-19T08:37:19.775152+0000","last_clean":"2024-09-19T08:37:19.775152+0000","last_became_active":"2024-09-19T08:37:12.315959+0000","last_became_peered":"2024-09-19T08:37:12.315959+0000","last_unstale":"2024-09-19T08:37:19.775152+0000","last_undegraded":"2024-09-19T08:37:19.775152+0000","last_fullsized":"2024-09-19T08:37:19.775152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:55.041313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342336+0000","last_change":"2024-09-19T08:37:13.321643+0000","last_active":"2024-09-19T08:37:18.342336+0000","last_peered":"2024-09-19T08:37:18.342336+0000","last_clean":"2024-09-19T08:37:18.342336+0000","last_became_active":"2024-09-19T08:37:13.321386+0000","last_became_peered":"2024-09-19T08:37:13.321386+0000","last_unstale":"2024-09-19T08:37:18.342336+0000","last_undegraded":"2024-09-19T08:37:18.342336+0000","last_fullsized":"2024-09-19T08:37:18.342336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:26:14.554195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774176+0000","last_change":"2024-09-19T08:37:17.353843+0000","last_active":"2024-09-19T08:37:19.774176+0000","last_peered":"2024-09-19T08:37:19.774176+0000","last_clean":"2024-09-19T08:37:19.774176+0000","last_became_active":"2024-09-19T08:37:17.352102+0000","last_became_peered":"2024-09-19T08:37:17.352102+0000","last_unstale":"2024-09-19T08:37:19.774176+0000","last_undegraded":"2024-09-19T08:37:19.774176+0000","last_fullsized":"2024-09-19T08:37:19.774176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:29.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341743+0000","last_change":"2024-09-19T08:37:13.320341+0000","last_active":"2024-09-19T08:37:18.341743+0000","last_peered":"2024-09-19T08:37:18.341743+0000","last_clean":"2024-09-19T08:37:18.341743+0000","last_became_active":"2024-09-19T08:37:13.319040+0000","last_became_peered":"2024-09-19T08:37:13.319040+0000","last_unstale":"2024-09-19T08:37:18.341743+0000","last_undegraded":"2024-09-19T08:37:18.341743+0000","last_fullsized":"2024-09-19T08:37:18.341743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:52.392022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342025+0000","last_change":"2024-09-19T08:37:12.323275+0000","last_active":"2024-09-19T08:37:18.342025+0000","last_peered":"2024-09-19T08:37:18.342025+0000","last_clean":"2024-09-19T08:37:18.342025+0000","last_became_active":"2024-09-19T08:37:12.322994+0000","last_became_peered":"2024-09-19T08:37:12.322994+0000","last_unstale":"2024-09-19T08:37:18.342025+0000","last_undegraded":"2024-09-19T08:37:18.342025+0000","last_fullsized":"2024-09-19T08:37:18.342025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:43.809060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342234+0000","last_change":"2024-09-19T08:37:17.356994+0000","last_active":"2024-09-19T08:37:18.342234+0000","last_peered":"2024-09-19T08:37:18.342234+0000","last_clean":"2024-09-19T08:37:18.342234+0000","last_became_active":"2024-09-19T08:37:17.356598+0000","last_became_peered":"2024-09-19T08:37:17.356598+0000","last_unstale":"2024-09-19T08:37:18.342234+0000","last_undegraded":"2024-09-19T08:37:18.342234+0000","last_fullsized":"2024-09-19T08:37:18.342234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:18.052908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673510+0000","last_change":"2024-09-19T08:37:13.326437+0000","last_active":"2024-09-19T08:37:18.673510+0000","last_peered":"2024-09-19T08:37:18.673510+0000","last_clean":"2024-09-19T08:37:18.673510+0000","last_became_active":"2024-09-19T08:37:13.326165+0000","last_became_peered":"2024-09-19T08:37:13.326165+0000","last_unstale":"2024-09-19T08:37:18.673510+0000","last_undegraded":"2024-09-19T08:37:18.673510+0000","last_fullsized":"2024-09-19T08:37:18.673510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:42.492725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550317+0000","last_change":"2024-09-19T08:37:12.321145+0000","last_active":"2024-09-19T08:37:19.550317+0000","last_peered":"2024-09-19T08:37:19.550317+0000","last_clean":"2024-09-19T08:37:19.550317+0000","last_became_active":"2024-09-19T08:37:12.320846+0000","last_became_peered":"2024-09-19T08:37:12.320846+0000","last_unstale":"2024-09-19T08:37:19.550317+0000","last_undegraded":"2024-09-19T08:37:19.550317+0000","last_fullsized":"2024-09-19T08:37:19.550317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:48.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774766+0000","last_change":"2024-09-19T08:37:17.355922+0000","last_active":"2024-09-19T08:37:19.774766+0000","last_peered":"2024-09-19T08:37:19.774766+0000","last_clean":"2024-09-19T08:37:19.774766+0000","last_became_active":"2024-09-19T08:37:17.355537+0000","last_became_peered":"2024-09-19T08:37:17.355537+0000","last_unstale":"2024-09-19T08:37:19.774766+0000","last_undegraded":"2024-09-19T08:37:19.774766+0000","last_fullsized":"2024-09-19T08:37:19.774766+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:25.565544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342913+0000","last_change":"2024-09-19T08:37:13.317754+0000","last_active":"2024-09-19T08:37:18.342913+0000","last_peered":"2024-09-19T08:37:18.342913+0000","last_clean":"2024-09-19T08:37:18.342913+0000","last_became_active":"2024-09-19T08:37:13.317483+0000","last_became_peered":"2024-09-19T08:37:13.317483+0000","last_unstale":"2024-09-19T08:37:18.342913+0000","last_undegraded":"2024-09-19T08:37:18.342913+0000","last_fullsized":"2024-09-19T08:37:18.342913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:34.222102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343157+0000","last_change":"2024-09-19T08:37:12.319094+0000","last_active":"2024-09-19T08:37:18.343157+0000","last_peered":"2024-09-19T08:37:18.343157+0000","last_clean":"2024-09-19T08:37:18.343157+0000","last_became_active":"2024-09-19T08:37:12.318782+0000","last_became_peered":"2024-09-19T08:37:12.318782+0000","last_unstale":"2024-09-19T08:37:18.343157+0000","last_undegraded":"2024-09-19T08:37:18.343157+0000","last_fullsized":"2024-09-19T08:37:18.343157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:08.631783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.674052+0000","last_change":"2024-09-19T08:37:17.362678+0000","last_active":"2024-09-19T08:37:18.674052+0000","last_peered":"2024-09-19T08:37:18.674052+0000","last_clean":"2024-09-19T08:37:18.674052+0000","last_became_active":"2024-09-19T08:37:17.362281+0000","last_became_peered":"2024-09-19T08:37:17.362281+0000","last_unstale":"2024-09-19T08:37:18.674052+0000","last_undegraded":"2024-09-19T08:37:18.674052+0000","last_fullsized":"2024-09-19T08:37:18.674052+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:37.134018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341605+0000","last_change":"2024-09-19T08:37:13.328741+0000","last_active":"2024-09-19T08:37:18.341605+0000","last_peered":"2024-09-19T08:37:18.341605+0000","last_clean":"2024-09-19T08:37:18.341605+0000","last_became_active":"2024-09-19T08:37:13.328156+0000","last_became_peered":"2024-09-19T08:37:13.328156+0000","last_unstale":"2024-09-19T08:37:18.341605+0000","last_undegraded":"2024-09-19T08:37:18.341605+0000","last_fullsized":"2024-09-19T08:37:18.341605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:21.534501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773822+0000","last_change":"2024-09-19T08:37:12.314762+0000","last_active":"2024-09-19T08:37:19.773822+0000","last_peered":"2024-09-19T08:37:19.773822+0000","last_clean":"2024-09-19T08:37:19.773822+0000","last_became_active":"2024-09-19T08:37:12.314471+0000","last_became_peered":"2024-09-19T08:37:12.314471+0000","last_unstale":"2024-09-19T08:37:19.773822+0000","last_undegraded":"2024-09-19T08:37:19.773822+0000","last_fullsized":"2024-09-19T08:37:19.773822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:08.631783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774584+0000","last_change":"2024-09-19T08:37:17.353677+0000","last_active":"2024-09-19T08:37:19.774584+0000","last_peered":"2024-09-19T08:37:19.774584+0000","last_clean":"2024-09-19T08:37:19.774584+0000","last_became_active":"2024-09-19T08:37:17.353311+0000","last_became_peered":"2024-09-19T08:37:17.353311+0000","last_unstale":"2024-09-19T08:37:19.774584+0000","last_undegraded":"2024-09-19T08:37:19.774584+0000","last_fullsized":"2024-09-19T08:37:19.774584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:55.818752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343663+0000","last_change":"2024-09-19T08:37:13.322046+0000","last_active":"2024-09-19T08:37:18.343663+0000","last_peered":"2024-09-19T08:37:18.343663+0000","last_clean":"2024-09-19T08:37:18.343663+0000","last_became_active":"2024-09-19T08:37:13.321632+0000","last_became_peered":"2024-09-19T08:37:13.321632+0000","last_unstale":"2024-09-19T08:37:18.343663+0000","last_undegraded":"2024-09-19T08:37:18.343663+0000","last_fullsized":"2024-09-19T08:37:18.343663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:31.517337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342528+0000","last_change":"2024-09-19T08:37:12.326667+0000","last_active":"2024-09-19T08:37:18.342528+0000","last_peered":"2024-09-19T08:37:18.342528+0000","last_clean":"2024-09-19T08:37:18.342528+0000","last_became_active":"2024-09-19T08:37:12.326400+0000","last_became_peered":"2024-09-19T08:37:12.326400+0000","last_unstale":"2024-09-19T08:37:18.342528+0000","last_undegraded":"2024-09-19T08:37:18.342528+0000","last_fullsized":"2024-09-19T08:37:18.342528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:17.484267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774094+0000","last_change":"2024-09-19T08:37:17.353015+0000","last_active":"2024-09-19T08:37:19.774094+0000","last_peered":"2024-09-19T08:37:19.774094+0000","last_clean":"2024-09-19T08:37:19.774094+0000","last_became_active":"2024-09-19T08:37:17.352080+0000","last_became_peered":"2024-09-19T08:37:17.352080+0000","last_unstale":"2024-09-19T08:37:19.774094+0000","last_undegraded":"2024-09-19T08:37:19.774094+0000","last_fullsized":"2024-09-19T08:37:19.774094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:25.374722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343778+0000","last_change":"2024-09-19T08:37:13.315155+0000","last_active":"2024-09-19T08:37:18.343778+0000","last_peered":"2024-09-19T08:37:18.343778+0000","last_clean":"2024-09-19T08:37:18.343778+0000","last_became_active":"2024-09-19T08:37:13.314853+0000","last_became_peered":"2024-09-19T08:37:13.314853+0000","last_unstale":"2024-09-19T08:37:18.343778+0000","last_undegraded":"2024-09-19T08:37:18.343778+0000","last_fullsized":"2024-09-19T08:37:18.343778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:57.125390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343814+0000","last_change":"2024-09-19T08:37:12.307577+0000","last_active":"2024-09-19T08:37:18.343814+0000","last_peered":"2024-09-19T08:37:18.343814+0000","last_clean":"2024-09-19T08:37:18.343814+0000","last_became_active":"2024-09-19T08:37:12.307011+0000","last_became_peered":"2024-09-19T08:37:12.307011+0000","last_unstale":"2024-09-19T08:37:18.343814+0000","last_undegraded":"2024-09-19T08:37:18.343814+0000","last_fullsized":"2024-09-19T08:37:18.343814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:12.811398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342993+0000","last_change":"2024-09-19T08:37:17.350495+0000","last_active":"2024-09-19T08:37:18.342993+0000","last_peered":"2024-09-19T08:37:18.342993+0000","last_clean":"2024-09-19T08:37:18.342993+0000","last_became_active":"2024-09-19T08:37:17.349314+0000","last_became_peered":"2024-09-19T08:37:17.349314+0000","last_unstale":"2024-09-19T08:37:18.342993+0000","last_undegraded":"2024-09-19T08:37:18.342993+0000","last_fullsized":"2024-09-19T08:37:18.342993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:30.433955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550444+0000","last_change":"2024-09-19T08:37:13.326384+0000","last_active":"2024-09-19T08:37:19.550444+0000","last_peered":"2024-09-19T08:37:19.550444+0000","last_clean":"2024-09-19T08:37:19.550444+0000","last_became_active":"2024-09-19T08:37:13.326109+0000","last_became_peered":"2024-09-19T08:37:13.326109+0000","last_unstale":"2024-09-19T08:37:19.550444+0000","last_undegraded":"2024-09-19T08:37:19.550444+0000","last_fullsized":"2024-09-19T08:37:19.550444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:39.528322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342580+0000","last_change":"2024-09-19T08:37:12.323115+0000","last_active":"2024-09-19T08:37:18.342580+0000","last_peered":"2024-09-19T08:37:18.342580+0000","last_clean":"2024-09-19T08:37:18.342580+0000","last_became_active":"2024-09-19T08:37:12.322685+0000","last_became_peered":"2024-09-19T08:37:12.322685+0000","last_unstale":"2024-09-19T08:37:18.342580+0000","last_undegraded":"2024-09-19T08:37:18.342580+0000","last_fullsized":"2024-09-19T08:37:18.342580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:44.440667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550017+0000","last_change":"2024-09-19T08:37:17.358072+0000","last_active":"2024-09-19T08:37:19.550017+0000","last_peered":"2024-09-19T08:37:19.550017+0000","last_clean":"2024-09-19T08:37:19.550017+0000","last_became_active":"2024-09-19T08:37:17.357595+0000","last_became_peered":"2024-09-19T08:37:17.357595+0000","last_unstale":"2024-09-19T08:37:19.550017+0000","last_undegraded":"2024-09-19T08:37:19.550017+0000","last_fullsized":"2024-09-19T08:37:19.550017+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:29.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775441+0000","last_change":"2024-09-19T08:37:13.319823+0000","last_active":"2024-09-19T08:37:19.775441+0000","last_peered":"2024-09-19T08:37:19.775441+0000","last_clean":"2024-09-19T08:37:19.775441+0000","last_became_active":"2024-09-19T08:37:13.319552+0000","last_became_peered":"2024-09-19T08:37:13.319552+0000","last_unstale":"2024-09-19T08:37:19.775441+0000","last_undegraded":"2024-09-19T08:37:19.775441+0000","last_fullsized":"2024-09-19T08:37:19.775441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:23.965109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582542+0000","last_change":"2024-09-19T08:37:12.320429+0000","last_active":"2024-09-19T08:37:19.582542+0000","last_peered":"2024-09-19T08:37:19.582542+0000","last_clean":"2024-09-19T08:37:19.582542+0000","last_became_active":"2024-09-19T08:37:12.320136+0000","last_became_peered":"2024-09-19T08:37:12.320136+0000","last_unstale":"2024-09-19T08:37:19.582542+0000","last_undegraded":"2024-09-19T08:37:19.582542+0000","last_fullsized":"2024-09-19T08:37:19.582542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:48.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.549893+0000","last_change":"2024-09-19T08:37:17.351017+0000","last_active":"2024-09-19T08:37:19.549893+0000","last_peered":"2024-09-19T08:37:19.549893+0000","last_clean":"2024-09-19T08:37:19.549893+0000","last_became_active":"2024-09-19T08:37:17.350612+0000","last_became_peered":"2024-09-19T08:37:17.350612+0000","last_unstale":"2024-09-19T08:37:19.549893+0000","last_undegraded":"2024-09-19T08:37:19.549893+0000","last_fullsized":"2024-09-19T08:37:19.549893+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:25.374722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774665+0000","last_change":"2024-09-19T08:37:13.322685+0000","last_active":"2024-09-19T08:37:19.774665+0000","last_peered":"2024-09-19T08:37:19.774665+0000","last_clean":"2024-09-19T08:37:19.774665+0000","last_became_active":"2024-09-19T08:37:13.322422+0000","last_became_peered":"2024-09-19T08:37:13.322422+0000","last_unstale":"2024-09-19T08:37:19.774665+0000","last_undegraded":"2024-09-19T08:37:19.774665+0000","last_fullsized":"2024-09-19T08:37:19.774665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:32.352238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341955+0000","last_change":"2024-09-19T08:37:12.321407+0000","last_active":"2024-09-19T08:37:18.341955+0000","last_peered":"2024-09-19T08:37:18.341955+0000","last_clean":"2024-09-19T08:37:18.341955+0000","last_became_active":"2024-09-19T08:37:12.321129+0000","last_became_peered":"2024-09-19T08:37:12.321129+0000","last_unstale":"2024-09-19T08:37:18.341955+0000","last_undegraded":"2024-09-19T08:37:18.341955+0000","last_fullsized":"2024-09-19T08:37:18.341955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:03.696329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550190+0000","last_change":"2024-09-19T08:37:17.358653+0000","last_active":"2024-09-19T08:37:19.550190+0000","last_peered":"2024-09-19T08:37:19.550190+0000","last_clean":"2024-09-19T08:37:19.550190+0000","last_became_active":"2024-09-19T08:37:17.357509+0000","last_became_peered":"2024-09-19T08:37:17.357509+0000","last_unstale":"2024-09-19T08:37:19.550190+0000","last_undegraded":"2024-09-19T08:37:19.550190+0000","last_fullsized":"2024-09-19T08:37:19.550190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:55.818752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582178+0000","last_change":"2024-09-19T08:37:13.327783+0000","last_active":"2024-09-19T08:37:19.582178+0000","last_peered":"2024-09-19T08:37:19.582178+0000","last_clean":"2024-09-19T08:37:19.582178+0000","last_became_active":"2024-09-19T08:37:13.327296+0000","last_became_peered":"2024-09-19T08:37:13.327296+0000","last_unstale":"2024-09-19T08:37:19.582178+0000","last_undegraded":"2024-09-19T08:37:19.582178+0000","last_fullsized":"2024-09-19T08:37:19.582178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:31.517337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673483+0000","last_change":"2024-09-19T08:37:12.318619+0000","last_active":"2024-09-19T08:37:18.673483+0000","last_peered":"2024-09-19T08:37:18.673483+0000","last_clean":"2024-09-19T08:37:18.673483+0000","last_became_active":"2024-09-19T08:37:12.318299+0000","last_became_peered":"2024-09-19T08:37:12.318299+0000","last_unstale":"2024-09-19T08:37:18.673483+0000","last_undegraded":"2024-09-19T08:37:18.673483+0000","last_fullsized":"2024-09-19T08:37:18.673483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:20.563149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550435+0000","last_change":"2024-09-19T08:37:17.353727+0000","last_active":"2024-09-19T08:37:19.550435+0000","last_peered":"2024-09-19T08:37:19.550435+0000","last_clean":"2024-09-19T08:37:19.550435+0000","last_became_active":"2024-09-19T08:37:17.353180+0000","last_became_peered":"2024-09-19T08:37:17.353180+0000","last_unstale":"2024-09-19T08:37:19.550435+0000","last_undegraded":"2024-09-19T08:37:19.550435+0000","last_fullsized":"2024-09-19T08:37:19.550435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:41.877203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.549807+0000","last_change":"2024-09-19T08:37:13.323403+0000","last_active":"2024-09-19T08:37:19.549807+0000","last_peered":"2024-09-19T08:37:19.549807+0000","last_clean":"2024-09-19T08:37:19.549807+0000","last_became_active":"2024-09-19T08:37:13.323125+0000","last_became_peered":"2024-09-19T08:37:13.323125+0000","last_unstale":"2024-09-19T08:37:19.549807+0000","last_undegraded":"2024-09-19T08:37:19.549807+0000","last_fullsized":"2024-09-19T08:37:19.549807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:04.705399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341725+0000","last_change":"2024-09-19T08:37:12.325472+0000","last_active":"2024-09-19T08:37:18.341725+0000","last_peered":"2024-09-19T08:37:18.341725+0000","last_clean":"2024-09-19T08:37:18.341725+0000","last_became_active":"2024-09-19T08:37:12.325213+0000","last_became_peered":"2024-09-19T08:37:12.325213+0000","last_unstale":"2024-09-19T08:37:18.341725+0000","last_undegraded":"2024-09-19T08:37:18.341725+0000","last_fullsized":"2024-09-19T08:37:18.341725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:55.041313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582821+0000","last_change":"2024-09-19T08:37:17.354723+0000","last_active":"2024-09-19T08:37:19.582821+0000","last_peered":"2024-09-19T08:37:19.582821+0000","last_clean":"2024-09-19T08:37:19.582821+0000","last_became_active":"2024-09-19T08:37:17.354349+0000","last_became_peered":"2024-09-19T08:37:17.354349+0000","last_unstale":"2024-09-19T08:37:19.582821+0000","last_undegraded":"2024-09-19T08:37:19.582821+0000","last_fullsized":"2024-09-19T08:37:19.582821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:26:18.585237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343346+0000","last_change":"2024-09-19T08:37:13.314451+0000","last_active":"2024-09-19T08:37:18.343346+0000","last_peered":"2024-09-19T08:37:18.343346+0000","last_clean":"2024-09-19T08:37:18.343346+0000","last_became_active":"2024-09-19T08:37:13.314082+0000","last_became_peered":"2024-09-19T08:37:13.314082+0000","last_unstale":"2024-09-19T08:37:18.343346+0000","last_undegraded":"2024-09-19T08:37:18.343346+0000","last_fullsized":"2024-09-19T08:37:18.343346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:39.528322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342148+0000","last_change":"2024-09-19T08:37:12.321328+0000","last_active":"2024-09-19T08:37:18.342148+0000","last_peered":"2024-09-19T08:37:18.342148+0000","last_clean":"2024-09-19T08:37:18.342148+0000","last_became_active":"2024-09-19T08:37:12.321069+0000","last_became_peered":"2024-09-19T08:37:12.321069+0000","last_unstale":"2024-09-19T08:37:18.342148+0000","last_undegraded":"2024-09-19T08:37:18.342148+0000","last_fullsized":"2024-09-19T08:37:18.342148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:22.956039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774403+0000","last_change":"2024-09-19T08:37:04.479071+0000","last_active":"2024-09-19T08:37:19.774403+0000","last_peered":"2024-09-19T08:37:19.774403+0000","last_clean":"2024-09-19T08:37:19.774403+0000","last_became_active":"2024-09-19T08:37:04.478199+0000","last_became_peered":"2024-09-19T08:37:04.478199+0000","last_unstale":"2024-09-19T08:37:19.774403+0000","last_undegraded":"2024-09-19T08:37:19.774403+0000","last_fullsized":"2024-09-19T08:37:19.774403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_clean_scrub_stamp":"2024-09-19T08:37:02.519738+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:32.963748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342489+0000","last_change":"2024-09-19T08:37:17.360235+0000","last_active":"2024-09-19T08:37:18.342489+0000","last_peered":"2024-09-19T08:37:18.342489+0000","last_clean":"2024-09-19T08:37:18.342489+0000","last_became_active":"2024-09-19T08:37:17.359875+0000","last_became_peered":"2024-09-19T08:37:17.359875+0000","last_unstale":"2024-09-19T08:37:18.342489+0000","last_undegraded":"2024-09-19T08:37:18.342489+0000","last_fullsized":"2024-09-19T08:37:18.342489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:02.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342407+0000","last_change":"2024-09-19T08:37:13.318739+0000","last_active":"2024-09-19T08:37:18.342407+0000","last_peered":"2024-09-19T08:37:18.342407+0000","last_clean":"2024-09-19T08:37:18.342407+0000","last_became_active":"2024-09-19T08:37:13.318487+0000","last_became_peered":"2024-09-19T08:37:13.318487+0000","last_unstale":"2024-09-19T08:37:18.342407+0000","last_undegraded":"2024-09-19T08:37:18.342407+0000","last_fullsized":"2024-09-19T08:37:18.342407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:50.571163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550463+0000","last_change":"2024-09-19T08:37:12.321017+0000","last_active":"2024-09-19T08:37:19.550463+0000","last_peered":"2024-09-19T08:37:19.550463+0000","last_clean":"2024-09-19T08:37:19.550463+0000","last_became_active":"2024-09-19T08:37:12.320498+0000","last_became_peered":"2024-09-19T08:37:12.320498+0000","last_unstale":"2024-09-19T08:37:19.550463+0000","last_undegraded":"2024-09-19T08:37:19.550463+0000","last_fullsized":"2024-09-19T08:37:19.550463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:37.272613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774252+0000","last_change":"2024-09-19T08:37:17.351391+0000","last_active":"2024-09-19T08:37:19.774252+0000","last_peered":"2024-09-19T08:37:19.774252+0000","last_clean":"2024-09-19T08:37:19.774252+0000","last_became_active":"2024-09-19T08:37:17.350957+0000","last_became_peered":"2024-09-19T08:37:17.350957+0000","last_unstale":"2024-09-19T08:37:19.774252+0000","last_undegraded":"2024-09-19T08:37:19.774252+0000","last_fullsized":"2024-09-19T08:37:19.774252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:36.383281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775081+0000","last_change":"2024-09-19T08:37:13.323759+0000","last_active":"2024-09-19T08:37:19.775081+0000","last_peered":"2024-09-19T08:37:19.775081+0000","last_clean":"2024-09-19T08:37:19.775081+0000","last_became_active":"2024-09-19T08:37:13.322021+0000","last_became_peered":"2024-09-19T08:37:13.322021+0000","last_unstale":"2024-09-19T08:37:19.775081+0000","last_undegraded":"2024-09-19T08:37:19.775081+0000","last_fullsized":"2024-09-19T08:37:19.775081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:26.402913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582801+0000","last_change":"2024-09-19T08:37:12.321535+0000","last_active":"2024-09-19T08:37:19.582801+0000","last_peered":"2024-09-19T08:37:19.582801+0000","last_clean":"2024-09-19T08:37:19.582801+0000","last_became_active":"2024-09-19T08:37:12.321158+0000","last_became_peered":"2024-09-19T08:37:12.321158+0000","last_unstale":"2024-09-19T08:37:19.582801+0000","last_undegraded":"2024-09-19T08:37:19.582801+0000","last_fullsized":"2024-09-19T08:37:19.582801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:08.631783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582645+0000","last_change":"2024-09-19T08:37:17.355898+0000","last_active":"2024-09-19T08:37:19.582645+0000","last_peered":"2024-09-19T08:37:19.582645+0000","last_clean":"2024-09-19T08:37:19.582645+0000","last_became_active":"2024-09-19T08:37:17.355518+0000","last_became_peered":"2024-09-19T08:37:17.355518+0000","last_unstale":"2024-09-19T08:37:19.582645+0000","last_undegraded":"2024-09-19T08:37:19.582645+0000","last_fullsized":"2024-09-19T08:37:19.582645+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:54.602206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775159+0000","last_change":"2024-09-19T08:37:13.317412+0000","last_active":"2024-09-19T08:37:19.775159+0000","last_peered":"2024-09-19T08:37:19.775159+0000","last_clean":"2024-09-19T08:37:19.775159+0000","last_became_active":"2024-09-19T08:37:13.317158+0000","last_became_peered":"2024-09-19T08:37:13.317158+0000","last_unstale":"2024-09-19T08:37:19.775159+0000","last_undegraded":"2024-09-19T08:37:19.775159+0000","last_fullsized":"2024-09-19T08:37:19.775159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:37.846160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343804+0000","last_change":"2024-09-19T08:37:12.318485+0000","last_active":"2024-09-19T08:37:18.343804+0000","last_peered":"2024-09-19T08:37:18.343804+0000","last_clean":"2024-09-19T08:37:18.343804+0000","last_became_active":"2024-09-19T08:37:12.318173+0000","last_became_peered":"2024-09-19T08:37:12.318173+0000","last_unstale":"2024-09-19T08:37:18.343804+0000","last_undegraded":"2024-09-19T08:37:18.343804+0000","last_fullsized":"2024-09-19T08:37:18.343804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:32.812065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341486+0000","last_change":"2024-09-19T08:37:17.351969+0000","last_active":"2024-09-19T08:37:18.341486+0000","last_peered":"2024-09-19T08:37:18.341486+0000","last_clean":"2024-09-19T08:37:18.341486+0000","last_became_active":"2024-09-19T08:37:17.351602+0000","last_became_peered":"2024-09-19T08:37:17.351602+0000","last_unstale":"2024-09-19T08:37:18.341486+0000","last_undegraded":"2024-09-19T08:37:18.341486+0000","last_fullsized":"2024-09-19T08:37:18.341486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:07.810509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774839+0000","last_change":"2024-09-19T08:37:13.316790+0000","last_active":"2024-09-19T08:37:19.774839+0000","last_peered":"2024-09-19T08:37:19.774839+0000","last_clean":"2024-09-19T08:37:19.774839+0000","last_became_active":"2024-09-19T08:37:13.315664+0000","last_became_peered":"2024-09-19T08:37:13.315664+0000","last_unstale":"2024-09-19T08:37:19.774839+0000","last_undegraded":"2024-09-19T08:37:19.774839+0000","last_fullsized":"2024-09-19T08:37:19.774839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:55.229727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775212+0000","last_change":"2024-09-19T08:37:12.322929+0000","last_active":"2024-09-19T08:37:19.775212+0000","last_peered":"2024-09-19T08:37:19.775212+0000","last_clean":"2024-09-19T08:37:19.775212+0000","last_became_active":"2024-09-19T08:37:12.322679+0000","last_became_peered":"2024-09-19T08:37:12.322679+0000","last_unstale":"2024-09-19T08:37:19.775212+0000","last_undegraded":"2024-09-19T08:37:19.775212+0000","last_fullsized":"2024-09-19T08:37:19.775212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:12.811398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775212+0000","last_change":"2024-09-19T08:37:17.356653+0000","last_active":"2024-09-19T08:37:19.775212+0000","last_peered":"2024-09-19T08:37:19.775212+0000","last_clean":"2024-09-19T08:37:19.775212+0000","last_became_active":"2024-09-19T08:37:17.356295+0000","last_became_peered":"2024-09-19T08:37:17.356295+0000","last_unstale":"2024-09-19T08:37:19.775212+0000","last_undegraded":"2024-09-19T08:37:19.775212+0000","last_fullsized":"2024-09-19T08:37:19.775212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:59.260769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341570+0000","last_change":"2024-09-19T08:37:13.328997+0000","last_active":"2024-09-19T08:37:18.341570+0000","last_peered":"2024-09-19T08:37:18.341570+0000","last_clean":"2024-09-19T08:37:18.341570+0000","last_became_active":"2024-09-19T08:37:13.328496+0000","last_became_peered":"2024-09-19T08:37:13.328496+0000","last_unstale":"2024-09-19T08:37:18.341570+0000","last_undegraded":"2024-09-19T08:37:18.341570+0000","last_fullsized":"2024-09-19T08:37:18.341570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:11.464991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343175+0000","last_change":"2024-09-19T08:37:12.316395+0000","last_active":"2024-09-19T08:37:18.343175+0000","last_peered":"2024-09-19T08:37:18.343175+0000","last_clean":"2024-09-19T08:37:18.343175+0000","last_became_active":"2024-09-19T08:37:12.315734+0000","last_became_peered":"2024-09-19T08:37:12.315734+0000","last_unstale":"2024-09-19T08:37:18.343175+0000","last_undegraded":"2024-09-19T08:37:18.343175+0000","last_fullsized":"2024-09-19T08:37:18.343175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:48.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582970+0000","last_change":"2024-09-19T08:37:17.351618+0000","last_active":"2024-09-19T08:37:19.582970+0000","last_peered":"2024-09-19T08:37:19.582970+0000","last_clean":"2024-09-19T08:37:19.582970+0000","last_became_active":"2024-09-19T08:37:17.351235+0000","last_became_peered":"2024-09-19T08:37:17.351235+0000","last_unstale":"2024-09-19T08:37:19.582970+0000","last_undegraded":"2024-09-19T08:37:19.582970+0000","last_fullsized":"2024-09-19T08:37:19.582970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:50.477160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774327+0000","last_change":"2024-09-19T08:37:13.328281+0000","last_active":"2024-09-19T08:37:19.774327+0000","last_peered":"2024-09-19T08:37:19.774327+0000","last_clean":"2024-09-19T08:37:19.774327+0000","last_became_active":"2024-09-19T08:37:13.327925+0000","last_became_peered":"2024-09-19T08:37:13.327925+0000","last_unstale":"2024-09-19T08:37:19.774327+0000","last_undegraded":"2024-09-19T08:37:19.774327+0000","last_fullsized":"2024-09-19T08:37:19.774327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:05.312287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775776+0000","last_change":"2024-09-19T08:37:12.321424+0000","last_active":"2024-09-19T08:37:19.775776+0000","last_peered":"2024-09-19T08:37:19.775776+0000","last_clean":"2024-09-19T08:37:19.775776+0000","last_became_active":"2024-09-19T08:37:12.321176+0000","last_became_peered":"2024-09-19T08:37:12.321176+0000","last_unstale":"2024-09-19T08:37:19.775776+0000","last_undegraded":"2024-09-19T08:37:19.775776+0000","last_fullsized":"2024-09-19T08:37:19.775776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:32.812065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.583004+0000","last_change":"2024-09-19T08:37:17.349545+0000","last_active":"2024-09-19T08:37:19.583004+0000","last_peered":"2024-09-19T08:37:19.583004+0000","last_clean":"2024-09-19T08:37:19.583004+0000","last_became_active":"2024-09-19T08:37:17.349192+0000","last_became_peered":"2024-09-19T08:37:17.349192+0000","last_unstale":"2024-09-19T08:37:19.583004+0000","last_undegraded":"2024-09-19T08:37:19.583004+0000","last_fullsized":"2024-09-19T08:37:19.583004+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:38.360015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341839+0000","last_change":"2024-09-19T08:37:13.322205+0000","last_active":"2024-09-19T08:37:18.341839+0000","last_peered":"2024-09-19T08:37:18.341839+0000","last_clean":"2024-09-19T08:37:18.341839+0000","last_became_active":"2024-09-19T08:37:13.321483+0000","last_became_peered":"2024-09-19T08:37:13.321483+0000","last_unstale":"2024-09-19T08:37:18.341839+0000","last_undegraded":"2024-09-19T08:37:18.341839+0000","last_fullsized":"2024-09-19T08:37:18.341839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:49.043269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341935+0000","last_change":"2024-09-19T08:37:12.325272+0000","last_active":"2024-09-19T08:37:18.341935+0000","last_peered":"2024-09-19T08:37:18.341935+0000","last_clean":"2024-09-19T08:37:18.341935+0000","last_became_active":"2024-09-19T08:37:12.325028+0000","last_became_peered":"2024-09-19T08:37:12.325028+0000","last_unstale":"2024-09-19T08:37:18.341935+0000","last_undegraded":"2024-09-19T08:37:18.341935+0000","last_fullsized":"2024-09-19T08:37:18.341935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:33.465602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550181+0000","last_change":"2024-09-19T08:37:17.355589+0000","last_active":"2024-09-19T08:37:19.550181+0000","last_peered":"2024-09-19T08:37:19.550181+0000","last_clean":"2024-09-19T08:37:19.550181+0000","last_became_active":"2024-09-19T08:37:17.353243+0000","last_became_peered":"2024-09-19T08:37:17.353243+0000","last_unstale":"2024-09-19T08:37:19.550181+0000","last_undegraded":"2024-09-19T08:37:19.550181+0000","last_fullsized":"2024-09-19T08:37:19.550181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:36.383281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550216+0000","last_change":"2024-09-19T08:37:13.325522+0000","last_active":"2024-09-19T08:37:19.550216+0000","last_peered":"2024-09-19T08:37:19.550216+0000","last_clean":"2024-09-19T08:37:19.550216+0000","last_became_active":"2024-09-19T08:37:13.324792+0000","last_became_peered":"2024-09-19T08:37:13.324792+0000","last_unstale":"2024-09-19T08:37:19.550216+0000","last_undegraded":"2024-09-19T08:37:19.550216+0000","last_fullsized":"2024-09-19T08:37:19.550216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:55.229727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673680+0000","last_change":"2024-09-19T08:37:12.322147+0000","last_active":"2024-09-19T08:37:18.673680+0000","last_peered":"2024-09-19T08:37:18.673680+0000","last_clean":"2024-09-19T08:37:18.673680+0000","last_became_active":"2024-09-19T08:37:12.321849+0000","last_became_peered":"2024-09-19T08:37:12.321849+0000","last_unstale":"2024-09-19T08:37:18.673680+0000","last_undegraded":"2024-09-19T08:37:18.673680+0000","last_fullsized":"2024-09-19T08:37:18.673680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:13.052644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342312+0000","last_change":"2024-09-19T08:37:17.359818+0000","last_active":"2024-09-19T08:37:18.342312+0000","last_peered":"2024-09-19T08:37:18.342312+0000","last_clean":"2024-09-19T08:37:18.342312+0000","last_became_active":"2024-09-19T08:37:17.359442+0000","last_became_peered":"2024-09-19T08:37:17.359442+0000","last_unstale":"2024-09-19T08:37:18.342312+0000","last_undegraded":"2024-09-19T08:37:18.342312+0000","last_fullsized":"2024-09-19T08:37:18.342312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:23.916499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774686+0000","last_change":"2024-09-19T08:37:13.320385+0000","last_active":"2024-09-19T08:37:19.774686+0000","last_peered":"2024-09-19T08:37:19.774686+0000","last_clean":"2024-09-19T08:37:19.774686+0000","last_became_active":"2024-09-19T08:37:13.320121+0000","last_became_peered":"2024-09-19T08:37:13.320121+0000","last_unstale":"2024-09-19T08:37:19.774686+0000","last_undegraded":"2024-09-19T08:37:19.774686+0000","last_fullsized":"2024-09-19T08:37:19.774686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:25.894361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:22.767373+0000","last_change":"2024-09-19T08:37:12.317329+0000","last_active":"2024-09-19T08:37:22.767373+0000","last_peered":"2024-09-19T08:37:22.767373+0000","last_clean":"2024-09-19T08:37:22.767373+0000","last_became_active":"2024-09-19T08:37:12.317062+0000","last_became_peered":"2024-09-19T08:37:12.317062+0000","last_unstale":"2024-09-19T08:37:22.767373+0000","last_undegraded":"2024-09-19T08:37:22.767373+0000","last_fullsized":"2024-09-19T08:37:22.767373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:05.334179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343234+0000","last_change":"2024-09-19T08:37:17.351632+0000","last_active":"2024-09-19T08:37:18.343234+0000","last_peered":"2024-09-19T08:37:18.343234+0000","last_clean":"2024-09-19T08:37:18.343234+0000","last_became_active":"2024-09-19T08:37:17.351246+0000","last_became_peered":"2024-09-19T08:37:17.351246+0000","last_unstale":"2024-09-19T08:37:18.343234+0000","last_undegraded":"2024-09-19T08:37:18.343234+0000","last_fullsized":"2024-09-19T08:37:18.343234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:15.496034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341958+0000","last_change":"2024-09-19T08:37:13.328541+0000","last_active":"2024-09-19T08:37:18.341958+0000","last_peered":"2024-09-19T08:37:18.341958+0000","last_clean":"2024-09-19T08:37:18.341958+0000","last_became_active":"2024-09-19T08:37:13.328285+0000","last_became_peered":"2024-09-19T08:37:13.328285+0000","last_unstale":"2024-09-19T08:37:18.341958+0000","last_undegraded":"2024-09-19T08:37:18.341958+0000","last_fullsized":"2024-09-19T08:37:18.341958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:13.920583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673858+0000","last_change":"2024-09-19T08:37:12.318230+0000","last_active":"2024-09-19T08:37:18.673858+0000","last_peered":"2024-09-19T08:37:18.673858+0000","last_clean":"2024-09-19T08:37:18.673858+0000","last_became_active":"2024-09-19T08:37:12.317739+0000","last_became_peered":"2024-09-19T08:37:12.317739+0000","last_unstale":"2024-09-19T08:37:18.673858+0000","last_undegraded":"2024-09-19T08:37:18.673858+0000","last_fullsized":"2024-09-19T08:37:18.673858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:50.275215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775001+0000","last_change":"2024-09-19T08:37:17.353397+0000","last_active":"2024-09-19T08:37:19.775001+0000","last_peered":"2024-09-19T08:37:19.775001+0000","last_clean":"2024-09-19T08:37:19.775001+0000","last_became_active":"2024-09-19T08:37:17.352532+0000","last_became_peered":"2024-09-19T08:37:17.352532+0000","last_unstale":"2024-09-19T08:37:19.775001+0000","last_undegraded":"2024-09-19T08:37:19.775001+0000","last_fullsized":"2024-09-19T08:37:19.775001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:41.877203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.583030+0000","last_change":"2024-09-19T08:37:13.330183+0000","last_active":"2024-09-19T08:37:19.583030+0000","last_peered":"2024-09-19T08:37:19.583030+0000","last_clean":"2024-09-19T08:37:19.583030+0000","last_became_active":"2024-09-19T08:37:13.329810+0000","last_became_peered":"2024-09-19T08:37:13.329810+0000","last_unstale":"2024-09-19T08:37:19.583030+0000","last_undegraded":"2024-09-19T08:37:19.583030+0000","last_fullsized":"2024-09-19T08:37:19.583030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:32.352238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775009+0000","last_change":"2024-09-19T08:37:12.318995+0000","last_active":"2024-09-19T08:37:19.775009+0000","last_peered":"2024-09-19T08:37:19.775009+0000","last_clean":"2024-09-19T08:37:19.775009+0000","last_became_active":"2024-09-19T08:37:12.318707+0000","last_became_peered":"2024-09-19T08:37:12.318707+0000","last_unstale":"2024-09-19T08:37:19.775009+0000","last_undegraded":"2024-09-19T08:37:19.775009+0000","last_fullsized":"2024-09-19T08:37:19.775009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:43.809060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673308+0000","last_change":"2024-09-19T08:37:17.363394+0000","last_active":"2024-09-19T08:37:18.673308+0000","last_peered":"2024-09-19T08:37:18.673308+0000","last_clean":"2024-09-19T08:37:18.673308+0000","last_became_active":"2024-09-19T08:37:17.362912+0000","last_became_peered":"2024-09-19T08:37:17.362912+0000","last_unstale":"2024-09-19T08:37:18.673308+0000","last_undegraded":"2024-09-19T08:37:18.673308+0000","last_fullsized":"2024-09-19T08:37:18.673308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:04.239525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774754+0000","last_change":"2024-09-19T08:37:13.324283+0000","last_active":"2024-09-19T08:37:19.774754+0000","last_peered":"2024-09-19T08:37:19.774754+0000","last_clean":"2024-09-19T08:37:19.774754+0000","last_became_active":"2024-09-19T08:37:13.323386+0000","last_became_peered":"2024-09-19T08:37:13.323386+0000","last_unstale":"2024-09-19T08:37:19.774754+0000","last_undegraded":"2024-09-19T08:37:19.774754+0000","last_fullsized":"2024-09-19T08:37:19.774754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:04.705399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774939+0000","last_change":"2024-09-19T08:37:12.320151+0000","last_active":"2024-09-19T08:37:19.774939+0000","last_peered":"2024-09-19T08:37:19.774939+0000","last_clean":"2024-09-19T08:37:19.774939+0000","last_became_active":"2024-09-19T08:37:12.319848+0000","last_became_peered":"2024-09-19T08:37:12.319848+0000","last_unstale":"2024-09-19T08:37:19.774939+0000","last_undegraded":"2024-09-19T08:37:19.774939+0000","last_fullsized":"2024-09-19T08:37:19.774939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:57.623546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343446+0000","last_change":"2024-09-19T08:37:17.354272+0000","last_active":"2024-09-19T08:37:18.343446+0000","last_peered":"2024-09-19T08:37:18.343446+0000","last_clean":"2024-09-19T08:37:18.343446+0000","last_became_active":"2024-09-19T08:37:17.353914+0000","last_became_peered":"2024-09-19T08:37:17.353914+0000","last_unstale":"2024-09-19T08:37:18.343446+0000","last_undegraded":"2024-09-19T08:37:18.343446+0000","last_fullsized":"2024-09-19T08:37:18.343446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:53.074312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343607+0000","last_change":"2024-09-19T08:37:17.353588+0000","last_active":"2024-09-19T08:37:18.343607+0000","last_peered":"2024-09-19T08:37:18.343607+0000","last_clean":"2024-09-19T08:37:18.343607+0000","last_became_active":"2024-09-19T08:37:17.353202+0000","last_became_peered":"2024-09-19T08:37:17.353202+0000","last_unstale":"2024-09-19T08:37:18.343607+0000","last_undegraded":"2024-09-19T08:37:18.343607+0000","last_fullsized":"2024-09-19T08:37:18.343607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:56.423064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343044+0000","last_change":"2024-09-19T08:37:13.310656+0000","last_active":"2024-09-19T08:37:18.343044+0000","last_peered":"2024-09-19T08:37:18.343044+0000","last_clean":"2024-09-19T08:37:18.343044+0000","last_became_active":"2024-09-19T08:37:13.310365+0000","last_became_peered":"2024-09-19T08:37:13.310365+0000","last_unstale":"2024-09-19T08:37:18.343044+0000","last_undegraded":"2024-09-19T08:37:18.343044+0000","last_fullsized":"2024-09-19T08:37:18.343044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:48:56.646247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341695+0000","last_change":"2024-09-19T08:37:12.316198+0000","last_active":"2024-09-19T08:37:18.341695+0000","last_peered":"2024-09-19T08:37:18.341695+0000","last_clean":"2024-09-19T08:37:18.341695+0000","last_became_active":"2024-09-19T08:37:12.315954+0000","last_became_peered":"2024-09-19T08:37:12.315954+0000","last_unstale":"2024-09-19T08:37:18.341695+0000","last_undegraded":"2024-09-19T08:37:18.341695+0000","last_fullsized":"2024-09-19T08:37:18.341695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:04.303217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342109+0000","last_change":"2024-09-19T08:37:17.354035+0000","last_active":"2024-09-19T08:37:18.342109+0000","last_peered":"2024-09-19T08:37:18.342109+0000","last_clean":"2024-09-19T08:37:18.342109+0000","last_became_active":"2024-09-19T08:37:17.353669+0000","last_became_peered":"2024-09-19T08:37:17.353669+0000","last_unstale":"2024-09-19T08:37:18.342109+0000","last_undegraded":"2024-09-19T08:37:18.342109+0000","last_fullsized":"2024-09-19T08:37:18.342109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:12.322596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582389+0000","last_change":"2024-09-19T08:37:13.327070+0000","last_active":"2024-09-19T08:37:19.582389+0000","last_peered":"2024-09-19T08:37:19.582389+0000","last_clean":"2024-09-19T08:37:19.582389+0000","last_became_active":"2024-09-19T08:37:13.326721+0000","last_became_peered":"2024-09-19T08:37:13.326721+0000","last_unstale":"2024-09-19T08:37:19.582389+0000","last_undegraded":"2024-09-19T08:37:19.582389+0000","last_fullsized":"2024-09-19T08:37:19.582389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:57.125390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.549850+0000","last_change":"2024-09-19T08:37:12.320362+0000","last_active":"2024-09-19T08:37:19.549850+0000","last_peered":"2024-09-19T08:37:19.549850+0000","last_clean":"2024-09-19T08:37:19.549850+0000","last_became_active":"2024-09-19T08:37:12.320047+0000","last_became_peered":"2024-09-19T08:37:12.320047+0000","last_unstale":"2024-09-19T08:37:19.549850+0000","last_undegraded":"2024-09-19T08:37:19.549850+0000","last_fullsized":"2024-09-19T08:37:19.549850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:57.623546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341855+0000","last_change":"2024-09-19T08:37:12.326611+0000","last_active":"2024-09-19T08:37:18.341855+0000","last_peered":"2024-09-19T08:37:18.341855+0000","last_clean":"2024-09-19T08:37:18.341855+0000","last_became_active":"2024-09-19T08:37:12.326341+0000","last_became_peered":"2024-09-19T08:37:12.326341+0000","last_unstale":"2024-09-19T08:37:18.341855+0000","last_undegraded":"2024-09-19T08:37:18.341855+0000","last_fullsized":"2024-09-19T08:37:18.341855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:54.220657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343192+0000","last_change":"2024-09-19T08:37:13.315454+0000","last_active":"2024-09-19T08:37:18.343192+0000","last_peered":"2024-09-19T08:37:18.343192+0000","last_clean":"2024-09-19T08:37:18.343192+0000","last_became_active":"2024-09-19T08:37:13.315193+0000","last_became_peered":"2024-09-19T08:37:13.315193+0000","last_unstale":"2024-09-19T08:37:18.343192+0000","last_undegraded":"2024-09-19T08:37:18.343192+0000","last_fullsized":"2024-09-19T08:37:18.343192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:02.012602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343557+0000","last_change":"2024-09-19T08:37:17.348944+0000","last_active":"2024-09-19T08:37:18.343557+0000","last_peered":"2024-09-19T08:37:18.343557+0000","last_clean":"2024-09-19T08:37:18.343557+0000","last_became_active":"2024-09-19T08:37:17.348484+0000","last_became_peered":"2024-09-19T08:37:17.348484+0000","last_unstale":"2024-09-19T08:37:18.343557+0000","last_undegraded":"2024-09-19T08:37:18.343557+0000","last_fullsized":"2024-09-19T08:37:18.343557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:28.217244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582715+0000","last_change":"2024-09-19T08:37:12.323262+0000","last_active":"2024-09-19T08:37:19.582715+0000","last_peered":"2024-09-19T08:37:19.582715+0000","last_clean":"2024-09-19T08:37:19.582715+0000","last_became_active":"2024-09-19T08:37:12.322964+0000","last_became_peered":"2024-09-19T08:37:12.322964+0000","last_unstale":"2024-09-19T08:37:19.582715+0000","last_undegraded":"2024-09-19T08:37:19.582715+0000","last_fullsized":"2024-09-19T08:37:19.582715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:32.812065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773888+0000","last_change":"2024-09-19T08:37:13.327280+0000","last_active":"2024-09-19T08:37:19.773888+0000","last_peered":"2024-09-19T08:37:19.773888+0000","last_clean":"2024-09-19T08:37:19.773888+0000","last_became_active":"2024-09-19T08:37:13.326915+0000","last_became_peered":"2024-09-19T08:37:13.326915+0000","last_unstale":"2024-09-19T08:37:19.773888+0000","last_undegraded":"2024-09-19T08:37:19.773888+0000","last_fullsized":"2024-09-19T08:37:19.773888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:56.050383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673780+0000","last_change":"2024-09-19T08:37:17.363011+0000","last_active":"2024-09-19T08:37:18.673780+0000","last_peered":"2024-09-19T08:37:18.673780+0000","last_clean":"2024-09-19T08:37:18.673780+0000","last_became_active":"2024-09-19T08:37:17.362538+0000","last_became_peered":"2024-09-19T08:37:17.362538+0000","last_unstale":"2024-09-19T08:37:18.673780+0000","last_undegraded":"2024-09-19T08:37:18.673780+0000","last_fullsized":"2024-09-19T08:37:18.673780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:29.539457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773951+0000","last_change":"2024-09-19T08:37:13.315209+0000","last_active":"2024-09-19T08:37:19.773951+0000","last_peered":"2024-09-19T08:37:19.773951+0000","last_clean":"2024-09-19T08:37:19.773951+0000","last_became_active":"2024-09-19T08:37:13.314934+0000","last_became_peered":"2024-09-19T08:37:13.314934+0000","last_unstale":"2024-09-19T08:37:19.773951+0000","last_undegraded":"2024-09-19T08:37:19.773951+0000","last_fullsized":"2024-09-19T08:37:19.773951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:44.818129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673338+0000","last_change":"2024-09-19T08:37:13.329355+0000","last_active":"2024-09-19T08:37:18.673338+0000","last_peered":"2024-09-19T08:37:18.673338+0000","last_clean":"2024-09-19T08:37:18.673338+0000","last_became_active":"2024-09-19T08:37:13.327464+0000","last_became_peered":"2024-09-19T08:37:13.327464+0000","last_unstale":"2024-09-19T08:37:18.673338+0000","last_undegraded":"2024-09-19T08:37:18.673338+0000","last_fullsized":"2024-09-19T08:37:18.673338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:44.058583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341765+0000","last_change":"2024-09-19T08:37:13.326479+0000","last_active":"2024-09-19T08:37:18.341765+0000","last_peered":"2024-09-19T08:37:18.341765+0000","last_clean":"2024-09-19T08:37:18.341765+0000","last_became_active":"2024-09-19T08:37:13.326229+0000","last_became_peered":"2024-09-19T08:37:13.326229+0000","last_unstale":"2024-09-19T08:37:18.341765+0000","last_undegraded":"2024-09-19T08:37:18.341765+0000","last_fullsized":"2024-09-19T08:37:18.341765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:24.186202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582555+0000","last_change":"2024-09-19T08:37:13.327921+0000","last_active":"2024-09-19T08:37:19.582555+0000","last_peered":"2024-09-19T08:37:19.582555+0000","last_clean":"2024-09-19T08:37:19.582555+0000","last_became_active":"2024-09-19T08:37:13.327515+0000","last_became_peered":"2024-09-19T08:37:13.327515+0000","last_unstale":"2024-09-19T08:37:19.582555+0000","last_undegraded":"2024-09-19T08:37:19.582555+0000","last_fullsized":"2024-09-19T08:37:19.582555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:21.343680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550330+0000","last_change":"2024-09-19T08:37:13.328457+0000","last_active":"2024-09-19T08:37:19.550330+0000","last_peered":"2024-09-19T08:37:19.550330+0000","last_clean":"2024-09-19T08:37:19.550330+0000","last_became_active":"2024-09-19T08:37:13.328201+0000","last_became_peered":"2024-09-19T08:37:13.328201+0000","last_unstale":"2024-09-19T08:37:19.550330+0000","last_undegraded":"2024-09-19T08:37:19.550330+0000","last_fullsized":"2024-09-19T08:37:19.550330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:02.904237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550219+0000","last_change":"2024-09-19T08:37:13.323713+0000","last_active":"2024-09-19T08:37:19.550219+0000","last_peered":"2024-09-19T08:37:19.550219+0000","last_clean":"2024-09-19T08:37:19.550219+0000","last_became_active":"2024-09-19T08:37:13.323292+0000","last_became_peered":"2024-09-19T08:37:13.323292+0000","last_unstale":"2024-09-19T08:37:19.550219+0000","last_undegraded":"2024-09-19T08:37:19.550219+0000","last_fullsized":"2024-09-19T08:37:19.550219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:48:56.646247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774671+0000","last_change":"2024-09-19T08:37:13.324782+0000","last_active":"2024-09-19T08:37:19.774671+0000","last_peered":"2024-09-19T08:37:19.774671+0000","last_clean":"2024-09-19T08:37:19.774671+0000","last_became_active":"2024-09-19T08:37:13.324279+0000","last_became_peered":"2024-09-19T08:37:13.324279+0000","last_unstale":"2024-09-19T08:37:19.774671+0000","last_undegraded":"2024-09-19T08:37:19.774671+0000","last_fullsized":"2024-09-19T08:37:19.774671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:34.474672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582804+0000","last_change":"2024-09-19T08:37:13.331655+0000","last_active":"2024-09-19T08:37:19.582804+0000","last_peered":"2024-09-19T08:37:19.582804+0000","last_clean":"2024-09-19T08:37:19.582804+0000","last_became_active":"2024-09-19T08:37:13.331359+0000","last_became_peered":"2024-09-19T08:37:13.331359+0000","last_unstale":"2024-09-19T08:37:19.582804+0000","last_undegraded":"2024-09-19T08:37:19.582804+0000","last_fullsized":"2024-09-19T08:37:19.582804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:50.533572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341602+0000","last_change":"2024-09-19T08:37:13.328905+0000","last_active":"2024-09-19T08:37:18.341602+0000","last_peered":"2024-09-19T08:37:18.341602+0000","last_clean":"2024-09-19T08:37:18.341602+0000","last_became_active":"2024-09-19T08:37:13.328643+0000","last_became_peered":"2024-09-19T08:37:13.328643+0000","last_unstale":"2024-09-19T08:37:18.341602+0000","last_undegraded":"2024-09-19T08:37:18.341602+0000","last_fullsized":"2024-09-19T08:37:18.341602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:26.402913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582337+0000","last_change":"2024-09-19T08:37:13.325377+0000","last_active":"2024-09-19T08:37:19.582337+0000","last_peered":"2024-09-19T08:37:19.582337+0000","last_clean":"2024-09-19T08:37:19.582337+0000","last_became_active":"2024-09-19T08:37:13.325101+0000","last_became_peered":"2024-09-19T08:37:13.325101+0000","last_unstale":"2024-09-19T08:37:19.582337+0000","last_undegraded":"2024-09-19T08:37:19.582337+0000","last_fullsized":"2024-09-19T08:37:19.582337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:02.012602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773794+0000","last_change":"2024-09-19T08:37:13.313455+0000","last_active":"2024-09-19T08:37:19.773794+0000","last_peered":"2024-09-19T08:37:19.773794+0000","last_clean":"2024-09-19T08:37:19.773794+0000","last_became_active":"2024-09-19T08:37:13.313182+0000","last_became_peered":"2024-09-19T08:37:13.313182+0000","last_unstale":"2024-09-19T08:37:19.773794+0000","last_undegraded":"2024-09-19T08:37:19.773794+0000","last_fullsized":"2024-09-19T08:37:19.773794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:44.818129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343055+0000","last_change":"2024-09-19T08:37:13.314765+0000","last_active":"2024-09-19T08:37:18.343055+0000","last_peered":"2024-09-19T08:37:18.343055+0000","last_clean":"2024-09-19T08:37:18.343055+0000","last_became_active":"2024-09-19T08:37:13.314484+0000","last_became_peered":"2024-09-19T08:37:13.314484+0000","last_unstale":"2024-09-19T08:37:18.343055+0000","last_undegraded":"2024-09-19T08:37:18.343055+0000","last_fullsized":"2024-09-19T08:37:18.343055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:28.398584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775044+0000","last_change":"2024-09-19T08:37:13.321255+0000","last_active":"2024-09-19T08:37:19.775044+0000","last_peered":"2024-09-19T08:37:19.775044+0000","last_clean":"2024-09-19T08:37:19.775044+0000","last_became_active":"2024-09-19T08:37:13.320944+0000","last_became_peered":"2024-09-19T08:37:13.320944+0000","last_unstale":"2024-09-19T08:37:19.775044+0000","last_undegraded":"2024-09-19T08:37:19.775044+0000","last_fullsized":"2024-09-19T08:37:19.775044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:11.464991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342493+0000","last_change":"2024-09-19T08:37:13.321006+0000","last_active":"2024-09-19T08:37:18.342493+0000","last_peered":"2024-09-19T08:37:18.342493+0000","last_clean":"2024-09-19T08:37:18.342493+0000","last_became_active":"2024-09-19T08:37:13.320729+0000","last_became_peered":"2024-09-19T08:37:13.320729+0000","last_unstale":"2024-09-19T08:37:18.342493+0000","last_undegraded":"2024-09-19T08:37:18.342493+0000","last_fullsized":"2024-09-19T08:37:18.342493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:46.446118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673984+0000","last_change":"2024-09-19T08:37:13.326249+0000","last_active":"2024-09-19T08:37:18.673984+0000","last_peered":"2024-09-19T08:37:18.673984+0000","last_clean":"2024-09-19T08:37:18.673984+0000","last_became_active":"2024-09-19T08:37:13.325965+0000","last_became_peered":"2024-09-19T08:37:13.325965+0000","last_unstale":"2024-09-19T08:37:18.673984+0000","last_undegraded":"2024-09-19T08:37:18.673984+0000","last_fullsized":"2024-09-19T08:37:18.673984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:11.539214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342514+0000","last_change":"2024-09-19T08:37:13.325289+0000","last_active":"2024-09-19T08:37:18.342514+0000","last_peered":"2024-09-19T08:37:18.342514+0000","last_clean":"2024-09-19T08:37:18.342514+0000","last_became_active":"2024-09-19T08:37:13.322947+0000","last_became_peered":"2024-09-19T08:37:13.322947+0000","last_unstale":"2024-09-19T08:37:18.342514+0000","last_undegraded":"2024-09-19T08:37:18.342514+0000","last_fullsized":"2024-09-19T08:37:18.342514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:34.328972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341594+0000","last_change":"2024-09-19T08:37:13.323040+0000","last_active":"2024-09-19T08:37:18.341594+0000","last_peered":"2024-09-19T08:37:18.341594+0000","last_clean":"2024-09-19T08:37:18.341594+0000","last_became_active":"2024-09-19T08:37:13.322427+0000","last_became_peered":"2024-09-19T08:37:13.322427+0000","last_unstale":"2024-09-19T08:37:18.341594+0000","last_undegraded":"2024-09-19T08:37:18.341594+0000","last_fullsized":"2024-09-19T08:37:18.341594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:37.846160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582190+0000","last_change":"2024-09-19T08:37:13.330628+0000","last_active":"2024-09-19T08:37:19.582190+0000","last_peered":"2024-09-19T08:37:19.582190+0000","last_clean":"2024-09-19T08:37:19.582190+0000","last_became_active":"2024-09-19T08:37:13.330355+0000","last_became_peered":"2024-09-19T08:37:13.330355+0000","last_unstale":"2024-09-19T08:37:19.582190+0000","last_undegraded":"2024-09-19T08:37:19.582190+0000","last_fullsized":"2024-09-19T08:37:19.582190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:28.398584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550079+0000","last_change":"2024-09-19T08:37:13.322548+0000","last_active":"2024-09-19T08:37:19.550079+0000","last_peered":"2024-09-19T08:37:19.550079+0000","last_clean":"2024-09-19T08:37:19.550079+0000","last_became_active":"2024-09-19T08:37:13.322265+0000","last_became_peered":"2024-09-19T08:37:13.322265+0000","last_unstale":"2024-09-19T08:37:19.550079+0000","last_undegraded":"2024-09-19T08:37:19.550079+0000","last_fullsized":"2024-09-19T08:37:19.550079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:34.474672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550129+0000","last_change":"2024-09-19T08:37:13.329206+0000","last_active":"2024-09-19T08:37:19.550129+0000","last_peered":"2024-09-19T08:37:19.550129+0000","last_clean":"2024-09-19T08:37:19.550129+0000","last_became_active":"2024-09-19T08:37:13.328945+0000","last_became_peered":"2024-09-19T08:37:13.328945+0000","last_unstale":"2024-09-19T08:37:19.550129+0000","last_undegraded":"2024-09-19T08:37:19.550129+0000","last_fullsized":"2024-09-19T08:37:19.550129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:45.449737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774990+0000","last_change":"2024-09-19T08:37:13.321724+0000","last_active":"2024-09-19T08:37:19.774990+0000","last_peered":"2024-09-19T08:37:19.774990+0000","last_clean":"2024-09-19T08:37:19.774990+0000","last_became_active":"2024-09-19T08:37:13.321487+0000","last_became_peered":"2024-09-19T08:37:13.321487+0000","last_unstale":"2024-09-19T08:37:19.774990+0000","last_undegraded":"2024-09-19T08:37:19.774990+0000","last_fullsized":"2024-09-19T08:37:19.774990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:57.125390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774604+0000","last_change":"2024-09-19T08:37:13.326611+0000","last_active":"2024-09-19T08:37:19.774604+0000","last_peered":"2024-09-19T08:37:19.774604+0000","last_clean":"2024-09-19T08:37:19.774604+0000","last_became_active":"2024-09-19T08:37:13.326227+0000","last_became_peered":"2024-09-19T08:37:13.326227+0000","last_unstale":"2024-09-19T08:37:19.774604+0000","last_undegraded":"2024-09-19T08:37:19.774604+0000","last_fullsized":"2024-09-19T08:37:19.774604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:50.533572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774816+0000","last_change":"2024-09-19T08:37:13.322510+0000","last_active":"2024-09-19T08:37:19.774816+0000","last_peered":"2024-09-19T08:37:19.774816+0000","last_clean":"2024-09-19T08:37:19.774816+0000","last_became_active":"2024-09-19T08:37:13.322203+0000","last_became_peered":"2024-09-19T08:37:13.322203+0000","last_unstale":"2024-09-19T08:37:19.774816+0000","last_undegraded":"2024-09-19T08:37:19.774816+0000","last_fullsized":"2024-09-19T08:37:19.774816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:21.343680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774839+0000","last_change":"2024-09-19T08:37:13.318910+0000","last_active":"2024-09-19T08:37:19.774839+0000","last_peered":"2024-09-19T08:37:19.774839+0000","last_clean":"2024-09-19T08:37:19.774839+0000","last_became_active":"2024-09-19T08:37:13.318573+0000","last_became_peered":"2024-09-19T08:37:13.318573+0000","last_unstale":"2024-09-19T08:37:19.774839+0000","last_undegraded":"2024-09-19T08:37:19.774839+0000","last_fullsized":"2024-09-19T08:37:19.774839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:23.965109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582167+0000","last_change":"2024-09-19T08:37:13.331372+0000","last_active":"2024-09-19T08:37:19.582167+0000","last_peered":"2024-09-19T08:37:19.582167+0000","last_clean":"2024-09-19T08:37:19.582167+0000","last_became_active":"2024-09-19T08:37:13.330730+0000","last_became_peered":"2024-09-19T08:37:13.330730+0000","last_unstale":"2024-09-19T08:37:19.582167+0000","last_undegraded":"2024-09-19T08:37:19.582167+0000","last_fullsized":"2024-09-19T08:37:19.582167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:34.222102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775688+0000","last_change":"2024-09-19T08:37:13.324940+0000","last_active":"2024-09-19T08:37:19.775688+0000","last_peered":"2024-09-19T08:37:19.775688+0000","last_clean":"2024-09-19T08:37:19.775688+0000","last_became_active":"2024-09-19T08:37:13.324666+0000","last_became_peered":"2024-09-19T08:37:13.324666+0000","last_unstale":"2024-09-19T08:37:19.775688+0000","last_undegraded":"2024-09-19T08:37:19.775688+0000","last_fullsized":"2024-09-19T08:37:19.775688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:31.517337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774270+0000","last_change":"2024-09-19T08:37:13.319325+0000","last_active":"2024-09-19T08:37:19.774270+0000","last_peered":"2024-09-19T08:37:19.774270+0000","last_clean":"2024-09-19T08:37:19.774270+0000","last_became_active":"2024-09-19T08:37:13.318999+0000","last_became_peered":"2024-09-19T08:37:13.318999+0000","last_unstale":"2024-09-19T08:37:19.774270+0000","last_undegraded":"2024-09-19T08:37:19.774270+0000","last_fullsized":"2024-09-19T08:37:19.774270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:56.050383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774520+0000","last_change":"2024-09-19T08:37:13.328264+0000","last_active":"2024-09-19T08:37:19.774520+0000","last_peered":"2024-09-19T08:37:19.774520+0000","last_clean":"2024-09-19T08:37:19.774520+0000","last_became_active":"2024-09-19T08:37:13.327999+0000","last_became_peered":"2024-09-19T08:37:13.327999+0000","last_unstale":"2024-09-19T08:37:19.774520+0000","last_undegraded":"2024-09-19T08:37:19.774520+0000","last_fullsized":"2024-09-19T08:37:19.774520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:34.222102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773805+0000","last_change":"2024-09-19T08:37:13.315873+0000","last_active":"2024-09-19T08:37:19.773805+0000","last_peered":"2024-09-19T08:37:19.773805+0000","last_clean":"2024-09-19T08:37:19.773805+0000","last_became_active":"2024-09-19T08:37:13.315587+0000","last_became_peered":"2024-09-19T08:37:13.315587+0000","last_unstale":"2024-09-19T08:37:19.773805+0000","last_undegraded":"2024-09-19T08:37:19.773805+0000","last_fullsized":"2024-09-19T08:37:19.773805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:18.493336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582687+0000","last_change":"2024-09-19T08:37:13.329601+0000","last_active":"2024-09-19T08:37:19.582687+0000","last_peered":"2024-09-19T08:37:19.582687+0000","last_clean":"2024-09-19T08:37:19.582687+0000","last_became_active":"2024-09-19T08:37:13.328264+0000","last_became_peered":"2024-09-19T08:37:13.328264+0000","last_unstale":"2024-09-19T08:37:19.582687+0000","last_undegraded":"2024-09-19T08:37:19.582687+0000","last_fullsized":"2024-09-19T08:37:19.582687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:26.402913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582754+0000","last_change":"2024-09-19T08:37:13.327064+0000","last_active":"2024-09-19T08:37:19.582754+0000","last_peered":"2024-09-19T08:37:19.582754+0000","last_clean":"2024-09-19T08:37:19.582754+0000","last_became_active":"2024-09-19T08:37:13.326770+0000","last_became_peered":"2024-09-19T08:37:13.326770+0000","last_unstale":"2024-09-19T08:37:19.582754+0000","last_undegraded":"2024-09-19T08:37:19.582754+0000","last_fullsized":"2024-09-19T08:37:19.582754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:25.894361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775126+0000","last_change":"2024-09-19T08:37:13.330656+0000","last_active":"2024-09-19T08:37:19.775126+0000","last_peered":"2024-09-19T08:37:19.775126+0000","last_clean":"2024-09-19T08:37:19.775126+0000","last_became_active":"2024-09-19T08:37:13.330120+0000","last_became_peered":"2024-09-19T08:37:13.330120+0000","last_unstale":"2024-09-19T08:37:19.775126+0000","last_undegraded":"2024-09-19T08:37:19.775126+0000","last_fullsized":"2024-09-19T08:37:19.775126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:51.787710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":105614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":696074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":696052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":105738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:37:33.653 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T08:37:33.654 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T08:37:33.654 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-19T08:37:33.654 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-19T08:37:33.654 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-19T08:37:33.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.786+0000 7f2c2b674640 1 Processor -- start 2024-09-19T08:37:33.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.786+0000 7f2c2b674640 1 -- start start 2024-09-19T08:37:33.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.787+0000 7f2c2b674640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c240d21f0 0x7f2c240d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:33.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.787+0000 7f2c2b674640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2c24072590 0x7f2c2406d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:33.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.787+0000 7f2c2b674640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c240d2b10 con 0x7f2c24143a60 2024-09-19T08:37:33.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.787+0000 7f2c2b674640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2c24141750 con 0x7f2c24072590 2024-09-19T08:37:33.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.787+0000 7f2c2b674640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f2c241620b0 con 0x7f2c240d21f0 2024-09-19T08:37:33.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.787+0000 7f2c28c0f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2c24072590 0x7f2c2406d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:33.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.787+0000 7f2c28c0f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2c24072590 0x7f2c2406d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33988/0 (socket says 172.21.15.117:33988) 2024-09-19T08:37:33.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.787+0000 7f2c28c0f640 1 -- 172.21.15.117:0/79187713 learned_addr learned my addr 172.21.15.117:0/79187713 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:33.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.788+0000 7f2c29410640 1 --2- 172.21.15.117:0/79187713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c240d21f0 0x7f2c240d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:33.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.788+0000 7f2c28c0f640 1 -- 172.21.15.117:0/79187713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c240d21f0 msgr2=0x7f2c240d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:33.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.788+0000 7f2c28c0f640 1 --2- 172.21.15.117:0/79187713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c240d21f0 0x7f2c240d25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.788+0000 7f2c28c0f640 1 -- 172.21.15.117:0/79187713 >> v1:172.21.15.146:6789/0 conn(0x7f2c24143a60 legacy=0x7f2c24143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:33.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.788+0000 7f2c28c0f640 1 -- 172.21.15.117:0/79187713 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c24162370 con 0x7f2c24072590 2024-09-19T08:37:33.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.788+0000 7f2c28c0f640 1 --2- 172.21.15.117:0/79187713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c24072590 0x7f2c2406d0e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009870 tx=0x7f2c1802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cacba394d3cc47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:33.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.788+0000 7f2c23fff640 1 -- 172.21.15.117:0/79187713 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c18037070 con 0x7f2c24072590 2024-09-19T08:37:33.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.788+0000 7f2c23fff640 1 -- 172.21.15.117:0/79187713 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c18032440 con 0x7f2c24072590 2024-09-19T08:37:33.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.789+0000 7f2c23fff640 1 -- 172.21.15.117:0/79187713 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c18032810 con 0x7f2c24072590 2024-09-19T08:37:33.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.789+0000 7f2c2b674640 1 -- 172.21.15.117:0/79187713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c24072590 msgr2=0x7f2c2406d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:33.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.789+0000 7f2c2b674640 1 --2- 172.21.15.117:0/79187713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c24072590 0x7f2c2406d0e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009870 tx=0x7f2c1802a180 comp rx=0 tx=0).stop 2024-09-19T08:37:33.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.789+0000 7f2c2b674640 1 -- 172.21.15.117:0/79187713 shutdown_connections 2024-09-19T08:37:33.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.789+0000 7f2c2b674640 1 --2- 172.21.15.117:0/79187713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c24072590 0x7f2c2406d0e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.789+0000 7f2c2b674640 1 --2- 172.21.15.117:0/79187713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c240d21f0 0x7f2c240d25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.789+0000 7f2c2b674640 1 -- 172.21.15.117:0/79187713 >> 172.21.15.117:0/79187713 conn(0x7f2c240b3ed0 msgr2=0x7f2c240b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:33.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.789+0000 7f2c2b674640 1 -- 172.21.15.117:0/79187713 shutdown_connections 2024-09-19T08:37:33.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.789+0000 7f2c2b674640 1 -- 172.21.15.117:0/79187713 wait complete. 2024-09-19T08:37:33.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.790+0000 7f2c2b674640 1 Processor -- start 2024-09-19T08:37:33.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.790+0000 7f2c2b674640 1 -- start start 2024-09-19T08:37:33.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.791+0000 7f2c2b674640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c24072590 0x7f2c24140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:33.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.791+0000 7f2c2b674640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c240d21f0 0x7f2c240c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:33.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.791+0000 7f2c2b674640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c24143a60 0x7f2c240c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:33.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.791+0000 7f2c2b674640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2c24162c10 con 0x7f2c240d21f0 2024-09-19T08:37:33.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.791+0000 7f2c2b674640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2c24162930 con 0x7f2c24072590 2024-09-19T08:37:33.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.791+0000 7f2c2b674640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f2c2406d620 con 0x7f2c24143a60 2024-09-19T08:37:33.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.791+0000 7f2c28c0f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c240d21f0 0x7f2c240c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:33.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.791+0000 7f2c28c0f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c240d21f0 0x7f2c240c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33996/0 (socket says 172.21.15.117:33996) 2024-09-19T08:37:33.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.791+0000 7f2c28c0f640 1 -- 172.21.15.117:0/3788859834 learned_addr learned my addr 172.21.15.117:0/3788859834 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:33.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.791+0000 7f2c29410640 1 --2- 172.21.15.117:0/3788859834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c24072590 0x7f2c24140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:33.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.791+0000 7f2c29c11640 1 --2- 172.21.15.117:0/3788859834 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c24143a60 0x7f2c240c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:33.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.791+0000 7f2c28c0f640 1 -- 172.21.15.117:0/3788859834 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c24143a60 msgr2=0x7f2c240c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:33.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.791+0000 7f2c28c0f640 1 --2- 172.21.15.117:0/3788859834 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c24143a60 0x7f2c240c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.791+0000 7f2c28c0f640 1 -- 172.21.15.117:0/3788859834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c24072590 msgr2=0x7f2c24140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:33.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.791+0000 7f2c28c0f640 1 --2- 172.21.15.117:0/3788859834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c24072590 0x7f2c24140ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:33.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.791+0000 7f2c28c0f640 1 -- 172.21.15.117:0/3788859834 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c24141220 con 0x7f2c240d21f0 2024-09-19T08:37:33.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.792+0000 7f2c28c0f640 1 --2- 172.21.15.117:0/3788859834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c240d21f0 0x7f2c240c8190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2c18000c00 tx=0x7f2c180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:33.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.792+0000 7f2c21ffb640 1 -- 172.21.15.117:0/3788859834 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c18041070 con 0x7f2c240d21f0 2024-09-19T08:37:33.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.792+0000 7f2c21ffb640 1 -- 172.21.15.117:0/3788859834 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c1803c890 con 0x7f2c240d21f0 2024-09-19T08:37:33.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.792+0000 7f2c2b674640 1 -- 172.21.15.117:0/3788859834 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c2415d1c0 con 0x7f2c240d21f0 2024-09-19T08:37:33.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.792+0000 7f2c21ffb640 1 -- 172.21.15.117:0/3788859834 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c18037040 con 0x7f2c240d21f0 2024-09-19T08:37:33.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.792+0000 7f2c2b674640 1 -- 172.21.15.117:0/3788859834 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c240b6b70 con 0x7f2c240d21f0 2024-09-19T08:37:33.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.793+0000 7f2c2b674640 1 -- 172.21.15.117:0/3788859834 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c240b6680 con 0x7f2c240d21f0 2024-09-19T08:37:33.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.793+0000 7f2c21ffb640 1 -- 172.21.15.117:0/3788859834 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2c18044070 con 0x7f2c240d21f0 2024-09-19T08:37:33.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.794+0000 7f2c21ffb640 1 --2- 172.21.15.117:0/3788859834 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2c1006c2b0 0x7f2c1006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:33.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.794+0000 7f2c21ffb640 1 -- 172.21.15.117:0/3788859834 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2c180ac250 con 0x7f2c240d21f0 2024-09-19T08:37:33.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.794+0000 7f2c29410640 1 --2- 172.21.15.117:0/3788859834 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2c1006c2b0 0x7f2c1006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:33.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.795+0000 7f2c29410640 1 --2- 172.21.15.117:0/3788859834 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2c1006c2b0 0x7f2c1006e770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2c14003b80 tx=0x7f2c140098d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:33.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:33.798+0000 7f2c21ffb640 1 -- 172.21.15.117:0/3788859834 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2c24141220 con 0x7f2c240d21f0 2024-09-19T08:37:34.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.009+0000 7f2c2b674640 1 -- 172.21.15.117:0/3788859834 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f2c24158c30 con 0x7f2c240d21f0 2024-09-19T08:37:34.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.012+0000 7f2c21ffb640 1 -- 172.21.15.117:0/3788859834 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+173506 (secure 0 0 0) 0x7f2c1807a150 con 0x7f2c240d21f0 2024-09-19T08:37:34.014 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:34.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.015+0000 7f2c2b674640 1 -- 172.21.15.117:0/3788859834 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2c1006c2b0 msgr2=0x7f2c1006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.015+0000 7f2c2b674640 1 --2- 172.21.15.117:0/3788859834 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2c1006c2b0 0x7f2c1006e770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2c14003b80 tx=0x7f2c140098d0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.015+0000 7f2c2b674640 1 -- 172.21.15.117:0/3788859834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c240d21f0 msgr2=0x7f2c240c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.015+0000 7f2c2b674640 1 --2- 172.21.15.117:0/3788859834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c240d21f0 0x7f2c240c8190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2c18000c00 tx=0x7f2c180046c0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.015+0000 7f2c2b674640 1 -- 172.21.15.117:0/3788859834 shutdown_connections 2024-09-19T08:37:34.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.015+0000 7f2c2b674640 1 --2- 172.21.15.117:0/3788859834 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2c1006c2b0 0x7f2c1006e770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.015+0000 7f2c2b674640 1 --2- 172.21.15.117:0/3788859834 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c24143a60 0x7f2c240c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.015+0000 7f2c2b674640 1 --2- 172.21.15.117:0/3788859834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c240d21f0 0x7f2c240c8190 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.015+0000 7f2c2b674640 1 --2- 172.21.15.117:0/3788859834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c24072590 0x7f2c24140ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.015+0000 7f2c2b674640 1 -- 172.21.15.117:0/3788859834 >> 172.21.15.117:0/3788859834 conn(0x7f2c240b3ed0 msgr2=0x7f2c240b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:34.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.015+0000 7f2c2b674640 1 -- 172.21.15.117:0/3788859834 shutdown_connections 2024-09-19T08:37:34.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.015+0000 7f2c2b674640 1 -- 172.21.15.117:0/3788859834 wait complete. 2024-09-19T08:37:34.025 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":948175974},{"type":"v1","addr":"172.21.15.146:6833","nonce":948175974}]},"active_addr":"172.21.15.146:6833/948175974","active_change":"2024-09-19T08:36:53.832629+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":77102937}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":817291443}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":2874189747}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":1374410001}]}]} 2024-09-19T08:37:34.030 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-19T08:37:34.031 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-19T08:37:34.031 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:37:34.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.129+0000 7f7f7c9ed640 1 Processor -- start 2024-09-19T08:37:34.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.129+0000 7f7f7c9ed640 1 -- start start 2024-09-19T08:37:34.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.130+0000 7f7f7c9ed640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f780d0070 0x7f7f7815f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.130+0000 7f7f7c9ed640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f780d1b10 con 0x7f7f780d4130 2024-09-19T08:37:34.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.130+0000 7f7f7c9ed640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f780cf2b0 con 0x7f7f7815f0d0 2024-09-19T08:37:34.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.130+0000 7f7f7c9ed640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f7f780cf590 con 0x7f7f780d0070 2024-09-19T08:37:34.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.130+0000 7f7f76d9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f7f780d4130 0x7f7f780d4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:33634/0 (socket says 172.21.15.117:33634) 2024-09-19T08:37:34.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.130+0000 7f7f76d9d640 1 -- 172.21.15.117:0/1783784667 learned_addr learned my addr 172.21.15.117:0/1783784667 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:34.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f7559a640 1 -- 172.21.15.117:0/1783784667 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2786322788 0 0) 0x7f7f780d1b10 con 0x7f7f780d4130 2024-09-19T08:37:34.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f75d9b640 1 --2- 172.21.15.117:0/1783784667 >> v2:172.21.15.146:3300/0 conn(0x7f7f780d0070 0x7f7f7815f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f7559a640 1 -- 172.21.15.117:0/1783784667 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f60003520 con 0x7f7f780d4130 2024-09-19T08:37:34.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f7559a640 1 -- 172.21.15.117:0/1783784667 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2818121190 0 0) 0x7f7f60003520 con 0x7f7f780d4130 2024-09-19T08:37:34.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f7559a640 1 -- 172.21.15.117:0/1783784667 >> v2:172.21.15.146:3300/0 conn(0x7f7f780d0070 msgr2=0x7f7f7815f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:34.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f7559a640 1 --2- 172.21.15.117:0/1783784667 >> v2:172.21.15.146:3300/0 conn(0x7f7f780d0070 0x7f7f7815f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f7559a640 1 -- 172.21.15.117:0/1783784667 >> v1:172.21.15.146:6789/0 conn(0x7f7f7815f0d0 legacy=0x7f7f780d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f7559a640 1 -- 172.21.15.117:0/1783784667 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f780cf870 con 0x7f7f780d4130 2024-09-19T08:37:34.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f7559a640 1 -- 172.21.15.117:0/1783784667 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f7f70001a10 con 0x7f7f780d4130 2024-09-19T08:37:34.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f7559a640 1 -- 172.21.15.117:0/1783784667 >> v1:172.21.15.117:6789/0 conn(0x7f7f780d4130 legacy=0x7f7f780d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f7559a640 1 --2- 172.21.15.117:0/1783784667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f600039b0 0x7f7f60003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f7559a640 1 --2- 172.21.15.117:0/1783784667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f60004800 0x7f7f60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f7559a640 1 --2- 172.21.15.117:0/1783784667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f600052e0 0x7f7f6000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f7559a640 1 -- 172.21.15.117:0/1783784667 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7f780cf590 con 0x7f7f600039b0 2024-09-19T08:37:34.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f7559a640 1 -- 172.21.15.117:0/1783784667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6000c1b0 con 0x7f7f600052e0 2024-09-19T08:37:34.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f7559a640 1 -- 172.21.15.117:0/1783784667 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f7f6000c3b0 con 0x7f7f60004800 2024-09-19T08:37:34.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f7659c640 1 --2- 172.21.15.117:0/1783784667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f600039b0 0x7f7f60003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f75d9b640 1 --2- 172.21.15.117:0/1783784667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f60004800 0x7f7f60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f76d9d640 1 --2- 172.21.15.117:0/1783784667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f600052e0 0x7f7f6000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f7659c640 1 -- 172.21.15.117:0/1783784667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f60004800 msgr2=0x7f7f60004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:34.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f7659c640 1 --2- 172.21.15.117:0/1783784667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f60004800 0x7f7f60004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f7659c640 1 -- 172.21.15.117:0/1783784667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f600052e0 msgr2=0x7f7f6000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:34.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f7659c640 1 --2- 172.21.15.117:0/1783784667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f600052e0 0x7f7f6000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f76d9d640 1 -- 172.21.15.117:0/1783784667 reap_dead start 2024-09-19T08:37:34.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.131+0000 7f7f7659c640 1 -- 172.21.15.117:0/1783784667 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f60003520 con 0x7f7f600039b0 2024-09-19T08:37:34.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.132+0000 7f7f7659c640 1 --2- 172.21.15.117:0/1783784667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f600039b0 0x7f7f60003dd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7f68001720 tx=0x7f7f60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20560a9ee04ed1c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.132+0000 7f7f7559a640 1 -- 172.21.15.117:0/1783784667 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f68001370 con 0x7f7f600039b0 2024-09-19T08:37:34.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.132+0000 7f7f7559a640 1 -- 172.21.15.117:0/1783784667 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f680052d0 con 0x7f7f600039b0 2024-09-19T08:37:34.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.132+0000 7f7f7559a640 1 -- 172.21.15.117:0/1783784667 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6802ab90 con 0x7f7f600039b0 2024-09-19T08:37:34.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.133+0000 7f7f7c9ed640 1 -- 172.21.15.117:0/1783784667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f600039b0 msgr2=0x7f7f60003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.133+0000 7f7f7c9ed640 1 --2- 172.21.15.117:0/1783784667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f600039b0 0x7f7f60003dd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7f68001720 tx=0x7f7f60005830 comp rx=0 tx=0).stop 2024-09-19T08:37:34.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.133+0000 7f7f7c9ed640 1 -- 172.21.15.117:0/1783784667 shutdown_connections 2024-09-19T08:37:34.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.133+0000 7f7f7c9ed640 1 --2- 172.21.15.117:0/1783784667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f600039b0 0x7f7f60003dd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.133+0000 7f7f7c9ed640 1 -- 172.21.15.117:0/1783784667 >> 172.21.15.117:0/1783784667 conn(0x7f7f7809d760 msgr2=0x7f7f7808bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:34.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.133+0000 7f7f7c9ed640 1 -- 172.21.15.117:0/1783784667 shutdown_connections 2024-09-19T08:37:34.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.133+0000 7f7f7c9ed640 1 -- 172.21.15.117:0/1783784667 wait complete. 2024-09-19T08:37:34.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.134+0000 7f7f7c9ed640 1 Processor -- start 2024-09-19T08:37:34.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.134+0000 7f7f7c9ed640 1 -- start start 2024-09-19T08:37:34.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.135+0000 7f7f7c9ed640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f600039b0 0x7f7f78154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.135+0000 7f7f7c9ed640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f780b7bc0 0x7f7f780cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.135+0000 7f7f7c9ed640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f78159720 0x7f7f78159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.135+0000 7f7f7c9ed640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7815f4b0 con 0x7f7f600039b0 2024-09-19T08:37:34.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.135+0000 7f7f7c9ed640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7f780cef60 con 0x7f7f78159720 2024-09-19T08:37:34.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.135+0000 7f7f7c9ed640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f7f7815f630 con 0x7f7f780b7bc0 2024-09-19T08:37:34.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.135+0000 7f7f7659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f600039b0 0x7f7f78154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.135+0000 7f7f7659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f600039b0 0x7f7f78154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34012/0 (socket says 172.21.15.117:34012) 2024-09-19T08:37:34.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.135+0000 7f7f7659c640 1 -- 172.21.15.117:0/3176218151 learned_addr learned my addr 172.21.15.117:0/3176218151 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:34.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.135+0000 7f7f7659c640 1 -- 172.21.15.117:0/3176218151 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f780b7bc0 msgr2=0x7f7f780cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.135+0000 7f7f7659c640 1 --2- 172.21.15.117:0/3176218151 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f780b7bc0 0x7f7f780cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.135+0000 7f7f7659c640 1 -- 172.21.15.117:0/3176218151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f78159720 msgr2=0x7f7f78159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.135+0000 7f7f7659c640 1 --2- 172.21.15.117:0/3176218151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f78159720 0x7f7f78159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.135+0000 7f7f7659c640 1 -- 172.21.15.117:0/3176218151 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f781f4820 con 0x7f7f600039b0 2024-09-19T08:37:34.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.135+0000 7f7f7659c640 1 --2- 172.21.15.117:0/3176218151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f600039b0 0x7f7f78154a10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7f68000c00 tx=0x7f7f68001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.136+0000 7f7f66ffd640 1 -- 172.21.15.117:0/3176218151 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6803f030 con 0x7f7f600039b0 2024-09-19T08:37:34.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.136+0000 7f7f66ffd640 1 -- 172.21.15.117:0/3176218151 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f68005480 con 0x7f7f600039b0 2024-09-19T08:37:34.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.136+0000 7f7f7c9ed640 1 -- 172.21.15.117:0/3176218151 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f780cbe20 con 0x7f7f600039b0 2024-09-19T08:37:34.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.136+0000 7f7f66ffd640 1 -- 172.21.15.117:0/3176218151 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f68037040 con 0x7f7f600039b0 2024-09-19T08:37:34.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.136+0000 7f7f7c9ed640 1 -- 172.21.15.117:0/3176218151 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f780cc3e0 con 0x7f7f600039b0 2024-09-19T08:37:34.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.137+0000 7f7f7c9ed640 1 -- 172.21.15.117:0/3176218151 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f780d4560 con 0x7f7f600039b0 2024-09-19T08:37:34.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.137+0000 7f7f66ffd640 1 -- 172.21.15.117:0/3176218151 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7f68042070 con 0x7f7f600039b0 2024-09-19T08:37:34.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.138+0000 7f7f66ffd640 1 --2- 172.21.15.117:0/3176218151 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7f5806c2e0 0x7f7f5806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.138+0000 7f7f66ffd640 1 -- 172.21.15.117:0/3176218151 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7f680aacd0 con 0x7f7f600039b0 2024-09-19T08:37:34.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.138+0000 7f7f75d9b640 1 --2- 172.21.15.117:0/3176218151 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7f5806c2e0 0x7f7f5806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.138+0000 7f7f75d9b640 1 --2- 172.21.15.117:0/3176218151 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7f5806c2e0 0x7f7f5806e7a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c006b10 tx=0x7f7f6c006aa0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.142+0000 7f7f66ffd640 1 -- 172.21.15.117:0/3176218151 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7f680433b0 con 0x7f7f600039b0 2024-09-19T08:37:34.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.307+0000 7f7f7c9ed640 1 -- 172.21.15.117:0/3176218151 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f7806cf30 con 0x7f7f600039b0 2024-09-19T08:37:34.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.308+0000 7f7f66ffd640 1 -- 172.21.15.117:0/3176218151 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18650 (secure 0 0 0) 0x7f7f68079070 con 0x7f7f600039b0 2024-09-19T08:37:34.308 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:34.309 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":26,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:37:17.670150+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:37:10.463000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:37:11.619440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:37:15.342435+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:37:34.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.310+0000 7f7f7c9ed640 1 -- 172.21.15.117:0/3176218151 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7f5806c2e0 msgr2=0x7f7f5806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.310+0000 7f7f7c9ed640 1 --2- 172.21.15.117:0/3176218151 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7f5806c2e0 0x7f7f5806e7a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c006b10 tx=0x7f7f6c006aa0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.310+0000 7f7f7c9ed640 1 -- 172.21.15.117:0/3176218151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f600039b0 msgr2=0x7f7f78154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.310+0000 7f7f7c9ed640 1 --2- 172.21.15.117:0/3176218151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f600039b0 0x7f7f78154a10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7f68000c00 tx=0x7f7f68001120 comp rx=0 tx=0).stop 2024-09-19T08:37:34.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.310+0000 7f7f7c9ed640 1 -- 172.21.15.117:0/3176218151 shutdown_connections 2024-09-19T08:37:34.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.310+0000 7f7f7c9ed640 1 --2- 172.21.15.117:0/3176218151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f78159720 0x7f7f78159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.310+0000 7f7f7c9ed640 1 --2- 172.21.15.117:0/3176218151 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7f5806c2e0 0x7f7f5806e7a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.310+0000 7f7f7c9ed640 1 --2- 172.21.15.117:0/3176218151 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f780b7bc0 0x7f7f780cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.310+0000 7f7f7c9ed640 1 --2- 172.21.15.117:0/3176218151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f600039b0 0x7f7f78154a10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.310+0000 7f7f7c9ed640 1 -- 172.21.15.117:0/3176218151 >> 172.21.15.117:0/3176218151 conn(0x7f7f7809d760 msgr2=0x7f7f780d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:34.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.310+0000 7f7f7c9ed640 1 -- 172.21.15.117:0/3176218151 shutdown_connections 2024-09-19T08:37:34.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.310+0000 7f7f7c9ed640 1 -- 172.21.15.117:0/3176218151 wait complete. 2024-09-19T08:37:34.322 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-19T08:37:34.322 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:37:34.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.422+0000 7f16c6630640 1 Processor -- start 2024-09-19T08:37:34.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.422+0000 7f16c6630640 1 -- start start 2024-09-19T08:37:34.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.423+0000 7f16c6630640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f16c00d4370 0x7f16c00d4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.423+0000 7f16c6630640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16c00d1880 con 0x7f16c015e2a0 2024-09-19T08:37:34.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.423+0000 7f16c6630640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16c00d1b60 con 0x7f16c015e680 2024-09-19T08:37:34.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.423+0000 7f16c6630640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f16c00cf2d0 con 0x7f16c00d4370 2024-09-19T08:37:34.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.423+0000 7f16bffff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f16c015e2a0 0x7f16c006d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:54770/0 (socket says 172.21.15.117:54770) 2024-09-19T08:37:34.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.423+0000 7f16c4bcd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f16c00d4370 0x7f16c00d4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.423+0000 7f16bffff640 1 -- 172.21.15.117:0/2291506721 learned_addr learned my addr 172.21.15.117:0/2291506721 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:34.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.423+0000 7f16c4bcd640 1 -- 172.21.15.117:0/2291506721 >> v1:172.21.15.146:6789/0 conn(0x7f16c015e680 legacy=0x7f16c00cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:34.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.423+0000 7f16c4bcd640 1 -- 172.21.15.117:0/2291506721 >> v1:172.21.15.117:6789/0 conn(0x7f16c015e2a0 legacy=0x7f16c006d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.423+0000 7f16beffd640 1 -- 172.21.15.117:0/2291506721 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3469655417 0 0) 0x7f16c00d1880 con 0x7f16c015e2a0 2024-09-19T08:37:34.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.423+0000 7f16c4bcd640 1 -- 172.21.15.117:0/2291506721 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c00cf5b0 con 0x7f16c00d4370 2024-09-19T08:37:34.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.424+0000 7f16c4bcd640 1 --2- 172.21.15.117:0/2291506721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16c00d4370 0x7f16c00d4820 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f16b8009d90 tx=0x7f16b802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ab7d91f2d716ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.424+0000 7f16beffd640 1 -- 172.21.15.117:0/2291506721 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b8007740 con 0x7f16c00d4370 2024-09-19T08:37:34.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.424+0000 7f16beffd640 1 -- 172.21.15.117:0/2291506721 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b80078e0 con 0x7f16c00d4370 2024-09-19T08:37:34.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.424+0000 7f16beffd640 1 -- 172.21.15.117:0/2291506721 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b8007cb0 con 0x7f16c00d4370 2024-09-19T08:37:34.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.425+0000 7f16c6630640 1 -- 172.21.15.117:0/2291506721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16c00d4370 msgr2=0x7f16c00d4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.425+0000 7f16c6630640 1 --2- 172.21.15.117:0/2291506721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16c00d4370 0x7f16c00d4820 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f16b8009d90 tx=0x7f16b802a6a0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.425+0000 7f16c6630640 1 -- 172.21.15.117:0/2291506721 shutdown_connections 2024-09-19T08:37:34.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.425+0000 7f16c6630640 1 --2- 172.21.15.117:0/2291506721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16c00d4370 0x7f16c00d4820 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.425+0000 7f16c6630640 1 -- 172.21.15.117:0/2291506721 >> 172.21.15.117:0/2291506721 conn(0x7f16c009d760 msgr2=0x7f16c008bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:34.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.425+0000 7f16c6630640 1 -- 172.21.15.117:0/2291506721 shutdown_connections 2024-09-19T08:37:34.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.425+0000 7f16c6630640 1 -- 172.21.15.117:0/2291506721 wait complete. 2024-09-19T08:37:34.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.426+0000 7f16c6630640 1 Processor -- start 2024-09-19T08:37:34.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.426+0000 7f16c6630640 1 -- start start 2024-09-19T08:37:34.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.427+0000 7f16c6630640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16c00d4370 0x7f16c00c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.427+0000 7f16c6630640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16c015e2a0 0x7f16c01f7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.427+0000 7f16c6630640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16c015e680 0x7f16c00c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.427+0000 7f16c6630640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f16c006dcb0 con 0x7f16c00d4370 2024-09-19T08:37:34.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.427+0000 7f16c6630640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f16c006db30 con 0x7f16c015e2a0 2024-09-19T08:37:34.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.427+0000 7f16c6630640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f16c00d01e0 con 0x7f16c015e680 2024-09-19T08:37:34.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.427+0000 7f16bffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16c00d4370 0x7f16c00c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.427+0000 7f16bffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16c00d4370 0x7f16c00c98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34602/0 (socket says 172.21.15.117:34602) 2024-09-19T08:37:34.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.427+0000 7f16bffff640 1 -- 172.21.15.117:0/2075485291 learned_addr learned my addr 172.21.15.117:0/2075485291 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:34.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.427+0000 7f16bf7fe640 1 --2- 172.21.15.117:0/2075485291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16c015e2a0 0x7f16c01f7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.427+0000 7f16bffff640 1 -- 172.21.15.117:0/2075485291 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16c015e680 msgr2=0x7f16c00c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.427+0000 7f16bffff640 1 --2- 172.21.15.117:0/2075485291 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16c015e680 0x7f16c00c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.427+0000 7f16bffff640 1 -- 172.21.15.117:0/2075485291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16c015e2a0 msgr2=0x7f16c01f7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.427+0000 7f16bffff640 1 --2- 172.21.15.117:0/2075485291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16c015e2a0 0x7f16c01f7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.427+0000 7f16bffff640 1 -- 172.21.15.117:0/2075485291 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c00ca030 con 0x7f16c00d4370 2024-09-19T08:37:34.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.427+0000 7f16bf7fe640 1 --2- 172.21.15.117:0/2075485291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16c015e2a0 0x7f16c01f7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:34.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.427+0000 7f16bffff640 1 --2- 172.21.15.117:0/2075485291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16c00d4370 0x7f16c00c98e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f16b000c430 tx=0x7f16b000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.427+0000 7f16bcff9640 1 -- 172.21.15.117:0/2075485291 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b00074e0 con 0x7f16c00d4370 2024-09-19T08:37:34.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.428+0000 7f16bcff9640 1 -- 172.21.15.117:0/2075485291 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b00047e0 con 0x7f16c00d4370 2024-09-19T08:37:34.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.428+0000 7f16bcff9640 1 -- 172.21.15.117:0/2075485291 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b0004bd0 con 0x7f16c00d4370 2024-09-19T08:37:34.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.428+0000 7f16c6630640 1 -- 172.21.15.117:0/2075485291 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c00ca310 con 0x7f16c00d4370 2024-09-19T08:37:34.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.428+0000 7f16c6630640 1 -- 172.21.15.117:0/2075485291 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c00ca8d0 con 0x7f16c00d4370 2024-09-19T08:37:34.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.428+0000 7f16c6630640 1 -- 172.21.15.117:0/2075485291 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16c00d4820 con 0x7f16c00d4370 2024-09-19T08:37:34.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.429+0000 7f16bcff9640 1 -- 172.21.15.117:0/2075485291 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f16b0011070 con 0x7f16c00d4370 2024-09-19T08:37:34.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.429+0000 7f16bcff9640 1 --2- 172.21.15.117:0/2075485291 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f16ac06c2b0 0x7f16ac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.429+0000 7f16bcff9640 1 -- 172.21.15.117:0/2075485291 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f16b008b4c0 con 0x7f16c00d4370 2024-09-19T08:37:34.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.430+0000 7f16bf7fe640 1 --2- 172.21.15.117:0/2075485291 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f16ac06c2b0 0x7f16ac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.430+0000 7f16bf7fe640 1 --2- 172.21.15.117:0/2075485291 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f16ac06c2b0 0x7f16ac06e770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f16c0161b00 tx=0x7f16b4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.434+0000 7f16bcff9640 1 -- 172.21.15.117:0/2075485291 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f16b000e280 con 0x7f16c00d4370 2024-09-19T08:37:34.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.599+0000 7f16c6630640 1 -- 172.21.15.117:0/2075485291 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16c006cf90 con 0x7f16c00d4370 2024-09-19T08:37:34.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.601+0000 7f16bcff9640 1 -- 172.21.15.117:0/2075485291 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18650 (secure 0 0 0) 0x7f16b0059870 con 0x7f16c00d4370 2024-09-19T08:37:34.601 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:34.601 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":26,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:37:17.670150+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:37:10.463000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:37:11.619440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:37:15.342435+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:37:34.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.603+0000 7f16c6630640 1 -- 172.21.15.117:0/2075485291 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f16ac06c2b0 msgr2=0x7f16ac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.603+0000 7f16c6630640 1 --2- 172.21.15.117:0/2075485291 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f16ac06c2b0 0x7f16ac06e770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f16c0161b00 tx=0x7f16b4009040 comp rx=0 tx=0).stop 2024-09-19T08:37:34.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.603+0000 7f16c6630640 1 -- 172.21.15.117:0/2075485291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16c00d4370 msgr2=0x7f16c00c98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.603+0000 7f16c6630640 1 --2- 172.21.15.117:0/2075485291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16c00d4370 0x7f16c00c98e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f16b000c430 tx=0x7f16b000c8f0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.603+0000 7f16c6630640 1 -- 172.21.15.117:0/2075485291 shutdown_connections 2024-09-19T08:37:34.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.603+0000 7f16c6630640 1 --2- 172.21.15.117:0/2075485291 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f16ac06c2b0 0x7f16ac06e770 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.603+0000 7f16c6630640 1 --2- 172.21.15.117:0/2075485291 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16c015e680 0x7f16c00c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.603+0000 7f16c6630640 1 --2- 172.21.15.117:0/2075485291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16c015e2a0 0x7f16c01f7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.603+0000 7f16c6630640 1 --2- 172.21.15.117:0/2075485291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16c00d4370 0x7f16c00c98e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.603+0000 7f16c6630640 1 -- 172.21.15.117:0/2075485291 >> 172.21.15.117:0/2075485291 conn(0x7f16c009d760 msgr2=0x7f16c0161f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:34.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.603+0000 7f16c6630640 1 -- 172.21.15.117:0/2075485291 shutdown_connections 2024-09-19T08:37:34.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.603+0000 7f16c6630640 1 -- 172.21.15.117:0/2075485291 wait complete. 2024-09-19T08:37:34.614 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-19T08:37:34.615 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-19T08:37:34.615 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-19T08:37:34.615 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-19T08:37:34.616 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-19T08:37:34.616 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-19T08:37:34.617 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-19T08:37:34.617 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-19T08:37:34.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.781+0000 7fb7b0b3b640 1 Processor -- start 2024-09-19T08:37:34.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.782+0000 7fb7b0b3b640 1 -- start start 2024-09-19T08:37:34.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.783+0000 7fb7b0b3b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb7ac145ed0 0x7fb7ac0c7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.783+0000 7fb7b0b3b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb7ac0c75a0 0x7fb7ac163290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.783+0000 7fb7b0b3b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7ac0cfb70 con 0x7fb7ac0b4220 2024-09-19T08:37:34.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.783+0000 7fb7b0b3b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb7ac1668a0 con 0x7fb7ac0c75a0 2024-09-19T08:37:34.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.783+0000 7fb7b0b3b640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fb7ac166b80 con 0x7fb7ac145ed0 2024-09-19T08:37:34.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.783+0000 7f78595c5640 1 Processor -- start 2024-09-19T08:37:34.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.783+0000 7f8f32898640 1 Processor -- start 2024-09-19T08:37:34.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.784+0000 7f78595c5640 1 -- start start 2024-09-19T08:37:34.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.784+0000 7fb7aad9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb7ac0c75a0 0x7fb7ac163290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.784+0000 7f86fb59e640 1 Processor -- start 2024-09-19T08:37:34.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.784+0000 7f86fb59e640 1 -- start start 2024-09-19T08:37:34.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.784+0000 7fb7a9d9b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb7ac145ed0 0x7fb7ac0c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.784+0000 7fb7a9d9b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb7ac145ed0 0x7fb7ac0c7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.117:48092/0 (socket says 172.21.15.117:48092) 2024-09-19T08:37:34.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.784+0000 7fb7aad9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb7ac0c75a0 0x7fb7ac163290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34610/0 (socket says 172.21.15.117:34610) 2024-09-19T08:37:34.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.784+0000 7fb7aad9d640 1 -- 172.21.15.117:0/826592870 learned_addr learned my addr 172.21.15.117:0/826592870 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:34.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.784+0000 7f8f32898640 1 -- start start 2024-09-19T08:37:34.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7fe80eed0640 1 Processor -- start 2024-09-19T08:37:34.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7f78595c5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f78540b50f0 0x7f78540b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7f78595c5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78540aedf0 0x7f7854167d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7f78595c5640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78540ad900 con 0x7f78540b3600 2024-09-19T08:37:34.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7f78595c5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7854147ee0 con 0x7f78540b50f0 2024-09-19T08:37:34.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7f78595c5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f78540726f0 con 0x7f78540aedf0 2024-09-19T08:37:34.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7fb7aad9d640 1 -- 172.21.15.117:0/826592870 >> v2:172.21.15.146:3300/0 conn(0x7fb7ac145ed0 msgr2=0x7fb7ac0c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:34.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7fb7aad9d640 1 --2- 172.21.15.117:0/826592870 >> v2:172.21.15.146:3300/0 conn(0x7fb7ac145ed0 0x7fb7ac0c7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7fb7aad9d640 1 -- 172.21.15.117:0/826592870 >> v1:172.21.15.146:6789/0 conn(0x7fb7ac0b4220 legacy=0x7fb7ac148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:34.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7fb7aad9d640 1 -- 172.21.15.117:0/826592870 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7ac166e60 con 0x7fb7ac0c75a0 2024-09-19T08:37:34.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7f7853fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f78540b50f0 0x7f78540b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7f7853fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f78540b50f0 0x7f78540b30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34624/0 (socket says 172.21.15.117:34624) 2024-09-19T08:37:34.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7f7853fff640 1 -- 172.21.15.117:0/1701684221 learned_addr learned my addr 172.21.15.117:0/1701684221 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:34.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7f86fb59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86f40e2fd0 0x7f86f403a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7f8f32898640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8f240345d0 0x7f8f2403a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7f8f32898640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f240542b0 con 0x7f8f2403afd0 2024-09-19T08:37:34.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7f7853fff640 1 -- 172.21.15.117:0/1701684221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78540aedf0 msgr2=0x7f7854167d70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:37:34.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7f7853fff640 1 --2- 172.21.15.117:0/1701684221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78540aedf0 0x7f7854167d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7f7853fff640 1 -- 172.21.15.117:0/1701684221 >> v1:172.21.15.146:6789/0 conn(0x7f78540b3600 legacy=0x7f78540b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:34.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.786+0000 7f7853fff640 1 -- 172.21.15.117:0/1701684221 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78540729d0 con 0x7f78540b50f0 2024-09-19T08:37:34.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7f356ac2b640 1 Processor -- start 2024-09-19T08:37:34.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7f8f32898640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f240350a0 con 0x7f8f240369f0 2024-09-19T08:37:34.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.786+0000 7fdd331ea640 1 Processor -- start 2024-09-19T08:37:34.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7f8f32898640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f8f24036ef0 con 0x7f8f240345d0 2024-09-19T08:37:34.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.786+0000 7fdd331ea640 1 -- start start 2024-09-19T08:37:34.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.786+0000 7f86fa59c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86f40e2fd0 0x7f86f403a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.786+0000 7fb7aad9d640 1 --2- 172.21.15.117:0/826592870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7ac0c75a0 0x7fb7ac163290 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0c8ac0 tx=0x7fb7a402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16502f1efb4ad480 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.786+0000 7f356ac2b640 1 -- start start 2024-09-19T08:37:34.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.785+0000 7fe80eed0640 1 -- start start 2024-09-19T08:37:34.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.786+0000 7fb7a959a640 1 -- 172.21.15.117:0/826592870 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4036070 con 0x7fb7ac0c75a0 2024-09-19T08:37:34.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.786+0000 7fb7a959a640 1 -- 172.21.15.117:0/826592870 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7a4031600 con 0x7fb7ac0c75a0 2024-09-19T08:37:34.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.786+0000 7f86f9d9b640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f86f40345d0 0x7f86f403a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:54774/0 (socket says 172.21.15.117:54774) 2024-09-19T08:37:34.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.786+0000 7f86fa59c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86f40e2fd0 0x7f86f403a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34626/0 (socket says 172.21.15.117:34626) 2024-09-19T08:37:34.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.786+0000 7f86fb59e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f86f40369f0 0x7f86f4007720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.786+0000 7f86fb59e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86f40542b0 con 0x7f86f40345d0 2024-09-19T08:37:34.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.786+0000 7f86fb59e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f86f4036ef0 con 0x7f86f40e2fd0 2024-09-19T08:37:34.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.786+0000 7f86fb59e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f86f4008aa0 con 0x7f86f40369f0 2024-09-19T08:37:34.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.786+0000 7f8f31896640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8f240345d0 0x7f8f2403a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.786+0000 7f8f31095640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8f240369f0 0x7f8f2403a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.117:43492/0 (socket says 172.21.15.117:43492) 2024-09-19T08:37:34.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.786+0000 7f8f31095640 1 -- 172.21.15.117:0/1628684622 learned_addr learned my addr 172.21.15.117:0/1628684622 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:34.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f8f30894640 1 -- 172.21.15.117:0/1628684622 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 165371151 0 0) 0x7f8f240350a0 con 0x7f8f240369f0 2024-09-19T08:37:34.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f8f30894640 1 -- 172.21.15.117:0/1628684622 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f18003520 con 0x7f8f240369f0 2024-09-19T08:37:34.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.786+0000 7fe80eed0640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe80815efc0 0x7fe8080d2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.786+0000 7fe80cc6c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe80815e4d0 0x7fe8080d1600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:54784/0 (socket says 172.21.15.117:54784) 2024-09-19T08:37:34.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.786+0000 7fe80cc6c640 1 -- 172.21.15.117:0/2373056144 learned_addr learned my addr 172.21.15.117:0/2373056144 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:34.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.786+0000 7fe80eed0640 1 -- 172.21.15.117:0/2373056144 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8080d2250 con 0x7fe80815e4d0 2024-09-19T08:37:34.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7fe80eed0640 1 -- 172.21.15.117:0/2373056144 --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80815f520 con 0x7fe8080d29c0 2024-09-19T08:37:34.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7fe80eed0640 1 -- 172.21.15.117:0/2373056144 --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fe8080d3370 con 0x7fe80815efc0 2024-09-19T08:37:34.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7fe80d46d640 1 --2- 172.21.15.117:0/2373056144 >> v2:172.21.15.146:3300/0 conn(0x7fe80815efc0 0x7fe8080d2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f7853fff640 1 --2- 172.21.15.117:0/1701684221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78540b50f0 0x7f78540b30c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7844009870 tx=0x7f784402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27deabb2f83ae6f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f8f30894640 1 -- 172.21.15.117:0/1628684622 <== mon.1 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2681002778 0 0) 0x7f8f18003520 con 0x7f8f240369f0 2024-09-19T08:37:34.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f86f9d9b640 1 -- 172.21.15.117:0/2594004105 learned_addr learned my addr 172.21.15.117:0/2594004105 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:34.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f8f30894640 1 -- 172.21.15.117:0/1628684622 >> v2:172.21.15.146:3300/0 conn(0x7f8f240345d0 msgr2=0x7f8f2403a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:34.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f8f30894640 1 --2- 172.21.15.117:0/1628684622 >> v2:172.21.15.146:3300/0 conn(0x7f8f240345d0 0x7f8f2403a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f8f30894640 1 -- 172.21.15.117:0/1628684622 >> v1:172.21.15.117:6789/0 conn(0x7f8f2403afd0 legacy=0x7f8f240ea780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f8f30894640 1 -- 172.21.15.117:0/1628684622 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f240e6570 con 0x7f8f240369f0 2024-09-19T08:37:34.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f356ac2b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35641670d0 0x7f35640d4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f356ac2b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35640d4740 0x7f35640cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f356ac2b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35641661c0 con 0x7f3564165de0 2024-09-19T08:37:34.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f356ac2b640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f35640d2550 con 0x7f35640d4740 2024-09-19T08:37:34.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f356ac2b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f35640d27e0 con 0x7f35641670d0 2024-09-19T08:37:34.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f8f30894640 1 -- 172.21.15.117:0/1628684622 <== mon.1 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f8f2c063850 con 0x7f8f240369f0 2024-09-19T08:37:34.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f3569428640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35641670d0 0x7f35640d4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7fb7b0b3b640 1 -- 172.21.15.117:0/826592870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7ac0c75a0 msgr2=0x7fb7ac163290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7fb7b0b3b640 1 --2- 172.21.15.117:0/826592870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7ac0c75a0 0x7fb7ac163290 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0c8ac0 tx=0x7fb7a402a6f0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f3569428640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35641670d0 0x7f35640d4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.117:57780/0 (socket says 172.21.15.117:57780) 2024-09-19T08:37:34.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7fdd331ea640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdd2c1566c0 0x7fdd2c15c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7fdd331ea640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd2c0cd710 0x7fdd2c071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7fdd331ea640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdd2c0724a0 0x7fdd2c15fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7fdd331ea640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fdd2c0cdbf0 con 0x7fdd2c0724a0 2024-09-19T08:37:34.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7fdd331ea640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fdd2c0cded0 con 0x7fdd2c1566c0 2024-09-19T08:37:34.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7fdd331ea640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fdd2c0ce1b0 con 0x7fdd2c0cd710 2024-09-19T08:37:34.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f3569428640 1 -- 172.21.15.117:0/211413632 learned_addr learned my addr 172.21.15.117:0/211413632 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:34.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7f86fad9d640 1 --2- 172.21.15.117:0/2594004105 >> v2:172.21.15.146:3300/0 conn(0x7f86f40369f0 0x7f86f4007720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f8f30894640 1 -- 172.21.15.117:0/1628684622 >> v1:172.21.15.146:6789/0 conn(0x7f8f240369f0 legacy=0x7f8f2403a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f8f30894640 1 --2- 172.21.15.117:0/1628684622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f180039b0 0x7f8f18003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f8f30894640 1 --2- 172.21.15.117:0/1628684622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f18004800 0x7f8f18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f8f30894640 1 --2- 172.21.15.117:0/1628684622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f180051c0 0x7f8f1800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f8f30894640 1 -- 172.21.15.117:0/1628684622 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8f24036ef0 con 0x7f8f180051c0 2024-09-19T08:37:34.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f8f30894640 1 -- 172.21.15.117:0/1628684622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1800c060 con 0x7f8f18004800 2024-09-19T08:37:34.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f8f30894640 1 -- 172.21.15.117:0/1628684622 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f8f1800c260 con 0x7f8f180039b0 2024-09-19T08:37:34.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7fdd321e8640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdd2c1566c0 0x7fdd2c15c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.787+0000 7f8f32097640 1 --2- 172.21.15.117:0/1628684622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f180051c0 0x7f8f1800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7fdd321e8640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdd2c1566c0 0x7fdd2c15c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.117:48132/0 (socket says 172.21.15.117:48132) 2024-09-19T08:37:34.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7fdd321e8640 1 -- 172.21.15.117:0/3408570656 learned_addr learned my addr 172.21.15.117:0/3408570656 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:34.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7f8f31896640 1 --2- 172.21.15.117:0/1628684622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f180039b0 0x7f8f18003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7fdd319e7640 1 --2- 172.21.15.117:0/3408570656 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd2c0cd710 0x7fdd2c071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7f356a42a640 1 --2- 172.21.15.117:0/211413632 >> v2:172.21.15.146:3300/0 conn(0x7f35640d4740 0x7f35640cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7f86fad9d640 1 -- 172.21.15.117:0/2594004105 >> v2:172.21.15.117:3300/0 conn(0x7f86f40e2fd0 msgr2=0x7f86f403a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:34.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7fe80d46d640 1 -- 172.21.15.117:0/2373056144 >> v1:172.21.15.146:6789/0 conn(0x7fe8080d29c0 legacy=0x7fe80815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7fe80d46d640 1 -- 172.21.15.117:0/2373056144 >> v1:172.21.15.117:6789/0 conn(0x7fe80815e4d0 legacy=0x7fe8080d1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7fe80d46d640 1 -- 172.21.15.117:0/2373056144 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80815f800 con 0x7fe80815efc0 2024-09-19T08:37:34.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7fdd329e9640 1 --2- 172.21.15.117:0/3408570656 >> v2:172.21.15.117:3300/0 conn(0x7fdd2c0724a0 0x7fdd2c15fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7f8f31095640 1 --2- 172.21.15.117:0/1628684622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f18004800 0x7f8f18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7fb7b0b3b640 1 -- 172.21.15.117:0/826592870 shutdown_connections 2024-09-19T08:37:34.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7f86fad9d640 1 --2- 172.21.15.117:0/2594004105 >> v2:172.21.15.117:3300/0 conn(0x7f86f40e2fd0 0x7f86f403a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7f86fad9d640 1 -- 172.21.15.117:0/2594004105 >> v1:172.21.15.117:6789/0 conn(0x7f86f40345d0 legacy=0x7f86f403a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7f86fad9d640 1 -- 172.21.15.117:0/2594004105 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f40350a0 con 0x7f86f40369f0 2024-09-19T08:37:34.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7fdd319e7640 1 -- 172.21.15.117:0/3408570656 >> v2:172.21.15.146:3300/0 conn(0x7fdd2c1566c0 msgr2=0x7fdd2c15c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:34.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7fdd319e7640 1 --2- 172.21.15.117:0/3408570656 >> v2:172.21.15.146:3300/0 conn(0x7fdd2c1566c0 0x7fdd2c15c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7fdd319e7640 1 -- 172.21.15.117:0/3408570656 >> v2:172.21.15.117:3300/0 conn(0x7fdd2c0724a0 msgr2=0x7fdd2c15fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:34.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7fdd319e7640 1 --2- 172.21.15.117:0/3408570656 >> v2:172.21.15.117:3300/0 conn(0x7fdd2c0724a0 0x7fdd2c15fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7fdd319e7640 1 -- 172.21.15.117:0/3408570656 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2c0ce490 con 0x7fdd2c0cd710 2024-09-19T08:37:34.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7f8f31095640 1 -- 172.21.15.117:0/1628684622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f180039b0 msgr2=0x7f8f18003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:34.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7f7852ffd640 1 -- 172.21.15.117:0/1701684221 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7844037070 con 0x7f78540b50f0 2024-09-19T08:37:34.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7f94613e8640 1 Processor -- start 2024-09-19T08:37:34.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.789+0000 7f8f31095640 1 --2- 172.21.15.117:0/1628684622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f180039b0 0x7f8f18003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.789+0000 7f8f31095640 1 -- 172.21.15.117:0/1628684622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f180051c0 msgr2=0x7f8f1800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:34.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.789+0000 7f8f31095640 1 --2- 172.21.15.117:0/1628684622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f180051c0 0x7f8f1800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.789+0000 7f8f31095640 1 -- 172.21.15.117:0/1628684622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f240e6570 con 0x7f8f18004800 2024-09-19T08:37:34.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.789+0000 7f7852ffd640 1 -- 172.21.15.117:0/1701684221 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7844032440 con 0x7f78540b50f0 2024-09-19T08:37:34.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.789+0000 7f7852ffd640 1 -- 172.21.15.117:0/1701684221 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7844032810 con 0x7f78540b50f0 2024-09-19T08:37:34.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.789+0000 7f8f32097640 1 --2- 172.21.15.117:0/1628684622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f180051c0 0x7f8f1800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:37:34.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.789+0000 7f8f32097640 1 -- 172.21.15.117:0/1628684622 reap_dead start 2024-09-19T08:37:34.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7fb7b0b3b640 1 --2- 172.21.15.117:0/826592870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7ac0c75a0 0x7fb7ac163290 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7f3569428640 1 -- 172.21.15.117:0/211413632 >> v2:172.21.15.146:3300/0 conn(0x7f35640d4740 msgr2=0x7f35640cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:34.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7f3569428640 1 --2- 172.21.15.117:0/211413632 >> v2:172.21.15.146:3300/0 conn(0x7f35640d4740 0x7f35640cf3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7f3569428640 1 -- 172.21.15.117:0/211413632 >> v1:172.21.15.117:6789/0 conn(0x7f3564165de0 legacy=0x7f35640d1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:34.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7f3569428640 1 -- 172.21.15.117:0/211413632 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35640d2ac0 con 0x7f35641670d0 2024-09-19T08:37:34.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7fb7b0b3b640 1 --2- 172.21.15.117:0/826592870 >> v2:172.21.15.146:3300/0 conn(0x7fb7ac145ed0 0x7fb7ac0c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.788+0000 7fb7b0b3b640 1 -- 172.21.15.117:0/826592870 >> 172.21.15.117:0/826592870 conn(0x7fb7ac067fe0 msgr2=0x7fb7ac06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:34.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.789+0000 7fb7b0b3b640 1 -- 172.21.15.117:0/826592870 shutdown_connections 2024-09-19T08:37:34.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.789+0000 7fe80d46d640 1 --2- 172.21.15.117:0/2373056144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe80815efc0 0x7fe8080d2e30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe800009d90 tx=0x7fe80002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9414a3745d9e409d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.789+0000 7f3569428640 1 --2- 172.21.15.117:0/211413632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35641670d0 0x7f35640d4200 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3560009870 tx=0x7f356002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dd021727f499f9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.789+0000 7f94613e8640 1 -- start start 2024-09-19T08:37:34.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.789+0000 7f86fad9d640 1 --2- 172.21.15.117:0/2594004105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86f40369f0 0x7f86f4007720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f86f4053070 tx=0x7f86ec02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=801148e75d4f96ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.789+0000 7fe8077fe640 1 -- 172.21.15.117:0/2373056144 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800007740 con 0x7fe80815efc0 2024-09-19T08:37:34.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.789+0000 7fe8077fe640 1 -- 172.21.15.117:0/2373056144 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8000078e0 con 0x7fe80815efc0 2024-09-19T08:37:34.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.789+0000 7fe8077fe640 1 -- 172.21.15.117:0/2373056144 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800007cb0 con 0x7fe80815efc0 2024-09-19T08:37:34.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.789+0000 7f3568c27640 1 -- 172.21.15.117:0/211413632 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560037070 con 0x7f35641670d0 2024-09-19T08:37:34.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.789+0000 7fdd319e7640 1 --2- 172.21.15.117:0/3408570656 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd2c0cd710 0x7fdd2c071f60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c06cc60 tx=0x7fdd1c02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28165beb07807f59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.789+0000 7f3568c27640 1 -- 172.21.15.117:0/211413632 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3560032440 con 0x7f35641670d0 2024-09-19T08:37:34.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7f8f31095640 1 --2- 172.21.15.117:0/1628684622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f18004800 0x7f8f18004c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c074480 tx=0x7f8f18005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4180269882cc7b5e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7fdd311e6640 1 -- 172.21.15.117:0/3408570656 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c037070 con 0x7fdd2c0cd710 2024-09-19T08:37:34.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7fdd311e6640 1 -- 172.21.15.117:0/3408570656 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd1c032440 con 0x7fdd2c0cd710 2024-09-19T08:37:34.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7f8f30894640 1 -- 172.21.15.117:0/1628684622 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c074ac0 con 0x7f8f18004800 2024-09-19T08:37:34.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7f8f30894640 1 -- 172.21.15.117:0/1628684622 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f2c06d1b0 con 0x7f8f18004800 2024-09-19T08:37:34.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7f8f30894640 1 -- 172.21.15.117:0/1628684622 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c06d680 con 0x7f8f18004800 2024-09-19T08:37:34.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7f94613e8640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f945c15f0d0 0x7f945c15f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7f94613e8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f945c0d0070 0x7f945c0d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7f94613e8640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f945c0cf2b0 con 0x7f945c0d1940 2024-09-19T08:37:34.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7f94613e8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f945c0cf590 con 0x7f945c0d0070 2024-09-19T08:37:34.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7f94613e8640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f945c0cf870 con 0x7f945c15f0d0 2024-09-19T08:37:34.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.789+0000 7fb7b0b3b640 1 -- 172.21.15.117:0/826592870 wait complete. 2024-09-19T08:37:34.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7fdd311e6640 1 -- 172.21.15.117:0/3408570656 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c02ae60 con 0x7fdd2c0cd710 2024-09-19T08:37:34.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7f945affd640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f945c15f0d0 0x7f945c15f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7f78595c5640 1 -- 172.21.15.117:0/1701684221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78540b50f0 msgr2=0x7f78540b30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7f945affd640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f945c15f0d0 0x7f945c15f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.117:48162/0 (socket says 172.21.15.117:48162) 2024-09-19T08:37:34.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7f945affd640 1 -- 172.21.15.117:0/4085518002 learned_addr learned my addr 172.21.15.117:0/4085518002 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:34.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7f945a7fc640 1 --2- 172.21.15.117:0/4085518002 >> v2:172.21.15.117:3300/0 conn(0x7f945c0d0070 0x7f945c0d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7f356ac2b640 1 -- 172.21.15.117:0/211413632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35641670d0 msgr2=0x7f35640d4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7f356ac2b640 1 --2- 172.21.15.117:0/211413632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35641670d0 0x7f35640d4200 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3560009870 tx=0x7f356002a1a0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7fe80eed0640 1 -- 172.21.15.117:0/2373056144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe80815efc0 msgr2=0x7fe8080d2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7fe80eed0640 1 --2- 172.21.15.117:0/2373056144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe80815efc0 0x7fe8080d2e30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe800009d90 tx=0x7fe80002a6f0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7fe80eed0640 1 -- 172.21.15.117:0/2373056144 shutdown_connections 2024-09-19T08:37:34.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7fe80eed0640 1 --2- 172.21.15.117:0/2373056144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe80815efc0 0x7fe8080d2e30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7fe80eed0640 1 -- 172.21.15.117:0/2373056144 >> 172.21.15.117:0/2373056144 conn(0x7fe80809d770 msgr2=0x7fe80808bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:34.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7f78595c5640 1 --2- 172.21.15.117:0/1701684221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78540b50f0 0x7f78540b30c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7844009870 tx=0x7f784402a230 comp rx=0 tx=0).stop 2024-09-19T08:37:34.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7f86f959a640 1 -- 172.21.15.117:0/2594004105 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec037070 con 0x7f86f40369f0 2024-09-19T08:37:34.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7f86f959a640 1 -- 172.21.15.117:0/2594004105 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86ec032440 con 0x7f86f40369f0 2024-09-19T08:37:34.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.790+0000 7f86f959a640 1 -- 172.21.15.117:0/2594004105 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec02ae60 con 0x7f86f40369f0 2024-09-19T08:37:34.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f945a7fc640 1 -- 172.21.15.117:0/4085518002 >> v2:172.21.15.146:3300/0 conn(0x7f945c15f0d0 msgr2=0x7f945c15f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:34.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f356ac2b640 1 -- 172.21.15.117:0/211413632 shutdown_connections 2024-09-19T08:37:34.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f356ac2b640 1 --2- 172.21.15.117:0/211413632 >> v2:172.21.15.146:3300/0 conn(0x7f35640d4740 0x7f35640cf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f356ac2b640 1 --2- 172.21.15.117:0/211413632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35641670d0 0x7f35640d4200 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f356ac2b640 1 -- 172.21.15.117:0/211413632 >> 172.21.15.117:0/211413632 conn(0x7f356408dc80 msgr2=0x7f356409d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:34.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7fdd331ea640 1 -- 172.21.15.117:0/3408570656 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd2c0cd710 msgr2=0x7fdd2c071f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f945a7fc640 1 --2- 172.21.15.117:0/4085518002 >> v2:172.21.15.146:3300/0 conn(0x7f945c15f0d0 0x7f945c15f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f945a7fc640 1 -- 172.21.15.117:0/4085518002 >> v1:172.21.15.146:6789/0 conn(0x7f945c0d1940 legacy=0x7f945c0d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:34.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7fdd331ea640 1 --2- 172.21.15.117:0/3408570656 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd2c0cd710 0x7fdd2c071f60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c06cc60 tx=0x7fdd1c02a110 comp rx=0 tx=0).stop 2024-09-19T08:37:34.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f78595c5640 1 -- 172.21.15.117:0/1701684221 shutdown_connections 2024-09-19T08:37:34.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f78595c5640 1 --2- 172.21.15.117:0/1701684221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78540aedf0 0x7f7854167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f78595c5640 1 --2- 172.21.15.117:0/1701684221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78540b50f0 0x7f78540b30c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f945a7fc640 1 -- 172.21.15.117:0/4085518002 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945c0cfb50 con 0x7f945c0d0070 2024-09-19T08:37:34.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f945affd640 1 --2- 172.21.15.117:0/4085518002 >> v2:172.21.15.146:3300/0 conn(0x7f945c15f0d0 0x7f945c15f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:37:34.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f356ac2b640 1 -- 172.21.15.117:0/211413632 shutdown_connections 2024-09-19T08:37:34.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f78595c5640 1 -- 172.21.15.117:0/1701684221 >> 172.21.15.117:0/1701684221 conn(0x7f785406dae0 msgr2=0x7f785406dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:34.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f8f32898640 1 -- 172.21.15.117:0/1628684622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f18004800 msgr2=0x7f8f18004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f8f32898640 1 --2- 172.21.15.117:0/1628684622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f18004800 0x7f8f18004c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c074480 tx=0x7f8f18005830 comp rx=0 tx=0).stop 2024-09-19T08:37:34.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7fe80eed0640 1 -- 172.21.15.117:0/2373056144 shutdown_connections 2024-09-19T08:37:34.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f8f32898640 1 -- 172.21.15.117:0/1628684622 shutdown_connections 2024-09-19T08:37:34.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f8f32898640 1 --2- 172.21.15.117:0/1628684622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f18004800 0x7f8f18004c80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f8f32898640 1 -- 172.21.15.117:0/1628684622 >> 172.21.15.117:0/1628684622 conn(0x7f8f2401ea30 msgr2=0x7f8f240556d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:34.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7fe80eed0640 1 -- 172.21.15.117:0/2373056144 wait complete. 2024-09-19T08:37:34.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f86fb59e640 1 -- 172.21.15.117:0/2594004105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86f40369f0 msgr2=0x7f86f4007720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f86fb59e640 1 --2- 172.21.15.117:0/2594004105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86f40369f0 0x7f86f4007720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f86f4053070 tx=0x7f86ec02a110 comp rx=0 tx=0).stop 2024-09-19T08:37:34.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f8f32898640 1 -- 172.21.15.117:0/1628684622 shutdown_connections 2024-09-19T08:37:34.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f86fb59e640 1 -- 172.21.15.117:0/2594004105 shutdown_connections 2024-09-19T08:37:34.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f86fb59e640 1 --2- 172.21.15.117:0/2594004105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86f40369f0 0x7f86f4007720 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f86fb59e640 1 --2- 172.21.15.117:0/2594004105 >> v2:172.21.15.117:3300/0 conn(0x7f86f40e2fd0 0x7f86f403a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f86fb59e640 1 -- 172.21.15.117:0/2594004105 >> 172.21.15.117:0/2594004105 conn(0x7f86f401ea30 msgr2=0x7f86f40556d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:34.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f86fb59e640 1 -- 172.21.15.117:0/2594004105 shutdown_connections 2024-09-19T08:37:34.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f86fb59e640 1 -- 172.21.15.117:0/2594004105 wait complete. 2024-09-19T08:37:34.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f8f32898640 1 -- 172.21.15.117:0/1628684622 wait complete. 2024-09-19T08:37:34.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.792+0000 7f78595c5640 1 -- 172.21.15.117:0/1701684221 shutdown_connections 2024-09-19T08:37:34.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.792+0000 7fdd331ea640 1 -- 172.21.15.117:0/3408570656 shutdown_connections 2024-09-19T08:37:34.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.792+0000 7fdd331ea640 1 --2- 172.21.15.117:0/3408570656 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd2c0cd710 0x7fdd2c071f60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.792+0000 7fdd331ea640 1 --2- 172.21.15.117:0/3408570656 >> v2:172.21.15.117:3300/0 conn(0x7fdd2c0724a0 0x7fdd2c15fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.792+0000 7fdd331ea640 1 --2- 172.21.15.117:0/3408570656 >> v2:172.21.15.146:3300/0 conn(0x7fdd2c1566c0 0x7fdd2c15c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.792+0000 7fdd331ea640 1 -- 172.21.15.117:0/3408570656 >> 172.21.15.117:0/3408570656 conn(0x7fdd2c067b30 msgr2=0x7fdd2c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:34.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.792+0000 7f78595c5640 1 -- 172.21.15.117:0/1701684221 wait complete. 2024-09-19T08:37:34.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.792+0000 7fb7b0b3b640 1 Processor -- start 2024-09-19T08:37:34.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.792+0000 7fb7b0b3b640 1 -- start start 2024-09-19T08:37:34.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.792+0000 7fdd331ea640 1 -- 172.21.15.117:0/3408570656 shutdown_connections 2024-09-19T08:37:34.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.792+0000 7fdd331ea640 1 -- 172.21.15.117:0/3408570656 wait complete. 2024-09-19T08:37:34.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.791+0000 7f356ac2b640 1 -- 172.21.15.117:0/211413632 wait complete. 2024-09-19T08:37:34.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.793+0000 7f356ac2b640 1 Processor -- start 2024-09-19T08:37:34.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.793+0000 7fe80eed0640 1 Processor -- start 2024-09-19T08:37:34.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.793+0000 7fb7b0b3b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7ac0b4220 0x7fb7ac144900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.793+0000 7fb7b0b3b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7ac0c75a0 0x7fb7ac0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.793+0000 7fb7b0b3b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7ac145ed0 0x7fb7ac0cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.793+0000 7f86fb59e640 1 Processor -- start 2024-09-19T08:37:34.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7f8f32898640 1 Processor -- start 2024-09-19T08:37:34.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.793+0000 7fb7aad9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7ac145ed0 0x7fb7ac0cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7fb7aad9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7ac145ed0 0x7fb7ac0cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34668/0 (socket says 172.21.15.117:34668) 2024-09-19T08:37:34.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7fb7a9d9b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7ac0c75a0 0x7fb7ac0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7fb7a9d9b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7ac0c75a0 0x7fb7ac0cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.117:57802/0 (socket says 172.21.15.117:57802) 2024-09-19T08:37:34.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.793+0000 7fe80eed0640 1 -- start start 2024-09-19T08:37:34.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7fb7aad9d640 1 -- 172.21.15.117:0/750022784 learned_addr learned my addr 172.21.15.117:0/750022784 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:34.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7fb7b0b3b640 1 -- 172.21.15.117:0/750022784 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac1464a0 con 0x7fb7ac145ed0 2024-09-19T08:37:34.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7fb7b0b3b640 1 -- 172.21.15.117:0/750022784 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac146320 con 0x7fb7ac0b4220 2024-09-19T08:37:34.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7fb7b0b3b640 1 -- 172.21.15.117:0/750022784 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fb7ac0b4600 con 0x7fb7ac0c75a0 2024-09-19T08:37:34.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7f78595c5640 1 Processor -- start 2024-09-19T08:37:34.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.793+0000 7f86fb59e640 1 -- start start 2024-09-19T08:37:34.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.793+0000 7f356ac2b640 1 -- start start 2024-09-19T08:37:34.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7f356ac2b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35640d4740 0x7f35640c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7f356ac2b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3564165de0 0x7f356415b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7f356ac2b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f356415bae0 0x7f35640b80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7f356ac2b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f35640cee10 con 0x7f35640d4740 2024-09-19T08:37:34.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7f356ac2b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f35640d3080 con 0x7f356415bae0 2024-09-19T08:37:34.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7f356ac2b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f35640cf8e0 con 0x7f3564165de0 2024-09-19T08:37:34.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.793+0000 7f945a7fc640 1 --2- 172.21.15.117:0/4085518002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f945c0d0070 0x7f945c0d1400 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f945c0b6f40 tx=0x7f945002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2c4b83c373754b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.793+0000 7f9459ffb640 1 -- 172.21.15.117:0/4085518002 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9450037070 con 0x7f945c0d0070 2024-09-19T08:37:34.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.793+0000 7f9459ffb640 1 -- 172.21.15.117:0/4085518002 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9450032440 con 0x7f945c0d0070 2024-09-19T08:37:34.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.793+0000 7f9459ffb640 1 -- 172.21.15.117:0/4085518002 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945002ae60 con 0x7f945c0d0070 2024-09-19T08:37:34.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7f94613e8640 1 -- 172.21.15.117:0/4085518002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f945c0d0070 msgr2=0x7f945c0d1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7f94613e8640 1 --2- 172.21.15.117:0/4085518002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f945c0d0070 0x7f945c0d1400 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f945c0b6f40 tx=0x7f945002a110 comp rx=0 tx=0).stop 2024-09-19T08:37:34.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7fe80eed0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8080d29c0 0x7fe80815ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7f86fb59e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86f40345d0 0x7f86f404b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7f3569428640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3564165de0 0x7f356415b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7f3569428640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3564165de0 0x7f356415b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.117:57816/0 (socket says 172.21.15.117:57816) 2024-09-19T08:37:34.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7f3569428640 1 -- 172.21.15.117:0/2554866364 learned_addr learned my addr 172.21.15.117:0/2554866364 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:34.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7fb7aa59c640 1 --2- 172.21.15.117:0/750022784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7ac0b4220 0x7fb7ac144900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7fdd331ea640 1 Processor -- start 2024-09-19T08:37:34.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f78595c5640 1 -- start start 2024-09-19T08:37:34.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f356a42a640 1 --2- 172.21.15.117:0/2554866364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f356415bae0 0x7f35640b80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7fb7aa59c640 1 -- 172.21.15.117:0/750022784 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7ac0c75a0 msgr2=0x7fb7ac0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7fb7aa59c640 1 --2- 172.21.15.117:0/750022784 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7ac0c75a0 0x7fb7ac0cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7fb7aa59c640 1 -- 172.21.15.117:0/750022784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7ac145ed0 msgr2=0x7fb7ac0cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7fb7aa59c640 1 --2- 172.21.15.117:0/750022784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7ac145ed0 0x7fb7ac0cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7fb7aa59c640 1 -- 172.21.15.117:0/750022784 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7ac146bc0 con 0x7fb7ac0b4220 2024-09-19T08:37:34.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7fb7aad9d640 1 --2- 172.21.15.117:0/750022784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7ac145ed0 0x7fb7ac0cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:37:34.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f94613e8640 1 -- 172.21.15.117:0/4085518002 shutdown_connections 2024-09-19T08:37:34.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f94613e8640 1 --2- 172.21.15.117:0/4085518002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f945c0d0070 0x7f945c0d1400 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f94613e8640 1 --2- 172.21.15.117:0/4085518002 >> v2:172.21.15.146:3300/0 conn(0x7f945c15f0d0 0x7f945c15f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f94613e8640 1 -- 172.21.15.117:0/4085518002 >> 172.21.15.117:0/4085518002 conn(0x7f945c09d760 msgr2=0x7f945c08bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:34.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f3569c29640 1 --2- 172.21.15.117:0/2554866364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35640d4740 0x7f35640c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f3569428640 1 -- 172.21.15.117:0/2554866364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f356415bae0 msgr2=0x7f35640b80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f3569428640 1 --2- 172.21.15.117:0/2554866364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f356415bae0 0x7f35640b80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f3569428640 1 -- 172.21.15.117:0/2554866364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35640d4740 msgr2=0x7f35640c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f3569428640 1 --2- 172.21.15.117:0/2554866364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35640d4740 0x7f35640c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f3569428640 1 -- 172.21.15.117:0/2554866364 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356415ece0 con 0x7f3564165de0 2024-09-19T08:37:34.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7fdd331ea640 1 -- start start 2024-09-19T08:37:34.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f3569428640 1 --2- 172.21.15.117:0/2554866364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3564165de0 0x7f356415b330 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f35600097c0 tx=0x7f35600046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f3569c29640 1 --2- 172.21.15.117:0/2554866364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35640d4740 0x7f35640c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:34.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f356a42a640 1 --2- 172.21.15.117:0/2554866364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f356415bae0 0x7f35640b80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:37:34.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7f86fb59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86f40369f0 0x7f86f40373c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7f86fb59e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86f40e2fd0 0x7f86f4037900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7f86fb59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f86f403afd0 con 0x7f86f40369f0 2024-09-19T08:37:34.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7f86fb59e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f86f4008f30 con 0x7f86f40345d0 2024-09-19T08:37:34.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7f86fb59e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f86f403b150 con 0x7f86f40e2fd0 2024-09-19T08:37:34.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f86fa59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86f40345d0 0x7f86f404b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f86f9d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86f40369f0 0x7f86f40373c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f86f9d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86f40369f0 0x7f86f40373c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34684/0 (socket says 172.21.15.117:34684) 2024-09-19T08:37:34.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f86f9d9b640 1 -- 172.21.15.117:0/2672600410 learned_addr learned my addr 172.21.15.117:0/2672600410 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:34.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f86f9d9b640 1 -- 172.21.15.117:0/2672600410 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86f40e2fd0 msgr2=0x7f86f4037900 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T08:37:34.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f86f9d9b640 1 --2- 172.21.15.117:0/2672600410 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86f40e2fd0 0x7f86f4037900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f86f9d9b640 1 -- 172.21.15.117:0/2672600410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86f40345d0 msgr2=0x7f86f404b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f86f9d9b640 1 --2- 172.21.15.117:0/2672600410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86f40345d0 0x7f86f404b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f86f9d9b640 1 -- 172.21.15.117:0/2672600410 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f4037e40 con 0x7f86f40369f0 2024-09-19T08:37:34.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7f86f9d9b640 1 --2- 172.21.15.117:0/2672600410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86f40369f0 0x7f86f40373c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f86f000c3c0 tx=0x7f86f000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7f8f32898640 1 -- start start 2024-09-19T08:37:34.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7fb7aa59c640 1 --2- 172.21.15.117:0/750022784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7ac0b4220 0x7fb7ac144900 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00c410 tx=0x7fb79c00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7fe80eed0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe80815e4d0 0x7fe8080cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7fe80eed0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe80815efc0 0x7fe808161c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7fe80eed0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe8080d0e00 con 0x7fe8080d29c0 2024-09-19T08:37:34.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7fe80eed0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe8080d1170 con 0x7fe80815efc0 2024-09-19T08:37:34.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.794+0000 7fe80eed0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fe8080cef80 con 0x7fe80815e4d0 2024-09-19T08:37:34.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7fe807fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe80815e4d0 0x7fe8080cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7fe807fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe80815e4d0 0x7fe8080cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.117:57834/0 (socket says 172.21.15.117:57834) 2024-09-19T08:37:34.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7fe807fff640 1 -- 172.21.15.117:0/395862873 learned_addr learned my addr 172.21.15.117:0/395862873 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:34.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7fe807fff640 1 -- 172.21.15.117:0/395862873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe80815efc0 msgr2=0x7fe808161c20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T08:37:34.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7fe807fff640 1 --2- 172.21.15.117:0/395862873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe80815efc0 0x7fe808161c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.795+0000 7fe807fff640 1 -- 172.21.15.117:0/395862873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8080d29c0 msgr2=0x7fe80815ff90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:37:34.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f355a7fc640 1 -- 172.21.15.117:0/2554866364 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560037040 con 0x7f3564165de0 2024-09-19T08:37:34.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f355a7fc640 1 -- 172.21.15.117:0/2554866364 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3560042070 con 0x7f3564165de0 2024-09-19T08:37:34.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f78595c5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78540aedf0 0x7f785413dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f78595c5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78540b3600 0x7f7854147340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f78595c5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78540b50f0 0x7f78541447f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f78595c5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7854072f90 con 0x7f78540b50f0 2024-09-19T08:37:34.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f78595c5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f78540b6150 con 0x7f78540aedf0 2024-09-19T08:37:34.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7fe807fff640 1 --2- 172.21.15.117:0/395862873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8080d29c0 0x7fe80815ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7fe807fff640 1 -- 172.21.15.117:0/395862873 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe808160570 con 0x7fe80815e4d0 2024-09-19T08:37:34.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f78595c5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f78540b5be0 con 0x7f78540b3600 2024-09-19T08:37:34.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7fb79affd640 1 -- 172.21.15.117:0/750022784 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c005230 con 0x7fb7ac0b4220 2024-09-19T08:37:34.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f8f32898640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f18004800 0x7f8f2400ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f8f32898640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f2400b1b0 0x7f8f2400b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f8f32898640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f2417c030 0x7f8f2417c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f8f32898640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8f24008f30 con 0x7f8f2417c030 2024-09-19T08:37:34.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f8f32898640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8f24008aa0 con 0x7f8f2400b1b0 2024-09-19T08:37:34.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f8f32898640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f8f240e2fd0 con 0x7f8f18004800 2024-09-19T08:37:34.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7fdd331ea640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd2c0724a0 0x7fdd2c0cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7fb79affd640 1 -- 172.21.15.117:0/750022784 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79c0053d0 con 0x7fb7ac0b4220 2024-09-19T08:37:34.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f8f31095640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f2400b1b0 0x7f8f2400b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f8f31095640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f2400b1b0 0x7f8f2400b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.117:48210/0 (socket says 172.21.15.117:48210) 2024-09-19T08:37:34.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f8f31095640 1 -- 172.21.15.117:0/3731331690 learned_addr learned my addr 172.21.15.117:0/3731331690 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:34.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f7853fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78540aedf0 0x7f785413dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f7853fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78540aedf0 0x7f785413dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.117:48226/0 (socket says 172.21.15.117:48226) 2024-09-19T08:37:34.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f7853fff640 1 -- 172.21.15.117:0/1752546719 learned_addr learned my addr 172.21.15.117:0/1752546719 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:34.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f78537fe640 1 --2- 172.21.15.117:0/1752546719 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78540b3600 0x7f7854147340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f94613e8640 1 -- 172.21.15.117:0/4085518002 shutdown_connections 2024-09-19T08:37:34.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f356ac2b640 1 -- 172.21.15.117:0/2554866364 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f356415efc0 con 0x7f3564165de0 2024-09-19T08:37:34.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f356ac2b640 1 -- 172.21.15.117:0/2554866364 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f35640b8af0 con 0x7f3564165de0 2024-09-19T08:37:34.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f355a7fc640 1 -- 172.21.15.117:0/2554866364 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560032440 con 0x7f3564165de0 2024-09-19T08:37:34.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7fdd331ea640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd2c0cd710 0x7fdd2c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7fdd331ea640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd2c06f270 0x7fdd2c161170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7fdd321e8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd2c0724a0 0x7fdd2c0cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7fdd321e8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd2c0724a0 0x7fdd2c0cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.117:48230/0 (socket says 172.21.15.117:48230) 2024-09-19T08:37:34.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7fdd321e8640 1 -- 172.21.15.117:0/2615170871 learned_addr learned my addr 172.21.15.117:0/2615170871 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:34.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7fdd331ea640 1 -- 172.21.15.117:0/2615170871 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2c0cffc0 con 0x7fdd2c06f270 2024-09-19T08:37:34.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7fdd331ea640 1 -- 172.21.15.117:0/2615170871 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2c0cfe40 con 0x7fdd2c0724a0 2024-09-19T08:37:34.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7fdd331ea640 1 -- 172.21.15.117:0/2615170871 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fdd2c15ff40 con 0x7fdd2c0cd710 2024-09-19T08:37:34.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7fdd319e7640 1 --2- 172.21.15.117:0/2615170871 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd2c0cd710 0x7fdd2c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f7858dc4640 1 --2- 172.21.15.117:0/1752546719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78540b50f0 0x7f78541447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7fb79affd640 1 -- 172.21.15.117:0/750022784 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c005230 con 0x7fb7ac0b4220 2024-09-19T08:37:34.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7fb7b0b3b640 1 -- 172.21.15.117:0/750022784 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7ac146ea0 con 0x7fb7ac0b4220 2024-09-19T08:37:34.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7fb7b0b3b640 1 -- 172.21.15.117:0/750022784 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7ac147460 con 0x7fb7ac0b4220 2024-09-19T08:37:34.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f86eaffd640 1 -- 172.21.15.117:0/2672600410 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f0017070 con 0x7f86f40369f0 2024-09-19T08:37:34.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f86eaffd640 1 -- 172.21.15.117:0/2672600410 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f0005ce0 con 0x7f86f40369f0 2024-09-19T08:37:34.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f86eaffd640 1 -- 172.21.15.117:0/2672600410 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f00072d0 con 0x7f86f40369f0 2024-09-19T08:37:34.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f86fb59e640 1 -- 172.21.15.117:0/2672600410 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f400b670 con 0x7f86f40369f0 2024-09-19T08:37:34.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.796+0000 7f8f31896640 1 --2- 172.21.15.117:0/3731331690 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f18004800 0x7f8f2400ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f8f31095640 1 -- 172.21.15.117:0/3731331690 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f18004800 msgr2=0x7f8f2400ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f8f31095640 1 --2- 172.21.15.117:0/3731331690 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f18004800 0x7f8f2400ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f8f32097640 1 --2- 172.21.15.117:0/3731331690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f2417c030 0x7f8f2417c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f8f31095640 1 -- 172.21.15.117:0/3731331690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f2417c030 msgr2=0x7f8f2417c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f8f31095640 1 --2- 172.21.15.117:0/3731331690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f2417c030 0x7f8f2417c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f8f31095640 1 -- 172.21.15.117:0/3731331690 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f24050510 con 0x7f8f2400b1b0 2024-09-19T08:37:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f8f32097640 1 --2- 172.21.15.117:0/3731331690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f2417c030 0x7f8f2417c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f7853fff640 1 -- 172.21.15.117:0/1752546719 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78540b3600 msgr2=0x7f7854147340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f7853fff640 1 --2- 172.21.15.117:0/1752546719 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78540b3600 0x7f7854147340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f7853fff640 1 -- 172.21.15.117:0/1752546719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78540b50f0 msgr2=0x7f78541447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f7853fff640 1 --2- 172.21.15.117:0/1752546719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78540b50f0 0x7f78541447f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f7853fff640 1 -- 172.21.15.117:0/1752546719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f785413cbd0 con 0x7f78540aedf0 2024-09-19T08:37:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f78537fe640 1 --2- 172.21.15.117:0/1752546719 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78540b3600 0x7f7854147340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:37:34.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7fdd329e9640 1 --2- 172.21.15.117:0/2615170871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd2c06f270 0x7fdd2c161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f94613e8640 1 -- 172.21.15.117:0/4085518002 wait complete. 2024-09-19T08:37:34.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f8f31095640 1 --2- 172.21.15.117:0/3731331690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f2400b1b0 0x7f8f2400b630 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0759e0 tx=0x7f8f2c0699b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7fe807fff640 1 --2- 172.21.15.117:0/395862873 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe80815e4d0 0x7fe8080cdee0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4001b20 tx=0x7fe7f4014420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7fe8057fa640 1 -- 172.21.15.117:0/395862873 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4001d30 con 0x7fe80815e4d0 2024-09-19T08:37:34.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7fe8057fa640 1 -- 172.21.15.117:0/395862873 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7f4014d40 con 0x7fe80815e4d0 2024-09-19T08:37:34.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7fe8057fa640 1 -- 172.21.15.117:0/395862873 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4001d30 con 0x7fe80815e4d0 2024-09-19T08:37:34.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7fe80eed0640 1 -- 172.21.15.117:0/395862873 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe808160850 con 0x7fe80815e4d0 2024-09-19T08:37:34.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7fe80eed0640 1 -- 172.21.15.117:0/395862873 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe808160e10 con 0x7fe80815e4d0 2024-09-19T08:37:34.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7fdd319e7640 1 -- 172.21.15.117:0/2615170871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd2c0724a0 msgr2=0x7fdd2c0cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7fdd319e7640 1 --2- 172.21.15.117:0/2615170871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd2c0724a0 0x7fdd2c0cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7fdd319e7640 1 -- 172.21.15.117:0/2615170871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd2c06f270 msgr2=0x7fdd2c161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7fdd319e7640 1 --2- 172.21.15.117:0/2615170871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd2c06f270 0x7fdd2c161170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7fdd319e7640 1 -- 172.21.15.117:0/2615170871 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2c160c90 con 0x7fdd2c0cd710 2024-09-19T08:37:34.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f86fb59e640 1 -- 172.21.15.117:0/2672600410 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f40ccf20 con 0x7f86f40369f0 2024-09-19T08:37:34.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.798+0000 7fb7b0b3b640 1 -- 172.21.15.117:0/750022784 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb7ac166430 con 0x7fb7ac0b4220 2024-09-19T08:37:34.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.798+0000 7f86fb59e640 1 -- 172.21.15.117:0/2672600410 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f86f400b420 con 0x7f86f40369f0 2024-09-19T08:37:34.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.798+0000 7f8f227fc640 1 -- 172.21.15.117:0/3731331690 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c0bb070 con 0x7f8f2400b1b0 2024-09-19T08:37:34.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.798+0000 7f8f32898640 1 -- 172.21.15.117:0/3731331690 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f2404ff50 con 0x7f8f2400b1b0 2024-09-19T08:37:34.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.798+0000 7f8f32898640 1 -- 172.21.15.117:0/3731331690 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f2404a360 con 0x7f8f2400b1b0 2024-09-19T08:37:34.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.798+0000 7f8f227fc640 1 -- 172.21.15.117:0/3731331690 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f2c050520 con 0x7f8f2400b1b0 2024-09-19T08:37:34.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.799+0000 7fb79affd640 1 -- 172.21.15.117:0/750022784 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb79c0045e0 con 0x7fb7ac0b4220 2024-09-19T08:37:34.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.799+0000 7fb79affd640 1 --2- 172.21.15.117:0/750022784 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb78c06c4b0 0x7fb78c06e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.800+0000 7fb79affd640 1 -- 172.21.15.117:0/750022784 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb79c08b060 con 0x7fb7ac0b4220 2024-09-19T08:37:34.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.800+0000 7fb7a9d9b640 1 --2- 172.21.15.117:0/750022784 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb78c06c4b0 0x7fb78c06e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.800+0000 7fb79affd640 1 --2- 172.21.15.117:0/750022784 >> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] conn(0x7fb78c075ba0 0x7fb78c077fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.800+0000 7fb79affd640 1 -- 172.21.15.117:0/750022784 --> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb79c0076b0 con 0x7fb78c075ba0 2024-09-19T08:37:34.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.800+0000 7fb79affd640 1 -- 172.21.15.117:0/750022784 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb79c08b450 con 0x7fb7ac0b4220 2024-09-19T08:37:34.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f7853fff640 1 --2- 172.21.15.117:0/1752546719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78540aedf0 0x7f785413dc70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7844009870 tx=0x7f78440046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.798+0000 7f7850ff9640 1 -- 172.21.15.117:0/1752546719 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7844041070 con 0x7f78540aedf0 2024-09-19T08:37:34.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.798+0000 7f7850ff9640 1 -- 172.21.15.117:0/1752546719 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f784403c930 con 0x7f78540aedf0 2024-09-19T08:37:34.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.798+0000 7f7850ff9640 1 -- 172.21.15.117:0/1752546719 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7844037040 con 0x7f78540aedf0 2024-09-19T08:37:34.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.799+0000 7f78595c5640 1 -- 172.21.15.117:0/1752546719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f785413ceb0 con 0x7f78540aedf0 2024-09-19T08:37:34.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.799+0000 7f78595c5640 1 -- 172.21.15.117:0/1752546719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f785413d470 con 0x7f78540aedf0 2024-09-19T08:37:34.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.799+0000 7fe80eed0640 1 -- 172.21.15.117:0/395862873 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe80815fd70 con 0x7fe80815e4d0 2024-09-19T08:37:34.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.799+0000 7f94613e8640 1 Processor -- start 2024-09-19T08:37:34.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.799+0000 7f94613e8640 1 -- start start 2024-09-19T08:37:34.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.797+0000 7f356ac2b640 1 -- 172.21.15.117:0/2554866364 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f35641670d0 con 0x7f3564165de0 2024-09-19T08:37:34.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.800+0000 7f86eaffd640 1 -- 172.21.15.117:0/2672600410 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f86f001a070 con 0x7f86f40369f0 2024-09-19T08:37:34.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.800+0000 7fb7a9d9b640 1 --2- 172.21.15.117:0/750022784 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb78c06c4b0 0x7fb78c06e970 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0006fd0 tx=0x7fb7a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f94613e8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f945c0d0070 0x7f945c0b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f355a7fc640 1 -- 172.21.15.117:0/2554866364 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f35600325f0 con 0x7f3564165de0 2024-09-19T08:37:34.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7fdd319e7640 1 --2- 172.21.15.117:0/2615170871 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd2c0cd710 0x7fdd2c15a540 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c031000 tx=0x7fdd1c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f94613e8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f945c0d1940 0x7f945c153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f94613e8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f945c15f0d0 0x7f945c0d1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f945a7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f945c0d1940 0x7f945c153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f94613e8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f945c0d49c0 con 0x7f945c0d1940 2024-09-19T08:37:34.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f945a7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f945c0d1940 0x7f945c153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34728/0 (socket says 172.21.15.117:34728) 2024-09-19T08:37:34.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f945a7fc640 1 -- 172.21.15.117:0/4081805007 learned_addr learned my addr 172.21.15.117:0/4081805007 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:34.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f945affd640 1 --2- 172.21.15.117:0/4081805007 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f945c0d0070 0x7f945c0b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f94613e8640 1 -- 172.21.15.117:0/4081805007 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f945c0d4840 con 0x7f945c15f0d0 2024-09-19T08:37:34.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f94613e8640 1 -- 172.21.15.117:0/4081805007 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f945c0d4b40 con 0x7f945c0d0070 2024-09-19T08:37:34.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f86eaffd640 1 --2- 172.21.15.117:0/2672600410 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f86dc06c380 0x7f86dc06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7fb7aad9d640 1 --2- 172.21.15.117:0/750022784 >> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] conn(0x7fb78c075ba0 0x7fb78c077fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f355a7fc640 1 --2- 172.21.15.117:0/2554866364 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f354806c520 0x7f354806e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.799+0000 7f8f227fc640 1 -- 172.21.15.117:0/3731331690 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c06d560 con 0x7f8f2400b1b0 2024-09-19T08:37:34.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f8f32898640 1 -- 172.21.15.117:0/3731331690 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8f14001030 con 0x7f8f2400b1b0 2024-09-19T08:37:34.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f8f227fc640 1 -- 172.21.15.117:0/3731331690 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8f2c0be070 con 0x7f8f2400b1b0 2024-09-19T08:37:34.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f86eaffd640 1 -- 172.21.15.117:0/2672600410 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f86f008b450 con 0x7f86f40369f0 2024-09-19T08:37:34.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f86eaffd640 1 --2- 172.21.15.117:0/2672600410 >> [v2:172.21.15.117:6824/782460519,v1:172.21.15.117:6825/782460519] conn(0x7f86dc075b00 0x7f86dc077f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f86fa59c640 1 --2- 172.21.15.117:0/2672600410 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f86dc06c380 0x7f86dc06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f86eaffd640 1 -- 172.21.15.117:0/2672600410 --> [v2:172.21.15.117:6824/782460519,v1:172.21.15.117:6825/782460519] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f86f0015e70 con 0x7f86dc075b00 2024-09-19T08:37:34.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f86eaffd640 1 -- 172.21.15.117:0/2672600410 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f86f008b840 con 0x7f86f40369f0 2024-09-19T08:37:34.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f8f227fc640 1 --2- 172.21.15.117:0/3731331690 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f8f1006c330 0x7f8f1006e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f78595c5640 1 -- 172.21.15.117:0/1752546719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f78540b30c0 con 0x7f78540aedf0 2024-09-19T08:37:34.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f355a7fc640 1 -- 172.21.15.117:0/2554866364 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f35600ac400 con 0x7f3564165de0 2024-09-19T08:37:34.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.800+0000 7fe8057fa640 1 -- 172.21.15.117:0/395862873 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe7f40050d0 con 0x7fe80815e4d0 2024-09-19T08:37:34.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.800+0000 7fe8057fa640 1 --2- 172.21.15.117:0/395862873 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe7ec06c6b0 0x7fe7ec06eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7fe8057fa640 1 -- 172.21.15.117:0/395862873 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe7f4018050 con 0x7fe80815e4d0 2024-09-19T08:37:34.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7fe8057fa640 1 --2- 172.21.15.117:0/395862873 >> [v2:172.21.15.146:6816/128066450,v1:172.21.15.146:6817/128066450] conn(0x7fe7ec075db0 0x7fe7ec0781f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7fe8057fa640 1 -- 172.21.15.117:0/395862873 --> [v2:172.21.15.146:6816/128066450,v1:172.21.15.146:6817/128066450] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7f4022e50 con 0x7fe7ec075db0 2024-09-19T08:37:34.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7fe8057fa640 1 -- 172.21.15.117:0/395862873 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe7f40955e0 con 0x7fe80815e4d0 2024-09-19T08:37:34.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7fe80cc6c640 1 --2- 172.21.15.117:0/395862873 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe7ec06c6b0 0x7fe7ec06eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7fe80d46d640 1 --2- 172.21.15.117:0/395862873 >> [v2:172.21.15.146:6816/128066450,v1:172.21.15.146:6817/128066450] conn(0x7fe7ec075db0 0x7fe7ec0781f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7f8f227fc640 1 -- 172.21.15.117:0/3731331690 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8f2c1272f0 con 0x7f8f2400b1b0 2024-09-19T08:37:34.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7fdd22ffd640 1 -- 172.21.15.117:0/2615170871 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c04d070 con 0x7fdd2c0cd710 2024-09-19T08:37:34.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7fdd22ffd640 1 -- 172.21.15.117:0/2615170871 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd1c048410 con 0x7fdd2c0cd710 2024-09-19T08:37:34.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7fdd22ffd640 1 -- 172.21.15.117:0/2615170871 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c048800 con 0x7fdd2c0cd710 2024-09-19T08:37:34.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7f86fad9d640 1 --2- 172.21.15.117:0/2672600410 >> [v2:172.21.15.117:6824/782460519,v1:172.21.15.117:6825/782460519] conn(0x7f86dc075b00 0x7f86dc077f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7f8f31896640 1 --2- 172.21.15.117:0/3731331690 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f8f1006c330 0x7f8f1006e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7f8f227fc640 1 --2- 172.21.15.117:0/3731331690 >> [v2:172.21.15.117:6800/2056750572,v1:172.21.15.117:6801/2056750572] conn(0x7f8f10075ab0 0x7f8f10077ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7f8f227fc640 1 -- 172.21.15.117:0/3731331690 --> [v2:172.21.15.117:6800/2056750572,v1:172.21.15.117:6801/2056750572] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8f2c06d1b0 con 0x7f8f10075ab0 2024-09-19T08:37:34.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7f8f227fc640 1 -- 172.21.15.117:0/3731331690 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8f2c12e050 con 0x7f8f2400b1b0 2024-09-19T08:37:34.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7f355a7fc640 1 --2- 172.21.15.117:0/2554866364 >> [v2:172.21.15.146:6808/2379859639,v1:172.21.15.146:6809/2379859639] conn(0x7f3548075ca0 0x7f35480780e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7f355a7fc640 1 -- 172.21.15.117:0/2554866364 --> [v2:172.21.15.146:6808/2379859639,v1:172.21.15.146:6809/2379859639] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3560001d30 con 0x7f3548075ca0 2024-09-19T08:37:34.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7f355a7fc640 1 -- 172.21.15.117:0/2554866364 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f35600ac7f0 con 0x7f3564165de0 2024-09-19T08:37:34.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f945a7fc640 1 -- 172.21.15.117:0/4081805007 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f945c0d0070 msgr2=0x7f945c0b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.801+0000 7f945a7fc640 1 --2- 172.21.15.117:0/4081805007 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f945c0d0070 0x7f945c0b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7f945a7fc640 1 -- 172.21.15.117:0/4081805007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f945c15f0d0 msgr2=0x7f945c0d1f90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T08:37:34.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7f945a7fc640 1 --2- 172.21.15.117:0/4081805007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f945c15f0d0 0x7f945c0d1f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7f945a7fc640 1 -- 172.21.15.117:0/4081805007 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945c0cbff0 con 0x7f945c0d1940 2024-09-19T08:37:34.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7f7850ff9640 1 -- 172.21.15.117:0/1752546719 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7844044070 con 0x7f78540aedf0 2024-09-19T08:37:34.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7f3569c29640 1 --2- 172.21.15.117:0/2554866364 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f354806c520 0x7f354806e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7fdd331ea640 1 -- 172.21.15.117:0/2615170871 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd2c15ac90 con 0x7fdd2c0cd710 2024-09-19T08:37:34.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7fe80d46d640 1 --2- 172.21.15.117:0/395862873 >> [v2:172.21.15.146:6816/128066450,v1:172.21.15.146:6817/128066450] conn(0x7fe7ec075db0 0x7fe7ec0781f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7fdd331ea640 1 -- 172.21.15.117:0/2615170871 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd2c15b250 con 0x7fdd2c0cd710 2024-09-19T08:37:34.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7f945a7fc640 1 --2- 172.21.15.117:0/4081805007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f945c0d1940 0x7f945c153b90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9450009890 tx=0x7f94500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7f86fa59c640 1 --2- 172.21.15.117:0/2672600410 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f86dc06c380 0x7f86dc06e840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f86fc06b500 tx=0x7f86fc050520 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7fb7aad9d640 1 --2- 172.21.15.117:0/750022784 >> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] conn(0x7fb78c075ba0 0x7fb78c077fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7f8f32097640 1 --2- 172.21.15.117:0/3731331690 >> [v2:172.21.15.117:6800/2056750572,v1:172.21.15.117:6801/2056750572] conn(0x7f8f10075ab0 0x7f8f10077ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.803+0000 7f7850ff9640 1 --2- 172.21.15.117:0/1752546719 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f784006c380 0x7f784006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.803+0000 7f7850ff9640 1 -- 172.21.15.117:0/1752546719 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f78440ac3c0 con 0x7f78540aedf0 2024-09-19T08:37:34.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.803+0000 7f7850ff9640 1 --2- 172.21.15.117:0/1752546719 >> [v2:172.21.15.117:6816/1107529373,v1:172.21.15.117:6817/1107529373] conn(0x7f7840075b00 0x7f7840077f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.802+0000 7f94437fe640 1 -- 172.21.15.117:0/4081805007 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9450037050 con 0x7f945c0d1940 2024-09-19T08:37:34.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.803+0000 7f94437fe640 1 -- 172.21.15.117:0/4081805007 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9450038040 con 0x7f945c0d1940 2024-09-19T08:37:34.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.803+0000 7f94437fe640 1 -- 172.21.15.117:0/4081805007 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945003cb50 con 0x7f945c0d1940 2024-09-19T08:37:34.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.803+0000 7f3569c29640 1 --2- 172.21.15.117:0/2554866364 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f354806c520 0x7f354806e9e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f35640c7040 tx=0x7f355c009590 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.803+0000 7f7850ff9640 1 -- 172.21.15.117:0/1752546719 --> [v2:172.21.15.117:6816/1107529373,v1:172.21.15.117:6817/1107529373] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7844034ec0 con 0x7f7840075b00 2024-09-19T08:37:34.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.803+0000 7f7850ff9640 1 -- 172.21.15.117:0/1752546719 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f78440b3050 con 0x7f78540aedf0 2024-09-19T08:37:34.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.803+0000 7f7858dc4640 1 --2- 172.21.15.117:0/1752546719 >> [v2:172.21.15.117:6816/1107529373,v1:172.21.15.117:6817/1107529373] conn(0x7f7840075b00 0x7f7840077f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.803+0000 7fe8057fa640 1 -- 172.21.15.117:0/395862873 <== osd.4 v2:172.21.15.146:6816/128066450 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe7f4022e50 con 0x7fe7ec075db0 2024-09-19T08:37:34.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.803+0000 7f356a42a640 1 --2- 172.21.15.117:0/2554866364 >> [v2:172.21.15.146:6808/2379859639,v1:172.21.15.146:6809/2379859639] conn(0x7f3548075ca0 0x7f35480780e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.803+0000 7f7858dc4640 1 --2- 172.21.15.117:0/1752546719 >> [v2:172.21.15.117:6816/1107529373,v1:172.21.15.117:6817/1107529373] conn(0x7f7840075b00 0x7f7840077f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.803+0000 7f94613e8640 1 -- 172.21.15.117:0/4081805007 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f945c0cc2d0 con 0x7f945c0d1940 2024-09-19T08:37:34.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.803+0000 7f94613e8640 1 -- 172.21.15.117:0/4081805007 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f945c0cc890 con 0x7f945c0d1940 2024-09-19T08:37:34.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.804+0000 7f86fad9d640 1 --2- 172.21.15.117:0/2672600410 >> [v2:172.21.15.117:6824/782460519,v1:172.21.15.117:6825/782460519] conn(0x7f86dc075b00 0x7f86dc077f40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.804+0000 7fe80cc6c640 1 --2- 172.21.15.117:0/395862873 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe7ec06c6b0 0x7fe7ec06eb70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc005880 tx=0x7fe7fc007a00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.804+0000 7f78537fe640 1 --2- 172.21.15.117:0/1752546719 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f784006c380 0x7f784006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.804+0000 7fdd331ea640 1 -- 172.21.15.117:0/2615170871 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdd2c071f60 con 0x7fdd2c0cd710 2024-09-19T08:37:34.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.804+0000 7f94417fa640 1 -- 172.21.15.117:0/4081805007 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f945c1540d0 con 0x7f945c0d1940 2024-09-19T08:37:34.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.804+0000 7f8f31896640 1 --2- 172.21.15.117:0/3731331690 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f8f1006c330 0x7f8f1006e7f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8f240d2970 tx=0x7f8f28008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.804+0000 7f8f32097640 1 --2- 172.21.15.117:0/3731331690 >> [v2:172.21.15.117:6800/2056750572,v1:172.21.15.117:6801/2056750572] conn(0x7f8f10075ab0 0x7f8f10077ef0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.804+0000 7fb79affd640 1 -- 172.21.15.117:0/750022784 <== osd.0 v2:172.21.15.117:6808/1962525121 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb79c0076b0 con 0x7fb78c075ba0 2024-09-19T08:37:34.877 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.805+0000 7f86eaffd640 1 -- 172.21.15.117:0/2672600410 <== osd.1 v2:172.21.15.117:6824/782460519 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f86f0015e70 con 0x7f86dc075b00 2024-09-19T08:37:34.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.805+0000 7f7850ff9640 1 -- 172.21.15.117:0/1752546719 <== osd.3 v2:172.21.15.117:6816/1107529373 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7844034ec0 con 0x7f7840075b00 2024-09-19T08:37:34.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.805+0000 7f94437fe640 1 -- 172.21.15.117:0/4081805007 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f945003ccf0 con 0x7f945c0d1940 2024-09-19T08:37:34.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.805+0000 7fdd22ffd640 1 -- 172.21.15.117:0/2615170871 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdd1c050070 con 0x7fdd2c0cd710 2024-09-19T08:37:34.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.806+0000 7f94437fe640 1 --2- 172.21.15.117:0/4081805007 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f944806c300 0x7f944806e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.806+0000 7f94437fe640 1 -- 172.21.15.117:0/4081805007 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f94500aca40 con 0x7f945c0d1940 2024-09-19T08:37:34.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.806+0000 7f94437fe640 1 --2- 172.21.15.117:0/4081805007 >> [v2:172.21.15.146:6824/1051984651,v1:172.21.15.146:6825/1051984651] conn(0x7f9448075a80 0x7f9448077ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.806+0000 7f94437fe640 1 -- 172.21.15.117:0/4081805007 --> [v2:172.21.15.146:6824/1051984651,v1:172.21.15.146:6825/1051984651] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9450039e50 con 0x7f9448075a80 2024-09-19T08:37:34.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.806+0000 7f94437fe640 1 -- 172.21.15.117:0/4081805007 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f94500acf20 con 0x7f945c0d1940 2024-09-19T08:37:34.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.805+0000 7fdd22ffd640 1 --2- 172.21.15.117:0/2615170871 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fdd1006c300 0x7fdd1006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.806+0000 7fdd22ffd640 1 -- 172.21.15.117:0/2615170871 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fdd1c0b3d20 con 0x7fdd2c0cd710 2024-09-19T08:37:34.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.806+0000 7fdd321e8640 1 --2- 172.21.15.117:0/2615170871 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fdd1006c300 0x7fdd1006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.806+0000 7fdd22ffd640 1 --2- 172.21.15.117:0/2615170871 >> [v2:172.21.15.146:6800/3875302444,v1:172.21.15.146:6801/3875302444] conn(0x7fdd10075a80 0x7fdd10077ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:34.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.806+0000 7fdd22ffd640 1 -- 172.21.15.117:0/2615170871 --> [v2:172.21.15.146:6800/3875302444,v1:172.21.15.146:6801/3875302444] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd1c044e50 con 0x7fdd10075a80 2024-09-19T08:37:34.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.806+0000 7fdd22ffd640 1 -- 172.21.15.117:0/2615170871 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdd1c0b7020 con 0x7fdd2c0cd710 2024-09-19T08:37:34.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.806+0000 7fdd321e8640 1 --2- 172.21.15.117:0/2615170871 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fdd1006c300 0x7fdd1006e7c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c06ed90 tx=0x7fdd28009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.805+0000 7f8f227fc640 1 -- 172.21.15.117:0/3731331690 <== osd.2 v2:172.21.15.117:6800/2056750572 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8f2c06d1b0 con 0x7f8f10075ab0 2024-09-19T08:37:34.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.807+0000 7f945b7fe640 1 --2- 172.21.15.117:0/4081805007 >> [v2:172.21.15.146:6824/1051984651,v1:172.21.15.146:6825/1051984651] conn(0x7f9448075a80 0x7f9448077ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.807+0000 7f945affd640 1 --2- 172.21.15.117:0/4081805007 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f944806c300 0x7f944806e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.806+0000 7f356a42a640 1 --2- 172.21.15.117:0/2554866364 >> [v2:172.21.15.146:6808/2379859639,v1:172.21.15.146:6809/2379859639] conn(0x7f3548075ca0 0x7f35480780e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.807+0000 7fdd329e9640 1 --2- 172.21.15.117:0/2615170871 >> [v2:172.21.15.146:6800/3875302444,v1:172.21.15.146:6801/3875302444] conn(0x7fdd10075a80 0x7fdd10077ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:34.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.807+0000 7f945b7fe640 1 --2- 172.21.15.117:0/4081805007 >> [v2:172.21.15.146:6824/1051984651,v1:172.21.15.146:6825/1051984651] conn(0x7f9448075a80 0x7f9448077ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.807+0000 7fdd329e9640 1 --2- 172.21.15.117:0/2615170871 >> [v2:172.21.15.146:6800/3875302444,v1:172.21.15.146:6801/3875302444] conn(0x7fdd10075a80 0x7fdd10077ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.807+0000 7f945affd640 1 --2- 172.21.15.117:0/4081805007 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f944806c300 0x7f944806e7c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f944c006ca0 tx=0x7f944c009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.807+0000 7f355a7fc640 1 -- 172.21.15.117:0/2554866364 <== osd.6 v2:172.21.15.146:6808/2379859639 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3560001d30 con 0x7f3548075ca0 2024-09-19T08:37:34.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.808+0000 7f78537fe640 1 --2- 172.21.15.117:0/1752546719 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f784006c380 0x7f784006e840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f78540afb40 tx=0x7f7848009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:34.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.808+0000 7f94437fe640 1 -- 172.21.15.117:0/4081805007 <== osd.5 v2:172.21.15.146:6824/1051984651 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9450039e50 con 0x7f9448075a80 2024-09-19T08:37:34.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.808+0000 7fdd22ffd640 1 -- 172.21.15.117:0/2615170871 <== osd.7 v2:172.21.15.146:6800/3875302444 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdd1c044e50 con 0x7fdd10075a80 2024-09-19T08:37:34.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.821+0000 7f356ac2b640 1 -- 172.21.15.117:0/2554866364 --> [v2:172.21.15.146:6808/2379859639,v1:172.21.15.146:6809/2379859639] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f35640b8cf0 con 0x7f3548075ca0 2024-09-19T08:37:34.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.822+0000 7f355a7fc640 1 -- 172.21.15.117:0/2554866364 <== osd.6 v2:172.21.15.146:6808/2379859639 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f35640b8cf0 con 0x7f3548075ca0 2024-09-19T08:37:34.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.822+0000 7f356ac2b640 1 -- 172.21.15.117:0/2554866364 >> [v2:172.21.15.146:6808/2379859639,v1:172.21.15.146:6809/2379859639] conn(0x7f3548075ca0 msgr2=0x7f35480780e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.822+0000 7f356ac2b640 1 --2- 172.21.15.117:0/2554866364 >> [v2:172.21.15.146:6808/2379859639,v1:172.21.15.146:6809/2379859639] conn(0x7f3548075ca0 0x7f35480780e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.823+0000 7f356ac2b640 1 -- 172.21.15.117:0/2554866364 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f354806c520 msgr2=0x7f354806e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.823+0000 7f356ac2b640 1 --2- 172.21.15.117:0/2554866364 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f354806c520 0x7f354806e9e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f35640c7040 tx=0x7f355c009590 comp rx=0 tx=0).stop 2024-09-19T08:37:34.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.823+0000 7f356ac2b640 1 -- 172.21.15.117:0/2554866364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3564165de0 msgr2=0x7f356415b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.823+0000 7f356ac2b640 1 --2- 172.21.15.117:0/2554866364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3564165de0 0x7f356415b330 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f35600097c0 tx=0x7f35600046c0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.823+0000 7f356a42a640 1 -- 172.21.15.117:0/2554866364 reap_dead start 2024-09-19T08:37:34.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.823+0000 7f356ac2b640 1 -- 172.21.15.117:0/2554866364 shutdown_connections 2024-09-19T08:37:34.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.823+0000 7f356ac2b640 1 -- 172.21.15.117:0/2554866364 >> 172.21.15.117:0/2554866364 conn(0x7f356408dc80 msgr2=0x7f35640d33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:34.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.823+0000 7f356ac2b640 1 -- 172.21.15.117:0/2554866364 shutdown_connections 2024-09-19T08:37:34.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.823+0000 7f356ac2b640 1 -- 172.21.15.117:0/2554866364 wait complete. 2024-09-19T08:37:34.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.834+0000 7fe80eed0640 1 -- 172.21.15.117:0/395862873 --> [v2:172.21.15.146:6816/128066450,v1:172.21.15.146:6817/128066450] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe808162da0 con 0x7fe7ec075db0 2024-09-19T08:37:34.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.835+0000 7fb7b0b3b640 1 -- 172.21.15.117:0/750022784 --> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb7ac0cf600 con 0x7fb78c075ba0 2024-09-19T08:37:34.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.835+0000 7f86fb59e640 1 -- 172.21.15.117:0/2672600410 --> [v2:172.21.15.117:6824/782460519,v1:172.21.15.117:6825/782460519] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f86f400b420 con 0x7f86dc075b00 2024-09-19T08:37:34.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.835+0000 7fb79affd640 1 -- 172.21.15.117:0/750022784 <== osd.0 v2:172.21.15.117:6808/1962525121 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb7ac0cf600 con 0x7fb78c075ba0 2024-09-19T08:37:34.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.835+0000 7f86eaffd640 1 -- 172.21.15.117:0/2672600410 <== osd.1 v2:172.21.15.117:6824/782460519 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f86f400b420 con 0x7f86dc075b00 2024-09-19T08:37:34.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.835+0000 7fe8057fa640 1 -- 172.21.15.117:0/395862873 <== osd.4 v2:172.21.15.146:6816/128066450 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe808162da0 con 0x7fe7ec075db0 2024-09-19T08:37:34.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.836+0000 7fb798ff9640 1 -- 172.21.15.117:0/750022784 >> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] conn(0x7fb78c075ba0 msgr2=0x7fb78c077fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.836+0000 7fb798ff9640 1 --2- 172.21.15.117:0/750022784 >> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] conn(0x7fb78c075ba0 0x7fb78c077fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.836+0000 7f78595c5640 1 -- 172.21.15.117:0/1752546719 --> [v2:172.21.15.117:6816/1107529373,v1:172.21.15.117:6817/1107529373] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7854161490 con 0x7f7840075b00 2024-09-19T08:37:34.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.836+0000 7fe7f2ffd640 1 -- 172.21.15.117:0/395862873 >> [v2:172.21.15.146:6816/128066450,v1:172.21.15.146:6817/128066450] conn(0x7fe7ec075db0 msgr2=0x7fe7ec0781f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.836+0000 7fe7f2ffd640 1 --2- 172.21.15.117:0/395862873 >> [v2:172.21.15.146:6816/128066450,v1:172.21.15.146:6817/128066450] conn(0x7fe7ec075db0 0x7fe7ec0781f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.836+0000 7fb798ff9640 1 -- 172.21.15.117:0/750022784 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb78c06c4b0 msgr2=0x7fb78c06e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.836+0000 7fb798ff9640 1 --2- 172.21.15.117:0/750022784 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb78c06c4b0 0x7fb78c06e970 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0006fd0 tx=0x7fb7a0008040 comp rx=0 tx=0).stop 2024-09-19T08:37:34.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.836+0000 7fb798ff9640 1 -- 172.21.15.117:0/750022784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7ac0b4220 msgr2=0x7fb7ac144900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.836+0000 7fb798ff9640 1 --2- 172.21.15.117:0/750022784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7ac0b4220 0x7fb7ac144900 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00c410 tx=0x7fb79c00c8d0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.836+0000 7fb7aad9d640 1 -- 172.21.15.117:0/750022784 reap_dead start 2024-09-19T08:37:34.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.836+0000 7fb798ff9640 1 -- 172.21.15.117:0/750022784 shutdown_connections 2024-09-19T08:37:34.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.836+0000 7fb798ff9640 1 -- 172.21.15.117:0/750022784 >> 172.21.15.117:0/750022784 conn(0x7fb7ac067fe0 msgr2=0x7fb7ac06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:34.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.836+0000 7f86e8ff9640 1 -- 172.21.15.117:0/2672600410 >> [v2:172.21.15.117:6824/782460519,v1:172.21.15.117:6825/782460519] conn(0x7f86dc075b00 msgr2=0x7f86dc077f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.836+0000 7f86e8ff9640 1 --2- 172.21.15.117:0/2672600410 >> [v2:172.21.15.117:6824/782460519,v1:172.21.15.117:6825/782460519] conn(0x7f86dc075b00 0x7f86dc077f40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.836+0000 7f86e8ff9640 1 -- 172.21.15.117:0/2672600410 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f86dc06c380 msgr2=0x7f86dc06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.836+0000 7f86e8ff9640 1 --2- 172.21.15.117:0/2672600410 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f86dc06c380 0x7f86dc06e840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f86fc06b500 tx=0x7f86fc050520 comp rx=0 tx=0).stop 2024-09-19T08:37:34.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.836+0000 7f86e8ff9640 1 -- 172.21.15.117:0/2672600410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86f40369f0 msgr2=0x7f86f40373c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.836+0000 7f86e8ff9640 1 --2- 172.21.15.117:0/2672600410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86f40369f0 0x7f86f40373c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f86f000c3c0 tx=0x7f86f000c7c0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.836+0000 7f86fad9d640 1 -- 172.21.15.117:0/2672600410 reap_dead start 2024-09-19T08:37:34.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.836+0000 7f86e8ff9640 1 -- 172.21.15.117:0/2672600410 shutdown_connections 2024-09-19T08:37:34.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.836+0000 7f86e8ff9640 1 -- 172.21.15.117:0/2672600410 >> 172.21.15.117:0/2672600410 conn(0x7f86f401ea30 msgr2=0x7f86f4007720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:34.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.837+0000 7fb798ff9640 1 -- 172.21.15.117:0/750022784 shutdown_connections 2024-09-19T08:37:34.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.837+0000 7fb798ff9640 1 -- 172.21.15.117:0/750022784 wait complete. 2024-09-19T08:37:34.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.837+0000 7f86e8ff9640 1 -- 172.21.15.117:0/2672600410 shutdown_connections 2024-09-19T08:37:34.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.837+0000 7f86e8ff9640 1 -- 172.21.15.117:0/2672600410 wait complete. 2024-09-19T08:37:34.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.837+0000 7f7850ff9640 1 -- 172.21.15.117:0/1752546719 <== osd.3 v2:172.21.15.117:6816/1107529373 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7854161490 con 0x7f7840075b00 2024-09-19T08:37:34.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.837+0000 7fe7f2ffd640 1 -- 172.21.15.117:0/395862873 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe7ec06c6b0 msgr2=0x7fe7ec06eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.837+0000 7fe7f2ffd640 1 --2- 172.21.15.117:0/395862873 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe7ec06c6b0 0x7fe7ec06eb70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc005880 tx=0x7fe7fc007a00 comp rx=0 tx=0).stop 2024-09-19T08:37:34.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.837+0000 7fe7f2ffd640 1 -- 172.21.15.117:0/395862873 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe80815e4d0 msgr2=0x7fe8080cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.837+0000 7fe7f2ffd640 1 --2- 172.21.15.117:0/395862873 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe80815e4d0 0x7fe8080cdee0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4001b20 tx=0x7fe7f4014420 comp rx=0 tx=0).stop 2024-09-19T08:37:34.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.837+0000 7fe80d46d640 1 -- 172.21.15.117:0/395862873 reap_dead start 2024-09-19T08:37:34.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.837+0000 7fe7f2ffd640 1 -- 172.21.15.117:0/395862873 shutdown_connections 2024-09-19T08:37:34.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.837+0000 7fe7f2ffd640 1 -- 172.21.15.117:0/395862873 >> 172.21.15.117:0/395862873 conn(0x7fe80809d770 msgr2=0x7fe8080b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:34.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.837+0000 7fe7f2ffd640 1 -- 172.21.15.117:0/395862873 shutdown_connections 2024-09-19T08:37:34.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.837+0000 7fe7f2ffd640 1 -- 172.21.15.117:0/395862873 wait complete. 2024-09-19T08:37:34.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.838+0000 7f78595c5640 1 -- 172.21.15.117:0/1752546719 >> [v2:172.21.15.117:6816/1107529373,v1:172.21.15.117:6817/1107529373] conn(0x7f7840075b00 msgr2=0x7f7840077f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.838+0000 7f78595c5640 1 --2- 172.21.15.117:0/1752546719 >> [v2:172.21.15.117:6816/1107529373,v1:172.21.15.117:6817/1107529373] conn(0x7f7840075b00 0x7f7840077f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.838+0000 7f78595c5640 1 -- 172.21.15.117:0/1752546719 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f784006c380 msgr2=0x7f784006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.838+0000 7f78595c5640 1 --2- 172.21.15.117:0/1752546719 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f784006c380 0x7f784006e840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f78540afb40 tx=0x7f7848009060 comp rx=0 tx=0).stop 2024-09-19T08:37:34.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.838+0000 7f78595c5640 1 -- 172.21.15.117:0/1752546719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78540aedf0 msgr2=0x7f785413dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.838+0000 7f78595c5640 1 --2- 172.21.15.117:0/1752546719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78540aedf0 0x7f785413dc70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7844009870 tx=0x7f78440046c0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.898 INFO:teuthology.orchestra.run.smithi117.stdout:64424509450 2024-09-19T08:37:34.898 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-19T08:37:34.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.839+0000 7f7858dc4640 1 -- 172.21.15.117:0/1752546719 reap_dead start 2024-09-19T08:37:34.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.839+0000 7f78595c5640 1 -- 172.21.15.117:0/1752546719 shutdown_connections 2024-09-19T08:37:34.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.839+0000 7f78595c5640 1 -- 172.21.15.117:0/1752546719 >> 172.21.15.117:0/1752546719 conn(0x7f785406dae0 msgr2=0x7f7854160410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:34.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.839+0000 7fdd331ea640 1 -- 172.21.15.117:0/2615170871 --> [v2:172.21.15.146:6800/3875302444,v1:172.21.15.146:6801/3875302444] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdd2c160e60 con 0x7fdd10075a80 2024-09-19T08:37:34.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.839+0000 7f78595c5640 1 -- 172.21.15.117:0/1752546719 shutdown_connections 2024-09-19T08:37:34.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.839+0000 7f78595c5640 1 -- 172.21.15.117:0/1752546719 wait complete. 2024-09-19T08:37:34.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.839+0000 7f8f32898640 1 -- 172.21.15.117:0/3731331690 --> [v2:172.21.15.117:6800/2056750572,v1:172.21.15.117:6801/2056750572] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8f14002dd0 con 0x7f8f10075ab0 2024-09-19T08:37:34.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.840+0000 7fdd22ffd640 1 -- 172.21.15.117:0/2615170871 <== osd.7 v2:172.21.15.146:6800/3875302444 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdd2c160e60 con 0x7fdd10075a80 2024-09-19T08:37:34.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.840+0000 7f8f227fc640 1 -- 172.21.15.117:0/3731331690 <== osd.2 v2:172.21.15.117:6800/2056750572 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8f14002dd0 con 0x7f8f10075ab0 2024-09-19T08:37:34.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.840+0000 7fdd331ea640 1 -- 172.21.15.117:0/2615170871 >> [v2:172.21.15.146:6800/3875302444,v1:172.21.15.146:6801/3875302444] conn(0x7fdd10075a80 msgr2=0x7fdd10077ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.840+0000 7fdd331ea640 1 --2- 172.21.15.117:0/2615170871 >> [v2:172.21.15.146:6800/3875302444,v1:172.21.15.146:6801/3875302444] conn(0x7fdd10075a80 0x7fdd10077ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.841+0000 7f8f32898640 1 -- 172.21.15.117:0/3731331690 >> [v2:172.21.15.117:6800/2056750572,v1:172.21.15.117:6801/2056750572] conn(0x7f8f10075ab0 msgr2=0x7f8f10077ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.841+0000 7f8f32898640 1 --2- 172.21.15.117:0/3731331690 >> [v2:172.21.15.117:6800/2056750572,v1:172.21.15.117:6801/2056750572] conn(0x7f8f10075ab0 0x7f8f10077ef0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.840+0000 7fdd331ea640 1 -- 172.21.15.117:0/2615170871 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fdd1006c300 msgr2=0x7fdd1006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.841+0000 7fdd331ea640 1 --2- 172.21.15.117:0/2615170871 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fdd1006c300 0x7fdd1006e7c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c06ed90 tx=0x7fdd28009240 comp rx=0 tx=0).stop 2024-09-19T08:37:34.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.841+0000 7fdd331ea640 1 -- 172.21.15.117:0/2615170871 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd2c0cd710 msgr2=0x7fdd2c15a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.841+0000 7fdd331ea640 1 --2- 172.21.15.117:0/2615170871 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd2c0cd710 0x7fdd2c15a540 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c031000 tx=0x7fdd1c004730 comp rx=0 tx=0).stop 2024-09-19T08:37:34.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.841+0000 7fdd329e9640 1 -- 172.21.15.117:0/2615170871 reap_dead start 2024-09-19T08:37:34.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.841+0000 7f8f32898640 1 -- 172.21.15.117:0/3731331690 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f8f1006c330 msgr2=0x7f8f1006e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.841+0000 7f8f32898640 1 --2- 172.21.15.117:0/3731331690 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f8f1006c330 0x7f8f1006e7f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8f240d2970 tx=0x7f8f28008040 comp rx=0 tx=0).stop 2024-09-19T08:37:34.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.841+0000 7f8f32898640 1 -- 172.21.15.117:0/3731331690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f2400b1b0 msgr2=0x7f8f2400b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.841+0000 7f8f32898640 1 --2- 172.21.15.117:0/3731331690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f2400b1b0 0x7f8f2400b630 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0759e0 tx=0x7f8f2c0699b0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.841+0000 7f8f32097640 1 -- 172.21.15.117:0/3731331690 reap_dead start 2024-09-19T08:37:34.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.841+0000 7fdd331ea640 1 -- 172.21.15.117:0/2615170871 shutdown_connections 2024-09-19T08:37:34.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.841+0000 7fdd331ea640 1 -- 172.21.15.117:0/2615170871 >> 172.21.15.117:0/2615170871 conn(0x7fdd2c067b30 msgr2=0x7fdd2c06e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:34.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.841+0000 7f8f32898640 1 -- 172.21.15.117:0/3731331690 shutdown_connections 2024-09-19T08:37:34.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.841+0000 7f8f32898640 1 -- 172.21.15.117:0/3731331690 >> 172.21.15.117:0/3731331690 conn(0x7f8f2401ea30 msgr2=0x7f8f240d9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:34.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.841+0000 7f8f32898640 1 -- 172.21.15.117:0/3731331690 shutdown_connections 2024-09-19T08:37:34.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.841+0000 7f8f32898640 1 -- 172.21.15.117:0/3731331690 wait complete. 2024-09-19T08:37:34.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.841+0000 7fdd331ea640 1 -- 172.21.15.117:0/2615170871 shutdown_connections 2024-09-19T08:37:34.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.841+0000 7fdd331ea640 1 -- 172.21.15.117:0/2615170871 wait complete. 2024-09-19T08:37:34.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.842+0000 7f94417fa640 1 -- 172.21.15.117:0/4081805007 --> [v2:172.21.15.146:6824/1051984651,v1:172.21.15.146:6825/1051984651] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f945c1540d0 con 0x7f9448075a80 2024-09-19T08:37:34.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.846+0000 7f94437fe640 1 -- 172.21.15.117:0/4081805007 <== osd.5 v2:172.21.15.146:6824/1051984651 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9454001800 con 0x7f9448075a80 2024-09-19T08:37:34.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.846+0000 7f94417fa640 1 -- 172.21.15.117:0/4081805007 >> [v2:172.21.15.146:6824/1051984651,v1:172.21.15.146:6825/1051984651] conn(0x7f9448075a80 msgr2=0x7f9448077ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.846+0000 7f94417fa640 1 --2- 172.21.15.117:0/4081805007 >> [v2:172.21.15.146:6824/1051984651,v1:172.21.15.146:6825/1051984651] conn(0x7f9448075a80 0x7f9448077ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.847+0000 7f94417fa640 1 -- 172.21.15.117:0/4081805007 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f944806c300 msgr2=0x7f944806e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.847+0000 7f94417fa640 1 --2- 172.21.15.117:0/4081805007 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f944806c300 0x7f944806e7c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f944c006ca0 tx=0x7f944c009240 comp rx=0 tx=0).stop 2024-09-19T08:37:34.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.847+0000 7f94417fa640 1 -- 172.21.15.117:0/4081805007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f945c0d1940 msgr2=0x7f945c153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:34.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.847+0000 7f94417fa640 1 --2- 172.21.15.117:0/4081805007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f945c0d1940 0x7f945c153b90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9450009890 tx=0x7f94500046c0 comp rx=0 tx=0).stop 2024-09-19T08:37:34.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.847+0000 7f945b7fe640 1 -- 172.21.15.117:0/4081805007 reap_dead start 2024-09-19T08:37:34.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.847+0000 7f94417fa640 1 -- 172.21.15.117:0/4081805007 shutdown_connections 2024-09-19T08:37:34.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.847+0000 7f94417fa640 1 -- 172.21.15.117:0/4081805007 >> 172.21.15.117:0/4081805007 conn(0x7f945c09d760 msgr2=0x7f945c15c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:34.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.847+0000 7f94417fa640 1 -- 172.21.15.117:0/4081805007 shutdown_connections 2024-09-19T08:37:34.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:34.847+0000 7f94417fa640 1 -- 172.21.15.117:0/4081805007 wait complete. 2024-09-19T08:37:34.908 INFO:teuthology.orchestra.run.smithi117.stdout:64424509450 2024-09-19T08:37:34.908 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-19T08:37:34.909 INFO:teuthology.orchestra.run.smithi117.stdout:64424509449 2024-09-19T08:37:34.909 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-19T08:37:34.910 INFO:teuthology.orchestra.run.smithi117.stdout:64424509451 2024-09-19T08:37:34.910 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-19T08:37:34.911 INFO:teuthology.orchestra.run.smithi117.stdout:64424509449 2024-09-19T08:37:34.911 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T08:37:34.912 INFO:teuthology.orchestra.run.smithi117.stdout:64424509450 2024-09-19T08:37:34.912 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-19T08:37:34.913 INFO:teuthology.orchestra.run.smithi117.stdout:60129542154 2024-09-19T08:37:34.913 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-19T08:37:34.914 INFO:teuthology.orchestra.run.smithi117.stdout:64424509450 2024-09-19T08:37:34.914 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-19T08:37:35.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.115+0000 7f11d5998640 1 Processor -- start 2024-09-19T08:37:35.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.115+0000 7f11d5998640 1 -- start start 2024-09-19T08:37:35.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.116+0000 7f70b031a640 1 Processor -- start 2024-09-19T08:37:35.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.116+0000 7ff127581640 1 Processor -- start 2024-09-19T08:37:35.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.116+0000 7f70b031a640 1 -- start start 2024-09-19T08:37:35.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.116+0000 7f11d5998640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11d00b5c70 0x7f11d00b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.116+0000 7f11d5998640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11d0070720 0x7f11d015f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.116+0000 7f11d5998640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11d015ea40 con 0x7f11d015f760 2024-09-19T08:37:35.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.116+0000 7f11d5998640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f11d00b47b0 con 0x7f11d0070720 2024-09-19T08:37:35.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.116+0000 7f11d5998640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f11d00b4a90 con 0x7f11d00b5c70 2024-09-19T08:37:35.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.116+0000 7ff127581640 1 -- start start 2024-09-19T08:37:35.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.117+0000 7f0074ffc640 1 Processor -- start 2024-09-19T08:37:35.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.117+0000 7f0074ffc640 1 -- start start 2024-09-19T08:37:35.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.117+0000 7f11ce7fc640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11d0070720 0x7f11d015f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.117+0000 7f11ce7fc640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11d0070720 0x7f11d015f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.117:48248/0 (socket says 172.21.15.117:48248) 2024-09-19T08:37:35.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.117+0000 7f11ce7fc640 1 -- 172.21.15.117:0/4128513392 learned_addr learned my addr 172.21.15.117:0/4128513392 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:35.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.117+0000 7f11ceffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11d00b5c70 0x7f11d00b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.117+0000 7f11ce7fc640 1 -- 172.21.15.117:0/4128513392 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11d00b5c70 msgr2=0x7f11d00b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:35.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.117+0000 7f11ce7fc640 1 --2- 172.21.15.117:0/4128513392 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11d00b5c70 0x7f11d00b3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.117+0000 7f11ce7fc640 1 -- 172.21.15.117:0/4128513392 >> v1:172.21.15.146:6789/0 conn(0x7f11d015f760 legacy=0x7f11d006e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:35.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.117+0000 7f11ce7fc640 1 -- 172.21.15.117:0/4128513392 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d00b4d70 con 0x7f11d0070720 2024-09-19T08:37:35.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.117+0000 7f11ceffd640 1 --2- 172.21.15.117:0/4128513392 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11d00b5c70 0x7f11d00b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:37:35.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.117+0000 7ff127581640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff120165e50 0x7ff1200b3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7ff127581640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff1200b6570 0x7ff1200b8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7ff127581640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1200b7bf0 con 0x7ff1200b8690 2024-09-19T08:37:35.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.117+0000 7f70b031a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f70a8162530 0x7f70a80726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7ff127581640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff1200b8200 con 0x7ff1200b6570 2024-09-19T08:37:35.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7ff127581640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7ff1200d2bb0 con 0x7ff120165e50 2024-09-19T08:37:35.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7f70b031a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f70a806dae0 0x7f70a806df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.117+0000 7f5027227640 1 Processor -- start 2024-09-19T08:37:35.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.117+0000 7f5027227640 1 -- start start 2024-09-19T08:37:35.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7ff12531d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff120165e50 0x7ff1200b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7ff12531d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff120165e50 0x7ff1200b3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.117:57880/0 (socket says 172.21.15.117:57880) 2024-09-19T08:37:35.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7ff12531d640 1 -- 172.21.15.117:0/9084704 learned_addr learned my addr 172.21.15.117:0/9084704 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:35.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7ff124b1c640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff1200b8690 0x7ff1200b5e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.117:43514/0 (socket says 172.21.15.117:43514) 2024-09-19T08:37:35.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7f70b031a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70a80b4c80 con 0x7f70a80b3d20 2024-09-19T08:37:35.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7f70b031a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f70a8072c20 con 0x7f70a806dae0 2024-09-19T08:37:35.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7f70b031a640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f70a806e490 con 0x7f70a8162530 2024-09-19T08:37:35.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.117+0000 7f1794dff640 1 Processor -- start 2024-09-19T08:37:35.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.117+0000 7f1794dff640 1 -- start start 2024-09-19T08:37:35.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7f70ad8b5640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f70a80b3d20 0x7f70a80b4370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.117:43530/0 (socket says 172.21.15.117:43530) 2024-09-19T08:37:35.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7f70ad8b5640 1 -- 172.21.15.117:0/845475547 learned_addr learned my addr 172.21.15.117:0/845475547 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:35.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7f70ae0b6640 1 --2- 172.21.15.117:0/845475547 >> v2:172.21.15.146:3300/0 conn(0x7f70a8162530 0x7f70a80726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7f70ae8b7640 1 --2- 172.21.15.117:0/845475547 >> v2:172.21.15.117:3300/0 conn(0x7f70a806dae0 0x7f70a806df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7f966b1d8640 1 Processor -- start 2024-09-19T08:37:35.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7ff125b1e640 1 --2- 172.21.15.117:0/9084704 >> v2:172.21.15.117:3300/0 conn(0x7ff1200b6570 0x7ff1200b8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7ff117fff640 1 -- 172.21.15.117:0/9084704 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3352321403 0 0) 0x7ff1200b7bf0 con 0x7ff1200b8690 2024-09-19T08:37:35.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7ff117fff640 1 -- 172.21.15.117:0/9084704 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff10c003520 con 0x7ff1200b8690 2024-09-19T08:37:35.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7ff12531d640 1 -- 172.21.15.117:0/9084704 >> v2:172.21.15.117:3300/0 conn(0x7ff1200b6570 msgr2=0x7ff1200b8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:35.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f0074ffc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f006803bc60 0x7f0068053790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f0074ffc640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0068057830 0x7f00680066b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f0074ffc640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0068057d80 con 0x7f00680e28f0 2024-09-19T08:37:35.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f0074ffc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0068058060 con 0x7f006803bc60 2024-09-19T08:37:35.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f0074ffc640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f0068005eb0 con 0x7f0068057830 2024-09-19T08:37:35.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f006ffff640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0068057830 0x7f00680066b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f006f7fe640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f00680e28f0 0x7f0068053080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.117:43536/0 (socket says 172.21.15.117:43536) 2024-09-19T08:37:35.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f006f7fe640 1 -- 172.21.15.117:0/2207171505 learned_addr learned my addr 172.21.15.117:0/2207171505 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:35.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f006ffff640 1 -- 172.21.15.117:0/2207171505 >> v2:172.21.15.117:3300/0 conn(0x7f006803bc60 msgr2=0x7f0068053790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:35.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f006ffff640 1 --2- 172.21.15.117:0/2207171505 >> v2:172.21.15.117:3300/0 conn(0x7f006803bc60 0x7f0068053790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f006ffff640 1 -- 172.21.15.117:0/2207171505 >> v1:172.21.15.146:6789/0 conn(0x7f00680e28f0 legacy=0x7f0068053080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f006ffff640 1 -- 172.21.15.117:0/2207171505 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0068006190 con 0x7f0068057830 2024-09-19T08:37:35.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7ff12531d640 1 --2- 172.21.15.117:0/9084704 >> v2:172.21.15.117:3300/0 conn(0x7ff1200b6570 0x7ff1200b8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7ff12531d640 1 -- 172.21.15.117:0/9084704 >> v1:172.21.15.146:6789/0 conn(0x7ff1200b8690 legacy=0x7ff1200b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7ff12531d640 1 -- 172.21.15.117:0/9084704 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1200d2e90 con 0x7ff120165e50 2024-09-19T08:37:35.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7ff125b1e640 1 --2- 172.21.15.117:0/9084704 >> v2:172.21.15.117:3300/0 conn(0x7ff1200b6570 0x7ff1200b8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:35.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f1794dff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179015b180 0x7f17900ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f1794dff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f179015b630 con 0x7f179006e1f0 2024-09-19T08:37:35.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f1794dff640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17900cdc50 con 0x7f1790151020 2024-09-19T08:37:35.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f1794dff640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f1790072ac0 con 0x7f179015b180 2024-09-19T08:37:35.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f178dd9b640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f179006e1f0 0x7f17900ce0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:54830/0 (socket says 172.21.15.117:54830) 2024-09-19T08:37:35.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f178dd9b640 1 -- 172.21.15.117:0/3136478443 learned_addr learned my addr 172.21.15.117:0/3136478443 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:35.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f5024fc3640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f502006bc10 0x7f502006bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:54814/0 (socket says 172.21.15.117:54814) 2024-09-19T08:37:35.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f5024fc3640 1 -- 172.21.15.117:0/1710869885 learned_addr learned my addr 172.21.15.117:0/1710869885 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:35.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f5027227640 1 --2- 172.21.15.117:0/1710869885 >> v2:172.21.15.146:3300/0 conn(0x7f50201639e0 0x7f50200b2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f5027227640 1 --2- 172.21.15.117:0/1710869885 >> v2:172.21.15.117:3300/0 conn(0x7f50200b4110 0x7f50200b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7f11ce7fc640 1 --2- 172.21.15.117:0/4128513392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11d0070720 0x7f11d015f220 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009e50 tx=0x7f11c402a6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ddf6803b4cedfec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f11cdffb640 1 -- 172.21.15.117:0/4128513392 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c4036070 con 0x7f11d0070720 2024-09-19T08:37:35.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f11cdffb640 1 -- 172.21.15.117:0/4128513392 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11c4031600 con 0x7f11d0070720 2024-09-19T08:37:35.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f11cdffb640 1 -- 172.21.15.117:0/4128513392 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c40319d0 con 0x7f11d0070720 2024-09-19T08:37:35.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f70ad0b4640 1 -- 172.21.15.117:0/845475547 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3482811005 0 0) 0x7f70a80b4c80 con 0x7f70a80b3d20 2024-09-19T08:37:35.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f70ad0b4640 1 -- 172.21.15.117:0/845475547 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7094003520 con 0x7f70a80b3d20 2024-09-19T08:37:35.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f70ae0b6640 1 -- 172.21.15.117:0/845475547 >> v2:172.21.15.117:3300/0 conn(0x7f70a806dae0 msgr2=0x7f70a806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:35.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f70ae0b6640 1 --2- 172.21.15.117:0/845475547 >> v2:172.21.15.117:3300/0 conn(0x7f70a806dae0 0x7f70a806df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f70ae0b6640 1 -- 172.21.15.117:0/845475547 >> v1:172.21.15.146:6789/0 conn(0x7f70a80b3d20 legacy=0x7f70a80b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.119+0000 7f70ae0b6640 1 -- 172.21.15.117:0/845475547 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a8071c00 con 0x7f70a8162530 2024-09-19T08:37:35.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.118+0000 7f966b1d8640 1 -- start start 2024-09-19T08:37:35.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7f966b1d8640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9664099ae0 0x7f96640d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7f2b04023640 1 Processor -- start 2024-09-19T08:37:35.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7f50257c4640 1 --2- 172.21.15.117:0/1710869885 >> v2:172.21.15.117:3300/0 conn(0x7f50200b4110 0x7f50200b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7f501ffff640 1 --2- 172.21.15.117:0/1710869885 >> v2:172.21.15.146:3300/0 conn(0x7f50201639e0 0x7f50200b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7ff12531d640 1 --2- 172.21.15.117:0/9084704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff120165e50 0x7ff1200b3510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff118009e50 tx=0x7ff11802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=610114a197e046ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7f5027227640 1 -- 172.21.15.117:0/1710869885 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50200b6340 con 0x7f502006bc10 2024-09-19T08:37:35.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7f178d59a640 1 -- 172.21.15.117:0/3136478443 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 915547756 0 0) 0x7f179015b630 con 0x7f179006e1f0 2024-09-19T08:37:35.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7f9668f74640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f96640c5690 0x7f9664162d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.117:43548/0 (socket says 172.21.15.117:43548) 2024-09-19T08:37:35.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7f178d59a640 1 -- 172.21.15.117:0/3136478443 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1778003520 con 0x7f179006e1f0 2024-09-19T08:37:35.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7f9663fff640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9664099ae0 0x7f96640d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7f9663fff640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9664099ae0 0x7f96640d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.117:48298/0 (socket says 172.21.15.117:48298) 2024-09-19T08:37:35.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7f178ed9d640 1 --2- 172.21.15.117:0/3136478443 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179015b180 0x7f17900ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7f70ae0b6640 1 --2- 172.21.15.117:0/845475547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70a8162530 0x7f70a80726e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f70a806ecb0 tx=0x7f70a402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=def2baeea7d5cb44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7ff117fff640 1 -- 172.21.15.117:0/9084704 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118036070 con 0x7ff120165e50 2024-09-19T08:37:35.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7ff117fff640 1 -- 172.21.15.117:0/9084704 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff118031600 con 0x7ff120165e50 2024-09-19T08:37:35.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7f2b04023640 1 -- start start 2024-09-19T08:37:35.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7f9668f74640 1 -- 172.21.15.117:0/59344790 learned_addr learned my addr 172.21.15.117:0/59344790 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:35.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7f178d59a640 1 -- 172.21.15.117:0/3136478443 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1522091311 0 0) 0x7f1784001110 con 0x7f1790151020 2024-09-19T08:37:35.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7f178d59a640 1 -- 172.21.15.117:0/3136478443 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f179015b630 con 0x7f1790151020 2024-09-19T08:37:35.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7f966b1d8640 1 -- 172.21.15.117:0/59344790 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96640ad160 con 0x7f96640d09f0 2024-09-19T08:37:35.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7f70ad0b4640 1 -- 172.21.15.117:0/845475547 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a4037070 con 0x7f70a8162530 2024-09-19T08:37:35.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f70ad0b4640 1 -- 172.21.15.117:0/845475547 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a4032440 con 0x7f70a8162530 2024-09-19T08:37:35.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f5027227640 1 -- 172.21.15.117:0/1710869885 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f50200b5ae0 con 0x7f50200b4110 2024-09-19T08:37:35.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f5027227640 1 -- 172.21.15.117:0/1710869885 --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f50200b4580 con 0x7f50201639e0 2024-09-19T08:37:35.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f70ad0b4640 1 -- 172.21.15.117:0/845475547 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a4037070 con 0x7f70a8162530 2024-09-19T08:37:35.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f006ffff640 1 --2- 172.21.15.117:0/2207171505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0068057830 0x7f00680066b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f007006aac0 tx=0x7f00700a5e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2aa17340f0d052 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7ff117fff640 1 -- 172.21.15.117:0/9084704 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118036070 con 0x7ff120165e50 2024-09-19T08:37:35.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f178d59a640 1 -- 172.21.15.117:0/3136478443 <== mon.1 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4131203178 0 0) 0x7f179015b630 con 0x7f1790151020 2024-09-19T08:37:35.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7f966b1d8640 1 -- 172.21.15.117:0/59344790 --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9664163680 con 0x7f96640c5690 2024-09-19T08:37:35.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.120+0000 7f966b1d8640 1 -- 172.21.15.117:0/59344790 --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f96640d0e60 con 0x7f9664099ae0 2024-09-19T08:37:35.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f178d59a640 1 -- 172.21.15.117:0/3136478443 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179015b180 msgr2=0x7f17900ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:35.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f178d59a640 1 --2- 172.21.15.117:0/3136478443 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179015b180 0x7f17900ce7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f006e7fc640 1 -- 172.21.15.117:0/2207171505 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00700b3070 con 0x7f0068057830 2024-09-19T08:37:35.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f006e7fc640 1 -- 172.21.15.117:0/2207171505 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00700a6bb0 con 0x7f0068057830 2024-09-19T08:37:35.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f006e7fc640 1 -- 172.21.15.117:0/2207171505 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00700b3070 con 0x7f0068057830 2024-09-19T08:37:35.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f11d5998640 1 -- 172.21.15.117:0/4128513392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11d0070720 msgr2=0x7f11d015f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f178d59a640 1 -- 172.21.15.117:0/3136478443 >> v1:172.21.15.117:6789/0 conn(0x7f179006e1f0 legacy=0x7f17900ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f178d59a640 1 -- 172.21.15.117:0/3136478443 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1790071f40 con 0x7f1790151020 2024-09-19T08:37:35.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f178d59a640 1 -- 172.21.15.117:0/3136478443 <== mon.1 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f1784001840 con 0x7f1790151020 2024-09-19T08:37:35.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f178d59a640 1 -- 172.21.15.117:0/3136478443 >> v1:172.21.15.146:6789/0 conn(0x7f1790151020 legacy=0x7f179006dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f178d59a640 1 --2- 172.21.15.117:0/3136478443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17780039b0 0x7f1778003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f178d59a640 1 --2- 172.21.15.117:0/3136478443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17780043d0 0x7f1778008bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f178d59a640 1 --2- 172.21.15.117:0/3136478443 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1778009240 0x7f177800b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f178d59a640 1 -- 172.21.15.117:0/3136478443 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1790072ac0 con 0x7f17780043d0 2024-09-19T08:37:35.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f178d59a640 1 -- 172.21.15.117:0/3136478443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f177800bf60 con 0x7f17780039b0 2024-09-19T08:37:35.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f178d59a640 1 -- 172.21.15.117:0/3136478443 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f177800c160 con 0x7f1778009240 2024-09-19T08:37:35.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f178dd9b640 1 --2- 172.21.15.117:0/3136478443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17780043d0 0x7f1778008bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f178e59c640 1 --2- 172.21.15.117:0/3136478443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17780039b0 0x7f1778003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f11d5998640 1 --2- 172.21.15.117:0/4128513392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11d0070720 0x7f11d015f220 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009e50 tx=0x7f11c402a6d0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f178ed9d640 1 --2- 172.21.15.117:0/3136478443 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1778009240 0x7f177800b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7ff127581640 1 -- 172.21.15.117:0/9084704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff120165e50 msgr2=0x7ff1200b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f178dd9b640 1 -- 172.21.15.117:0/3136478443 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1778009240 msgr2=0x7f177800b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:35.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f178dd9b640 1 --2- 172.21.15.117:0/3136478443 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1778009240 0x7f177800b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f178dd9b640 1 -- 172.21.15.117:0/3136478443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17780039b0 msgr2=0x7f1778003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:35.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f178dd9b640 1 --2- 172.21.15.117:0/3136478443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17780039b0 0x7f1778003db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f178dd9b640 1 -- 172.21.15.117:0/3136478443 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1790071f40 con 0x7f17780043d0 2024-09-19T08:37:35.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7ff127581640 1 --2- 172.21.15.117:0/9084704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff120165e50 0x7ff1200b3510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff118009e50 tx=0x7ff11802a710 comp rx=0 tx=0).stop 2024-09-19T08:37:35.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f9663fff640 1 -- 172.21.15.117:0/59344790 >> v1:172.21.15.146:6789/0 conn(0x7f96640c5690 legacy=0x7f9664162d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f9663fff640 1 -- 172.21.15.117:0/59344790 >> v1:172.21.15.117:6789/0 conn(0x7f96640d09f0 legacy=0x7f96640ad920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:35.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f9663fff640 1 -- 172.21.15.117:0/59344790 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9664163960 con 0x7f9664099ae0 2024-09-19T08:37:35.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f2b04023640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2afc0b00d0 0x7f2afc0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f2b01dbf640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2afc15b3a0 0x7f2afc0b52f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.117:43564/0 (socket says 172.21.15.117:43564) 2024-09-19T08:37:35.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f2b015be640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2afc0b00d0 0x7f2afc0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f70b031a640 1 -- 172.21.15.117:0/845475547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70a8162530 msgr2=0x7f70a80726e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f70b031a640 1 --2- 172.21.15.117:0/845475547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70a8162530 0x7f70a80726e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f70a806ecb0 tx=0x7f70a402a1a0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f2b015be640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2afc0b00d0 0x7f2afc0b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34780/0 (socket says 172.21.15.117:34780) 2024-09-19T08:37:35.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f11d5998640 1 -- 172.21.15.117:0/4128513392 shutdown_connections 2024-09-19T08:37:35.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f11d5998640 1 --2- 172.21.15.117:0/4128513392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11d0070720 0x7f11d015f220 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f11d5998640 1 --2- 172.21.15.117:0/4128513392 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11d00b5c70 0x7f11d00b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f11d5998640 1 -- 172.21.15.117:0/4128513392 >> 172.21.15.117:0/4128513392 conn(0x7f11d00b2c60 msgr2=0x7f11d00b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:35.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f11d5998640 1 -- 172.21.15.117:0/4128513392 shutdown_connections 2024-09-19T08:37:35.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f2b01dbf640 1 -- 172.21.15.117:0/2551715972 learned_addr learned my addr 172.21.15.117:0/2551715972 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:35.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f501ffff640 1 -- 172.21.15.117:0/1710869885 >> v2:172.21.15.117:3300/0 conn(0x7f50200b4110 msgr2=0x7f50200b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:35.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f501ffff640 1 --2- 172.21.15.117:0/1710869885 >> v2:172.21.15.117:3300/0 conn(0x7f50200b4110 0x7f50200b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f501ffff640 1 -- 172.21.15.117:0/1710869885 >> v1:172.21.15.117:6789/0 conn(0x7f502006bc10 legacy=0x7f502006bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f70b031a640 1 -- 172.21.15.117:0/845475547 shutdown_connections 2024-09-19T08:37:35.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f70b031a640 1 --2- 172.21.15.117:0/845475547 >> v2:172.21.15.117:3300/0 conn(0x7f70a806dae0 0x7f70a806df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f70b031a640 1 --2- 172.21.15.117:0/845475547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70a8162530 0x7f70a80726e0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f70a806ecb0 tx=0x7f70a402a1a0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f70b031a640 1 -- 172.21.15.117:0/845475547 >> 172.21.15.117:0/845475547 conn(0x7f70a806f390 msgr2=0x7f70a806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:35.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.121+0000 7f501ffff640 1 -- 172.21.15.117:0/1710869885 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50200b5d80 con 0x7f50201639e0 2024-09-19T08:37:35.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f70b031a640 1 -- 172.21.15.117:0/845475547 shutdown_connections 2024-09-19T08:37:35.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f2b04023640 1 --2- 172.21.15.117:0/2551715972 >> v2:172.21.15.146:3300/0 conn(0x7f2afc0b12d0 0x7f2afc0b1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f2b04023640 1 -- 172.21.15.117:0/2551715972 --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2afc0afcb0 con 0x7f2afc15b3a0 2024-09-19T08:37:35.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f2b04023640 1 -- 172.21.15.117:0/2551715972 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2afc0b6e50 con 0x7f2afc0b00d0 2024-09-19T08:37:35.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f2b04023640 1 -- 172.21.15.117:0/2551715972 --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f2afc0b7130 con 0x7f2afc0b12d0 2024-09-19T08:37:35.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f2b025c0640 1 --2- 172.21.15.117:0/2551715972 >> v2:172.21.15.146:3300/0 conn(0x7f2afc0b12d0 0x7f2afc0b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f11d5998640 1 -- 172.21.15.117:0/4128513392 wait complete. 2024-09-19T08:37:35.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f0074ffc640 1 -- 172.21.15.117:0/2207171505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0068057830 msgr2=0x7f00680066b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f0074ffc640 1 --2- 172.21.15.117:0/2207171505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0068057830 0x7f00680066b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f007006aac0 tx=0x7f00700a5e60 comp rx=0 tx=0).stop 2024-09-19T08:37:35.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7ff127581640 1 -- 172.21.15.117:0/9084704 shutdown_connections 2024-09-19T08:37:35.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7f0074ffc640 1 -- 172.21.15.117:0/2207171505 shutdown_connections 2024-09-19T08:37:35.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7f0074ffc640 1 --2- 172.21.15.117:0/2207171505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0068057830 0x7f00680066b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7f0074ffc640 1 --2- 172.21.15.117:0/2207171505 >> v2:172.21.15.117:3300/0 conn(0x7f006803bc60 0x7f0068053790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f501ffff640 1 --2- 172.21.15.117:0/1710869885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50201639e0 0x7f50200b2510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f502009b040 tx=0x7f500c02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55afdd07c2f25ace server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7f0074ffc640 1 -- 172.21.15.117:0/2207171505 >> 172.21.15.117:0/2207171505 conn(0x7f006803a520 msgr2=0x7f006803a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:35.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7f9663fff640 1 --2- 172.21.15.117:0/59344790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9664099ae0 0x7f96640d04b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9650009720 tx=0x7f9650029fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c94e60c94c49cbc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7f70b031a640 1 -- 172.21.15.117:0/845475547 wait complete. 2024-09-19T08:37:35.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7f2b015be640 1 -- 172.21.15.117:0/2551715972 >> v2:172.21.15.146:3300/0 conn(0x7f2afc0b12d0 msgr2=0x7f2afc0b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:35.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7f2b015be640 1 --2- 172.21.15.117:0/2551715972 >> v2:172.21.15.146:3300/0 conn(0x7f2afc0b12d0 0x7f2afc0b1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7f2b015be640 1 -- 172.21.15.117:0/2551715972 >> v1:172.21.15.146:6789/0 conn(0x7f2afc15b3a0 legacy=0x7f2afc0b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7f2b015be640 1 -- 172.21.15.117:0/2551715972 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2afc0b4dd0 con 0x7f2afc0b00d0 2024-09-19T08:37:35.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7f0074ffc640 1 -- 172.21.15.117:0/2207171505 shutdown_connections 2024-09-19T08:37:35.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7ff127581640 1 --2- 172.21.15.117:0/9084704 >> v2:172.21.15.117:3300/0 conn(0x7ff1200b6570 0x7ff1200b8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7ff127581640 1 --2- 172.21.15.117:0/9084704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff120165e50 0x7ff1200b3510 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.122+0000 7ff127581640 1 -- 172.21.15.117:0/9084704 >> 172.21.15.117:0/9084704 conn(0x7ff1200b9fa0 msgr2=0x7ff1200d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:35.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7f0074ffc640 1 -- 172.21.15.117:0/2207171505 wait complete. 2024-09-19T08:37:35.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7f178dd9b640 1 --2- 172.21.15.117:0/3136478443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17780043d0 0x7f1778008bd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1788012e40 tx=0x7f1778004820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa2c7223ef7041b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7ff127581640 1 -- 172.21.15.117:0/9084704 shutdown_connections 2024-09-19T08:37:35.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7ff127581640 1 -- 172.21.15.117:0/9084704 wait complete. 2024-09-19T08:37:35.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7f178d59a640 1 -- 172.21.15.117:0/3136478443 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1788012ae0 con 0x7f17780043d0 2024-09-19T08:37:35.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7f178d59a640 1 -- 172.21.15.117:0/3136478443 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17880123f0 con 0x7f17780043d0 2024-09-19T08:37:35.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7f178d59a640 1 -- 172.21.15.117:0/3136478443 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17880048a0 con 0x7f17780043d0 2024-09-19T08:37:35.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7f96637fe640 1 -- 172.21.15.117:0/59344790 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9650037070 con 0x7f9664099ae0 2024-09-19T08:37:35.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7f96637fe640 1 -- 172.21.15.117:0/59344790 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f965002ace0 con 0x7f9664099ae0 2024-09-19T08:37:35.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7f96637fe640 1 -- 172.21.15.117:0/59344790 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9650032660 con 0x7f9664099ae0 2024-09-19T08:37:35.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7f501f7fe640 1 -- 172.21.15.117:0/1710869885 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c037070 con 0x7f50201639e0 2024-09-19T08:37:35.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7f501f7fe640 1 -- 172.21.15.117:0/1710869885 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f500c032440 con 0x7f50201639e0 2024-09-19T08:37:35.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.123+0000 7f501f7fe640 1 -- 172.21.15.117:0/1710869885 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c032810 con 0x7f50201639e0 2024-09-19T08:37:35.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.124+0000 7f11d5998640 1 Processor -- start 2024-09-19T08:37:35.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.124+0000 7f70b031a640 1 Processor -- start 2024-09-19T08:37:35.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.124+0000 7f70b031a640 1 -- start start 2024-09-19T08:37:35.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.124+0000 7f11d5998640 1 -- start start 2024-09-19T08:37:35.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.124+0000 7f966b1d8640 1 -- 172.21.15.117:0/59344790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9664099ae0 msgr2=0x7f96640d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.124+0000 7f966b1d8640 1 --2- 172.21.15.117:0/59344790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9664099ae0 0x7f96640d04b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9650009720 tx=0x7f9650029fd0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.124+0000 7f1794dff640 1 -- 172.21.15.117:0/3136478443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17780043d0 msgr2=0x7f1778008bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.124+0000 7f1794dff640 1 --2- 172.21.15.117:0/3136478443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17780043d0 0x7f1778008bd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1788012e40 tx=0x7f1778004820 comp rx=0 tx=0).stop 2024-09-19T08:37:35.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.124+0000 7f178ed9d640 1 -- 172.21.15.117:0/3136478443 reap_dead start 2024-09-19T08:37:35.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.124+0000 7f1794dff640 1 -- 172.21.15.117:0/3136478443 shutdown_connections 2024-09-19T08:37:35.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.124+0000 7f1794dff640 1 -- 172.21.15.117:0/3136478443 >> 172.21.15.117:0/3136478443 conn(0x7f179006f390 msgr2=0x7f179006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:35.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.124+0000 7f5027227640 1 -- 172.21.15.117:0/1710869885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50201639e0 msgr2=0x7f50200b2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.124+0000 7f5027227640 1 --2- 172.21.15.117:0/1710869885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50201639e0 0x7f50200b2510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f502009b040 tx=0x7f500c02a1a0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.124+0000 7f2b015be640 1 --2- 172.21.15.117:0/2551715972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2afc0b00d0 0x7f2afc0b0d90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2afc073f10 tx=0x7f2aec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d7f805405ae549 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.124+0000 7f2b00dbd640 1 -- 172.21.15.117:0/2551715972 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aec037070 con 0x7f2afc0b00d0 2024-09-19T08:37:35.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.124+0000 7f2b00dbd640 1 -- 172.21.15.117:0/2551715972 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aec032440 con 0x7f2afc0b00d0 2024-09-19T08:37:35.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.124+0000 7f2b00dbd640 1 -- 172.21.15.117:0/2551715972 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aec032810 con 0x7f2afc0b00d0 2024-09-19T08:37:35.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.124+0000 7f0074ffc640 1 Processor -- start 2024-09-19T08:37:35.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.125+0000 7f1794dff640 1 -- 172.21.15.117:0/3136478443 shutdown_connections 2024-09-19T08:37:35.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.125+0000 7ff127581640 1 Processor -- start 2024-09-19T08:37:35.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.125+0000 7ff127581640 1 -- start start 2024-09-19T08:37:35.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.125+0000 7f2b04023640 1 -- 172.21.15.117:0/2551715972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2afc0b00d0 msgr2=0x7f2afc0b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.125+0000 7f2b04023640 1 --2- 172.21.15.117:0/2551715972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2afc0b00d0 0x7f2afc0b0d90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2afc073f10 tx=0x7f2aec02a1a0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.125+0000 7f1794dff640 1 -- 172.21.15.117:0/3136478443 wait complete. 2024-09-19T08:37:35.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.125+0000 7f2b04023640 1 -- 172.21.15.117:0/2551715972 shutdown_connections 2024-09-19T08:37:35.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.125+0000 7f2b04023640 1 --2- 172.21.15.117:0/2551715972 >> v2:172.21.15.146:3300/0 conn(0x7f2afc0b12d0 0x7f2afc0b1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.125+0000 7f2b04023640 1 --2- 172.21.15.117:0/2551715972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2afc0b00d0 0x7f2afc0b0d90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.125+0000 7f2b04023640 1 -- 172.21.15.117:0/2551715972 >> 172.21.15.117:0/2551715972 conn(0x7f2afc09a9f0 msgr2=0x7f2afc0b6740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:35.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.125+0000 7f0074ffc640 1 -- start start 2024-09-19T08:37:35.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.125+0000 7f2b04023640 1 -- 172.21.15.117:0/2551715972 shutdown_connections 2024-09-19T08:37:35.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.125+0000 7f2b04023640 1 -- 172.21.15.117:0/2551715972 wait complete. 2024-09-19T08:37:35.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.125+0000 7f70b031a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70a806dae0 0x7f70a814e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f966b1d8640 1 -- 172.21.15.117:0/59344790 shutdown_connections 2024-09-19T08:37:35.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f966b1d8640 1 --2- 172.21.15.117:0/59344790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9664099ae0 0x7f96640d04b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f966b1d8640 1 -- 172.21.15.117:0/59344790 >> 172.21.15.117:0/59344790 conn(0x7f966406bdf0 msgr2=0x7f966406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:35.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f11d5998640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11d0070720 0x7f11d00c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7ff127581640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1200b6570 0x7ff1200ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f70b031a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70a80b3d20 0x7f70a81ee3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f11d5998640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11d00b5c70 0x7f11d01540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7ff127581640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1200b8690 0x7ff120201600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7ff127581640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff120165e50 0x7ff1200ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7ff127581640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff1200cec10 con 0x7ff120165e50 2024-09-19T08:37:35.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7ff127581640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff120166230 con 0x7ff1200b6570 2024-09-19T08:37:35.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7ff127581640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7ff1200ced90 con 0x7ff1200b8690 2024-09-19T08:37:35.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f70b031a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70a81ee910 0x7f70a81ebf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7ff125b1e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff120165e50 0x7ff1200ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7ff12531d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1200b6570 0x7ff1200ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7ff125b1e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff120165e50 0x7ff1200ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34796/0 (socket says 172.21.15.117:34796) 2024-09-19T08:37:35.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7ff125b1e640 1 -- 172.21.15.117:0/2012967827 learned_addr learned my addr 172.21.15.117:0/2012967827 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:35.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f70ae0b6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70a806dae0 0x7f70a814e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7ff124b1c640 1 --2- 172.21.15.117:0/2012967827 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1200b8690 0x7ff120201600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f70ae0b6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70a806dae0 0x7f70a814e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.117:57900/0 (socket says 172.21.15.117:57900) 2024-09-19T08:37:35.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f11ceffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11d0070720 0x7f11d00c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f11ceffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11d0070720 0x7f11d00c6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.117:57894/0 (socket says 172.21.15.117:57894) 2024-09-19T08:37:35.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f11ce7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11d00b5c70 0x7f11d01540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f11ce7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11d00b5c70 0x7f11d01540b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34788/0 (socket says 172.21.15.117:34788) 2024-09-19T08:37:35.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f11ceffd640 1 -- 172.21.15.117:0/890324572 learned_addr learned my addr 172.21.15.117:0/890324572 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:35.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f11d5998640 1 --2- 172.21.15.117:0/890324572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11d015f760 0x7f11d015ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f0074ffc640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f006803bc60 0x7f006803d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f0074ffc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0068057830 0x7f006804ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f0074ffc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00680e28f0 0x7f0068184630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f0074ffc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0068053e50 con 0x7f0068057830 2024-09-19T08:37:35.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f0074ffc640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0068053cd0 con 0x7f00680e28f0 2024-09-19T08:37:35.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f0074ffc640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f00680e2cd0 con 0x7f006803bc60 2024-09-19T08:37:35.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f006f7fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f006803bc60 0x7f006803d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f006f7fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f006803bc60 0x7f006803d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.117:57918/0 (socket says 172.21.15.117:57918) 2024-09-19T08:37:35.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f006f7fe640 1 -- 172.21.15.117:0/1902636455 learned_addr learned my addr 172.21.15.117:0/1902636455 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:35.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f11d5998640 1 -- 172.21.15.117:0/890324572 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f11d006f0f0 con 0x7f11d00b5c70 2024-09-19T08:37:35.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f966b1d8640 1 -- 172.21.15.117:0/59344790 shutdown_connections 2024-09-19T08:37:35.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f11d5998640 1 -- 172.21.15.117:0/890324572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f11d00b44a0 con 0x7f11d015f760 2024-09-19T08:37:35.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f11d5998640 1 -- 172.21.15.117:0/890324572 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f11d006f270 con 0x7f11d0070720 2024-09-19T08:37:35.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f006ffff640 1 --2- 172.21.15.117:0/1902636455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00680e28f0 0x7f0068184630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f966b1d8640 1 -- 172.21.15.117:0/59344790 wait complete. 2024-09-19T08:37:35.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f5027227640 1 -- 172.21.15.117:0/1710869885 shutdown_connections 2024-09-19T08:37:35.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f5027227640 1 --2- 172.21.15.117:0/1710869885 >> v2:172.21.15.117:3300/0 conn(0x7f50200b4110 0x7f50200b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7f5027227640 1 --2- 172.21.15.117:0/1710869885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50201639e0 0x7f50200b2510 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f5027227640 1 -- 172.21.15.117:0/1710869885 >> 172.21.15.117:0/1710869885 conn(0x7f502009a9f0 msgr2=0x7f50200b6530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:35.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7ff12531d640 1 -- 172.21.15.117:0/2012967827 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1200b8690 msgr2=0x7ff120201600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f1794dff640 1 Processor -- start 2024-09-19T08:37:35.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f70ad8b5640 1 --2- 172.21.15.117:0/2884825681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70a80b3d20 0x7f70a81ee3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f70ae0b6640 1 -- 172.21.15.117:0/2884825681 learned_addr learned my addr 172.21.15.117:0/2884825681 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:35.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f70b031a640 1 -- 172.21.15.117:0/2884825681 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f70a8162910 con 0x7f70a81ee910 2024-09-19T08:37:35.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f70b031a640 1 -- 172.21.15.117:0/2884825681 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f70a80721c0 con 0x7f70a80b3d20 2024-09-19T08:37:35.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f1794dff640 1 -- start start 2024-09-19T08:37:35.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f70b031a640 1 -- 172.21.15.117:0/2884825681 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f70a80b4f60 con 0x7f70a806dae0 2024-09-19T08:37:35.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7ff12531d640 1 --2- 172.21.15.117:0/2012967827 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1200b8690 0x7ff120201600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f70ae8b7640 1 --2- 172.21.15.117:0/2884825681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70a81ee910 0x7f70a81ebf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f006f7fe640 1 -- 172.21.15.117:0/1902636455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00680e28f0 msgr2=0x7f0068184630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f006f7fe640 1 --2- 172.21.15.117:0/1902636455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00680e28f0 0x7f0068184630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f006f7fe640 1 -- 172.21.15.117:0/1902636455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0068057830 msgr2=0x7f006804ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f006f7fe640 1 --2- 172.21.15.117:0/1902636455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0068057830 0x7f006804ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f006f7fe640 1 -- 172.21.15.117:0/1902636455 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006804f630 con 0x7f006803bc60 2024-09-19T08:37:35.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.126+0000 7ff12531d640 1 -- 172.21.15.117:0/2012967827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff120165e50 msgr2=0x7ff1200ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7ff12531d640 1 --2- 172.21.15.117:0/2012967827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff120165e50 0x7ff1200ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7ff12531d640 1 -- 172.21.15.117:0/2012967827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff120201b40 con 0x7ff1200b6570 2024-09-19T08:37:35.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f006f7fe640 1 --2- 172.21.15.117:0/1902636455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f006803bc60 0x7f006803d790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f005c00c5a0 tx=0x7f005c00ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f11ce7fc640 1 -- 172.21.15.117:0/890324572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11d0070720 msgr2=0x7f11d00c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f11ce7fc640 1 --2- 172.21.15.117:0/890324572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11d0070720 0x7f11d00c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f11ce7fc640 1 -- 172.21.15.117:0/890324572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11d015f760 msgr2=0x7f11d015ae10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:37:35.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f11ce7fc640 1 --2- 172.21.15.117:0/890324572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11d015f760 0x7f11d015ae10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f11ce7fc640 1 -- 172.21.15.117:0/890324572 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d00c60e0 con 0x7f11d00b5c70 2024-09-19T08:37:35.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7ff12531d640 1 --2- 172.21.15.117:0/2012967827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1200b6570 0x7ff1200ca0f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff118030000 tx=0x7ff118004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f70ae8b7640 1 -- 172.21.15.117:0/2884825681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70a806dae0 msgr2=0x7f70a814e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f70ae8b7640 1 --2- 172.21.15.117:0/2884825681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70a806dae0 0x7f70a814e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f70ae8b7640 1 -- 172.21.15.117:0/2884825681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70a80b3d20 msgr2=0x7f70a81ee3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f70ae8b7640 1 --2- 172.21.15.117:0/2884825681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70a80b3d20 0x7f70a81ee3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f70ae8b7640 1 -- 172.21.15.117:0/2884825681 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a81ecc20 con 0x7f70a81ee910 2024-09-19T08:37:35.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f5027227640 1 -- 172.21.15.117:0/1710869885 shutdown_connections 2024-09-19T08:37:35.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7ff115ffb640 1 -- 172.21.15.117:0/2012967827 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118041020 con 0x7ff1200b6570 2024-09-19T08:37:35.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7f2b04023640 1 Processor -- start 2024-09-19T08:37:35.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7f2b04023640 1 -- start start 2024-09-19T08:37:35.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7ff127581640 1 -- 172.21.15.117:0/2012967827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1200c9050 con 0x7ff1200b6570 2024-09-19T08:37:35.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7f70ae8b7640 1 --2- 172.21.15.117:0/2884825681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70a81ee910 0x7f70a81ebf30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f70a000efc0 tx=0x7f70a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.127+0000 7f5027227640 1 -- 172.21.15.117:0/1710869885 wait complete. 2024-09-19T08:37:35.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7f005bfff640 1 -- 172.21.15.117:0/1902636455 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005c018070 con 0x7f006803bc60 2024-09-19T08:37:35.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7f0074ffc640 1 -- 172.21.15.117:0/1902636455 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f006804c540 con 0x7f006803bc60 2024-09-19T08:37:35.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7f0074ffc640 1 -- 172.21.15.117:0/1902636455 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f006804cb00 con 0x7f006803bc60 2024-09-19T08:37:35.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7f709affd640 1 -- 172.21.15.117:0/2884825681 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a0018020 con 0x7f70a81ee910 2024-09-19T08:37:35.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7f1794dff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1790147c90 0x7f1790151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7f005bfff640 1 -- 172.21.15.117:0/1902636455 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f005c0074e0 con 0x7f006803bc60 2024-09-19T08:37:35.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7f005bfff640 1 -- 172.21.15.117:0/1902636455 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005c004a00 con 0x7f006803bc60 2024-09-19T08:37:35.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7ff115ffb640 1 -- 172.21.15.117:0/2012967827 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff118003e50 con 0x7ff1200b6570 2024-09-19T08:37:35.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7ff115ffb640 1 -- 172.21.15.117:0/2012967827 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118036040 con 0x7ff1200b6570 2024-09-19T08:37:35.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7ff127581640 1 -- 172.21.15.117:0/2012967827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1200c9610 con 0x7ff1200b6570 2024-09-19T08:37:35.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7f1794dff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17901539a0 0x7f1790153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7f178e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1790147c90 0x7f1790151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7f178e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1790147c90 0x7f1790151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.117:48354/0 (socket says 172.21.15.117:48354) 2024-09-19T08:37:35.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7f178e59c640 1 -- 172.21.15.117:0/178946467 learned_addr learned my addr 172.21.15.117:0/178946467 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:35.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.129+0000 7f1794dff640 1 --2- 172.21.15.117:0/178946467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1790154360 0x7f1790158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.129+0000 7f1794dff640 1 -- 172.21.15.117:0/178946467 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f17900727e0 con 0x7f17901539a0 2024-09-19T08:37:35.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.129+0000 7f1794dff640 1 -- 172.21.15.117:0/178946467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1790072500 con 0x7f1790147c90 2024-09-19T08:37:35.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.129+0000 7f1794dff640 1 -- 172.21.15.117:0/178946467 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f1790072fc0 con 0x7f1790154360 2024-09-19T08:37:35.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.129+0000 7f5027227640 1 Processor -- start 2024-09-19T08:37:35.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.129+0000 7f5027227640 1 -- start start 2024-09-19T08:37:35.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7f709affd640 1 -- 172.21.15.117:0/2884825681 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a0014480 con 0x7f70a81ee910 2024-09-19T08:37:35.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7f709affd640 1 -- 172.21.15.117:0/2884825681 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a0009b10 con 0x7f70a81ee910 2024-09-19T08:37:35.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.129+0000 7f70b031a640 1 -- 172.21.15.117:0/2884825681 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a81ecf00 con 0x7f70a81ee910 2024-09-19T08:37:35.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.129+0000 7f70b031a640 1 -- 172.21.15.117:0/2884825681 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a81ed4c0 con 0x7f70a81ee910 2024-09-19T08:37:35.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7f966b1d8640 1 Processor -- start 2024-09-19T08:37:35.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.128+0000 7f966b1d8640 1 -- start start 2024-09-19T08:37:35.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.129+0000 7f2b04023640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2afc0b00d0 0x7f2afc15c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.129+0000 7f2b04023640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2afc0b12d0 0x7f2afc1f0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.129+0000 7f2b04023640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2afc15b3a0 0x7f2afc146b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.129+0000 7f2b04023640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc06bd90 con 0x7f2afc0b00d0 2024-09-19T08:37:35.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.129+0000 7f2b04023640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc06bc10 con 0x7f2afc15b3a0 2024-09-19T08:37:35.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.129+0000 7f2b04023640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f2afc06bf10 con 0x7f2afc0b12d0 2024-09-19T08:37:35.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.129+0000 7f2b015be640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2afc0b12d0 0x7f2afc1f0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.129+0000 7f2b015be640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2afc0b12d0 0x7f2afc1f0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.117:57942/0 (socket says 172.21.15.117:57942) 2024-09-19T08:37:35.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.129+0000 7f2b015be640 1 -- 172.21.15.117:0/3569250419 learned_addr learned my addr 172.21.15.117:0/3569250419 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:35.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.129+0000 7f2b025c0640 1 --2- 172.21.15.117:0/3569250419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2afc15b3a0 0x7f2afc146b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.129+0000 7f178ed9d640 1 --2- 172.21.15.117:0/178946467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1790154360 0x7f1790158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.130+0000 7f0074ffc640 1 -- 172.21.15.117:0/1902636455 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0050005290 con 0x7f006803bc60 2024-09-19T08:37:35.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.130+0000 7f966b1d8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9664099ae0 0x7f9664072cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.130+0000 7f966b1d8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96640c5690 0x7f9664200ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.130+0000 7f966b1d8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96640d09f0 0x7f9664201410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.130+0000 7f2b01dbf640 1 --2- 172.21.15.117:0/3569250419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2afc0b00d0 0x7f2afc15c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.129+0000 7f11ce7fc640 1 --2- 172.21.15.117:0/890324572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11d00b5c70 0x7f11d01540b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f11c4030000 tx=0x7f11c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.130+0000 7f9669775640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96640d09f0 0x7f9664201410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.130+0000 7f9669775640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96640d09f0 0x7f9664201410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34830/0 (socket says 172.21.15.117:34830) 2024-09-19T08:37:35.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.130+0000 7f9669775640 1 -- 172.21.15.117:0/2929949393 learned_addr learned my addr 172.21.15.117:0/2929949393 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:35.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.130+0000 7f966b1d8640 1 -- 172.21.15.117:0/2929949393 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f96640ad400 con 0x7f96640d09f0 2024-09-19T08:37:35.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.130+0000 7f966b1d8640 1 -- 172.21.15.117:0/2929949393 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f966415d2d0 con 0x7f9664099ae0 2024-09-19T08:37:35.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.130+0000 7f178dd9b640 1 --2- 172.21.15.117:0/178946467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17901539a0 0x7f1790153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.130+0000 7f70b031a640 1 -- 172.21.15.117:0/2884825681 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70a8068c30 con 0x7f70a81ee910 2024-09-19T08:37:35.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.130+0000 7f966b1d8640 1 -- 172.21.15.117:0/2929949393 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f96640c5a70 con 0x7f96640c5690 2024-09-19T08:37:35.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f178e59c640 1 -- 172.21.15.117:0/178946467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1790154360 msgr2=0x7f1790158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f178e59c640 1 --2- 172.21.15.117:0/178946467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1790154360 0x7f1790158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f178e59c640 1 -- 172.21.15.117:0/178946467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17901539a0 msgr2=0x7f1790153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f005bfff640 1 -- 172.21.15.117:0/1902636455 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f005c01b070 con 0x7f006803bc60 2024-09-19T08:37:35.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f5027227640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f502006bc10 0x7f502009bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f178e59c640 1 --2- 172.21.15.117:0/178946467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17901539a0 0x7f1790153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f5027227640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50200b4110 0x7f5020160e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f178e59c640 1 -- 172.21.15.117:0/178946467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1790152350 con 0x7f1790147c90 2024-09-19T08:37:35.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f5027227640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50201639e0 0x7f502009db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f5027227640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f50200b2100 con 0x7f502006bc10 2024-09-19T08:37:35.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f2b01dbf640 1 -- 172.21.15.117:0/3569250419 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2afc0b12d0 msgr2=0x7f2afc1f0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f2b01dbf640 1 --2- 172.21.15.117:0/3569250419 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2afc0b12d0 0x7f2afc1f0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f2b01dbf640 1 -- 172.21.15.117:0/3569250419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2afc15b3a0 msgr2=0x7f2afc146b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f2b01dbf640 1 --2- 172.21.15.117:0/3569250419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2afc15b3a0 0x7f2afc146b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f2b01dbf640 1 -- 172.21.15.117:0/3569250419 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2afc1f0dc0 con 0x7f2afc0b00d0 2024-09-19T08:37:35.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f178ed9d640 1 --2- 172.21.15.117:0/178946467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1790154360 0x7f1790158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:37:35.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f178dd9b640 1 --2- 172.21.15.117:0/178946467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17901539a0 0x7f1790153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:35.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f5027227640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f50200b16a0 con 0x7f50200b4110 2024-09-19T08:37:35.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f5027227640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f50200b2280 con 0x7f50201639e0 2024-09-19T08:37:35.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f50257c4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50201639e0 0x7f502009db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f501ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50200b4110 0x7f5020160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f9669775640 1 -- 172.21.15.117:0/2929949393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96640c5690 msgr2=0x7f9664200ed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:37:35.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f9669775640 1 --2- 172.21.15.117:0/2929949393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96640c5690 0x7f9664200ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f9669775640 1 -- 172.21.15.117:0/2929949393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9664099ae0 msgr2=0x7f9664072cc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:37:35.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f9669775640 1 --2- 172.21.15.117:0/2929949393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9664099ae0 0x7f9664072cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f9669775640 1 -- 172.21.15.117:0/2929949393 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96640d0050 con 0x7f96640d09f0 2024-09-19T08:37:35.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f50257c4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50201639e0 0x7f502009db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.117:57944/0 (socket says 172.21.15.117:57944) 2024-09-19T08:37:35.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f50257c4640 1 -- 172.21.15.117:0/762624302 learned_addr learned my addr 172.21.15.117:0/762624302 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:35.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f5024fc3640 1 --2- 172.21.15.117:0/762624302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f502006bc10 0x7f502009bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f2b01dbf640 1 --2- 172.21.15.117:0/3569250419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2afc0b00d0 0x7f2afc15c610 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2af800c390 tx=0x7f2af800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f9669775640 1 --2- 172.21.15.117:0/2929949393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96640d09f0 0x7f9664201410 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f965c00b970 tx=0x7f965c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f005bfff640 1 --2- 172.21.15.117:0/1902636455 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f005406c380 0x7f005406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f501ffff640 1 -- 172.21.15.117:0/762624302 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50201639e0 msgr2=0x7f502009db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f005bfff640 1 -- 172.21.15.117:0/1902636455 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f005c08aba0 con 0x7f006803bc60 2024-09-19T08:37:35.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f2af27fc640 1 -- 172.21.15.117:0/3569250419 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af8017070 con 0x7f2afc0b00d0 2024-09-19T08:37:35.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.131+0000 7f501ffff640 1 --2- 172.21.15.117:0/762624302 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50201639e0 0x7f502009db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.132+0000 7ff127581640 1 -- 172.21.15.117:0/2012967827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1200b3510 con 0x7ff1200b6570 2024-09-19T08:37:35.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.132+0000 7f501ffff640 1 -- 172.21.15.117:0/762624302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f502006bc10 msgr2=0x7f502009bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.132+0000 7f11b7fff640 1 -- 172.21.15.117:0/890324572 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c4049030 con 0x7f11d00b5c70 2024-09-19T08:37:35.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.132+0000 7f11b7fff640 1 -- 172.21.15.117:0/890324572 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11c4037040 con 0x7f11d00b5c70 2024-09-19T08:37:35.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.132+0000 7f11b7fff640 1 -- 172.21.15.117:0/890324572 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c4036070 con 0x7f11d00b5c70 2024-09-19T08:37:35.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.132+0000 7f501ffff640 1 --2- 172.21.15.117:0/762624302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f502006bc10 0x7f502009bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.132+0000 7f11d5998640 1 -- 172.21.15.117:0/890324572 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11d00c63c0 con 0x7f11d00b5c70 2024-09-19T08:37:35.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.132+0000 7f2b04023640 1 -- 172.21.15.117:0/3569250419 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2afc147040 con 0x7f2afc0b00d0 2024-09-19T08:37:35.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.132+0000 7f501ffff640 1 -- 172.21.15.117:0/762624302 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502009c7e0 con 0x7f50200b4110 2024-09-19T08:37:35.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.132+0000 7f2b04023640 1 -- 172.21.15.117:0/3569250419 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2afc15bb30 con 0x7f2afc0b00d0 2024-09-19T08:37:35.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.132+0000 7f11d5998640 1 -- 172.21.15.117:0/890324572 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11d01545f0 con 0x7f11d00b5c70 2024-09-19T08:37:35.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.132+0000 7ff115ffb640 1 -- 172.21.15.117:0/2012967827 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff118044020 con 0x7ff1200b6570 2024-09-19T08:37:35.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.132+0000 7f006effd640 1 --2- 172.21.15.117:0/1902636455 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f005406c380 0x7f005406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.132+0000 7f5024fc3640 1 --2- 172.21.15.117:0/762624302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f502006bc10 0x7f502009bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:37:35.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.132+0000 7f50257c4640 1 --2- 172.21.15.117:0/762624302 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50201639e0 0x7f502009db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:37:35.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.132+0000 7f178e59c640 1 --2- 172.21.15.117:0/178946467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1790147c90 0x7f1790151e10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f178400d8e0 tx=0x7f178400dda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.132+0000 7f177effd640 1 -- 172.21.15.117:0/178946467 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1784005480 con 0x7f1790147c90 2024-09-19T08:37:35.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.132+0000 7f177effd640 1 -- 172.21.15.117:0/178946467 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1784017070 con 0x7f1790147c90 2024-09-19T08:37:35.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.132+0000 7f1794dff640 1 -- 172.21.15.117:0/178946467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17901525f0 con 0x7f1790147c90 2024-09-19T08:37:35.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.132+0000 7f2af27fc640 1 -- 172.21.15.117:0/3569250419 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af8005ce0 con 0x7f2afc0b00d0 2024-09-19T08:37:35.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.132+0000 7f2af27fc640 1 -- 172.21.15.117:0/3569250419 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af80072d0 con 0x7f2afc0b00d0 2024-09-19T08:37:35.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.133+0000 7f709affd640 1 -- 172.21.15.117:0/2884825681 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f70a0005d10 con 0x7f70a81ee910 2024-09-19T08:37:35.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.133+0000 7ff115ffb640 1 --2- 172.21.15.117:0/2012967827 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff10406c2b0 0x7ff10406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.133+0000 7f96617fa640 1 -- 172.21.15.117:0/2929949393 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c019070 con 0x7f96640d09f0 2024-09-19T08:37:35.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.133+0000 7ff124b1c640 1 --2- 172.21.15.117:0/2012967827 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff10406c2b0 0x7ff10406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.133+0000 7f966b1d8640 1 -- 172.21.15.117:0/2929949393 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96640b3710 con 0x7f96640d09f0 2024-09-19T08:37:35.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.133+0000 7f966b1d8640 1 -- 172.21.15.117:0/2929949393 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96640cfd70 con 0x7f96640d09f0 2024-09-19T08:37:35.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.133+0000 7f709affd640 1 --2- 172.21.15.117:0/2884825681 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f708c06c380 0x7f708c06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.133+0000 7f709affd640 1 -- 172.21.15.117:0/2884825681 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f70a008caf0 con 0x7f70a81ee910 2024-09-19T08:37:35.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.133+0000 7f11d5998640 1 -- 172.21.15.117:0/890324572 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11d00756e0 con 0x7f11d00b5c70 2024-09-19T08:37:35.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.134+0000 7ff115ffb640 1 -- 172.21.15.117:0/2012967827 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff1180ac240 con 0x7ff1200b6570 2024-09-19T08:37:35.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.133+0000 7f177effd640 1 -- 172.21.15.117:0/178946467 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178400b8f0 con 0x7f1790147c90 2024-09-19T08:37:35.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.133+0000 7f1794dff640 1 -- 172.21.15.117:0/178946467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1790152bb0 con 0x7f1790147c90 2024-09-19T08:37:35.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.134+0000 7f2b04023640 1 -- 172.21.15.117:0/3569250419 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ae4005290 con 0x7f2afc0b00d0 2024-09-19T08:37:35.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.134+0000 7ff124b1c640 1 --2- 172.21.15.117:0/2012967827 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff10406c2b0 0x7ff10406e770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff1200ca630 tx=0x7ff11c007c70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.134+0000 7f501ffff640 1 --2- 172.21.15.117:0/762624302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50200b4110 0x7f5020160e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f500c031000 tx=0x7f500c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.134+0000 7f70ae0b6640 1 --2- 172.21.15.117:0/2884825681 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f708c06c380 0x7f708c06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.134+0000 7f006effd640 1 --2- 172.21.15.117:0/1902636455 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f005406c380 0x7f005406e840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0068037830 tx=0x7f0064006c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.134+0000 7f966b1d8640 1 -- 172.21.15.117:0/2929949393 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96640b38e0 con 0x7f96640d09f0 2024-09-19T08:37:35.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.134+0000 7f70ae0b6640 1 --2- 172.21.15.117:0/2884825681 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f708c06c380 0x7f708c06e840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f70a815e230 tx=0x7f70a402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.134+0000 7f1794dff640 1 -- 172.21.15.117:0/178946467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1790152df0 con 0x7f1790147c90 2024-09-19T08:37:35.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.136+0000 7f005bfff640 1 -- 172.21.15.117:0/1902636455 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f005c058960 con 0x7f006803bc60 2024-09-19T08:37:35.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.137+0000 7ff115ffb640 1 -- 172.21.15.117:0/2012967827 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff11804b030 con 0x7ff1200b6570 2024-09-19T08:37:35.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.137+0000 7f501d7fa640 1 -- 172.21.15.117:0/762624302 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c037050 con 0x7f50200b4110 2024-09-19T08:37:35.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.138+0000 7f501d7fa640 1 -- 172.21.15.117:0/762624302 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f500c043070 con 0x7f50200b4110 2024-09-19T08:37:35.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.138+0000 7f5027227640 1 -- 172.21.15.117:0/762624302 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f502009ca80 con 0x7f50200b4110 2024-09-19T08:37:35.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.138+0000 7f5027227640 1 -- 172.21.15.117:0/762624302 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f502009d040 con 0x7f50200b4110 2024-09-19T08:37:35.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.138+0000 7f709affd640 1 -- 172.21.15.117:0/2884825681 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f70a8068c30 con 0x7f70a81ee910 2024-09-19T08:37:35.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.139+0000 7f96617fa640 1 -- 172.21.15.117:0/2929949393 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f965c00cb40 con 0x7f96640d09f0 2024-09-19T08:37:35.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.139+0000 7f96617fa640 1 -- 172.21.15.117:0/2929949393 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c003970 con 0x7f96640d09f0 2024-09-19T08:37:35.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.139+0000 7f177effd640 1 -- 172.21.15.117:0/178946467 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f178400ba90 con 0x7f1790147c90 2024-09-19T08:37:35.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.140+0000 7f177effd640 1 --2- 172.21.15.117:0/178946467 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f177006c380 0x7f177006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.140+0000 7f177effd640 1 -- 172.21.15.117:0/178946467 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f178408c1e0 con 0x7f1790147c90 2024-09-19T08:37:35.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.139+0000 7f501d7fa640 1 -- 172.21.15.117:0/762624302 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c037050 con 0x7f50200b4110 2024-09-19T08:37:35.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.139+0000 7f5027227640 1 -- 172.21.15.117:0/762624302 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50200b1bc0 con 0x7f50200b4110 2024-09-19T08:37:35.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.140+0000 7f2af27fc640 1 -- 172.21.15.117:0/3569250419 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2af801a070 con 0x7f2afc0b00d0 2024-09-19T08:37:35.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.140+0000 7f11b7fff640 1 -- 172.21.15.117:0/890324572 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f11c404c070 con 0x7f11d00b5c70 2024-09-19T08:37:35.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.140+0000 7f11b7fff640 1 --2- 172.21.15.117:0/890324572 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f11bc06c300 0x7f11bc06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.140+0000 7f178dd9b640 1 --2- 172.21.15.117:0/178946467 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f177006c380 0x7f177006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.140+0000 7f11b7fff640 1 -- 172.21.15.117:0/890324572 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f11c404fe00 con 0x7f11d00b5c70 2024-09-19T08:37:35.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.141+0000 7f11ceffd640 1 --2- 172.21.15.117:0/890324572 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f11bc06c300 0x7f11bc06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.141+0000 7f2af27fc640 1 --2- 172.21.15.117:0/3569250419 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2ae006c2b0 0x7f2ae006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.141+0000 7f2af27fc640 1 -- 172.21.15.117:0/3569250419 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2af808afe0 con 0x7f2afc0b00d0 2024-09-19T08:37:35.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.141+0000 7f2b015be640 1 --2- 172.21.15.117:0/3569250419 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2ae006c2b0 0x7f2ae006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.141+0000 7f11ceffd640 1 --2- 172.21.15.117:0/890324572 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f11bc06c300 0x7f11bc06e7c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009560 tx=0x7f11c8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.141+0000 7f178dd9b640 1 --2- 172.21.15.117:0/178946467 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f177006c380 0x7f177006e840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1788012e10 tx=0x7f1788011000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.141+0000 7f96617fa640 1 -- 172.21.15.117:0/2929949393 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f965c01c070 con 0x7f96640d09f0 2024-09-19T08:37:35.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.142+0000 7f2b015be640 1 --2- 172.21.15.117:0/3569250419 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2ae006c2b0 0x7f2ae006e770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2afc15d210 tx=0x7f2aec02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.142+0000 7f96617fa640 1 --2- 172.21.15.117:0/2929949393 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f964806c2b0 0x7f964806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.142+0000 7f9668f74640 1 --2- 172.21.15.117:0/2929949393 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f964806c2b0 0x7f964806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.142+0000 7f96617fa640 1 -- 172.21.15.117:0/2929949393 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f965c08b590 con 0x7f96640d09f0 2024-09-19T08:37:35.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.142+0000 7f177effd640 1 -- 172.21.15.117:0/178946467 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1790152df0 con 0x7f1790147c90 2024-09-19T08:37:35.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.142+0000 7f9668f74640 1 --2- 172.21.15.117:0/2929949393 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f964806c2b0 0x7f964806e770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9658007fd0 tx=0x7f96580079a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.144+0000 7f501d7fa640 1 -- 172.21.15.117:0/762624302 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f500c030990 con 0x7f50200b4110 2024-09-19T08:37:35.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.144+0000 7f501d7fa640 1 --2- 172.21.15.117:0/762624302 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f500406c6b0 0x7f500406eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:35.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.145+0000 7f501d7fa640 1 -- 172.21.15.117:0/762624302 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f500c030790 con 0x7f50200b4110 2024-09-19T08:37:35.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.145+0000 7f5024fc3640 1 --2- 172.21.15.117:0/762624302 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f500406c6b0 0x7f500406eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:35.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.145+0000 7f5024fc3640 1 --2- 172.21.15.117:0/762624302 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f500406c6b0 0x7f500406eb70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5014005880 tx=0x7f5014009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:35.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.147+0000 7f11b7fff640 1 -- 172.21.15.117:0/890324572 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f11d00756e0 con 0x7f11d00b5c70 2024-09-19T08:37:35.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.147+0000 7f501d7fa640 1 -- 172.21.15.117:0/762624302 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f500c07a5d0 con 0x7f50200b4110 2024-09-19T08:37:35.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.154+0000 7f2af27fc640 1 -- 172.21.15.117:0/3569250419 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2afc1f0dc0 con 0x7f2afc0b00d0 2024-09-19T08:37:35.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.164+0000 7f96617fa640 1 -- 172.21.15.117:0/2929949393 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f965c059a30 con 0x7f96640d09f0 2024-09-19T08:37:35.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.521+0000 7f70b031a640 1 -- 172.21.15.117:0/2884825681 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f70a814e9c0 con 0x7f70a81ee910 2024-09-19T08:37:35.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.522+0000 7f709affd640 1 -- 172.21.15.117:0/2884825681 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f70a0022020 con 0x7f70a81ee910 2024-09-19T08:37:35.522 INFO:teuthology.orchestra.run.smithi117.stdout:64424509449 2024-09-19T08:37:35.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.525+0000 7f70b031a640 1 -- 172.21.15.117:0/2884825681 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f708c06c380 msgr2=0x7f708c06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.525+0000 7f70b031a640 1 --2- 172.21.15.117:0/2884825681 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f708c06c380 0x7f708c06e840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f70a815e230 tx=0x7f70a402e000 comp rx=0 tx=0).stop 2024-09-19T08:37:35.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.525+0000 7f70b031a640 1 -- 172.21.15.117:0/2884825681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70a81ee910 msgr2=0x7f70a81ebf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.525+0000 7f70b031a640 1 --2- 172.21.15.117:0/2884825681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70a81ee910 0x7f70a81ebf30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f70a000efc0 tx=0x7f70a000c490 comp rx=0 tx=0).stop 2024-09-19T08:37:35.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.525+0000 7f70b031a640 1 -- 172.21.15.117:0/2884825681 shutdown_connections 2024-09-19T08:37:35.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.526+0000 7f70b031a640 1 --2- 172.21.15.117:0/2884825681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70a81ee910 0x7f70a81ebf30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.526+0000 7f70b031a640 1 --2- 172.21.15.117:0/2884825681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70a80b3d20 0x7f70a81ee3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.526+0000 7f70b031a640 1 --2- 172.21.15.117:0/2884825681 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f708c06c380 0x7f708c06e840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.526+0000 7f70b031a640 1 --2- 172.21.15.117:0/2884825681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70a806dae0 0x7f70a814e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.526+0000 7f70b031a640 1 -- 172.21.15.117:0/2884825681 >> 172.21.15.117:0/2884825681 conn(0x7f70a806f390 msgr2=0x7f70a80b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:35.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.526+0000 7f70b031a640 1 -- 172.21.15.117:0/2884825681 shutdown_connections 2024-09-19T08:37:35.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.526+0000 7f70b031a640 1 -- 172.21.15.117:0/2884825681 wait complete. 2024-09-19T08:37:35.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.535+0000 7f0074ffc640 1 -- 172.21.15.117:0/1902636455 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f0050005580 con 0x7f006803bc60 2024-09-19T08:37:35.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.540+0000 7f1794dff640 1 -- 172.21.15.117:0/178946467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f179006bdb0 con 0x7f1790147c90 2024-09-19T08:37:35.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.540+0000 7f005bfff640 1 -- 172.21.15.117:0/1902636455 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f005c05cc60 con 0x7f006803bc60 2024-09-19T08:37:35.541 INFO:teuthology.orchestra.run.smithi117.stdout:64424509449 2024-09-19T08:37:35.541 INFO:teuthology.orchestra.run.smithi117.stdout:64424509448 2024-09-19T08:37:35.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.541+0000 7f177effd640 1 -- 172.21.15.117:0/178946467 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f17900cdc50 con 0x7f1790147c90 2024-09-19T08:37:35.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.542+0000 7f11d5998640 1 -- 172.21.15.117:0/890324572 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f11d015f220 con 0x7f11d00b5c70 2024-09-19T08:37:35.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.543+0000 7f11b7fff640 1 -- 172.21.15.117:0/890324572 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f11c4053070 con 0x7f11d00b5c70 2024-09-19T08:37:35.542 INFO:teuthology.orchestra.run.smithi117.stdout:64424509448 2024-09-19T08:37:35.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.543+0000 7ff127581640 1 -- 172.21.15.117:0/2012967827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff1200d0290 con 0x7ff1200b6570 2024-09-19T08:37:35.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.544+0000 7f0074ffc640 1 -- 172.21.15.117:0/1902636455 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f005406c380 msgr2=0x7f005406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.544+0000 7f0074ffc640 1 --2- 172.21.15.117:0/1902636455 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f005406c380 0x7f005406e840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0068037830 tx=0x7f0064006c90 comp rx=0 tx=0).stop 2024-09-19T08:37:35.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.544+0000 7f0074ffc640 1 -- 172.21.15.117:0/1902636455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f006803bc60 msgr2=0x7f006803d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.544+0000 7f0074ffc640 1 --2- 172.21.15.117:0/1902636455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f006803bc60 0x7f006803d790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f005c00c5a0 tx=0x7f005c00ca60 comp rx=0 tx=0).stop 2024-09-19T08:37:35.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.544+0000 7f0074ffc640 1 -- 172.21.15.117:0/1902636455 shutdown_connections 2024-09-19T08:37:35.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.544+0000 7f0074ffc640 1 --2- 172.21.15.117:0/1902636455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00680e28f0 0x7f0068184630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.544+0000 7f0074ffc640 1 --2- 172.21.15.117:0/1902636455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0068057830 0x7f006804ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.544+0000 7f0074ffc640 1 --2- 172.21.15.117:0/1902636455 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f005406c380 0x7f005406e840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.544+0000 7f0074ffc640 1 --2- 172.21.15.117:0/1902636455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f006803bc60 0x7f006803d790 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.544+0000 7f0074ffc640 1 -- 172.21.15.117:0/1902636455 >> 172.21.15.117:0/1902636455 conn(0x7f006803a520 msgr2=0x7f006803c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:35.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.544+0000 7ff115ffb640 1 -- 172.21.15.117:0/2012967827 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff120201b40 con 0x7ff1200b6570 2024-09-19T08:37:35.546 INFO:teuthology.orchestra.run.smithi117.stdout:64424509449 2024-09-19T08:37:35.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.5 2024-09-19T08:37:35.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.544+0000 7f0074ffc640 1 -- 172.21.15.117:0/1902636455 shutdown_connections 2024-09-19T08:37:35.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.545+0000 7f0074ffc640 1 -- 172.21.15.117:0/1902636455 wait complete. 2024-09-19T08:37:35.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.545+0000 7f1794dff640 1 -- 172.21.15.117:0/178946467 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f177006c380 msgr2=0x7f177006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.545+0000 7f1794dff640 1 --2- 172.21.15.117:0/178946467 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f177006c380 0x7f177006e840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1788012e10 tx=0x7f1788011000 comp rx=0 tx=0).stop 2024-09-19T08:37:35.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.545+0000 7f1794dff640 1 -- 172.21.15.117:0/178946467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1790147c90 msgr2=0x7f1790151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.545+0000 7f1794dff640 1 --2- 172.21.15.117:0/178946467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1790147c90 0x7f1790151e10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f178400d8e0 tx=0x7f178400dda0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.545+0000 7f1794dff640 1 -- 172.21.15.117:0/178946467 shutdown_connections 2024-09-19T08:37:35.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.545+0000 7f1794dff640 1 --2- 172.21.15.117:0/178946467 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f177006c380 0x7f177006e840 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.545+0000 7f1794dff640 1 --2- 172.21.15.117:0/178946467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1790154360 0x7f1790158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.545+0000 7f1794dff640 1 --2- 172.21.15.117:0/178946467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17901539a0 0x7f1790153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.545+0000 7f1794dff640 1 --2- 172.21.15.117:0/178946467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1790147c90 0x7f1790151e10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.545+0000 7f1794dff640 1 -- 172.21.15.117:0/178946467 >> 172.21.15.117:0/178946467 conn(0x7f179006f390 msgr2=0x7f179015e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:35.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.545+0000 7f5027227640 1 -- 172.21.15.117:0/762624302 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f50200b67f0 con 0x7f50200b4110 2024-09-19T08:37:35.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.545+0000 7f1794dff640 1 -- 172.21.15.117:0/178946467 shutdown_connections 2024-09-19T08:37:35.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.545+0000 7f1794dff640 1 -- 172.21.15.117:0/178946467 wait complete. 2024-09-19T08:37:35.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.546+0000 7f501d7fa640 1 -- 172.21.15.117:0/762624302 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f500c07e8d0 con 0x7f50200b4110 2024-09-19T08:37:35.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.546+0000 7f11d5998640 1 -- 172.21.15.117:0/890324572 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f11bc06c300 msgr2=0x7f11bc06e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.546+0000 7f11d5998640 1 --2- 172.21.15.117:0/890324572 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f11bc06c300 0x7f11bc06e7c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009560 tx=0x7f11c8009190 comp rx=0 tx=0).stop 2024-09-19T08:37:35.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.546+0000 7f11d5998640 1 -- 172.21.15.117:0/890324572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11d00b5c70 msgr2=0x7f11d01540b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.546+0000 7f11d5998640 1 --2- 172.21.15.117:0/890324572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11d00b5c70 0x7f11d01540b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f11c4030000 tx=0x7f11c4004a40 comp rx=0 tx=0).stop 2024-09-19T08:37:35.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.546+0000 7f11d5998640 1 -- 172.21.15.117:0/890324572 shutdown_connections 2024-09-19T08:37:35.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.546+0000 7f11d5998640 1 --2- 172.21.15.117:0/890324572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11d015f760 0x7f11d015ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.546+0000 7f11d5998640 1 --2- 172.21.15.117:0/890324572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11d00b5c70 0x7f11d01540b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.546+0000 7f11d5998640 1 --2- 172.21.15.117:0/890324572 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f11bc06c300 0x7f11bc06e7c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.546+0000 7f11d5998640 1 --2- 172.21.15.117:0/890324572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11d0070720 0x7f11d00c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.546+0000 7f11d5998640 1 -- 172.21.15.117:0/890324572 >> 172.21.15.117:0/890324572 conn(0x7f11d00b2c60 msgr2=0x7f11d006e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:35.551 INFO:teuthology.orchestra.run.smithi117.stdout:64424509450 2024-09-19T08:37:35.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.546+0000 7f11d5998640 1 -- 172.21.15.117:0/890324572 shutdown_connections 2024-09-19T08:37:35.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.546+0000 7f11d5998640 1 -- 172.21.15.117:0/890324572 wait complete. 2024-09-19T08:37:35.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.546+0000 7f2b04023640 1 -- 172.21.15.117:0/3569250419 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f2ae4005850 con 0x7f2afc0b00d0 2024-09-19T08:37:35.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.546+0000 7f2af27fc640 1 -- 172.21.15.117:0/3569250419 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2af8058ea0 con 0x7f2afc0b00d0 2024-09-19T08:37:35.552 INFO:teuthology.orchestra.run.smithi117.stdout:64424509449 2024-09-19T08:37:35.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.547+0000 7ff127581640 1 -- 172.21.15.117:0/2012967827 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff10406c2b0 msgr2=0x7ff10406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.547+0000 7ff127581640 1 --2- 172.21.15.117:0/2012967827 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff10406c2b0 0x7ff10406e770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff1200ca630 tx=0x7ff11c007c70 comp rx=0 tx=0).stop 2024-09-19T08:37:35.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.547+0000 7ff127581640 1 -- 172.21.15.117:0/2012967827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1200b6570 msgr2=0x7ff1200ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.547+0000 7ff127581640 1 --2- 172.21.15.117:0/2012967827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1200b6570 0x7ff1200ca0f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff118030000 tx=0x7ff118004a40 comp rx=0 tx=0).stop 2024-09-19T08:37:35.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.548+0000 7ff127581640 1 -- 172.21.15.117:0/2012967827 shutdown_connections 2024-09-19T08:37:35.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.548+0000 7ff127581640 1 --2- 172.21.15.117:0/2012967827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff120165e50 0x7ff1200ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.548+0000 7ff127581640 1 --2- 172.21.15.117:0/2012967827 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff10406c2b0 0x7ff10406e770 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff1200ca630 tx=0x7ff11c007c70 comp rx=0 tx=0).stop 2024-09-19T08:37:35.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.548+0000 7ff127581640 1 --2- 172.21.15.117:0/2012967827 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1200b8690 0x7ff120201600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.548+0000 7ff127581640 1 --2- 172.21.15.117:0/2012967827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1200b6570 0x7ff1200ca0f0 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff118030000 tx=0x7ff118004a40 comp rx=0 tx=0).stop 2024-09-19T08:37:35.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.548+0000 7ff127581640 1 -- 172.21.15.117:0/2012967827 >> 172.21.15.117:0/2012967827 conn(0x7ff1200b9fa0 msgr2=0x7ff120161e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:35.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.548+0000 7ff127581640 1 -- 172.21.15.117:0/2012967827 shutdown_connections 2024-09-19T08:37:35.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.548+0000 7ff127581640 1 -- 172.21.15.117:0/2012967827 wait complete. 2024-09-19T08:37:35.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.549+0000 7f5027227640 1 -- 172.21.15.117:0/762624302 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f500406c6b0 msgr2=0x7f500406eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.549+0000 7f5027227640 1 --2- 172.21.15.117:0/762624302 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f500406c6b0 0x7f500406eb70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5014005880 tx=0x7f5014009040 comp rx=0 tx=0).stop 2024-09-19T08:37:35.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.549+0000 7f5027227640 1 -- 172.21.15.117:0/762624302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50200b4110 msgr2=0x7f5020160e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.549+0000 7f5027227640 1 --2- 172.21.15.117:0/762624302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50200b4110 0x7f5020160e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f500c031000 tx=0x7f500c0046c0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.549+0000 7f5027227640 1 -- 172.21.15.117:0/762624302 shutdown_connections 2024-09-19T08:37:35.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.549+0000 7f5027227640 1 --2- 172.21.15.117:0/762624302 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f500406c6b0 0x7f500406eb70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.550+0000 7f5027227640 1 --2- 172.21.15.117:0/762624302 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50201639e0 0x7f502009db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.550+0000 7f5027227640 1 --2- 172.21.15.117:0/762624302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50200b4110 0x7f5020160e10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.550+0000 7f5027227640 1 --2- 172.21.15.117:0/762624302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f502006bc10 0x7f502009bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.550+0000 7f5027227640 1 -- 172.21.15.117:0/762624302 >> 172.21.15.117:0/762624302 conn(0x7f502009a9f0 msgr2=0x7f50200adff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:35.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.550+0000 7f5027227640 1 -- 172.21.15.117:0/762624302 shutdown_connections 2024-09-19T08:37:35.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.550+0000 7f5027227640 1 -- 172.21.15.117:0/762624302 wait complete. 2024-09-19T08:37:35.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.550+0000 7f2b04023640 1 -- 172.21.15.117:0/3569250419 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2ae006c2b0 msgr2=0x7f2ae006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.550+0000 7f2b04023640 1 --2- 172.21.15.117:0/3569250419 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2ae006c2b0 0x7f2ae006e770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2afc15d210 tx=0x7f2aec02e000 comp rx=0 tx=0).stop 2024-09-19T08:37:35.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.550+0000 7f2b04023640 1 -- 172.21.15.117:0/3569250419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2afc0b00d0 msgr2=0x7f2afc15c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.550+0000 7f2b04023640 1 --2- 172.21.15.117:0/3569250419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2afc0b00d0 0x7f2afc15c610 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2af800c390 tx=0x7f2af800c790 comp rx=0 tx=0).stop 2024-09-19T08:37:35.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.550+0000 7f2b04023640 1 -- 172.21.15.117:0/3569250419 shutdown_connections 2024-09-19T08:37:35.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.550+0000 7f2b04023640 1 --2- 172.21.15.117:0/3569250419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2afc15b3a0 0x7f2afc146b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.550+0000 7f2b04023640 1 --2- 172.21.15.117:0/3569250419 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2ae006c2b0 0x7f2ae006e770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.550+0000 7f2b04023640 1 --2- 172.21.15.117:0/3569250419 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2afc0b12d0 0x7f2afc1f0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.550+0000 7f2b04023640 1 --2- 172.21.15.117:0/3569250419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2afc0b00d0 0x7f2afc15c610 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.551+0000 7f2b04023640 1 -- 172.21.15.117:0/3569250419 >> 172.21.15.117:0/3569250419 conn(0x7f2afc09a9f0 msgr2=0x7f2afc06c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:35.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.551+0000 7f2b04023640 1 -- 172.21.15.117:0/3569250419 shutdown_connections 2024-09-19T08:37:35.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.551+0000 7f2b04023640 1 -- 172.21.15.117:0/3569250419 wait complete. 2024-09-19T08:37:35.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.557+0000 7f966b1d8640 1 -- 172.21.15.117:0/2929949393 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9664167250 con 0x7f96640d09f0 2024-09-19T08:37:35.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.558+0000 7f96617fa640 1 -- 172.21.15.117:0/2929949393 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f965c059330 con 0x7f96640d09f0 2024-09-19T08:37:35.559 INFO:teuthology.orchestra.run.smithi117.stdout:60129542153 2024-09-19T08:37:35.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.562+0000 7f966b1d8640 1 -- 172.21.15.117:0/2929949393 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f964806c2b0 msgr2=0x7f964806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.562+0000 7f966b1d8640 1 --2- 172.21.15.117:0/2929949393 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f964806c2b0 0x7f964806e770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9658007fd0 tx=0x7f96580079a0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.562+0000 7f966b1d8640 1 -- 172.21.15.117:0/2929949393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96640d09f0 msgr2=0x7f9664201410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:35.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.562+0000 7f966b1d8640 1 --2- 172.21.15.117:0/2929949393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96640d09f0 0x7f9664201410 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f965c00b970 tx=0x7f965c00be30 comp rx=0 tx=0).stop 2024-09-19T08:37:35.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.563+0000 7f966b1d8640 1 -- 172.21.15.117:0/2929949393 shutdown_connections 2024-09-19T08:37:35.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.563+0000 7f966b1d8640 1 --2- 172.21.15.117:0/2929949393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96640d09f0 0x7f9664201410 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.563+0000 7f966b1d8640 1 --2- 172.21.15.117:0/2929949393 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f964806c2b0 0x7f964806e770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.563+0000 7f966b1d8640 1 --2- 172.21.15.117:0/2929949393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96640c5690 0x7f9664200ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.563+0000 7f966b1d8640 1 --2- 172.21.15.117:0/2929949393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9664099ae0 0x7f9664072cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:35.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.563+0000 7f966b1d8640 1 -- 172.21.15.117:0/2929949393 >> 172.21.15.117:0/2929949393 conn(0x7f966406bdf0 msgr2=0x7f96640b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:35.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.563+0000 7f966b1d8640 1 -- 172.21.15.117:0/2929949393 shutdown_connections 2024-09-19T08:37:35.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:35.563+0000 7f966b1d8640 1 -- 172.21.15.117:0/2929949393 wait complete. 2024-09-19T08:37:35.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.6 2024-09-19T08:37:35.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.0 2024-09-19T08:37:35.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.4 2024-09-19T08:37:35.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.3 2024-09-19T08:37:35.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.1 2024-09-19T08:37:35.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.2 2024-09-19T08:37:35.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.7 2024-09-19T08:37:35.785 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T08:37:35.788 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T08:37:36.548 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-19T08:37:36.567 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-19T08:37:36.569 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-19T08:37:36.570 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-19T08:37:36.571 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T08:37:36.574 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-19T08:37:36.575 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-19T08:37:36.577 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-19T08:37:36.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.690+0000 7faa72e37640 1 Processor -- start 2024-09-19T08:37:36.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.691+0000 7faa72e37640 1 -- start start 2024-09-19T08:37:36.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.692+0000 7faa72e37640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faa6c0b27b0 0x7faa6c1544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.692+0000 7faa72e37640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa6c0729e0 con 0x7faa6c06ef70 2024-09-19T08:37:36.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.692+0000 7faa72e37640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa6c072cc0 con 0x7faa6c072370 2024-09-19T08:37:36.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.692+0000 7faa72e37640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7faa6c0727a0 con 0x7faa6c0b27b0 2024-09-19T08:37:36.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.692+0000 7faa70bd3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faa6c0b27b0 0x7faa6c1544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.692+0000 7faa70bd3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faa6c0b27b0 0x7faa6c1544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34838/0 (socket says 172.21.15.117:34838) 2024-09-19T08:37:36.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.692+0000 7faa70bd3640 1 -- 172.21.15.117:0/3945758309 learned_addr learned my addr 172.21.15.117:0/3945758309 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:36.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.693+0000 7faa70bd3640 1 -- 172.21.15.117:0/3945758309 >> v1:172.21.15.146:6789/0 conn(0x7faa6c072370 legacy=0x7faa6c0ce410 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:37:36.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.693+0000 7faa70bd3640 1 -- 172.21.15.117:0/3945758309 >> v1:172.21.15.117:6789/0 conn(0x7faa6c06ef70 legacy=0x7faa6c071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.693+0000 7faa70bd3640 1 -- 172.21.15.117:0/3945758309 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6c072fa0 con 0x7faa6c0b27b0 2024-09-19T08:37:36.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.694+0000 7faa70bd3640 1 --2- 172.21.15.117:0/3945758309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa6c0b27b0 0x7faa6c1544d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faa64014a00 tx=0x7faa64033320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5389e7da378330f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.695+0000 7faa6b7fe640 1 -- 172.21.15.117:0/3945758309 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa640112d0 con 0x7faa6c0b27b0 2024-09-19T08:37:36.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.695+0000 7faa6b7fe640 1 -- 172.21.15.117:0/3945758309 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa64011470 con 0x7faa6c0b27b0 2024-09-19T08:37:36.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.696+0000 7faa72e37640 1 -- 172.21.15.117:0/3945758309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa6c0b27b0 msgr2=0x7faa6c1544d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.696+0000 7faa72e37640 1 --2- 172.21.15.117:0/3945758309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa6c0b27b0 0x7faa6c1544d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faa64014a00 tx=0x7faa64033320 comp rx=0 tx=0).stop 2024-09-19T08:37:36.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.696+0000 7faa72e37640 1 -- 172.21.15.117:0/3945758309 shutdown_connections 2024-09-19T08:37:36.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.696+0000 7faa72e37640 1 --2- 172.21.15.117:0/3945758309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa6c0b27b0 0x7faa6c1544d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.696+0000 7faa72e37640 1 -- 172.21.15.117:0/3945758309 >> 172.21.15.117:0/3945758309 conn(0x7faa6c0b1cc0 msgr2=0x7faa6c0b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:36.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.696+0000 7faa72e37640 1 -- 172.21.15.117:0/3945758309 shutdown_connections 2024-09-19T08:37:36.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.696+0000 7faa72e37640 1 -- 172.21.15.117:0/3945758309 wait complete. 2024-09-19T08:37:36.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.698+0000 7faa72e37640 1 Processor -- start 2024-09-19T08:37:36.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.698+0000 7faa72e37640 1 -- start start 2024-09-19T08:37:36.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.699+0000 7faa72e37640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa6c06ef70 0x7faa6c2124f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.699+0000 7faa72e37640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa6c072370 0x7faa6c20b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.700+0000 7faa72e37640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa6c0b27b0 0x7faa6c0a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.700+0000 7faa6bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa6c072370 0x7faa6c20b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.700+0000 7faa713d4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa6c0b27b0 0x7faa6c0a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.700+0000 7faa6bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa6c072370 0x7faa6c20b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.117:48382/0 (socket says 172.21.15.117:48382) 2024-09-19T08:37:36.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.700+0000 7faa713d4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa6c0b27b0 0x7faa6c0a9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34850/0 (socket says 172.21.15.117:34850) 2024-09-19T08:37:36.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.700+0000 7faa70bd3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa6c06ef70 0x7faa6c2124f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.700+0000 7faa70bd3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa6c06ef70 0x7faa6c2124f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.117:57948/0 (socket says 172.21.15.117:57948) 2024-09-19T08:37:36.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.700+0000 7faa6bfff640 1 -- 172.21.15.117:0/2284956818 learned_addr learned my addr 172.21.15.117:0/2284956818 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:36.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.700+0000 7faa72e37640 1 -- 172.21.15.117:0/2284956818 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c154a10 con 0x7faa6c0b27b0 2024-09-19T08:37:36.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.700+0000 7faa72e37640 1 -- 172.21.15.117:0/2284956818 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c0cdbe0 con 0x7faa6c072370 2024-09-19T08:37:36.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.700+0000 7faa72e37640 1 -- 172.21.15.117:0/2284956818 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7faa6c213910 con 0x7faa6c06ef70 2024-09-19T08:37:36.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.701+0000 7faa713d4640 1 -- 172.21.15.117:0/2284956818 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa6c06ef70 msgr2=0x7faa6c2124f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.701+0000 7faa713d4640 1 --2- 172.21.15.117:0/2284956818 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa6c06ef70 0x7faa6c2124f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.701+0000 7faa713d4640 1 -- 172.21.15.117:0/2284956818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa6c072370 msgr2=0x7faa6c20b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.701+0000 7faa713d4640 1 --2- 172.21.15.117:0/2284956818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa6c072370 0x7faa6c20b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.701+0000 7faa713d4640 1 -- 172.21.15.117:0/2284956818 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6c212d20 con 0x7faa6c0b27b0 2024-09-19T08:37:36.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.702+0000 7faa713d4640 1 --2- 172.21.15.117:0/2284956818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa6c0b27b0 0x7faa6c0a9450 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faa5c00b750 tx=0x7faa5c00bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.702+0000 7faa70bd3640 1 --2- 172.21.15.117:0/2284956818 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa6c06ef70 0x7faa6c2124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:36.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.702+0000 7faa697fa640 1 -- 172.21.15.117:0/2284956818 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c019070 con 0x7faa6c0b27b0 2024-09-19T08:37:36.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.703+0000 7faa72e37640 1 -- 172.21.15.117:0/2284956818 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa6c212fe0 con 0x7faa6c0b27b0 2024-09-19T08:37:36.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.703+0000 7faa72e37640 1 -- 172.21.15.117:0/2284956818 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa6c2135a0 con 0x7faa6c0b27b0 2024-09-19T08:37:36.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.703+0000 7faa697fa640 1 -- 172.21.15.117:0/2284956818 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa5c00c740 con 0x7faa6c0b27b0 2024-09-19T08:37:36.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.703+0000 7faa697fa640 1 -- 172.21.15.117:0/2284956818 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c00cb30 con 0x7faa6c0b27b0 2024-09-19T08:37:36.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.706+0000 7faa697fa640 1 -- 172.21.15.117:0/2284956818 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faa5c01c070 con 0x7faa6c0b27b0 2024-09-19T08:37:36.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.707+0000 7faa697fa640 1 --2- 172.21.15.117:0/2284956818 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faa5806c380 0x7faa5806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.707+0000 7faa697fa640 1 -- 172.21.15.117:0/2284956818 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7faa5c08ab00 con 0x7faa6c0b27b0 2024-09-19T08:37:36.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.707+0000 7faa70bd3640 1 --2- 172.21.15.117:0/2284956818 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faa5806c380 0x7faa5806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.708+0000 7faa70bd3640 1 --2- 172.21.15.117:0/2284956818 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faa5806c380 0x7faa5806e840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faa6403c000 tx=0x7faa64037000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.709+0000 7faa72e37640 1 -- 172.21.15.117:0/2284956818 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa4c005290 con 0x7faa6c0b27b0 2024-09-19T08:37:36.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.719+0000 7faa697fa640 1 -- 172.21.15.117:0/2284956818 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7faa5c058a10 con 0x7faa6c0b27b0 2024-09-19T08:37:36.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.753+0000 7f6d852c6640 1 Processor -- start 2024-09-19T08:37:36.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.754+0000 7f6d852c6640 1 -- start start 2024-09-19T08:37:36.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.755+0000 7f6d852c6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d80154680 0x7f6d8015a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.755+0000 7f6d852c6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6d800cdce0 0x7f6d800b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.755+0000 7f6d852c6640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d800ce470 con 0x7f6d800b5960 2024-09-19T08:37:36.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.755+0000 7f6d852c6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6d800b5db0 con 0x7f6d800cdce0 2024-09-19T08:37:36.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.755+0000 7f6d852c6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f6d800ce750 con 0x7f6d80154680 2024-09-19T08:37:36.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.756+0000 7f6d7f7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6d800cdce0 0x7f6d800b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.756+0000 7f6d7f7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6d800cdce0 0x7f6d800b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34854/0 (socket says 172.21.15.117:34854) 2024-09-19T08:37:36.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.756+0000 7f6d7f7fe640 1 -- 172.21.15.117:0/2054696220 learned_addr learned my addr 172.21.15.117:0/2054696220 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:36.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.756+0000 7f6d7f7fe640 1 -- 172.21.15.117:0/2054696220 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d80154680 msgr2=0x7f6d8015a700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:37:36.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.756+0000 7f6d7f7fe640 1 --2- 172.21.15.117:0/2054696220 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d80154680 0x7f6d8015a700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.756+0000 7f6d7f7fe640 1 -- 172.21.15.117:0/2054696220 >> v1:172.21.15.146:6789/0 conn(0x7f6d800b5960 legacy=0x7f6d800b46a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:37:36.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.756+0000 7f6d7f7fe640 1 -- 172.21.15.117:0/2054696220 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d800cea30 con 0x7f6d800cdce0 2024-09-19T08:37:36.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.756+0000 7f019bfff640 1 Processor -- start 2024-09-19T08:37:36.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.757+0000 7f1e0319b640 1 Processor -- start 2024-09-19T08:37:36.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.757+0000 7f1e0319b640 1 -- start start 2024-09-19T08:37:36.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.757+0000 7f6d7f7fe640 1 --2- 172.21.15.117:0/2054696220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d800cdce0 0x7f6d800b5420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800c770 tx=0x7f6d7802b270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0e4cc5a16e0151 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.757+0000 7f019bfff640 1 -- start start 2024-09-19T08:37:36.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.758+0000 7f6ec0e8f640 1 Processor -- start 2024-09-19T08:37:36.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.758+0000 7f6d7effd640 1 -- 172.21.15.117:0/2054696220 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7802bd70 con 0x7f6d800cdce0 2024-09-19T08:37:36.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.758+0000 7f6d7effd640 1 -- 172.21.15.117:0/2054696220 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d780333f0 con 0x7f6d800cdce0 2024-09-19T08:37:36.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.758+0000 7f6d7effd640 1 -- 172.21.15.117:0/2054696220 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d780337c0 con 0x7f6d800cdce0 2024-09-19T08:37:36.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.759+0000 7f1e0319b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1dfc0aedf0 0x7f1dfc0b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.759+0000 7f1e0319b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1dfc0b5a10 0x7f1dfc167d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.759+0000 7f1e0319b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dfc0ad900 con 0x7f1dfc0b50f0 2024-09-19T08:37:36.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.759+0000 7f1e0299a640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1dfc0b5a10 0x7f1dfc167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.759+0000 7f1e01998640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1dfc0aedf0 0x7f1dfc0b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.759+0000 7f019bfff640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f019c0b5b30 0x7f019c15a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.759+0000 7f019bfff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f019c0cdce0 0x7f019c0b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.759+0000 7f019bfff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f019c0ce470 con 0x7f019c154680 2024-09-19T08:37:36.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.759+0000 7f019bfff640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f019c0ce750 con 0x7f019c0b5b30 2024-09-19T08:37:36.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.759+0000 7f019bfff640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f019c0cea30 con 0x7f019c0cdce0 2024-09-19T08:37:36.763 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.759+0000 7f1e01998640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1dfc0aedf0 0x7f1dfc0b54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34860/0 (socket says 172.21.15.117:34860) 2024-09-19T08:37:36.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.759+0000 7f1e01998640 1 -- 172.21.15.117:0/870266264 learned_addr learned my addr 172.21.15.117:0/870266264 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:36.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.759+0000 7f019affd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f019c154680 0x7f019c0b5420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:54864/0 (socket says 172.21.15.117:54864) 2024-09-19T08:37:36.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.759+0000 7f1e0319b640 1 -- 172.21.15.117:0/870266264 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1dfc147ee0 con 0x7f1dfc0aedf0 2024-09-19T08:37:36.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.759+0000 7f1e0319b640 1 -- 172.21.15.117:0/870266264 --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f1dfc0726f0 con 0x7f1dfc0b5a10 2024-09-19T08:37:36.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.759+0000 7f019affd640 1 -- 172.21.15.117:0/2327576084 learned_addr learned my addr 172.21.15.117:0/2327576084 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:36.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.759+0000 7f6d852c6640 1 -- 172.21.15.117:0/2054696220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d800cdce0 msgr2=0x7f6d800b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f6d852c6640 1 --2- 172.21.15.117:0/2054696220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d800cdce0 0x7f6d800b5420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800c770 tx=0x7f6d7802b270 comp rx=0 tx=0).stop 2024-09-19T08:37:36.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.758+0000 7f6ec0e8f640 1 -- start start 2024-09-19T08:37:36.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f6ec0e8f640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6ebc15cc70 0x7f6ebc0b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f6ec0e8f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ebc071b60 con 0x7f6ebc0b5500 2024-09-19T08:37:36.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f6ec0e8f640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ebc15d050 con 0x7f6ebc073630 2024-09-19T08:37:36.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f6ec0e8f640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f6ebc0b5970 con 0x7f6ebc15cc70 2024-09-19T08:37:36.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f6ebaffd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f6ebc0b5500 0x7f6ebc0b3280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:54878/0 (socket says 172.21.15.117:54878) 2024-09-19T08:37:36.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f6ebaffd640 1 -- 172.21.15.117:0/1643637780 learned_addr learned my addr 172.21.15.117:0/1643637780 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:36.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f6ebb7fe640 1 --2- 172.21.15.117:0/1643637780 >> v2:172.21.15.146:3300/0 conn(0x7f6ebc15cc70 0x7f6ebc0b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f6d852c6640 1 -- 172.21.15.117:0/2054696220 shutdown_connections 2024-09-19T08:37:36.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f6d852c6640 1 --2- 172.21.15.117:0/2054696220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d800cdce0 0x7f6d800b5420 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f6d852c6640 1 --2- 172.21.15.117:0/2054696220 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d80154680 0x7f6d8015a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f6d852c6640 1 -- 172.21.15.117:0/2054696220 >> 172.21.15.117:0/2054696220 conn(0x7f6d8006dae0 msgr2=0x7f6d8006dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:36.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f6eba7fc640 1 -- 172.21.15.117:0/1643637780 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3124523898 0 0) 0x7f6ebc071b60 con 0x7f6ebc0b5500 2024-09-19T08:37:36.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f6eba7fc640 1 -- 172.21.15.117:0/1643637780 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ea4003520 con 0x7f6ebc0b5500 2024-09-19T08:37:36.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f6ebb7fe640 1 -- 172.21.15.117:0/1643637780 >> v1:172.21.15.146:6789/0 conn(0x7f6ebc073630 legacy=0x7f6ebc16c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f6ebb7fe640 1 -- 172.21.15.117:0/1643637780 >> v1:172.21.15.117:6789/0 conn(0x7f6ebc0b5500 legacy=0x7f6ebc0b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f6ebb7fe640 1 -- 172.21.15.117:0/1643637780 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ebc0b3ff0 con 0x7f6ebc15cc70 2024-09-19T08:37:36.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f019a7fc640 1 --2- 172.21.15.117:0/2327576084 >> v2:172.21.15.146:3300/0 conn(0x7f019c0b5b30 0x7f019c15a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f019b7fe640 1 --2- 172.21.15.117:0/2327576084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f019c0cdce0 0x7f019c0b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f1e01998640 1 -- 172.21.15.117:0/870266264 >> v2:172.21.15.146:3300/0 conn(0x7f1dfc0b5a10 msgr2=0x7f1dfc167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:36.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f1e01998640 1 --2- 172.21.15.117:0/870266264 >> v2:172.21.15.146:3300/0 conn(0x7f1dfc0b5a10 0x7f1dfc167d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f1e01998640 1 -- 172.21.15.117:0/870266264 >> v1:172.21.15.146:6789/0 conn(0x7f1dfc0b50f0 legacy=0x7f1dfc0b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:36.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f1e01998640 1 -- 172.21.15.117:0/870266264 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dfc0729d0 con 0x7f1dfc0aedf0 2024-09-19T08:37:36.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.761+0000 7f6d852c6640 1 -- 172.21.15.117:0/2054696220 shutdown_connections 2024-09-19T08:37:36.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f019b7fe640 1 -- 172.21.15.117:0/2327576084 >> v2:172.21.15.146:3300/0 conn(0x7f019c0b5b30 msgr2=0x7f019c15a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:36.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f019b7fe640 1 --2- 172.21.15.117:0/2327576084 >> v2:172.21.15.146:3300/0 conn(0x7f019c0b5b30 0x7f019c15a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f019b7fe640 1 -- 172.21.15.117:0/2327576084 >> v1:172.21.15.117:6789/0 conn(0x7f019c154680 legacy=0x7f019c0b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.760+0000 7f019b7fe640 1 -- 172.21.15.117:0/2327576084 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019c0ced10 con 0x7f019c0cdce0 2024-09-19T08:37:36.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.761+0000 7f1e01998640 1 --2- 172.21.15.117:0/870266264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dfc0aedf0 0x7f1dfc0b54d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc06e710 tx=0x7f1dec02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5207954e17996d49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.761+0000 7f1e0299a640 1 --2- 172.21.15.117:0/870266264 >> v2:172.21.15.146:3300/0 conn(0x7f1dfc0b5a10 0x7f1dfc167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:36.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.761+0000 7f6d852c6640 1 -- 172.21.15.117:0/2054696220 wait complete. 2024-09-19T08:37:36.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.762+0000 7f1e01197640 1 -- 172.21.15.117:0/870266264 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec037070 con 0x7f1dfc0aedf0 2024-09-19T08:37:36.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.762+0000 7f6ebb7fe640 1 --2- 172.21.15.117:0/1643637780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ebc15cc70 0x7f6ebc0b4fc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4009d90 tx=0x7f6eb402a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5dfa626e4ae71f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.762+0000 7f1e01197640 1 -- 172.21.15.117:0/870266264 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dec032440 con 0x7f1dfc0aedf0 2024-09-19T08:37:36.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.762+0000 7f1e01197640 1 -- 172.21.15.117:0/870266264 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dec0327f0 con 0x7f1dfc0aedf0 2024-09-19T08:37:36.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.762+0000 7f6eba7fc640 1 -- 172.21.15.117:0/1643637780 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4007740 con 0x7f6ebc15cc70 2024-09-19T08:37:36.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.762+0000 7f6eba7fc640 1 -- 172.21.15.117:0/1643637780 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb40078e0 con 0x7f6ebc15cc70 2024-09-19T08:37:36.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.762+0000 7f6eba7fc640 1 -- 172.21.15.117:0/1643637780 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4007cb0 con 0x7f6ebc15cc70 2024-09-19T08:37:36.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.762+0000 7f019b7fe640 1 --2- 172.21.15.117:0/2327576084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f019c0cdce0 0x7f019c0b46a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f018c0097a0 tx=0x7f018c02c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74cd303ec301ef44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.762+0000 7f0199ffb640 1 -- 172.21.15.117:0/2327576084 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c039070 con 0x7f019c0cdce0 2024-09-19T08:37:36.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.763+0000 7f0199ffb640 1 -- 172.21.15.117:0/2327576084 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f018c034640 con 0x7f019c0cdce0 2024-09-19T08:37:36.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.763+0000 7f0199ffb640 1 -- 172.21.15.117:0/2327576084 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c034a10 con 0x7f019c0cdce0 2024-09-19T08:37:36.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.763+0000 7f1e0319b640 1 -- 172.21.15.117:0/870266264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dfc0aedf0 msgr2=0x7f1dfc0b54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.763+0000 7f1e0319b640 1 --2- 172.21.15.117:0/870266264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dfc0aedf0 0x7f1dfc0b54d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc06e710 tx=0x7f1dec02a250 comp rx=0 tx=0).stop 2024-09-19T08:37:36.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.763+0000 7f6d852c6640 1 Processor -- start 2024-09-19T08:37:36.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.763+0000 7f1e0319b640 1 -- 172.21.15.117:0/870266264 shutdown_connections 2024-09-19T08:37:36.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.763+0000 7f0a3bb11640 1 Processor -- start 2024-09-19T08:37:36.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.763+0000 7f1e0319b640 1 --2- 172.21.15.117:0/870266264 >> v2:172.21.15.146:3300/0 conn(0x7f1dfc0b5a10 0x7f1dfc167d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.763+0000 7f6ec0e8f640 1 -- 172.21.15.117:0/1643637780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ebc15cc70 msgr2=0x7f6ebc0b4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.763+0000 7f6ec0e8f640 1 --2- 172.21.15.117:0/1643637780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ebc15cc70 0x7f6ebc0b4fc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4009d90 tx=0x7f6eb402a610 comp rx=0 tx=0).stop 2024-09-19T08:37:36.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.763+0000 7f1e0319b640 1 --2- 172.21.15.117:0/870266264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dfc0aedf0 0x7f1dfc0b54d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.763+0000 7f1e0319b640 1 -- 172.21.15.117:0/870266264 >> 172.21.15.117:0/870266264 conn(0x7f1dfc06dae0 msgr2=0x7f1dfc06dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:36.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.763+0000 7f3820311640 1 Processor -- start 2024-09-19T08:37:36.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.763+0000 7f3820311640 1 -- start start 2024-09-19T08:37:36.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.763+0000 7f6d852c6640 1 -- start start 2024-09-19T08:37:36.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.763+0000 7f1e0319b640 1 -- 172.21.15.117:0/870266264 shutdown_connections 2024-09-19T08:37:36.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.763+0000 7f1e0319b640 1 -- 172.21.15.117:0/870266264 wait complete. 2024-09-19T08:37:36.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.764+0000 7f6ec0e8f640 1 -- 172.21.15.117:0/1643637780 shutdown_connections 2024-09-19T08:37:36.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.764+0000 7f6ec0e8f640 1 --2- 172.21.15.117:0/1643637780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ebc15cc70 0x7f6ebc0b4fc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.764+0000 7f6ec0e8f640 1 -- 172.21.15.117:0/1643637780 >> 172.21.15.117:0/1643637780 conn(0x7f6ebc0b1dc0 msgr2=0x7f6ebc0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:36.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.764+0000 7f019bfff640 1 -- 172.21.15.117:0/2327576084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f019c0cdce0 msgr2=0x7f019c0b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.764+0000 7f019bfff640 1 --2- 172.21.15.117:0/2327576084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f019c0cdce0 0x7f019c0b46a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f018c0097a0 tx=0x7f018c02c390 comp rx=0 tx=0).stop 2024-09-19T08:37:36.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.764+0000 7f0a3bb11640 1 -- start start 2024-09-19T08:37:36.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.764+0000 7f019bfff640 1 -- 172.21.15.117:0/2327576084 shutdown_connections 2024-09-19T08:37:36.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.764+0000 7f019bfff640 1 --2- 172.21.15.117:0/2327576084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f019c0cdce0 0x7f019c0b46a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.764+0000 7f019bfff640 1 --2- 172.21.15.117:0/2327576084 >> v2:172.21.15.146:3300/0 conn(0x7f019c0b5b30 0x7f019c15a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.764+0000 7f019bfff640 1 -- 172.21.15.117:0/2327576084 >> 172.21.15.117:0/2327576084 conn(0x7f019c06dae0 msgr2=0x7f019c06dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:36.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.764+0000 7f019bfff640 1 -- 172.21.15.117:0/2327576084 shutdown_connections 2024-09-19T08:37:36.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.764+0000 7f019bfff640 1 -- 172.21.15.117:0/2327576084 wait complete. 2024-09-19T08:37:36.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.764+0000 7f6d852c6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d800b5960 0x7f6d80071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.764+0000 7f6d852c6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d800cdce0 0x7f6d8014ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.764+0000 7f6d852c6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d80154680 0x7f6d801558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.764+0000 7f6d852c6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6d80073ae0 con 0x7f6d800b5960 2024-09-19T08:37:36.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.764+0000 7f6d852c6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6d800ceff0 con 0x7f6d80154680 2024-09-19T08:37:36.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.764+0000 7f6d852c6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f6d800ce140 con 0x7f6d800cdce0 2024-09-19T08:37:36.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f6d7ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d800b5960 0x7f6d80071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f6d7ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d800b5960 0x7f6d80071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34866/0 (socket says 172.21.15.117:34866) 2024-09-19T08:37:36.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f3820311640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f38180b44a0 0x7f381806efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f3820311640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f381806f4e0 0x7f381815a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f3820311640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38180b4c80 con 0x7f381806ff50 2024-09-19T08:37:36.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f3820311640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f38180b4f60 con 0x7f38180b44a0 2024-09-19T08:37:36.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f3820311640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f381806ea80 con 0x7f381806f4e0 2024-09-19T08:37:36.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f6d7ffff640 1 -- 172.21.15.117:0/2226467293 learned_addr learned my addr 172.21.15.117:0/2226467293 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:36.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f6d84ac5640 1 --2- 172.21.15.117:0/2226467293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d80154680 0x7f6d801558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f0a3bb11640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0a3415bee0 0x7f0a340d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f0a3bb11640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a3415c2c0 0x7f0a340d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f381e8ae640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f381806f4e0 0x7f381815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f381e8ae640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f381806f4e0 0x7f381815a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.117:57972/0 (socket says 172.21.15.117:57972) 2024-09-19T08:37:36.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f381e8ae640 1 -- 172.21.15.117:0/2209629595 learned_addr learned my addr 172.21.15.117:0/2209629595 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:36.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f0a3bb11640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a340cdee0 con 0x7f0a340cf200 2024-09-19T08:37:36.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f0a3bb11640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f0a340ceaf0 con 0x7f0a3415bee0 2024-09-19T08:37:36.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f0a3bb11640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f0a340ce1c0 con 0x7f0a3415c2c0 2024-09-19T08:37:36.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f6d84ac5640 1 -- 172.21.15.117:0/2226467293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d800cdce0 msgr2=0x7f6d8014ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f6d84ac5640 1 --2- 172.21.15.117:0/2226467293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d800cdce0 0x7f6d8014ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f6d84ac5640 1 -- 172.21.15.117:0/2226467293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d800b5960 msgr2=0x7f6d80071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f6d84ac5640 1 --2- 172.21.15.117:0/2226467293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d800b5960 0x7f6d80071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f6d84ac5640 1 -- 172.21.15.117:0/2226467293 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8014c260 con 0x7f6d80154680 2024-09-19T08:37:36.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.765+0000 7f381d8ac640 1 --2- 172.21.15.117:0/2209629595 >> v2:172.21.15.146:3300/0 conn(0x7f38180b44a0 0x7f381806efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f6d84ac5640 1 --2- 172.21.15.117:0/2226467293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d80154680 0x7f6d801558b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400b3e0 tx=0x7f6d7400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f0a390ac640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a3415c2c0 0x7f0a340d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f0a390ac640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a3415c2c0 0x7f0a340d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.117:57984/0 (socket says 172.21.15.117:57984) 2024-09-19T08:37:36.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f0a390ac640 1 -- 172.21.15.117:0/3405811962 learned_addr learned my addr 172.21.15.117:0/3405811962 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:36.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f0a398ad640 1 --2- 172.21.15.117:0/3405811962 >> v2:172.21.15.146:3300/0 conn(0x7f0a3415bee0 0x7f0a340d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f1e0319b640 1 Processor -- start 2024-09-19T08:37:36.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f6d7cff9640 1 -- 172.21.15.117:0/2226467293 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d74015020 con 0x7f6d80154680 2024-09-19T08:37:36.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f1e0319b640 1 -- start start 2024-09-19T08:37:36.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f6d7ffff640 1 --2- 172.21.15.117:0/2226467293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d800b5960 0x7f6d80071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:37:36.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f6d852c6640 1 -- 172.21.15.117:0/2226467293 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d8014b6e0 con 0x7f6d80154680 2024-09-19T08:37:36.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f381e8ae640 1 -- 172.21.15.117:0/2209629595 >> v2:172.21.15.146:3300/0 conn(0x7f38180b44a0 msgr2=0x7f381806efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:36.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f381e8ae640 1 --2- 172.21.15.117:0/2209629595 >> v2:172.21.15.146:3300/0 conn(0x7f38180b44a0 0x7f381806efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f381e8ae640 1 -- 172.21.15.117:0/2209629595 >> v1:172.21.15.117:6789/0 conn(0x7f381806ff50 legacy=0x7f38180cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f381e8ae640 1 -- 172.21.15.117:0/2209629595 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f381815a6c0 con 0x7f381806f4e0 2024-09-19T08:37:36.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f6ec0e8f640 1 -- 172.21.15.117:0/1643637780 shutdown_connections 2024-09-19T08:37:36.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f6d852c6640 1 -- 172.21.15.117:0/2226467293 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d8014bca0 con 0x7f6d80154680 2024-09-19T08:37:36.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f0a390ac640 1 -- 172.21.15.117:0/3405811962 >> v2:172.21.15.146:3300/0 conn(0x7f0a3415bee0 msgr2=0x7f0a340d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:36.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f6d7cff9640 1 -- 172.21.15.117:0/2226467293 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d74011850 con 0x7f6d80154680 2024-09-19T08:37:36.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f0a390ac640 1 --2- 172.21.15.117:0/3405811962 >> v2:172.21.15.146:3300/0 conn(0x7f0a3415bee0 0x7f0a340d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f6d7cff9640 1 -- 172.21.15.117:0/2226467293 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d74011c40 con 0x7f6d80154680 2024-09-19T08:37:36.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f0a390ac640 1 -- 172.21.15.117:0/3405811962 >> v1:172.21.15.117:6789/0 conn(0x7f0a340cf200 legacy=0x7f0a340cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f019bfff640 1 Processor -- start 2024-09-19T08:37:36.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.767+0000 7f0a390ac640 1 -- 172.21.15.117:0/3405811962 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a340ce4a0 con 0x7f0a3415c2c0 2024-09-19T08:37:36.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.767+0000 7faf8b32f640 1 Processor -- start 2024-09-19T08:37:36.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.767+0000 7faf8b32f640 1 -- start start 2024-09-19T08:37:36.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.767+0000 7f381e8ae640 1 --2- 172.21.15.117:0/2209629595 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f381806f4e0 0x7f381815a180 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3810009e50 tx=0x7f381002a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90bd854b52008a56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f019bfff640 1 -- start start 2024-09-19T08:37:36.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.767+0000 7f019bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019c0b5b30 0x7f019c159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.767+0000 7f019bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f019c0cdce0 0x7f019c0cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.767+0000 7f1e0319b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dfc0aedf0 0x7f1dfc13b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.767+0000 7f1e0319b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1dfc0b50f0 0x7f1dfc1f7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f381d0ab640 1 -- 172.21.15.117:0/2209629595 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3810036070 con 0x7f381806f4e0 2024-09-19T08:37:36.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f381d0ab640 1 -- 172.21.15.117:0/2209629595 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3810031600 con 0x7f381806f4e0 2024-09-19T08:37:36.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f381d0ab640 1 -- 172.21.15.117:0/2209629595 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38100319d0 con 0x7f381806f4e0 2024-09-19T08:37:36.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.767+0000 7f1e0319b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dfc0b5a10 0x7f1dfc137670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.767+0000 7f1e0319b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc072f90 con 0x7f1dfc0b5a10 2024-09-19T08:37:36.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f019bfff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f019c154680 0x7f019c0c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f019bfff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f019c0ce150 con 0x7f019c0cdce0 2024-09-19T08:37:36.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f019bfff640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f019c073ae0 con 0x7f019c0b5b30 2024-09-19T08:37:36.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f019bfff640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f019c154a60 con 0x7f019c154680 2024-09-19T08:37:36.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f019affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019c0b5b30 0x7f019c159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f019affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019c0b5b30 0x7f019c159690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.117:48464/0 (socket says 172.21.15.117:48464) 2024-09-19T08:37:36.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f019affd640 1 -- 172.21.15.117:0/1325980440 learned_addr learned my addr 172.21.15.117:0/1325980440 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:36.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f019b7fe640 1 --2- 172.21.15.117:0/1325980440 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f019c154680 0x7f019c0c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.767+0000 7f1e0319b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc0b6150 con 0x7f1dfc0aedf0 2024-09-19T08:37:36.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.767+0000 7f1e0319b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f1dfc0b37d0 con 0x7f1dfc0b50f0 2024-09-19T08:37:36.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.767+0000 7f1e02199640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dfc0aedf0 0x7f1dfc13b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f1e02199640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dfc0aedf0 0x7f1dfc13b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.117:48448/0 (socket says 172.21.15.117:48448) 2024-09-19T08:37:36.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f1e02199640 1 -- 172.21.15.117:0/2778794887 learned_addr learned my addr 172.21.15.117:0/2778794887 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:36.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f1e0299a640 1 --2- 172.21.15.117:0/2778794887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dfc0b5a10 0x7f1dfc137670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f019affd640 1 -- 172.21.15.117:0/1325980440 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f019c154680 msgr2=0x7f019c0c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f019affd640 1 --2- 172.21.15.117:0/1325980440 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f019c154680 0x7f019c0c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f0a390ac640 1 --2- 172.21.15.117:0/3405811962 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a3415c2c0 0x7f0a340d09f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009870 tx=0x7f0a3002a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1daf554d4d8e1bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f1e02199640 1 -- 172.21.15.117:0/2778794887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1dfc0b50f0 msgr2=0x7f1dfc1f7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f1e02199640 1 --2- 172.21.15.117:0/2778794887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1dfc0b50f0 0x7f1dfc1f7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f1e02199640 1 -- 172.21.15.117:0/2778794887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dfc0b5a10 msgr2=0x7f1dfc137670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f1e02199640 1 --2- 172.21.15.117:0/2778794887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dfc0b5a10 0x7f1dfc137670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f1e02199640 1 -- 172.21.15.117:0/2778794887 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dfc1394c0 con 0x7f1dfc0aedf0 2024-09-19T08:37:36.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f1e0299a640 1 --2- 172.21.15.117:0/2778794887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dfc0b5a10 0x7f1dfc137670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:37:36.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f019affd640 1 -- 172.21.15.117:0/1325980440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f019c0cdce0 msgr2=0x7f019c0cb070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:37:36.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7faf8b32f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf841568d0 0x7faf840b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7faf8b32f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf84156cb0 con 0x7faf8415d270 2024-09-19T08:37:36.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.769+0000 7faf8b32f640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf840b67a0 con 0x7faf840b4400 2024-09-19T08:37:36.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.769+0000 7faf8b32f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7faf8406ed40 con 0x7faf841568d0 2024-09-19T08:37:36.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.769+0000 7f6d7cff9640 1 -- 172.21.15.117:0/2226467293 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6d74018020 con 0x7f6d80154680 2024-09-19T08:37:36.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.769+0000 7f3820311640 1 -- 172.21.15.117:0/2209629595 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f381806f4e0 msgr2=0x7f381815a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.769+0000 7f3820311640 1 --2- 172.21.15.117:0/2209629595 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f381806f4e0 0x7f381815a180 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3810009e50 tx=0x7f381002a7a0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.766+0000 7f6ec0e8f640 1 -- 172.21.15.117:0/1643637780 wait complete. 2024-09-19T08:37:36.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f6ec0e8f640 1 Processor -- start 2024-09-19T08:37:36.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.768+0000 7f6ec0e8f640 1 -- start start 2024-09-19T08:37:36.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.769+0000 7f0a388ab640 1 -- 172.21.15.117:0/3405811962 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a30037070 con 0x7f0a3415c2c0 2024-09-19T08:37:36.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.769+0000 7f0a388ab640 1 -- 172.21.15.117:0/3405811962 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a3002adf0 con 0x7f0a3415c2c0 2024-09-19T08:37:36.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.769+0000 7f0a388ab640 1 -- 172.21.15.117:0/3405811962 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a30032660 con 0x7f0a3415c2c0 2024-09-19T08:37:36.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.769+0000 7faf8ab2e640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7faf840b4400 0x7faf840d0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.117:43600/0 (socket says 172.21.15.117:43600) 2024-09-19T08:37:36.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.769+0000 7faf8ab2e640 1 -- 172.21.15.117:0/3137171846 learned_addr learned my addr 172.21.15.117:0/3137171846 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:36.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.769+0000 7f6d852c6640 1 -- 172.21.15.117:0/2226467293 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d60005290 con 0x7f6d80154680 2024-09-19T08:37:36.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.769+0000 7f6d7cff9640 1 --2- 172.21.15.117:0/2226467293 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6d6c06c3b0 0x7f6d6c06e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.769+0000 7f019a7fc640 1 --2- 172.21.15.117:0/1325980440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f019c0cdce0 0x7f019c0cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.769+0000 7f019affd640 1 --2- 172.21.15.117:0/1325980440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f019c0cdce0 0x7f019c0cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.769+0000 7f019affd640 1 -- 172.21.15.117:0/1325980440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019c0c6640 con 0x7f019c0b5b30 2024-09-19T08:37:36.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.769+0000 7faf8932b640 1 -- 172.21.15.117:0/3137171846 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1384362436 0 0) 0x7faf840b67a0 con 0x7faf840b4400 2024-09-19T08:37:36.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.769+0000 7faf8932b640 1 -- 172.21.15.117:0/3137171846 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf70003520 con 0x7faf840b4400 2024-09-19T08:37:36.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.769+0000 7f1e02199640 1 --2- 172.21.15.117:0/2778794887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dfc0aedf0 0x7f1dfc13b920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1df800b3f0 tx=0x7f1df800b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.769+0000 7f6d7cff9640 1 -- 172.21.15.117:0/2226467293 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6d7408b580 con 0x7f6d80154680 2024-09-19T08:37:36.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.769+0000 7f6d7ffff640 1 --2- 172.21.15.117:0/2226467293 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6d6c06c3b0 0x7f6d6c06e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f0a3bb11640 1 -- 172.21.15.117:0/3405811962 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a3415c2c0 msgr2=0x7f0a340d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f0a3bb11640 1 --2- 172.21.15.117:0/3405811962 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a3415c2c0 0x7f0a340d09f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009870 tx=0x7f0a3002a160 comp rx=0 tx=0).stop 2024-09-19T08:37:36.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f3820311640 1 -- 172.21.15.117:0/2209629595 shutdown_connections 2024-09-19T08:37:36.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7faf8a32d640 1 --2- 172.21.15.117:0/3137171846 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf841568d0 0x7faf840b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f0a3bb11640 1 -- 172.21.15.117:0/3405811962 shutdown_connections 2024-09-19T08:37:36.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f0a3bb11640 1 --2- 172.21.15.117:0/3405811962 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a3415c2c0 0x7f0a340d09f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f0a3bb11640 1 --2- 172.21.15.117:0/3405811962 >> v2:172.21.15.146:3300/0 conn(0x7f0a3415bee0 0x7f0a340d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f0a3bb11640 1 -- 172.21.15.117:0/3405811962 >> 172.21.15.117:0/3405811962 conn(0x7f0a3406bdf0 msgr2=0x7f0a3406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:36.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7faf8932b640 1 -- 172.21.15.117:0/3137171846 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1052668073 0 0) 0x7faf84156cb0 con 0x7faf8415d270 2024-09-19T08:37:36.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7faf8932b640 1 -- 172.21.15.117:0/3137171846 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf840b67a0 con 0x7faf8415d270 2024-09-19T08:37:36.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f3820311640 1 --2- 172.21.15.117:0/2209629595 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f381806f4e0 0x7f381815a180 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f3820311640 1 --2- 172.21.15.117:0/2209629595 >> v2:172.21.15.146:3300/0 conn(0x7f38180b44a0 0x7f381806efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f3820311640 1 -- 172.21.15.117:0/2209629595 >> 172.21.15.117:0/2209629595 conn(0x7f381806bdf0 msgr2=0x7f381806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:36.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f6ec0e8f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ebc073630 0x7f6ebc152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f3820311640 1 -- 172.21.15.117:0/2209629595 shutdown_connections 2024-09-19T08:37:36.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f6ec0e8f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ebc0b5500 0x7f6ebc15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f0a3bb11640 1 -- 172.21.15.117:0/3405811962 shutdown_connections 2024-09-19T08:37:36.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f0a3bb11640 1 -- 172.21.15.117:0/3405811962 wait complete. 2024-09-19T08:37:36.812 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f3820311640 1 -- 172.21.15.117:0/2209629595 wait complete. 2024-09-19T08:37:36.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f019affd640 1 --2- 172.21.15.117:0/1325980440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019c0b5b30 0x7f019c159690 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0194001a80 tx=0x7f0194001f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f6ebb7fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ebc073630 0x7f6ebc152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f6ebb7fe640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ebc073630 0x7f6ebc152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.117:58010/0 (socket says 172.21.15.117:58010) 2024-09-19T08:37:36.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f6ebb7fe640 1 -- 172.21.15.117:0/1230988790 learned_addr learned my addr 172.21.15.117:0/1230988790 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:36.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f6ebaffd640 1 --2- 172.21.15.117:0/1230988790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ebc0b5500 0x7f6ebc15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f6ec0e8f640 1 --2- 172.21.15.117:0/1230988790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ebc15cc70 0x7f6ebc15b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f6ec0e8f640 1 -- 172.21.15.117:0/1230988790 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6ebc071e20 con 0x7f6ebc0b5500 2024-09-19T08:37:36.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7faf8a32d640 1 -- 172.21.15.117:0/3137171846 >> v1:172.21.15.146:6789/0 conn(0x7faf840b4400 legacy=0x7faf840d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7faf8a32d640 1 -- 172.21.15.117:0/3137171846 >> v1:172.21.15.117:6789/0 conn(0x7faf8415d270 legacy=0x7faf840b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7faf8a32d640 1 -- 172.21.15.117:0/3137171846 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf840b6a80 con 0x7faf841568d0 2024-09-19T08:37:36.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f6ec0e8f640 1 -- 172.21.15.117:0/1230988790 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6ebc072190 con 0x7f6ebc15cc70 2024-09-19T08:37:36.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f6ec0e8f640 1 -- 172.21.15.117:0/1230988790 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f6ebc0b3990 con 0x7f6ebc073630 2024-09-19T08:37:36.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f6ebaffd640 1 -- 172.21.15.117:0/1230988790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ebc073630 msgr2=0x7f6ebc152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f6ebaffd640 1 --2- 172.21.15.117:0/1230988790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ebc073630 0x7f6ebc152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.771+0000 7f6ebaffd640 1 -- 172.21.15.117:0/1230988790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ebc15cc70 msgr2=0x7f6ebc15b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f6ebbfff640 1 --2- 172.21.15.117:0/1230988790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ebc15cc70 0x7f6ebc15b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.770+0000 7f6d7ffff640 1 --2- 172.21.15.117:0/2226467293 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6d6c06c3b0 0x7f6d6c06e870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009d70 tx=0x7f6d700090e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.771+0000 7f6ebaffd640 1 --2- 172.21.15.117:0/1230988790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ebc15cc70 0x7f6ebc15b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.771+0000 7f6ebaffd640 1 -- 172.21.15.117:0/1230988790 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ebc1f5c20 con 0x7f6ebc0b5500 2024-09-19T08:37:36.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.771+0000 7f6ebbfff640 1 --2- 172.21.15.117:0/1230988790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ebc15cc70 0x7f6ebc15b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:36.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.771+0000 7f6ebaffd640 1 --2- 172.21.15.117:0/1230988790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ebc0b5500 0x7f6ebc15adb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00c460 tx=0x7f6eac00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.771+0000 7f6ea3fff640 1 -- 172.21.15.117:0/1230988790 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac017070 con 0x7f6ebc0b5500 2024-09-19T08:37:36.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.771+0000 7f6ea3fff640 1 -- 172.21.15.117:0/1230988790 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eac005ce0 con 0x7f6ebc0b5500 2024-09-19T08:37:36.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.771+0000 7faf8a32d640 1 --2- 172.21.15.117:0/3137171846 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf841568d0 0x7faf840b60e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faf7c009dc0 tx=0x7faf7c02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a07572257b5e9f79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.771+0000 7f6ea3fff640 1 -- 172.21.15.117:0/1230988790 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac007270 con 0x7f6ebc0b5500 2024-09-19T08:37:36.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.771+0000 7f6ec0e8f640 1 -- 172.21.15.117:0/1230988790 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ebc15ead0 con 0x7f6ebc0b5500 2024-09-19T08:37:36.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.771+0000 7f6ec0e8f640 1 -- 172.21.15.117:0/1230988790 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ebc1f61c0 con 0x7f6ebc0b5500 2024-09-19T08:37:36.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.771+0000 7f3820311640 1 Processor -- start 2024-09-19T08:37:36.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.771+0000 7f0a3bb11640 1 Processor -- start 2024-09-19T08:37:36.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.772+0000 7f0a3bb11640 1 -- start start 2024-09-19T08:37:36.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.772+0000 7f0a3bb11640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a340cf200 0x7f0a34148620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.772+0000 7f0a3bb11640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a3415bee0 0x7f0a3415c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.772+0000 7f0a3bb11640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a3415c2c0 0x7f0a340c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.772+0000 7f0a3bb11640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3406e040 con 0x7f0a3415c2c0 2024-09-19T08:37:36.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.772+0000 7f0a3bb11640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3406dec0 con 0x7f0a340cf200 2024-09-19T08:37:36.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.772+0000 7f0a3bb11640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f0a3406e1c0 con 0x7f0a3415bee0 2024-09-19T08:37:36.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.772+0000 7faf8932b640 1 -- 172.21.15.117:0/3137171846 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c007740 con 0x7faf841568d0 2024-09-19T08:37:36.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.772+0000 7faf8932b640 1 -- 172.21.15.117:0/3137171846 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf7c0078e0 con 0x7faf841568d0 2024-09-19T08:37:36.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f0a3a0ae640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a3415c2c0 0x7f0a340c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.772+0000 7f3820311640 1 -- start start 2024-09-19T08:37:36.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f0a3a0ae640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a3415c2c0 0x7f0a340c6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34898/0 (socket says 172.21.15.117:34898) 2024-09-19T08:37:36.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f0a3a0ae640 1 -- 172.21.15.117:0/1226319937 learned_addr learned my addr 172.21.15.117:0/1226319937 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:36.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f6ec0e8f640 1 -- 172.21.15.117:0/1230988790 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ebc0b4fc0 con 0x7f6ebc0b5500 2024-09-19T08:37:36.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7faf8932b640 1 -- 172.21.15.117:0/3137171846 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c007cb0 con 0x7faf841568d0 2024-09-19T08:37:36.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f3820311640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f381806f4e0 0x7f38180735b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f0a390ac640 1 --2- 172.21.15.117:0/1226319937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a3415bee0 0x7f0a3415c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f3820311640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f381806ff50 0x7f381814ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f0a398ad640 1 --2- 172.21.15.117:0/1226319937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a340cf200 0x7f0a34148620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7faf8b32f640 1 -- 172.21.15.117:0/3137171846 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf841568d0 msgr2=0x7faf840b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7faf8b32f640 1 --2- 172.21.15.117:0/3137171846 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf841568d0 0x7faf840b60e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faf7c009dc0 tx=0x7faf7c02a6d0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f3820311640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38180b44a0 0x7f38180ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f3820311640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f38180cdfc0 con 0x7f38180b44a0 2024-09-19T08:37:36.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f3820311640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f38180cde40 con 0x7f381806f4e0 2024-09-19T08:37:36.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f3820311640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f38180ce140 con 0x7f381806ff50 2024-09-19T08:37:36.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f381e0ad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f381806f4e0 0x7f38180735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f381d8ac640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f381806ff50 0x7f381814ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f381e0ad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f381806f4e0 0x7f38180735b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.117:48486/0 (socket says 172.21.15.117:48486) 2024-09-19T08:37:36.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f381d8ac640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f381806ff50 0x7f381814ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.117:58032/0 (socket says 172.21.15.117:58032) 2024-09-19T08:37:36.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f381e0ad640 1 -- 172.21.15.117:0/3806239813 learned_addr learned my addr 172.21.15.117:0/3806239813 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:36.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f0a3a0ae640 1 -- 172.21.15.117:0/1226319937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a3415bee0 msgr2=0x7f0a3415c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7faf8b32f640 1 -- 172.21.15.117:0/3137171846 shutdown_connections 2024-09-19T08:37:36.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7faf8b32f640 1 --2- 172.21.15.117:0/3137171846 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf841568d0 0x7faf840b60e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7faf8b32f640 1 -- 172.21.15.117:0/3137171846 >> 172.21.15.117:0/3137171846 conn(0x7faf840b74c0 msgr2=0x7faf840b78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:36.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f381e8ae640 1 --2- 172.21.15.117:0/3806239813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38180b44a0 0x7f38180ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f0a3a0ae640 1 --2- 172.21.15.117:0/1226319937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a3415bee0 0x7f0a3415c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7faf8b32f640 1 -- 172.21.15.117:0/3137171846 shutdown_connections 2024-09-19T08:37:36.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f0a3a0ae640 1 -- 172.21.15.117:0/1226319937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a340cf200 msgr2=0x7f0a34148620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f0a3a0ae640 1 --2- 172.21.15.117:0/1226319937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a340cf200 0x7f0a34148620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f0a3a0ae640 1 -- 172.21.15.117:0/1226319937 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3415f190 con 0x7f0a3415c2c0 2024-09-19T08:37:36.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.774+0000 7f6ea3fff640 1 -- 172.21.15.117:0/1230988790 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6eac01a070 con 0x7f6ebc0b5500 2024-09-19T08:37:36.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7faf8b32f640 1 -- 172.21.15.117:0/3137171846 wait complete. 2024-09-19T08:37:36.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.773+0000 7f381d8ac640 1 -- 172.21.15.117:0/3806239813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f381806f4e0 msgr2=0x7f38180735b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.774+0000 7f0a3a0ae640 1 --2- 172.21.15.117:0/1226319937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a3415c2c0 0x7f0a340c6780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00c8c0 tx=0x7f0a2c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.774+0000 7f381d8ac640 1 --2- 172.21.15.117:0/3806239813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f381806f4e0 0x7f38180735b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.774+0000 7f381d8ac640 1 -- 172.21.15.117:0/3806239813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38180b44a0 msgr2=0x7f38180ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.774+0000 7f381d8ac640 1 --2- 172.21.15.117:0/3806239813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38180b44a0 0x7f38180ca8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.774+0000 7f381d8ac640 1 -- 172.21.15.117:0/3806239813 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f381814d470 con 0x7f381806ff50 2024-09-19T08:37:36.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.774+0000 7f6ea3fff640 1 --2- 172.21.15.117:0/1230988790 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6ea806c2b0 0x7f6ea806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.774+0000 7f381d8ac640 1 --2- 172.21.15.117:0/3806239813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f381806ff50 0x7f381814ca90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f38180b48d0 tx=0x7f381400d980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.774+0000 7f6ea3fff640 1 -- 172.21.15.117:0/1230988790 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6eac08a890 con 0x7f6ebc0b5500 2024-09-19T08:37:36.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.774+0000 7f380effd640 1 -- 172.21.15.117:0/3806239813 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38140125f0 con 0x7f381806ff50 2024-09-19T08:37:36.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.774+0000 7f380effd640 1 -- 172.21.15.117:0/3806239813 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3814019070 con 0x7f381806ff50 2024-09-19T08:37:36.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.774+0000 7f3820311640 1 -- 172.21.15.117:0/3806239813 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f381814d750 con 0x7f381806ff50 2024-09-19T08:37:36.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.774+0000 7f380effd640 1 -- 172.21.15.117:0/3806239813 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38140129b0 con 0x7f381806ff50 2024-09-19T08:37:36.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.774+0000 7f3820311640 1 -- 172.21.15.117:0/3806239813 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f38180c7750 con 0x7f381806ff50 2024-09-19T08:37:36.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.774+0000 7f6ebb7fe640 1 --2- 172.21.15.117:0/1230988790 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6ea806c2b0 0x7f6ea806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.775+0000 7f6ebb7fe640 1 --2- 172.21.15.117:0/1230988790 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6ea806c2b0 0x7f6ea806e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4000f80 tx=0x7f6eb402f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.775+0000 7f1df2ffd640 1 -- 172.21.15.117:0/2778794887 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df8015020 con 0x7f1dfc0aedf0 2024-09-19T08:37:36.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.775+0000 7f1df2ffd640 1 -- 172.21.15.117:0/2778794887 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df8011830 con 0x7f1dfc0aedf0 2024-09-19T08:37:36.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.775+0000 7f1df2ffd640 1 -- 172.21.15.117:0/2778794887 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df8011c20 con 0x7f1dfc0aedf0 2024-09-19T08:37:36.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.775+0000 7f1e0319b640 1 -- 172.21.15.117:0/2778794887 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dfc1397a0 con 0x7f1dfc0aedf0 2024-09-19T08:37:36.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.775+0000 7faf8b32f640 1 Processor -- start 2024-09-19T08:37:36.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.775+0000 7f01837fe640 1 -- 172.21.15.117:0/1325980440 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0194018070 con 0x7f019c0b5b30 2024-09-19T08:37:36.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.775+0000 7f01837fe640 1 -- 172.21.15.117:0/1325980440 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019400d6c0 con 0x7f019c0b5b30 2024-09-19T08:37:36.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.775+0000 7f01837fe640 1 -- 172.21.15.117:0/1325980440 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019400da70 con 0x7f019c0b5b30 2024-09-19T08:37:36.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.775+0000 7faf8b32f640 1 -- start start 2024-09-19T08:37:36.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.775+0000 7f1e0319b640 1 -- 172.21.15.117:0/2778794887 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dfc13fd30 con 0x7f1dfc0aedf0 2024-09-19T08:37:36.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.775+0000 7f019bfff640 1 -- 172.21.15.117:0/1325980440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f019c1585f0 con 0x7f019c0b5b30 2024-09-19T08:37:36.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.775+0000 7f019bfff640 1 -- 172.21.15.117:0/1325980440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f019c158bb0 con 0x7f019c0b5b30 2024-09-19T08:37:36.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.776+0000 7f3820311640 1 -- 172.21.15.117:0/3806239813 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38180c7950 con 0x7f381806ff50 2024-09-19T08:37:36.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.776+0000 7f6d7cff9640 1 -- 172.21.15.117:0/2226467293 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6d7401f020 con 0x7f6d80154680 2024-09-19T08:37:36.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.776+0000 7faf8b32f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf840b4400 0x7faf84145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.777+0000 7f1e0319b640 1 -- 172.21.15.117:0/2778794887 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dfc06d7b0 con 0x7f1dfc0aedf0 2024-09-19T08:37:36.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.777+0000 7f019bfff640 1 -- 172.21.15.117:0/1325980440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f019c070030 con 0x7f019c0b5b30 2024-09-19T08:37:36.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.777+0000 7faf8b32f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf841568d0 0x7faf8414dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.777+0000 7faf8b32f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf8415d270 0x7faf8414e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.777+0000 7faf8b32f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faf8415d6d0 con 0x7faf841568d0 2024-09-19T08:37:36.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.777+0000 7f1df2ffd640 1 -- 172.21.15.117:0/2778794887 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1df8018020 con 0x7f1dfc0aedf0 2024-09-19T08:37:36.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.777+0000 7faf8b32f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faf840b7040 con 0x7faf8415d270 2024-09-19T08:37:36.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.777+0000 7faf8b32f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7faf840d0b10 con 0x7faf840b4400 2024-09-19T08:37:36.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.777+0000 7faf8a32d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf840b4400 0x7faf84145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.777+0000 7faf8a32d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf840b4400 0x7faf84145aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.117:58044/0 (socket says 172.21.15.117:58044) 2024-09-19T08:37:36.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.777+0000 7faf8a32d640 1 -- 172.21.15.117:0/2456586720 learned_addr learned my addr 172.21.15.117:0/2456586720 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:36.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.777+0000 7faf8ab2e640 1 --2- 172.21.15.117:0/2456586720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf8415d270 0x7faf8414e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.777+0000 7faf89b2c640 1 --2- 172.21.15.117:0/2456586720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf841568d0 0x7faf8414dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.777+0000 7faf8a32d640 1 -- 172.21.15.117:0/2456586720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf8415d270 msgr2=0x7faf8414e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.777+0000 7faf8a32d640 1 --2- 172.21.15.117:0/2456586720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf8415d270 0x7faf8414e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.777+0000 7faf8a32d640 1 -- 172.21.15.117:0/2456586720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf841568d0 msgr2=0x7faf8414dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:36.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.777+0000 7faf8a32d640 1 --2- 172.21.15.117:0/2456586720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf841568d0 0x7faf8414dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:36.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.777+0000 7faf8a32d640 1 -- 172.21.15.117:0/2456586720 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8415a540 con 0x7faf840b4400 2024-09-19T08:37:36.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.777+0000 7faf89b2c640 1 --2- 172.21.15.117:0/2456586720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf841568d0 0x7faf8414dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:36.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.777+0000 7faf8a32d640 1 --2- 172.21.15.117:0/2456586720 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf840b4400 0x7faf84145aa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faf7c000f80 tx=0x7faf7c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.778+0000 7faf76ffd640 1 -- 172.21.15.117:0/2456586720 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c040070 con 0x7faf840b4400 2024-09-19T08:37:36.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.778+0000 7f1df2ffd640 1 --2- 172.21.15.117:0/2778794887 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1de006c2b0 0x7f1de006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.778+0000 7f1df2ffd640 1 -- 172.21.15.117:0/2778794887 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1df808b3a0 con 0x7f1dfc0aedf0 2024-09-19T08:37:36.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.778+0000 7faf8b32f640 1 -- 172.21.15.117:0/2456586720 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf8415a820 con 0x7faf840b4400 2024-09-19T08:37:36.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.778+0000 7f01837fe640 1 -- 172.21.15.117:0/1325980440 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f019401b070 con 0x7f019c0b5b30 2024-09-19T08:37:36.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.778+0000 7f1e01998640 1 --2- 172.21.15.117:0/2778794887 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1de006c2b0 0x7f1de006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.778+0000 7faf8b32f640 1 -- 172.21.15.117:0/2456586720 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faf8415ade0 con 0x7faf840b4400 2024-09-19T08:37:36.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.778+0000 7f380effd640 1 -- 172.21.15.117:0/3806239813 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3814012b50 con 0x7f381806ff50 2024-09-19T08:37:36.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.778+0000 7f01837fe640 1 --2- 172.21.15.117:0/1325980440 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f018806c2b0 0x7f018806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.779+0000 7f01837fe640 1 -- 172.21.15.117:0/1325980440 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f019408aea0 con 0x7f019c0b5b30 2024-09-19T08:37:36.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.779+0000 7f019a7fc640 1 --2- 172.21.15.117:0/1325980440 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f018806c2b0 0x7f018806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.779+0000 7f380effd640 1 --2- 172.21.15.117:0/3806239813 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f37fc06c2b0 0x7f37fc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.778+0000 7faf76ffd640 1 -- 172.21.15.117:0/2456586720 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf7c031bc0 con 0x7faf840b4400 2024-09-19T08:37:36.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.779+0000 7faf76ffd640 1 -- 172.21.15.117:0/2456586720 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c045460 con 0x7faf840b4400 2024-09-19T08:37:36.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.779+0000 7f380effd640 1 -- 172.21.15.117:0/3806239813 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f381408b960 con 0x7f381806ff50 2024-09-19T08:37:36.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.779+0000 7f1e01998640 1 --2- 172.21.15.117:0/2778794887 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1de006c2b0 0x7f1de006e770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1dec034000 tx=0x7f1dec02c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.779+0000 7f381e0ad640 1 --2- 172.21.15.117:0/3806239813 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f37fc06c2b0 0x7f37fc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.779+0000 7f019a7fc640 1 --2- 172.21.15.117:0/1325980440 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f018806c2b0 0x7f018806e770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0190006fd0 tx=0x7f0190008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.780+0000 7faf76ffd640 1 -- 172.21.15.117:0/2456586720 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faf7c039040 con 0x7faf840b4400 2024-09-19T08:37:36.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.780+0000 7f381e0ad640 1 --2- 172.21.15.117:0/3806239813 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f37fc06c2b0 0x7f37fc06e770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3808007fd0 tx=0x7f3808009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.780+0000 7faf8b32f640 1 -- 172.21.15.117:0/2456586720 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf6c005290 con 0x7faf840b4400 2024-09-19T08:37:36.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.780+0000 7faf76ffd640 1 --2- 172.21.15.117:0/2456586720 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faf6806c300 0x7faf6806e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.780+0000 7faf76ffd640 1 -- 172.21.15.117:0/2456586720 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7faf7c0aced0 con 0x7faf840b4400 2024-09-19T08:37:36.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.781+0000 7faf89b2c640 1 --2- 172.21.15.117:0/2456586720 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faf6806c300 0x7faf6806e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.781+0000 7faf89b2c640 1 --2- 172.21.15.117:0/2456586720 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faf6806c300 0x7faf6806e7c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faf8406ed10 tx=0x7faf80009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.782+0000 7f1df2ffd640 1 -- 172.21.15.117:0/2778794887 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1df801f030 con 0x7f1dfc0aedf0 2024-09-19T08:37:36.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.783+0000 7f0a2a7fc640 1 -- 172.21.15.117:0/1226319937 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c017070 con 0x7f0a3415c2c0 2024-09-19T08:37:36.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.783+0000 7f0a2a7fc640 1 -- 172.21.15.117:0/1226319937 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2c003da0 con 0x7f0a3415c2c0 2024-09-19T08:37:36.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.783+0000 7f0a3bb11640 1 -- 172.21.15.117:0/1226319937 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a3415f470 con 0x7f0a3415c2c0 2024-09-19T08:37:36.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.783+0000 7f6ea3fff640 1 -- 172.21.15.117:0/1230988790 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6eac058700 con 0x7f6ebc0b5500 2024-09-19T08:37:36.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.784+0000 7f380effd640 1 -- 172.21.15.117:0/3806239813 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3814059730 con 0x7f381806ff50 2024-09-19T08:37:36.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.783+0000 7f0a2a7fc640 1 -- 172.21.15.117:0/1226319937 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c0052b0 con 0x7f0a3415c2c0 2024-09-19T08:37:36.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.784+0000 7f0a3bb11640 1 -- 172.21.15.117:0/1226319937 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a3415fa30 con 0x7f0a3415c2c0 2024-09-19T08:37:36.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.785+0000 7f0a3bb11640 1 -- 172.21.15.117:0/1226319937 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a34070800 con 0x7f0a3415c2c0 2024-09-19T08:37:36.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.786+0000 7f0a2a7fc640 1 -- 172.21.15.117:0/1226319937 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0a2c01a070 con 0x7f0a3415c2c0 2024-09-19T08:37:36.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.786+0000 7f0a2a7fc640 1 --2- 172.21.15.117:0/1226319937 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f0a1806c330 0x7f0a1806e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:36.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.786+0000 7f0a2a7fc640 1 -- 172.21.15.117:0/1226319937 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0a2c08aea0 con 0x7f0a3415c2c0 2024-09-19T08:37:36.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.787+0000 7f01837fe640 1 -- 172.21.15.117:0/1325980440 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0194058c70 con 0x7f019c0b5b30 2024-09-19T08:37:36.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.787+0000 7f0a398ad640 1 --2- 172.21.15.117:0/1226319937 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f0a1806c330 0x7f0a1806e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:36.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.788+0000 7f0a398ad640 1 --2- 172.21.15.117:0/1226319937 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f0a1806c330 0x7f0a1806e7f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0a24006fd0 tx=0x7f0a24008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:36.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.789+0000 7faf76ffd640 1 -- 172.21.15.117:0/2456586720 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7faf7c07b370 con 0x7faf840b4400 2024-09-19T08:37:36.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:36.794+0000 7f0a2a7fc640 1 -- 172.21.15.117:0/1226319937 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0a34070800 con 0x7f0a3415c2c0 2024-09-19T08:37:37.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.105+0000 7faa72e37640 1 -- 172.21.15.117:0/2284956818 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7faa4c005580 con 0x7faa6c0b27b0 2024-09-19T08:37:37.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.106+0000 7faa697fa640 1 -- 172.21.15.117:0/2284956818 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faa5c05cd10 con 0x7faa6c0b27b0 2024-09-19T08:37:37.105 INFO:teuthology.orchestra.run.smithi117.stdout:64424509450 2024-09-19T08:37:37.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.109+0000 7faa52ffd640 1 -- 172.21.15.117:0/2284956818 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faa5806c380 msgr2=0x7faa5806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.109+0000 7faa52ffd640 1 --2- 172.21.15.117:0/2284956818 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faa5806c380 0x7faa5806e840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faa6403c000 tx=0x7faa64037000 comp rx=0 tx=0).stop 2024-09-19T08:37:37.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.110+0000 7faa52ffd640 1 -- 172.21.15.117:0/2284956818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa6c0b27b0 msgr2=0x7faa6c0a9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.110+0000 7faa52ffd640 1 --2- 172.21.15.117:0/2284956818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa6c0b27b0 0x7faa6c0a9450 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faa5c00b750 tx=0x7faa5c00bc10 comp rx=0 tx=0).stop 2024-09-19T08:37:37.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.110+0000 7faa52ffd640 1 -- 172.21.15.117:0/2284956818 shutdown_connections 2024-09-19T08:37:37.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.110+0000 7faa52ffd640 1 --2- 172.21.15.117:0/2284956818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa6c0b27b0 0x7faa6c0a9450 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.110+0000 7faa52ffd640 1 --2- 172.21.15.117:0/2284956818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa6c072370 0x7faa6c20b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.110+0000 7faa52ffd640 1 --2- 172.21.15.117:0/2284956818 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faa5806c380 0x7faa5806e840 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.110+0000 7faa52ffd640 1 --2- 172.21.15.117:0/2284956818 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa6c06ef70 0x7faa6c2124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.110+0000 7faa52ffd640 1 -- 172.21.15.117:0/2284956818 >> 172.21.15.117:0/2284956818 conn(0x7faa6c0b1cc0 msgr2=0x7faa6c15ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:37.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.111+0000 7faa52ffd640 1 -- 172.21.15.117:0/2284956818 shutdown_connections 2024-09-19T08:37:37.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.111+0000 7faa52ffd640 1 -- 172.21.15.117:0/2284956818 wait complete. 2024-09-19T08:37:37.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.5 2024-09-19T08:37:37.128 DEBUG:teuthology.parallel:result is None 2024-09-19T08:37:37.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.150+0000 7faf8b32f640 1 -- 172.21.15.117:0/2456586720 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7faf6c005580 con 0x7faf840b4400 2024-09-19T08:37:37.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.150+0000 7faf76ffd640 1 -- 172.21.15.117:0/2456586720 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faf7c0ac020 con 0x7faf840b4400 2024-09-19T08:37:37.150 INFO:teuthology.orchestra.run.smithi117.stdout:64424509450 2024-09-19T08:37:37.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.152+0000 7faf8b32f640 1 -- 172.21.15.117:0/2456586720 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faf6806c300 msgr2=0x7faf6806e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.152+0000 7faf8b32f640 1 --2- 172.21.15.117:0/2456586720 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faf6806c300 0x7faf6806e7c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faf8406ed10 tx=0x7faf80009040 comp rx=0 tx=0).stop 2024-09-19T08:37:37.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.152+0000 7faf8b32f640 1 -- 172.21.15.117:0/2456586720 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf840b4400 msgr2=0x7faf84145aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.152+0000 7faf8b32f640 1 --2- 172.21.15.117:0/2456586720 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf840b4400 0x7faf84145aa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faf7c000f80 tx=0x7faf7c004a40 comp rx=0 tx=0).stop 2024-09-19T08:37:37.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.153+0000 7faf8b32f640 1 -- 172.21.15.117:0/2456586720 shutdown_connections 2024-09-19T08:37:37.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.153+0000 7faf8b32f640 1 --2- 172.21.15.117:0/2456586720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf8415d270 0x7faf8414e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.153+0000 7faf8b32f640 1 --2- 172.21.15.117:0/2456586720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf841568d0 0x7faf8414dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.153+0000 7faf8b32f640 1 --2- 172.21.15.117:0/2456586720 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faf6806c300 0x7faf6806e7c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.153+0000 7faf8b32f640 1 --2- 172.21.15.117:0/2456586720 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf840b4400 0x7faf84145aa0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.153+0000 7faf8b32f640 1 -- 172.21.15.117:0/2456586720 >> 172.21.15.117:0/2456586720 conn(0x7faf840b74c0 msgr2=0x7faf840b78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:37.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.153+0000 7faf8b32f640 1 -- 172.21.15.117:0/2456586720 shutdown_connections 2024-09-19T08:37:37.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.153+0000 7faf8b32f640 1 -- 172.21.15.117:0/2456586720 wait complete. 2024-09-19T08:37:37.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.2 2024-09-19T08:37:37.164 DEBUG:teuthology.parallel:result is None 2024-09-19T08:37:37.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.179+0000 7f6d852c6640 1 -- 172.21.15.117:0/2226467293 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6d60005580 con 0x7f6d80154680 2024-09-19T08:37:37.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.180+0000 7f6d7cff9640 1 -- 172.21.15.117:0/2226467293 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6d74059900 con 0x7f6d80154680 2024-09-19T08:37:37.180 INFO:teuthology.orchestra.run.smithi117.stdout:64424509449 2024-09-19T08:37:37.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.182+0000 7f6d852c6640 1 -- 172.21.15.117:0/2226467293 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6d6c06c3b0 msgr2=0x7f6d6c06e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.182+0000 7f6d852c6640 1 --2- 172.21.15.117:0/2226467293 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6d6c06c3b0 0x7f6d6c06e870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009d70 tx=0x7f6d700090e0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.182+0000 7f6d852c6640 1 -- 172.21.15.117:0/2226467293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d80154680 msgr2=0x7f6d801558b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.182+0000 7f6d852c6640 1 --2- 172.21.15.117:0/2226467293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d80154680 0x7f6d801558b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400b3e0 tx=0x7f6d7400b8a0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.182+0000 7f6d852c6640 1 -- 172.21.15.117:0/2226467293 shutdown_connections 2024-09-19T08:37:37.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.182+0000 7f6d852c6640 1 --2- 172.21.15.117:0/2226467293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d80154680 0x7f6d801558b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.182+0000 7f6d852c6640 1 --2- 172.21.15.117:0/2226467293 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6d6c06c3b0 0x7f6d6c06e870 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.182+0000 7f6d852c6640 1 --2- 172.21.15.117:0/2226467293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d800cdce0 0x7f6d8014ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.182+0000 7f6d852c6640 1 --2- 172.21.15.117:0/2226467293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d800b5960 0x7f6d80071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.182+0000 7f6d852c6640 1 -- 172.21.15.117:0/2226467293 >> 172.21.15.117:0/2226467293 conn(0x7f6d8006dae0 msgr2=0x7f6d8015ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:37.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.182+0000 7f6d852c6640 1 -- 172.21.15.117:0/2226467293 shutdown_connections 2024-09-19T08:37:37.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.182+0000 7f6d852c6640 1 -- 172.21.15.117:0/2226467293 wait complete. 2024-09-19T08:37:37.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.185+0000 7f019bfff640 1 -- 172.21.15.117:0/1325980440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f019c159bd0 con 0x7f019c0b5b30 2024-09-19T08:37:37.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.185+0000 7f01837fe640 1 -- 172.21.15.117:0/1325980440 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f019405cf70 con 0x7f019c0b5b30 2024-09-19T08:37:37.185 INFO:teuthology.orchestra.run.smithi117.stdout:64424509449 2024-09-19T08:37:37.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.186+0000 7f1e0319b640 1 -- 172.21.15.117:0/2778794887 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f1dfc06f3d0 con 0x7f1dfc0aedf0 2024-09-19T08:37:37.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.186+0000 7f1df2ffd640 1 -- 172.21.15.117:0/2778794887 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1df80597c0 con 0x7f1dfc0aedf0 2024-09-19T08:37:37.186 INFO:teuthology.orchestra.run.smithi117.stdout:64424509450 2024-09-19T08:37:37.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.188+0000 7f6ec0e8f640 1 -- 172.21.15.117:0/1230988790 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6ebc0b0600 con 0x7f6ebc0b5500 2024-09-19T08:37:37.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.188+0000 7f3820311640 1 -- 172.21.15.117:0/3806239813 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f3818075140 con 0x7f381806ff50 2024-09-19T08:37:37.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.188+0000 7f380effd640 1 -- 172.21.15.117:0/3806239813 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f381405da30 con 0x7f381806ff50 2024-09-19T08:37:37.188 INFO:teuthology.orchestra.run.smithi117.stdout:60129542154 2024-09-19T08:37:37.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f6ea3fff640 1 -- 172.21.15.117:0/1230988790 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6eac05ca00 con 0x7f6ebc0b5500 2024-09-19T08:37:37.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f1e0319b640 1 -- 172.21.15.117:0/2778794887 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1de006c2b0 msgr2=0x7f1de006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.189 INFO:teuthology.orchestra.run.smithi117.stdout:64424509450 2024-09-19T08:37:37.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f1e0319b640 1 --2- 172.21.15.117:0/2778794887 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1de006c2b0 0x7f1de006e770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1dec034000 tx=0x7f1dec02c000 comp rx=0 tx=0).stop 2024-09-19T08:37:37.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f019bfff640 1 -- 172.21.15.117:0/1325980440 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f018806c2b0 msgr2=0x7f018806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f019bfff640 1 --2- 172.21.15.117:0/1325980440 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f018806c2b0 0x7f018806e770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0190006fd0 tx=0x7f0190008040 comp rx=0 tx=0).stop 2024-09-19T08:37:37.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f019bfff640 1 -- 172.21.15.117:0/1325980440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019c0b5b30 msgr2=0x7f019c159690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f019bfff640 1 --2- 172.21.15.117:0/1325980440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019c0b5b30 0x7f019c159690 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0194001a80 tx=0x7f0194001f40 comp rx=0 tx=0).stop 2024-09-19T08:37:37.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f1e0319b640 1 -- 172.21.15.117:0/2778794887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dfc0aedf0 msgr2=0x7f1dfc13b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f1e0319b640 1 --2- 172.21.15.117:0/2778794887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dfc0aedf0 0x7f1dfc13b920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1df800b3f0 tx=0x7f1df800b8b0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f019bfff640 1 -- 172.21.15.117:0/1325980440 shutdown_connections 2024-09-19T08:37:37.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f1e0319b640 1 -- 172.21.15.117:0/2778794887 shutdown_connections 2024-09-19T08:37:37.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f019bfff640 1 --2- 172.21.15.117:0/1325980440 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f018806c2b0 0x7f018806e770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f019bfff640 1 --2- 172.21.15.117:0/1325980440 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f019c154680 0x7f019c0c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f019bfff640 1 --2- 172.21.15.117:0/1325980440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f019c0cdce0 0x7f019c0cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f019bfff640 1 --2- 172.21.15.117:0/1325980440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f019c0b5b30 0x7f019c159690 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f1e0319b640 1 --2- 172.21.15.117:0/2778794887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1dfc0b5a10 0x7f1dfc137670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f1e0319b640 1 --2- 172.21.15.117:0/2778794887 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1de006c2b0 0x7f1de006e770 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f019bfff640 1 -- 172.21.15.117:0/1325980440 >> 172.21.15.117:0/1325980440 conn(0x7f019c06dae0 msgr2=0x7f019c071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:37.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f1e0319b640 1 --2- 172.21.15.117:0/2778794887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1dfc0b50f0 0x7f1dfc1f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f1e0319b640 1 --2- 172.21.15.117:0/2778794887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dfc0aedf0 0x7f1dfc13b920 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f1e0319b640 1 -- 172.21.15.117:0/2778794887 >> 172.21.15.117:0/2778794887 conn(0x7f1dfc06dae0 msgr2=0x7f1dfc073440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:37.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f019bfff640 1 -- 172.21.15.117:0/1325980440 shutdown_connections 2024-09-19T08:37:37.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f019bfff640 1 -- 172.21.15.117:0/1325980440 wait complete. 2024-09-19T08:37:37.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f1e0319b640 1 -- 172.21.15.117:0/2778794887 shutdown_connections 2024-09-19T08:37:37.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.189+0000 7f1e0319b640 1 -- 172.21.15.117:0/2778794887 wait complete. 2024-09-19T08:37:37.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.191+0000 7f3820311640 1 -- 172.21.15.117:0/3806239813 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f37fc06c2b0 msgr2=0x7f37fc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.191+0000 7f3820311640 1 --2- 172.21.15.117:0/3806239813 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f37fc06c2b0 0x7f37fc06e770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3808007fd0 tx=0x7f3808009040 comp rx=0 tx=0).stop 2024-09-19T08:37:37.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.191+0000 7f3820311640 1 -- 172.21.15.117:0/3806239813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f381806ff50 msgr2=0x7f381814ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.191+0000 7f3820311640 1 --2- 172.21.15.117:0/3806239813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f381806ff50 0x7f381814ca90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f38180b48d0 tx=0x7f381400d980 comp rx=0 tx=0).stop 2024-09-19T08:37:37.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.191+0000 7f3820311640 1 -- 172.21.15.117:0/3806239813 shutdown_connections 2024-09-19T08:37:37.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.191+0000 7f3820311640 1 --2- 172.21.15.117:0/3806239813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38180b44a0 0x7f38180ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.191+0000 7f3820311640 1 --2- 172.21.15.117:0/3806239813 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f37fc06c2b0 0x7f37fc06e770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.191+0000 7f3820311640 1 --2- 172.21.15.117:0/3806239813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f381806ff50 0x7f381814ca90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.191+0000 7f3820311640 1 --2- 172.21.15.117:0/3806239813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f381806f4e0 0x7f38180735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.191+0000 7f3820311640 1 -- 172.21.15.117:0/3806239813 >> 172.21.15.117:0/3806239813 conn(0x7f381806bdf0 msgr2=0x7f381816bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:37.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.191+0000 7f3820311640 1 -- 172.21.15.117:0/3806239813 shutdown_connections 2024-09-19T08:37:37.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.191+0000 7f3820311640 1 -- 172.21.15.117:0/3806239813 wait complete. 2024-09-19T08:37:37.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.192+0000 7f6ec0e8f640 1 -- 172.21.15.117:0/1230988790 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6ea806c2b0 msgr2=0x7f6ea806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.192+0000 7f6ec0e8f640 1 --2- 172.21.15.117:0/1230988790 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6ea806c2b0 0x7f6ea806e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4000f80 tx=0x7f6eb402f000 comp rx=0 tx=0).stop 2024-09-19T08:37:37.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.193+0000 7f6ec0e8f640 1 -- 172.21.15.117:0/1230988790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ebc0b5500 msgr2=0x7f6ebc15adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.193+0000 7f6ec0e8f640 1 --2- 172.21.15.117:0/1230988790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ebc0b5500 0x7f6ebc15adb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00c460 tx=0x7f6eac00c920 comp rx=0 tx=0).stop 2024-09-19T08:37:37.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.193+0000 7f6ec0e8f640 1 -- 172.21.15.117:0/1230988790 shutdown_connections 2024-09-19T08:37:37.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.193+0000 7f6ec0e8f640 1 --2- 172.21.15.117:0/1230988790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ebc15cc70 0x7f6ebc15b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.193+0000 7f6ec0e8f640 1 --2- 172.21.15.117:0/1230988790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ebc0b5500 0x7f6ebc15adb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.193+0000 7f6ec0e8f640 1 --2- 172.21.15.117:0/1230988790 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6ea806c2b0 0x7f6ea806e770 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.193+0000 7f6ec0e8f640 1 --2- 172.21.15.117:0/1230988790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ebc073630 0x7f6ebc152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.193+0000 7f6ec0e8f640 1 -- 172.21.15.117:0/1230988790 >> 172.21.15.117:0/1230988790 conn(0x7f6ebc0b1dc0 msgr2=0x7f6ebc074ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:37.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.193+0000 7f6ec0e8f640 1 -- 172.21.15.117:0/1230988790 shutdown_connections 2024-09-19T08:37:37.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.193+0000 7f6ec0e8f640 1 -- 172.21.15.117:0/1230988790 wait complete. 2024-09-19T08:37:37.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.193+0000 7f0a3bb11640 1 -- 172.21.15.117:0/1226319937 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0a340cf6b0 con 0x7f0a3415c2c0 2024-09-19T08:37:37.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.194+0000 7f0a2a7fc640 1 -- 172.21.15.117:0/1226319937 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0a2c058c60 con 0x7f0a3415c2c0 2024-09-19T08:37:37.198 INFO:teuthology.orchestra.run.smithi117.stdout:64424509451 2024-09-19T08:37:37.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.196+0000 7f0a3bb11640 1 -- 172.21.15.117:0/1226319937 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f0a1806c330 msgr2=0x7f0a1806e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.197+0000 7f0a3bb11640 1 --2- 172.21.15.117:0/1226319937 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f0a1806c330 0x7f0a1806e7f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0a24006fd0 tx=0x7f0a24008040 comp rx=0 tx=0).stop 2024-09-19T08:37:37.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.197+0000 7f0a3bb11640 1 -- 172.21.15.117:0/1226319937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a3415c2c0 msgr2=0x7f0a340c6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.197+0000 7f0a3bb11640 1 --2- 172.21.15.117:0/1226319937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a3415c2c0 0x7f0a340c6780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00c8c0 tx=0x7f0a2c00cd80 comp rx=0 tx=0).stop 2024-09-19T08:37:37.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.0 2024-09-19T08:37:37.200 DEBUG:teuthology.parallel:result is None 2024-09-19T08:37:37.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.198+0000 7f0a3bb11640 1 -- 172.21.15.117:0/1226319937 shutdown_connections 2024-09-19T08:37:37.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.198+0000 7f0a3bb11640 1 --2- 172.21.15.117:0/1226319937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a3415c2c0 0x7f0a340c6780 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.198+0000 7f0a3bb11640 1 --2- 172.21.15.117:0/1226319937 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f0a1806c330 0x7f0a1806e7f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.198+0000 7f0a3bb11640 1 --2- 172.21.15.117:0/1226319937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a3415bee0 0x7f0a3415c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.198+0000 7f0a3bb11640 1 --2- 172.21.15.117:0/1226319937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a340cf200 0x7f0a34148620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.198+0000 7f0a3bb11640 1 -- 172.21.15.117:0/1226319937 >> 172.21.15.117:0/1226319937 conn(0x7f0a3406bdf0 msgr2=0x7f0a340d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:37.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.198+0000 7f0a3bb11640 1 -- 172.21.15.117:0/1226319937 shutdown_connections 2024-09-19T08:37:37.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.198+0000 7f0a3bb11640 1 -- 172.21.15.117:0/1226319937 wait complete. 2024-09-19T08:37:37.208 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.7 2024-09-19T08:37:37.208 DEBUG:teuthology.parallel:result is None 2024-09-19T08:37:37.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.6 2024-09-19T08:37:37.209 DEBUG:teuthology.parallel:result is None 2024-09-19T08:37:37.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.4 2024-09-19T08:37:37.211 DEBUG:teuthology.parallel:result is None 2024-09-19T08:37:37.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.3 2024-09-19T08:37:37.212 DEBUG:teuthology.parallel:result is None 2024-09-19T08:37:37.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.1 2024-09-19T08:37:37.213 DEBUG:teuthology.parallel:result is None 2024-09-19T08:37:37.213 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T08:37:37.213 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:37:37.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.354+0000 7f4d12f76640 1 Processor -- start 2024-09-19T08:37:37.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.354+0000 7f4d12f76640 1 -- start start 2024-09-19T08:37:37.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.355+0000 7f4d12f76640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4d0c145ec0 0x7f4d0c15d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:37.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.355+0000 7f4d12f76640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4d0c06c320 0x7f4d0c15e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:37.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.355+0000 7f4d12f76640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0c15dae0 con 0x7f4d0c0b6c40 2024-09-19T08:37:37.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.355+0000 7f4d12f76640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4d0c15d8b0 con 0x7f4d0c06c320 2024-09-19T08:37:37.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.355+0000 7f4d12f76640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f4d0c15ddc0 con 0x7f4d0c145ec0 2024-09-19T08:37:37.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.355+0000 7f4d11513640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4d0c06c320 0x7f4d0c15e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:37.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.355+0000 7f4d11513640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4d0c06c320 0x7f4d0c15e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34932/0 (socket says 172.21.15.117:34932) 2024-09-19T08:37:37.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.355+0000 7f4d11513640 1 -- 172.21.15.117:0/4168422221 learned_addr learned my addr 172.21.15.117:0/4168422221 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:37.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.355+0000 7f4d10d12640 1 --2- 172.21.15.117:0/4168422221 >> v2:172.21.15.146:3300/0 conn(0x7f4d0c145ec0 0x7f4d0c15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:37.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.355+0000 7f4d11513640 1 -- 172.21.15.117:0/4168422221 >> v2:172.21.15.146:3300/0 conn(0x7f4d0c145ec0 msgr2=0x7f4d0c15d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:37.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.355+0000 7f4d11513640 1 --2- 172.21.15.117:0/4168422221 >> v2:172.21.15.146:3300/0 conn(0x7f4d0c145ec0 0x7f4d0c15d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.355+0000 7f4d11513640 1 -- 172.21.15.117:0/4168422221 >> v1:172.21.15.146:6789/0 conn(0x7f4d0c0b6c40 legacy=0x7f4d0c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.355+0000 7f4d11513640 1 -- 172.21.15.117:0/4168422221 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c15e0a0 con 0x7f4d0c06c320 2024-09-19T08:37:37.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.356+0000 7f4d11513640 1 --2- 172.21.15.117:0/4168422221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d0c06c320 0x7f4d0c15e8a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0d2140 tx=0x7f4cf402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad1c48cf83a584a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:37.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.356+0000 7f4d0b7fe640 1 -- 172.21.15.117:0/4168422221 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4037070 con 0x7f4d0c06c320 2024-09-19T08:37:37.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.356+0000 7f4d0b7fe640 1 -- 172.21.15.117:0/4168422221 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf4032440 con 0x7f4d0c06c320 2024-09-19T08:37:37.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.356+0000 7f4d0b7fe640 1 -- 172.21.15.117:0/4168422221 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4032810 con 0x7f4d0c06c320 2024-09-19T08:37:37.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.356+0000 7f4d12f76640 1 -- 172.21.15.117:0/4168422221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d0c06c320 msgr2=0x7f4d0c15e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.356+0000 7f4d12f76640 1 --2- 172.21.15.117:0/4168422221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d0c06c320 0x7f4d0c15e8a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0d2140 tx=0x7f4cf402a1e0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.357+0000 7f4d12f76640 1 -- 172.21.15.117:0/4168422221 shutdown_connections 2024-09-19T08:37:37.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.357+0000 7f4d12f76640 1 --2- 172.21.15.117:0/4168422221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d0c06c320 0x7f4d0c15e8a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.357+0000 7f4d12f76640 1 --2- 172.21.15.117:0/4168422221 >> v2:172.21.15.146:3300/0 conn(0x7f4d0c145ec0 0x7f4d0c15d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.357+0000 7f4d12f76640 1 -- 172.21.15.117:0/4168422221 >> 172.21.15.117:0/4168422221 conn(0x7f4d0c09a9f0 msgr2=0x7f4d0c0b6530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:37.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.357+0000 7f4d12f76640 1 -- 172.21.15.117:0/4168422221 shutdown_connections 2024-09-19T08:37:37.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.357+0000 7f4d12f76640 1 -- 172.21.15.117:0/4168422221 wait complete. 2024-09-19T08:37:37.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.358+0000 7f4d12f76640 1 Processor -- start 2024-09-19T08:37:37.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.358+0000 7f4d12f76640 1 -- start start 2024-09-19T08:37:37.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d12f76640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d0c06c320 0x7f4d0c158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:37.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d12f76640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d0c0b6c40 0x7f4d0c0b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:37.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d12f76640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d0c145ec0 0x7f4d0c15c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:37.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d12f76640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c15ede0 con 0x7f4d0c145ec0 2024-09-19T08:37:37.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d12f76640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c0b70b0 con 0x7f4d0c0b6c40 2024-09-19T08:37:37.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d12f76640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f4d0c15ef60 con 0x7f4d0c06c320 2024-09-19T08:37:37.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d11513640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d0c145ec0 0x7f4d0c15c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:37.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d11513640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d0c145ec0 0x7f4d0c15c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34940/0 (socket says 172.21.15.117:34940) 2024-09-19T08:37:37.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d11513640 1 -- 172.21.15.117:0/3275756354 learned_addr learned my addr 172.21.15.117:0/3275756354 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:37.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d10d12640 1 --2- 172.21.15.117:0/3275756354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d0c06c320 0x7f4d0c158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:37.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d0bfff640 1 --2- 172.21.15.117:0/3275756354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d0c0b6c40 0x7f4d0c0b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:37.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d11513640 1 -- 172.21.15.117:0/3275756354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d0c06c320 msgr2=0x7f4d0c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d11513640 1 --2- 172.21.15.117:0/3275756354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d0c06c320 0x7f4d0c158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d11513640 1 -- 172.21.15.117:0/3275756354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d0c0b6c40 msgr2=0x7f4d0c0b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d11513640 1 --2- 172.21.15.117:0/3275756354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d0c0b6c40 0x7f4d0c0b5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d11513640 1 -- 172.21.15.117:0/3275756354 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c0b44f0 con 0x7f4d0c145ec0 2024-09-19T08:37:37.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d11513640 1 --2- 172.21.15.117:0/3275756354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d0c145ec0 0x7f4d0c15c020 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40090b0 tx=0x7f4cf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:37.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d097fa640 1 -- 172.21.15.117:0/3275756354 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4037040 con 0x7f4d0c145ec0 2024-09-19T08:37:37.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d097fa640 1 -- 172.21.15.117:0/3275756354 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf4042070 con 0x7f4d0c145ec0 2024-09-19T08:37:37.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d12f76640 1 -- 172.21.15.117:0/3275756354 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d0c0b47d0 con 0x7f4d0c145ec0 2024-09-19T08:37:37.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d097fa640 1 -- 172.21.15.117:0/3275756354 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4030920 con 0x7f4d0c145ec0 2024-09-19T08:37:37.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.359+0000 7f4d12f76640 1 -- 172.21.15.117:0/3275756354 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d0c0b4d90 con 0x7f4d0c145ec0 2024-09-19T08:37:37.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.360+0000 7f4d12f76640 1 -- 172.21.15.117:0/3275756354 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d0c0b5170 con 0x7f4d0c145ec0 2024-09-19T08:37:37.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.361+0000 7f4d097fa640 1 -- 172.21.15.117:0/3275756354 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4cf4030ac0 con 0x7f4d0c145ec0 2024-09-19T08:37:37.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.361+0000 7f4d097fa640 1 --2- 172.21.15.117:0/3275756354 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4cec06c2b0 0x7f4cec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:37.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.361+0000 7f4d097fa640 1 -- 172.21.15.117:0/3275756354 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4cf40abe40 con 0x7f4d0c145ec0 2024-09-19T08:37:37.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.361+0000 7f4d10d12640 1 --2- 172.21.15.117:0/3275756354 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4cec06c2b0 0x7f4cec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:37.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.362+0000 7f4d10d12640 1 --2- 172.21.15.117:0/3275756354 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4cec06c2b0 0x7f4cec06e770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4d040079a0 tx=0x7f4d04008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:37.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.365+0000 7f4d097fa640 1 -- 172.21.15.117:0/3275756354 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4d0c0b5170 con 0x7f4d0c145ec0 2024-09-19T08:37:37.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.527+0000 7f4d12f76640 1 -- 172.21.15.117:0/3275756354 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4d0c15b680 con 0x7f4cec06c2b0 2024-09-19T08:37:37.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.535+0000 7f4d097fa640 1 -- 172.21.15.117:0/3275756354 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332530 (secure 0 0 0) 0x7f4d0c15b680 con 0x7f4cec06c2b0 2024-09-19T08:37:37.539 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:37.540 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-09-19T08:37:37.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.538+0000 7f4d12f76640 1 -- 172.21.15.117:0/3275756354 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4cec06c2b0 msgr2=0x7f4cec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.538+0000 7f4d12f76640 1 --2- 172.21.15.117:0/3275756354 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4cec06c2b0 0x7f4cec06e770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4d040079a0 tx=0x7f4d04008040 comp rx=0 tx=0).stop 2024-09-19T08:37:37.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.538+0000 7f4d12f76640 1 -- 172.21.15.117:0/3275756354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d0c145ec0 msgr2=0x7f4d0c15c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.538+0000 7f4d12f76640 1 --2- 172.21.15.117:0/3275756354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d0c145ec0 0x7f4d0c15c020 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40090b0 tx=0x7f4cf40046c0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.538+0000 7f4d12f76640 1 -- 172.21.15.117:0/3275756354 shutdown_connections 2024-09-19T08:37:37.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.538+0000 7f4d12f76640 1 --2- 172.21.15.117:0/3275756354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d0c145ec0 0x7f4d0c15c020 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.538+0000 7f4d12f76640 1 --2- 172.21.15.117:0/3275756354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d0c0b6c40 0x7f4d0c0b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.538+0000 7f4d12f76640 1 --2- 172.21.15.117:0/3275756354 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4cec06c2b0 0x7f4cec06e770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.538+0000 7f4d12f76640 1 --2- 172.21.15.117:0/3275756354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d0c06c320 0x7f4d0c158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.538+0000 7f4d12f76640 1 -- 172.21.15.117:0/3275756354 >> 172.21.15.117:0/3275756354 conn(0x7f4d0c09a9f0 msgr2=0x7f4d0c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:37.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.539+0000 7f4d12f76640 1 -- 172.21.15.117:0/3275756354 shutdown_connections 2024-09-19T08:37:37.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.539+0000 7f4d12f76640 1 -- 172.21.15.117:0/3275756354 wait complete. 2024-09-19T08:37:37.552 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-19T08:37:35.851654+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3416064,"data_stored":2034932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003586"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343917+0000","last_change":"2024-09-19T08:37:12.321838+0000","last_active":"2024-09-19T08:37:18.343917+0000","last_peered":"2024-09-19T08:37:18.343917+0000","last_clean":"2024-09-19T08:37:18.343917+0000","last_became_active":"2024-09-19T08:37:12.321488+0000","last_became_peered":"2024-09-19T08:37:12.321488+0000","last_unstale":"2024-09-19T08:37:18.343917+0000","last_undegraded":"2024-09-19T08:37:18.343917+0000","last_fullsized":"2024-09-19T08:37:18.343917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:04.303217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582954+0000","last_change":"2024-09-19T08:37:13.326422+0000","last_active":"2024-09-19T08:37:19.582954+0000","last_peered":"2024-09-19T08:37:19.582954+0000","last_clean":"2024-09-19T08:37:19.582954+0000","last_became_active":"2024-09-19T08:37:13.326165+0000","last_became_peered":"2024-09-19T08:37:13.326165+0000","last_unstale":"2024-09-19T08:37:19.582954+0000","last_undegraded":"2024-09-19T08:37:19.582954+0000","last_fullsized":"2024-09-19T08:37:19.582954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:37.846160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673419+0000","last_change":"2024-09-19T08:37:17.363683+0000","last_active":"2024-09-19T08:37:18.673419+0000","last_peered":"2024-09-19T08:37:18.673419+0000","last_clean":"2024-09-19T08:37:18.673419+0000","last_became_active":"2024-09-19T08:37:17.363290+0000","last_became_peered":"2024-09-19T08:37:17.363290+0000","last_unstale":"2024-09-19T08:37:18.673419+0000","last_undegraded":"2024-09-19T08:37:18.673419+0000","last_fullsized":"2024-09-19T08:37:18.673419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:42.065833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.583087+0000","last_change":"2024-09-19T08:37:12.322967+0000","last_active":"2024-09-19T08:37:19.583087+0000","last_peered":"2024-09-19T08:37:19.583087+0000","last_clean":"2024-09-19T08:37:19.583087+0000","last_became_active":"2024-09-19T08:37:12.322465+0000","last_became_peered":"2024-09-19T08:37:12.322465+0000","last_unstale":"2024-09-19T08:37:19.583087+0000","last_undegraded":"2024-09-19T08:37:19.583087+0000","last_fullsized":"2024-09-19T08:37:19.583087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:12.811398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582952+0000","last_change":"2024-09-19T08:37:13.331535+0000","last_active":"2024-09-19T08:37:19.582952+0000","last_peered":"2024-09-19T08:37:19.582952+0000","last_clean":"2024-09-19T08:37:19.582952+0000","last_became_active":"2024-09-19T08:37:13.331292+0000","last_became_peered":"2024-09-19T08:37:13.331292+0000","last_unstale":"2024-09-19T08:37:19.582952+0000","last_undegraded":"2024-09-19T08:37:19.582952+0000","last_fullsized":"2024-09-19T08:37:19.582952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:51.787710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773777+0000","last_change":"2024-09-19T08:37:17.349230+0000","last_active":"2024-09-19T08:37:19.773777+0000","last_peered":"2024-09-19T08:37:19.773777+0000","last_clean":"2024-09-19T08:37:19.773777+0000","last_became_active":"2024-09-19T08:37:17.348844+0000","last_became_peered":"2024-09-19T08:37:17.348844+0000","last_unstale":"2024-09-19T08:37:19.773777+0000","last_undegraded":"2024-09-19T08:37:19.773777+0000","last_fullsized":"2024-09-19T08:37:19.773777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:54.564614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774843+0000","last_change":"2024-09-19T08:37:12.318109+0000","last_active":"2024-09-19T08:37:19.774843+0000","last_peered":"2024-09-19T08:37:19.774843+0000","last_clean":"2024-09-19T08:37:19.774843+0000","last_became_active":"2024-09-19T08:37:12.316698+0000","last_became_peered":"2024-09-19T08:37:12.316698+0000","last_unstale":"2024-09-19T08:37:19.774843+0000","last_undegraded":"2024-09-19T08:37:19.774843+0000","last_fullsized":"2024-09-19T08:37:19.774843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:04.303217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774313+0000","last_change":"2024-09-19T08:37:13.323402+0000","last_active":"2024-09-19T08:37:19.774313+0000","last_peered":"2024-09-19T08:37:19.774313+0000","last_clean":"2024-09-19T08:37:19.774313+0000","last_became_active":"2024-09-19T08:37:13.322905+0000","last_became_peered":"2024-09-19T08:37:13.322905+0000","last_unstale":"2024-09-19T08:37:19.774313+0000","last_undegraded":"2024-09-19T08:37:19.774313+0000","last_fullsized":"2024-09-19T08:37:19.774313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:18.493336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775330+0000","last_change":"2024-09-19T08:37:17.357692+0000","last_active":"2024-09-19T08:37:19.775330+0000","last_peered":"2024-09-19T08:37:19.775330+0000","last_clean":"2024-09-19T08:37:19.775330+0000","last_became_active":"2024-09-19T08:37:17.357312+0000","last_became_peered":"2024-09-19T08:37:17.357312+0000","last_unstale":"2024-09-19T08:37:19.775330+0000","last_undegraded":"2024-09-19T08:37:19.775330+0000","last_fullsized":"2024-09-19T08:37:19.775330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:30.433955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775152+0000","last_change":"2024-09-19T08:37:12.316361+0000","last_active":"2024-09-19T08:37:19.775152+0000","last_peered":"2024-09-19T08:37:19.775152+0000","last_clean":"2024-09-19T08:37:19.775152+0000","last_became_active":"2024-09-19T08:37:12.315959+0000","last_became_peered":"2024-09-19T08:37:12.315959+0000","last_unstale":"2024-09-19T08:37:19.775152+0000","last_undegraded":"2024-09-19T08:37:19.775152+0000","last_fullsized":"2024-09-19T08:37:19.775152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:55.041313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342336+0000","last_change":"2024-09-19T08:37:13.321643+0000","last_active":"2024-09-19T08:37:18.342336+0000","last_peered":"2024-09-19T08:37:18.342336+0000","last_clean":"2024-09-19T08:37:18.342336+0000","last_became_active":"2024-09-19T08:37:13.321386+0000","last_became_peered":"2024-09-19T08:37:13.321386+0000","last_unstale":"2024-09-19T08:37:18.342336+0000","last_undegraded":"2024-09-19T08:37:18.342336+0000","last_fullsized":"2024-09-19T08:37:18.342336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:26:14.554195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774176+0000","last_change":"2024-09-19T08:37:17.353843+0000","last_active":"2024-09-19T08:37:19.774176+0000","last_peered":"2024-09-19T08:37:19.774176+0000","last_clean":"2024-09-19T08:37:19.774176+0000","last_became_active":"2024-09-19T08:37:17.352102+0000","last_became_peered":"2024-09-19T08:37:17.352102+0000","last_unstale":"2024-09-19T08:37:19.774176+0000","last_undegraded":"2024-09-19T08:37:19.774176+0000","last_fullsized":"2024-09-19T08:37:19.774176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:29.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341743+0000","last_change":"2024-09-19T08:37:13.320341+0000","last_active":"2024-09-19T08:37:18.341743+0000","last_peered":"2024-09-19T08:37:18.341743+0000","last_clean":"2024-09-19T08:37:18.341743+0000","last_became_active":"2024-09-19T08:37:13.319040+0000","last_became_peered":"2024-09-19T08:37:13.319040+0000","last_unstale":"2024-09-19T08:37:18.341743+0000","last_undegraded":"2024-09-19T08:37:18.341743+0000","last_fullsized":"2024-09-19T08:37:18.341743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:52.392022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342025+0000","last_change":"2024-09-19T08:37:12.323275+0000","last_active":"2024-09-19T08:37:18.342025+0000","last_peered":"2024-09-19T08:37:18.342025+0000","last_clean":"2024-09-19T08:37:18.342025+0000","last_became_active":"2024-09-19T08:37:12.322994+0000","last_became_peered":"2024-09-19T08:37:12.322994+0000","last_unstale":"2024-09-19T08:37:18.342025+0000","last_undegraded":"2024-09-19T08:37:18.342025+0000","last_fullsized":"2024-09-19T08:37:18.342025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:43.809060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342234+0000","last_change":"2024-09-19T08:37:17.356994+0000","last_active":"2024-09-19T08:37:18.342234+0000","last_peered":"2024-09-19T08:37:18.342234+0000","last_clean":"2024-09-19T08:37:18.342234+0000","last_became_active":"2024-09-19T08:37:17.356598+0000","last_became_peered":"2024-09-19T08:37:17.356598+0000","last_unstale":"2024-09-19T08:37:18.342234+0000","last_undegraded":"2024-09-19T08:37:18.342234+0000","last_fullsized":"2024-09-19T08:37:18.342234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:18.052908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673510+0000","last_change":"2024-09-19T08:37:13.326437+0000","last_active":"2024-09-19T08:37:18.673510+0000","last_peered":"2024-09-19T08:37:18.673510+0000","last_clean":"2024-09-19T08:37:18.673510+0000","last_became_active":"2024-09-19T08:37:13.326165+0000","last_became_peered":"2024-09-19T08:37:13.326165+0000","last_unstale":"2024-09-19T08:37:18.673510+0000","last_undegraded":"2024-09-19T08:37:18.673510+0000","last_fullsized":"2024-09-19T08:37:18.673510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:42.492725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550317+0000","last_change":"2024-09-19T08:37:12.321145+0000","last_active":"2024-09-19T08:37:19.550317+0000","last_peered":"2024-09-19T08:37:19.550317+0000","last_clean":"2024-09-19T08:37:19.550317+0000","last_became_active":"2024-09-19T08:37:12.320846+0000","last_became_peered":"2024-09-19T08:37:12.320846+0000","last_unstale":"2024-09-19T08:37:19.550317+0000","last_undegraded":"2024-09-19T08:37:19.550317+0000","last_fullsized":"2024-09-19T08:37:19.550317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:48.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774766+0000","last_change":"2024-09-19T08:37:17.355922+0000","last_active":"2024-09-19T08:37:19.774766+0000","last_peered":"2024-09-19T08:37:19.774766+0000","last_clean":"2024-09-19T08:37:19.774766+0000","last_became_active":"2024-09-19T08:37:17.355537+0000","last_became_peered":"2024-09-19T08:37:17.355537+0000","last_unstale":"2024-09-19T08:37:19.774766+0000","last_undegraded":"2024-09-19T08:37:19.774766+0000","last_fullsized":"2024-09-19T08:37:19.774766+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:25.565544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342913+0000","last_change":"2024-09-19T08:37:13.317754+0000","last_active":"2024-09-19T08:37:18.342913+0000","last_peered":"2024-09-19T08:37:18.342913+0000","last_clean":"2024-09-19T08:37:18.342913+0000","last_became_active":"2024-09-19T08:37:13.317483+0000","last_became_peered":"2024-09-19T08:37:13.317483+0000","last_unstale":"2024-09-19T08:37:18.342913+0000","last_undegraded":"2024-09-19T08:37:18.342913+0000","last_fullsized":"2024-09-19T08:37:18.342913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:34.222102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343157+0000","last_change":"2024-09-19T08:37:12.319094+0000","last_active":"2024-09-19T08:37:18.343157+0000","last_peered":"2024-09-19T08:37:18.343157+0000","last_clean":"2024-09-19T08:37:18.343157+0000","last_became_active":"2024-09-19T08:37:12.318782+0000","last_became_peered":"2024-09-19T08:37:12.318782+0000","last_unstale":"2024-09-19T08:37:18.343157+0000","last_undegraded":"2024-09-19T08:37:18.343157+0000","last_fullsized":"2024-09-19T08:37:18.343157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:08.631783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.674052+0000","last_change":"2024-09-19T08:37:17.362678+0000","last_active":"2024-09-19T08:37:18.674052+0000","last_peered":"2024-09-19T08:37:18.674052+0000","last_clean":"2024-09-19T08:37:18.674052+0000","last_became_active":"2024-09-19T08:37:17.362281+0000","last_became_peered":"2024-09-19T08:37:17.362281+0000","last_unstale":"2024-09-19T08:37:18.674052+0000","last_undegraded":"2024-09-19T08:37:18.674052+0000","last_fullsized":"2024-09-19T08:37:18.674052+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:37.134018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341605+0000","last_change":"2024-09-19T08:37:13.328741+0000","last_active":"2024-09-19T08:37:18.341605+0000","last_peered":"2024-09-19T08:37:18.341605+0000","last_clean":"2024-09-19T08:37:18.341605+0000","last_became_active":"2024-09-19T08:37:13.328156+0000","last_became_peered":"2024-09-19T08:37:13.328156+0000","last_unstale":"2024-09-19T08:37:18.341605+0000","last_undegraded":"2024-09-19T08:37:18.341605+0000","last_fullsized":"2024-09-19T08:37:18.341605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:21.534501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773822+0000","last_change":"2024-09-19T08:37:12.314762+0000","last_active":"2024-09-19T08:37:19.773822+0000","last_peered":"2024-09-19T08:37:19.773822+0000","last_clean":"2024-09-19T08:37:19.773822+0000","last_became_active":"2024-09-19T08:37:12.314471+0000","last_became_peered":"2024-09-19T08:37:12.314471+0000","last_unstale":"2024-09-19T08:37:19.773822+0000","last_undegraded":"2024-09-19T08:37:19.773822+0000","last_fullsized":"2024-09-19T08:37:19.773822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:08.631783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774584+0000","last_change":"2024-09-19T08:37:17.353677+0000","last_active":"2024-09-19T08:37:19.774584+0000","last_peered":"2024-09-19T08:37:19.774584+0000","last_clean":"2024-09-19T08:37:19.774584+0000","last_became_active":"2024-09-19T08:37:17.353311+0000","last_became_peered":"2024-09-19T08:37:17.353311+0000","last_unstale":"2024-09-19T08:37:19.774584+0000","last_undegraded":"2024-09-19T08:37:19.774584+0000","last_fullsized":"2024-09-19T08:37:19.774584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:55.818752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343663+0000","last_change":"2024-09-19T08:37:13.322046+0000","last_active":"2024-09-19T08:37:18.343663+0000","last_peered":"2024-09-19T08:37:18.343663+0000","last_clean":"2024-09-19T08:37:18.343663+0000","last_became_active":"2024-09-19T08:37:13.321632+0000","last_became_peered":"2024-09-19T08:37:13.321632+0000","last_unstale":"2024-09-19T08:37:18.343663+0000","last_undegraded":"2024-09-19T08:37:18.343663+0000","last_fullsized":"2024-09-19T08:37:18.343663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:31.517337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342528+0000","last_change":"2024-09-19T08:37:12.326667+0000","last_active":"2024-09-19T08:37:18.342528+0000","last_peered":"2024-09-19T08:37:18.342528+0000","last_clean":"2024-09-19T08:37:18.342528+0000","last_became_active":"2024-09-19T08:37:12.326400+0000","last_became_peered":"2024-09-19T08:37:12.326400+0000","last_unstale":"2024-09-19T08:37:18.342528+0000","last_undegraded":"2024-09-19T08:37:18.342528+0000","last_fullsized":"2024-09-19T08:37:18.342528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:17.484267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774094+0000","last_change":"2024-09-19T08:37:17.353015+0000","last_active":"2024-09-19T08:37:19.774094+0000","last_peered":"2024-09-19T08:37:19.774094+0000","last_clean":"2024-09-19T08:37:19.774094+0000","last_became_active":"2024-09-19T08:37:17.352080+0000","last_became_peered":"2024-09-19T08:37:17.352080+0000","last_unstale":"2024-09-19T08:37:19.774094+0000","last_undegraded":"2024-09-19T08:37:19.774094+0000","last_fullsized":"2024-09-19T08:37:19.774094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:25.374722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343778+0000","last_change":"2024-09-19T08:37:13.315155+0000","last_active":"2024-09-19T08:37:18.343778+0000","last_peered":"2024-09-19T08:37:18.343778+0000","last_clean":"2024-09-19T08:37:18.343778+0000","last_became_active":"2024-09-19T08:37:13.314853+0000","last_became_peered":"2024-09-19T08:37:13.314853+0000","last_unstale":"2024-09-19T08:37:18.343778+0000","last_undegraded":"2024-09-19T08:37:18.343778+0000","last_fullsized":"2024-09-19T08:37:18.343778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:57.125390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343814+0000","last_change":"2024-09-19T08:37:12.307577+0000","last_active":"2024-09-19T08:37:18.343814+0000","last_peered":"2024-09-19T08:37:18.343814+0000","last_clean":"2024-09-19T08:37:18.343814+0000","last_became_active":"2024-09-19T08:37:12.307011+0000","last_became_peered":"2024-09-19T08:37:12.307011+0000","last_unstale":"2024-09-19T08:37:18.343814+0000","last_undegraded":"2024-09-19T08:37:18.343814+0000","last_fullsized":"2024-09-19T08:37:18.343814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:12.811398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342993+0000","last_change":"2024-09-19T08:37:17.350495+0000","last_active":"2024-09-19T08:37:18.342993+0000","last_peered":"2024-09-19T08:37:18.342993+0000","last_clean":"2024-09-19T08:37:18.342993+0000","last_became_active":"2024-09-19T08:37:17.349314+0000","last_became_peered":"2024-09-19T08:37:17.349314+0000","last_unstale":"2024-09-19T08:37:18.342993+0000","last_undegraded":"2024-09-19T08:37:18.342993+0000","last_fullsized":"2024-09-19T08:37:18.342993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:30.433955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550444+0000","last_change":"2024-09-19T08:37:13.326384+0000","last_active":"2024-09-19T08:37:19.550444+0000","last_peered":"2024-09-19T08:37:19.550444+0000","last_clean":"2024-09-19T08:37:19.550444+0000","last_became_active":"2024-09-19T08:37:13.326109+0000","last_became_peered":"2024-09-19T08:37:13.326109+0000","last_unstale":"2024-09-19T08:37:19.550444+0000","last_undegraded":"2024-09-19T08:37:19.550444+0000","last_fullsized":"2024-09-19T08:37:19.550444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:39.528322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342580+0000","last_change":"2024-09-19T08:37:12.323115+0000","last_active":"2024-09-19T08:37:18.342580+0000","last_peered":"2024-09-19T08:37:18.342580+0000","last_clean":"2024-09-19T08:37:18.342580+0000","last_became_active":"2024-09-19T08:37:12.322685+0000","last_became_peered":"2024-09-19T08:37:12.322685+0000","last_unstale":"2024-09-19T08:37:18.342580+0000","last_undegraded":"2024-09-19T08:37:18.342580+0000","last_fullsized":"2024-09-19T08:37:18.342580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:44.440667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550017+0000","last_change":"2024-09-19T08:37:17.358072+0000","last_active":"2024-09-19T08:37:19.550017+0000","last_peered":"2024-09-19T08:37:19.550017+0000","last_clean":"2024-09-19T08:37:19.550017+0000","last_became_active":"2024-09-19T08:37:17.357595+0000","last_became_peered":"2024-09-19T08:37:17.357595+0000","last_unstale":"2024-09-19T08:37:19.550017+0000","last_undegraded":"2024-09-19T08:37:19.550017+0000","last_fullsized":"2024-09-19T08:37:19.550017+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:29.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775441+0000","last_change":"2024-09-19T08:37:13.319823+0000","last_active":"2024-09-19T08:37:19.775441+0000","last_peered":"2024-09-19T08:37:19.775441+0000","last_clean":"2024-09-19T08:37:19.775441+0000","last_became_active":"2024-09-19T08:37:13.319552+0000","last_became_peered":"2024-09-19T08:37:13.319552+0000","last_unstale":"2024-09-19T08:37:19.775441+0000","last_undegraded":"2024-09-19T08:37:19.775441+0000","last_fullsized":"2024-09-19T08:37:19.775441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:23.965109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582542+0000","last_change":"2024-09-19T08:37:12.320429+0000","last_active":"2024-09-19T08:37:19.582542+0000","last_peered":"2024-09-19T08:37:19.582542+0000","last_clean":"2024-09-19T08:37:19.582542+0000","last_became_active":"2024-09-19T08:37:12.320136+0000","last_became_peered":"2024-09-19T08:37:12.320136+0000","last_unstale":"2024-09-19T08:37:19.582542+0000","last_undegraded":"2024-09-19T08:37:19.582542+0000","last_fullsized":"2024-09-19T08:37:19.582542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:48.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.549893+0000","last_change":"2024-09-19T08:37:17.351017+0000","last_active":"2024-09-19T08:37:19.549893+0000","last_peered":"2024-09-19T08:37:19.549893+0000","last_clean":"2024-09-19T08:37:19.549893+0000","last_became_active":"2024-09-19T08:37:17.350612+0000","last_became_peered":"2024-09-19T08:37:17.350612+0000","last_unstale":"2024-09-19T08:37:19.549893+0000","last_undegraded":"2024-09-19T08:37:19.549893+0000","last_fullsized":"2024-09-19T08:37:19.549893+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:25.374722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774665+0000","last_change":"2024-09-19T08:37:13.322685+0000","last_active":"2024-09-19T08:37:19.774665+0000","last_peered":"2024-09-19T08:37:19.774665+0000","last_clean":"2024-09-19T08:37:19.774665+0000","last_became_active":"2024-09-19T08:37:13.322422+0000","last_became_peered":"2024-09-19T08:37:13.322422+0000","last_unstale":"2024-09-19T08:37:19.774665+0000","last_undegraded":"2024-09-19T08:37:19.774665+0000","last_fullsized":"2024-09-19T08:37:19.774665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:32.352238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341955+0000","last_change":"2024-09-19T08:37:12.321407+0000","last_active":"2024-09-19T08:37:18.341955+0000","last_peered":"2024-09-19T08:37:18.341955+0000","last_clean":"2024-09-19T08:37:18.341955+0000","last_became_active":"2024-09-19T08:37:12.321129+0000","last_became_peered":"2024-09-19T08:37:12.321129+0000","last_unstale":"2024-09-19T08:37:18.341955+0000","last_undegraded":"2024-09-19T08:37:18.341955+0000","last_fullsized":"2024-09-19T08:37:18.341955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:03.696329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550190+0000","last_change":"2024-09-19T08:37:17.358653+0000","last_active":"2024-09-19T08:37:19.550190+0000","last_peered":"2024-09-19T08:37:19.550190+0000","last_clean":"2024-09-19T08:37:19.550190+0000","last_became_active":"2024-09-19T08:37:17.357509+0000","last_became_peered":"2024-09-19T08:37:17.357509+0000","last_unstale":"2024-09-19T08:37:19.550190+0000","last_undegraded":"2024-09-19T08:37:19.550190+0000","last_fullsized":"2024-09-19T08:37:19.550190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:55.818752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582178+0000","last_change":"2024-09-19T08:37:13.327783+0000","last_active":"2024-09-19T08:37:19.582178+0000","last_peered":"2024-09-19T08:37:19.582178+0000","last_clean":"2024-09-19T08:37:19.582178+0000","last_became_active":"2024-09-19T08:37:13.327296+0000","last_became_peered":"2024-09-19T08:37:13.327296+0000","last_unstale":"2024-09-19T08:37:19.582178+0000","last_undegraded":"2024-09-19T08:37:19.582178+0000","last_fullsized":"2024-09-19T08:37:19.582178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:31.517337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673483+0000","last_change":"2024-09-19T08:37:12.318619+0000","last_active":"2024-09-19T08:37:18.673483+0000","last_peered":"2024-09-19T08:37:18.673483+0000","last_clean":"2024-09-19T08:37:18.673483+0000","last_became_active":"2024-09-19T08:37:12.318299+0000","last_became_peered":"2024-09-19T08:37:12.318299+0000","last_unstale":"2024-09-19T08:37:18.673483+0000","last_undegraded":"2024-09-19T08:37:18.673483+0000","last_fullsized":"2024-09-19T08:37:18.673483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:20.563149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550435+0000","last_change":"2024-09-19T08:37:17.353727+0000","last_active":"2024-09-19T08:37:19.550435+0000","last_peered":"2024-09-19T08:37:19.550435+0000","last_clean":"2024-09-19T08:37:19.550435+0000","last_became_active":"2024-09-19T08:37:17.353180+0000","last_became_peered":"2024-09-19T08:37:17.353180+0000","last_unstale":"2024-09-19T08:37:19.550435+0000","last_undegraded":"2024-09-19T08:37:19.550435+0000","last_fullsized":"2024-09-19T08:37:19.550435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:41.877203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.549807+0000","last_change":"2024-09-19T08:37:13.323403+0000","last_active":"2024-09-19T08:37:19.549807+0000","last_peered":"2024-09-19T08:37:19.549807+0000","last_clean":"2024-09-19T08:37:19.549807+0000","last_became_active":"2024-09-19T08:37:13.323125+0000","last_became_peered":"2024-09-19T08:37:13.323125+0000","last_unstale":"2024-09-19T08:37:19.549807+0000","last_undegraded":"2024-09-19T08:37:19.549807+0000","last_fullsized":"2024-09-19T08:37:19.549807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:04.705399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341725+0000","last_change":"2024-09-19T08:37:12.325472+0000","last_active":"2024-09-19T08:37:18.341725+0000","last_peered":"2024-09-19T08:37:18.341725+0000","last_clean":"2024-09-19T08:37:18.341725+0000","last_became_active":"2024-09-19T08:37:12.325213+0000","last_became_peered":"2024-09-19T08:37:12.325213+0000","last_unstale":"2024-09-19T08:37:18.341725+0000","last_undegraded":"2024-09-19T08:37:18.341725+0000","last_fullsized":"2024-09-19T08:37:18.341725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:55.041313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582821+0000","last_change":"2024-09-19T08:37:17.354723+0000","last_active":"2024-09-19T08:37:19.582821+0000","last_peered":"2024-09-19T08:37:19.582821+0000","last_clean":"2024-09-19T08:37:19.582821+0000","last_became_active":"2024-09-19T08:37:17.354349+0000","last_became_peered":"2024-09-19T08:37:17.354349+0000","last_unstale":"2024-09-19T08:37:19.582821+0000","last_undegraded":"2024-09-19T08:37:19.582821+0000","last_fullsized":"2024-09-19T08:37:19.582821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:26:18.585237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343346+0000","last_change":"2024-09-19T08:37:13.314451+0000","last_active":"2024-09-19T08:37:18.343346+0000","last_peered":"2024-09-19T08:37:18.343346+0000","last_clean":"2024-09-19T08:37:18.343346+0000","last_became_active":"2024-09-19T08:37:13.314082+0000","last_became_peered":"2024-09-19T08:37:13.314082+0000","last_unstale":"2024-09-19T08:37:18.343346+0000","last_undegraded":"2024-09-19T08:37:18.343346+0000","last_fullsized":"2024-09-19T08:37:18.343346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:39.528322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342148+0000","last_change":"2024-09-19T08:37:12.321328+0000","last_active":"2024-09-19T08:37:18.342148+0000","last_peered":"2024-09-19T08:37:18.342148+0000","last_clean":"2024-09-19T08:37:18.342148+0000","last_became_active":"2024-09-19T08:37:12.321069+0000","last_became_peered":"2024-09-19T08:37:12.321069+0000","last_unstale":"2024-09-19T08:37:18.342148+0000","last_undegraded":"2024-09-19T08:37:18.342148+0000","last_fullsized":"2024-09-19T08:37:18.342148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:22.956039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774403+0000","last_change":"2024-09-19T08:37:04.479071+0000","last_active":"2024-09-19T08:37:19.774403+0000","last_peered":"2024-09-19T08:37:19.774403+0000","last_clean":"2024-09-19T08:37:19.774403+0000","last_became_active":"2024-09-19T08:37:04.478199+0000","last_became_peered":"2024-09-19T08:37:04.478199+0000","last_unstale":"2024-09-19T08:37:19.774403+0000","last_undegraded":"2024-09-19T08:37:19.774403+0000","last_fullsized":"2024-09-19T08:37:19.774403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_clean_scrub_stamp":"2024-09-19T08:37:02.519738+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:32.963748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342489+0000","last_change":"2024-09-19T08:37:17.360235+0000","last_active":"2024-09-19T08:37:18.342489+0000","last_peered":"2024-09-19T08:37:18.342489+0000","last_clean":"2024-09-19T08:37:18.342489+0000","last_became_active":"2024-09-19T08:37:17.359875+0000","last_became_peered":"2024-09-19T08:37:17.359875+0000","last_unstale":"2024-09-19T08:37:18.342489+0000","last_undegraded":"2024-09-19T08:37:18.342489+0000","last_fullsized":"2024-09-19T08:37:18.342489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:02.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342407+0000","last_change":"2024-09-19T08:37:13.318739+0000","last_active":"2024-09-19T08:37:18.342407+0000","last_peered":"2024-09-19T08:37:18.342407+0000","last_clean":"2024-09-19T08:37:18.342407+0000","last_became_active":"2024-09-19T08:37:13.318487+0000","last_became_peered":"2024-09-19T08:37:13.318487+0000","last_unstale":"2024-09-19T08:37:18.342407+0000","last_undegraded":"2024-09-19T08:37:18.342407+0000","last_fullsized":"2024-09-19T08:37:18.342407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:50.571163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550463+0000","last_change":"2024-09-19T08:37:12.321017+0000","last_active":"2024-09-19T08:37:19.550463+0000","last_peered":"2024-09-19T08:37:19.550463+0000","last_clean":"2024-09-19T08:37:19.550463+0000","last_became_active":"2024-09-19T08:37:12.320498+0000","last_became_peered":"2024-09-19T08:37:12.320498+0000","last_unstale":"2024-09-19T08:37:19.550463+0000","last_undegraded":"2024-09-19T08:37:19.550463+0000","last_fullsized":"2024-09-19T08:37:19.550463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:37.272613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774252+0000","last_change":"2024-09-19T08:37:17.351391+0000","last_active":"2024-09-19T08:37:19.774252+0000","last_peered":"2024-09-19T08:37:19.774252+0000","last_clean":"2024-09-19T08:37:19.774252+0000","last_became_active":"2024-09-19T08:37:17.350957+0000","last_became_peered":"2024-09-19T08:37:17.350957+0000","last_unstale":"2024-09-19T08:37:19.774252+0000","last_undegraded":"2024-09-19T08:37:19.774252+0000","last_fullsized":"2024-09-19T08:37:19.774252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:36.383281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775081+0000","last_change":"2024-09-19T08:37:13.323759+0000","last_active":"2024-09-19T08:37:19.775081+0000","last_peered":"2024-09-19T08:37:19.775081+0000","last_clean":"2024-09-19T08:37:19.775081+0000","last_became_active":"2024-09-19T08:37:13.322021+0000","last_became_peered":"2024-09-19T08:37:13.322021+0000","last_unstale":"2024-09-19T08:37:19.775081+0000","last_undegraded":"2024-09-19T08:37:19.775081+0000","last_fullsized":"2024-09-19T08:37:19.775081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:26.402913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582801+0000","last_change":"2024-09-19T08:37:12.321535+0000","last_active":"2024-09-19T08:37:19.582801+0000","last_peered":"2024-09-19T08:37:19.582801+0000","last_clean":"2024-09-19T08:37:19.582801+0000","last_became_active":"2024-09-19T08:37:12.321158+0000","last_became_peered":"2024-09-19T08:37:12.321158+0000","last_unstale":"2024-09-19T08:37:19.582801+0000","last_undegraded":"2024-09-19T08:37:19.582801+0000","last_fullsized":"2024-09-19T08:37:19.582801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:08.631783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582645+0000","last_change":"2024-09-19T08:37:17.355898+0000","last_active":"2024-09-19T08:37:19.582645+0000","last_peered":"2024-09-19T08:37:19.582645+0000","last_clean":"2024-09-19T08:37:19.582645+0000","last_became_active":"2024-09-19T08:37:17.355518+0000","last_became_peered":"2024-09-19T08:37:17.355518+0000","last_unstale":"2024-09-19T08:37:19.582645+0000","last_undegraded":"2024-09-19T08:37:19.582645+0000","last_fullsized":"2024-09-19T08:37:19.582645+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:54.602206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775159+0000","last_change":"2024-09-19T08:37:13.317412+0000","last_active":"2024-09-19T08:37:19.775159+0000","last_peered":"2024-09-19T08:37:19.775159+0000","last_clean":"2024-09-19T08:37:19.775159+0000","last_became_active":"2024-09-19T08:37:13.317158+0000","last_became_peered":"2024-09-19T08:37:13.317158+0000","last_unstale":"2024-09-19T08:37:19.775159+0000","last_undegraded":"2024-09-19T08:37:19.775159+0000","last_fullsized":"2024-09-19T08:37:19.775159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:37.846160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343804+0000","last_change":"2024-09-19T08:37:12.318485+0000","last_active":"2024-09-19T08:37:18.343804+0000","last_peered":"2024-09-19T08:37:18.343804+0000","last_clean":"2024-09-19T08:37:18.343804+0000","last_became_active":"2024-09-19T08:37:12.318173+0000","last_became_peered":"2024-09-19T08:37:12.318173+0000","last_unstale":"2024-09-19T08:37:18.343804+0000","last_undegraded":"2024-09-19T08:37:18.343804+0000","last_fullsized":"2024-09-19T08:37:18.343804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:32.812065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341486+0000","last_change":"2024-09-19T08:37:17.351969+0000","last_active":"2024-09-19T08:37:18.341486+0000","last_peered":"2024-09-19T08:37:18.341486+0000","last_clean":"2024-09-19T08:37:18.341486+0000","last_became_active":"2024-09-19T08:37:17.351602+0000","last_became_peered":"2024-09-19T08:37:17.351602+0000","last_unstale":"2024-09-19T08:37:18.341486+0000","last_undegraded":"2024-09-19T08:37:18.341486+0000","last_fullsized":"2024-09-19T08:37:18.341486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:07.810509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774839+0000","last_change":"2024-09-19T08:37:13.316790+0000","last_active":"2024-09-19T08:37:19.774839+0000","last_peered":"2024-09-19T08:37:19.774839+0000","last_clean":"2024-09-19T08:37:19.774839+0000","last_became_active":"2024-09-19T08:37:13.315664+0000","last_became_peered":"2024-09-19T08:37:13.315664+0000","last_unstale":"2024-09-19T08:37:19.774839+0000","last_undegraded":"2024-09-19T08:37:19.774839+0000","last_fullsized":"2024-09-19T08:37:19.774839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:55.229727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775212+0000","last_change":"2024-09-19T08:37:12.322929+0000","last_active":"2024-09-19T08:37:19.775212+0000","last_peered":"2024-09-19T08:37:19.775212+0000","last_clean":"2024-09-19T08:37:19.775212+0000","last_became_active":"2024-09-19T08:37:12.322679+0000","last_became_peered":"2024-09-19T08:37:12.322679+0000","last_unstale":"2024-09-19T08:37:19.775212+0000","last_undegraded":"2024-09-19T08:37:19.775212+0000","last_fullsized":"2024-09-19T08:37:19.775212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:12.811398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775212+0000","last_change":"2024-09-19T08:37:17.356653+0000","last_active":"2024-09-19T08:37:19.775212+0000","last_peered":"2024-09-19T08:37:19.775212+0000","last_clean":"2024-09-19T08:37:19.775212+0000","last_became_active":"2024-09-19T08:37:17.356295+0000","last_became_peered":"2024-09-19T08:37:17.356295+0000","last_unstale":"2024-09-19T08:37:19.775212+0000","last_undegraded":"2024-09-19T08:37:19.775212+0000","last_fullsized":"2024-09-19T08:37:19.775212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:59.260769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341570+0000","last_change":"2024-09-19T08:37:13.328997+0000","last_active":"2024-09-19T08:37:18.341570+0000","last_peered":"2024-09-19T08:37:18.341570+0000","last_clean":"2024-09-19T08:37:18.341570+0000","last_became_active":"2024-09-19T08:37:13.328496+0000","last_became_peered":"2024-09-19T08:37:13.328496+0000","last_unstale":"2024-09-19T08:37:18.341570+0000","last_undegraded":"2024-09-19T08:37:18.341570+0000","last_fullsized":"2024-09-19T08:37:18.341570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:11.464991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343175+0000","last_change":"2024-09-19T08:37:12.316395+0000","last_active":"2024-09-19T08:37:18.343175+0000","last_peered":"2024-09-19T08:37:18.343175+0000","last_clean":"2024-09-19T08:37:18.343175+0000","last_became_active":"2024-09-19T08:37:12.315734+0000","last_became_peered":"2024-09-19T08:37:12.315734+0000","last_unstale":"2024-09-19T08:37:18.343175+0000","last_undegraded":"2024-09-19T08:37:18.343175+0000","last_fullsized":"2024-09-19T08:37:18.343175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:48.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582970+0000","last_change":"2024-09-19T08:37:17.351618+0000","last_active":"2024-09-19T08:37:19.582970+0000","last_peered":"2024-09-19T08:37:19.582970+0000","last_clean":"2024-09-19T08:37:19.582970+0000","last_became_active":"2024-09-19T08:37:17.351235+0000","last_became_peered":"2024-09-19T08:37:17.351235+0000","last_unstale":"2024-09-19T08:37:19.582970+0000","last_undegraded":"2024-09-19T08:37:19.582970+0000","last_fullsized":"2024-09-19T08:37:19.582970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:50.477160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774327+0000","last_change":"2024-09-19T08:37:13.328281+0000","last_active":"2024-09-19T08:37:19.774327+0000","last_peered":"2024-09-19T08:37:19.774327+0000","last_clean":"2024-09-19T08:37:19.774327+0000","last_became_active":"2024-09-19T08:37:13.327925+0000","last_became_peered":"2024-09-19T08:37:13.327925+0000","last_unstale":"2024-09-19T08:37:19.774327+0000","last_undegraded":"2024-09-19T08:37:19.774327+0000","last_fullsized":"2024-09-19T08:37:19.774327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:05.312287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775776+0000","last_change":"2024-09-19T08:37:12.321424+0000","last_active":"2024-09-19T08:37:19.775776+0000","last_peered":"2024-09-19T08:37:19.775776+0000","last_clean":"2024-09-19T08:37:19.775776+0000","last_became_active":"2024-09-19T08:37:12.321176+0000","last_became_peered":"2024-09-19T08:37:12.321176+0000","last_unstale":"2024-09-19T08:37:19.775776+0000","last_undegraded":"2024-09-19T08:37:19.775776+0000","last_fullsized":"2024-09-19T08:37:19.775776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:32.812065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.583004+0000","last_change":"2024-09-19T08:37:17.349545+0000","last_active":"2024-09-19T08:37:19.583004+0000","last_peered":"2024-09-19T08:37:19.583004+0000","last_clean":"2024-09-19T08:37:19.583004+0000","last_became_active":"2024-09-19T08:37:17.349192+0000","last_became_peered":"2024-09-19T08:37:17.349192+0000","last_unstale":"2024-09-19T08:37:19.583004+0000","last_undegraded":"2024-09-19T08:37:19.583004+0000","last_fullsized":"2024-09-19T08:37:19.583004+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:38.360015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341839+0000","last_change":"2024-09-19T08:37:13.322205+0000","last_active":"2024-09-19T08:37:18.341839+0000","last_peered":"2024-09-19T08:37:18.341839+0000","last_clean":"2024-09-19T08:37:18.341839+0000","last_became_active":"2024-09-19T08:37:13.321483+0000","last_became_peered":"2024-09-19T08:37:13.321483+0000","last_unstale":"2024-09-19T08:37:18.341839+0000","last_undegraded":"2024-09-19T08:37:18.341839+0000","last_fullsized":"2024-09-19T08:37:18.341839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:49.043269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341935+0000","last_change":"2024-09-19T08:37:12.325272+0000","last_active":"2024-09-19T08:37:18.341935+0000","last_peered":"2024-09-19T08:37:18.341935+0000","last_clean":"2024-09-19T08:37:18.341935+0000","last_became_active":"2024-09-19T08:37:12.325028+0000","last_became_peered":"2024-09-19T08:37:12.325028+0000","last_unstale":"2024-09-19T08:37:18.341935+0000","last_undegraded":"2024-09-19T08:37:18.341935+0000","last_fullsized":"2024-09-19T08:37:18.341935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:33.465602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550181+0000","last_change":"2024-09-19T08:37:17.355589+0000","last_active":"2024-09-19T08:37:19.550181+0000","last_peered":"2024-09-19T08:37:19.550181+0000","last_clean":"2024-09-19T08:37:19.550181+0000","last_became_active":"2024-09-19T08:37:17.353243+0000","last_became_peered":"2024-09-19T08:37:17.353243+0000","last_unstale":"2024-09-19T08:37:19.550181+0000","last_undegraded":"2024-09-19T08:37:19.550181+0000","last_fullsized":"2024-09-19T08:37:19.550181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:36.383281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550216+0000","last_change":"2024-09-19T08:37:13.325522+0000","last_active":"2024-09-19T08:37:19.550216+0000","last_peered":"2024-09-19T08:37:19.550216+0000","last_clean":"2024-09-19T08:37:19.550216+0000","last_became_active":"2024-09-19T08:37:13.324792+0000","last_became_peered":"2024-09-19T08:37:13.324792+0000","last_unstale":"2024-09-19T08:37:19.550216+0000","last_undegraded":"2024-09-19T08:37:19.550216+0000","last_fullsized":"2024-09-19T08:37:19.550216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:55.229727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673680+0000","last_change":"2024-09-19T08:37:12.322147+0000","last_active":"2024-09-19T08:37:18.673680+0000","last_peered":"2024-09-19T08:37:18.673680+0000","last_clean":"2024-09-19T08:37:18.673680+0000","last_became_active":"2024-09-19T08:37:12.321849+0000","last_became_peered":"2024-09-19T08:37:12.321849+0000","last_unstale":"2024-09-19T08:37:18.673680+0000","last_undegraded":"2024-09-19T08:37:18.673680+0000","last_fullsized":"2024-09-19T08:37:18.673680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:13.052644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342312+0000","last_change":"2024-09-19T08:37:17.359818+0000","last_active":"2024-09-19T08:37:18.342312+0000","last_peered":"2024-09-19T08:37:18.342312+0000","last_clean":"2024-09-19T08:37:18.342312+0000","last_became_active":"2024-09-19T08:37:17.359442+0000","last_became_peered":"2024-09-19T08:37:17.359442+0000","last_unstale":"2024-09-19T08:37:18.342312+0000","last_undegraded":"2024-09-19T08:37:18.342312+0000","last_fullsized":"2024-09-19T08:37:18.342312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:23.916499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774686+0000","last_change":"2024-09-19T08:37:13.320385+0000","last_active":"2024-09-19T08:37:19.774686+0000","last_peered":"2024-09-19T08:37:19.774686+0000","last_clean":"2024-09-19T08:37:19.774686+0000","last_became_active":"2024-09-19T08:37:13.320121+0000","last_became_peered":"2024-09-19T08:37:13.320121+0000","last_unstale":"2024-09-19T08:37:19.774686+0000","last_undegraded":"2024-09-19T08:37:19.774686+0000","last_fullsized":"2024-09-19T08:37:19.774686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:25.894361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:22.767373+0000","last_change":"2024-09-19T08:37:12.317329+0000","last_active":"2024-09-19T08:37:22.767373+0000","last_peered":"2024-09-19T08:37:22.767373+0000","last_clean":"2024-09-19T08:37:22.767373+0000","last_became_active":"2024-09-19T08:37:12.317062+0000","last_became_peered":"2024-09-19T08:37:12.317062+0000","last_unstale":"2024-09-19T08:37:22.767373+0000","last_undegraded":"2024-09-19T08:37:22.767373+0000","last_fullsized":"2024-09-19T08:37:22.767373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:05.334179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343234+0000","last_change":"2024-09-19T08:37:17.351632+0000","last_active":"2024-09-19T08:37:18.343234+0000","last_peered":"2024-09-19T08:37:18.343234+0000","last_clean":"2024-09-19T08:37:18.343234+0000","last_became_active":"2024-09-19T08:37:17.351246+0000","last_became_peered":"2024-09-19T08:37:17.351246+0000","last_unstale":"2024-09-19T08:37:18.343234+0000","last_undegraded":"2024-09-19T08:37:18.343234+0000","last_fullsized":"2024-09-19T08:37:18.343234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:15.496034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341958+0000","last_change":"2024-09-19T08:37:13.328541+0000","last_active":"2024-09-19T08:37:18.341958+0000","last_peered":"2024-09-19T08:37:18.341958+0000","last_clean":"2024-09-19T08:37:18.341958+0000","last_became_active":"2024-09-19T08:37:13.328285+0000","last_became_peered":"2024-09-19T08:37:13.328285+0000","last_unstale":"2024-09-19T08:37:18.341958+0000","last_undegraded":"2024-09-19T08:37:18.341958+0000","last_fullsized":"2024-09-19T08:37:18.341958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:13.920583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673858+0000","last_change":"2024-09-19T08:37:12.318230+0000","last_active":"2024-09-19T08:37:18.673858+0000","last_peered":"2024-09-19T08:37:18.673858+0000","last_clean":"2024-09-19T08:37:18.673858+0000","last_became_active":"2024-09-19T08:37:12.317739+0000","last_became_peered":"2024-09-19T08:37:12.317739+0000","last_unstale":"2024-09-19T08:37:18.673858+0000","last_undegraded":"2024-09-19T08:37:18.673858+0000","last_fullsized":"2024-09-19T08:37:18.673858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:50.275215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775001+0000","last_change":"2024-09-19T08:37:17.353397+0000","last_active":"2024-09-19T08:37:19.775001+0000","last_peered":"2024-09-19T08:37:19.775001+0000","last_clean":"2024-09-19T08:37:19.775001+0000","last_became_active":"2024-09-19T08:37:17.352532+0000","last_became_peered":"2024-09-19T08:37:17.352532+0000","last_unstale":"2024-09-19T08:37:19.775001+0000","last_undegraded":"2024-09-19T08:37:19.775001+0000","last_fullsized":"2024-09-19T08:37:19.775001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:41.877203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.583030+0000","last_change":"2024-09-19T08:37:13.330183+0000","last_active":"2024-09-19T08:37:19.583030+0000","last_peered":"2024-09-19T08:37:19.583030+0000","last_clean":"2024-09-19T08:37:19.583030+0000","last_became_active":"2024-09-19T08:37:13.329810+0000","last_became_peered":"2024-09-19T08:37:13.329810+0000","last_unstale":"2024-09-19T08:37:19.583030+0000","last_undegraded":"2024-09-19T08:37:19.583030+0000","last_fullsized":"2024-09-19T08:37:19.583030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:32.352238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775009+0000","last_change":"2024-09-19T08:37:12.318995+0000","last_active":"2024-09-19T08:37:19.775009+0000","last_peered":"2024-09-19T08:37:19.775009+0000","last_clean":"2024-09-19T08:37:19.775009+0000","last_became_active":"2024-09-19T08:37:12.318707+0000","last_became_peered":"2024-09-19T08:37:12.318707+0000","last_unstale":"2024-09-19T08:37:19.775009+0000","last_undegraded":"2024-09-19T08:37:19.775009+0000","last_fullsized":"2024-09-19T08:37:19.775009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:43.809060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673308+0000","last_change":"2024-09-19T08:37:17.363394+0000","last_active":"2024-09-19T08:37:18.673308+0000","last_peered":"2024-09-19T08:37:18.673308+0000","last_clean":"2024-09-19T08:37:18.673308+0000","last_became_active":"2024-09-19T08:37:17.362912+0000","last_became_peered":"2024-09-19T08:37:17.362912+0000","last_unstale":"2024-09-19T08:37:18.673308+0000","last_undegraded":"2024-09-19T08:37:18.673308+0000","last_fullsized":"2024-09-19T08:37:18.673308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:04.239525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774754+0000","last_change":"2024-09-19T08:37:13.324283+0000","last_active":"2024-09-19T08:37:19.774754+0000","last_peered":"2024-09-19T08:37:19.774754+0000","last_clean":"2024-09-19T08:37:19.774754+0000","last_became_active":"2024-09-19T08:37:13.323386+0000","last_became_peered":"2024-09-19T08:37:13.323386+0000","last_unstale":"2024-09-19T08:37:19.774754+0000","last_undegraded":"2024-09-19T08:37:19.774754+0000","last_fullsized":"2024-09-19T08:37:19.774754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:04.705399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774939+0000","last_change":"2024-09-19T08:37:12.320151+0000","last_active":"2024-09-19T08:37:19.774939+0000","last_peered":"2024-09-19T08:37:19.774939+0000","last_clean":"2024-09-19T08:37:19.774939+0000","last_became_active":"2024-09-19T08:37:12.319848+0000","last_became_peered":"2024-09-19T08:37:12.319848+0000","last_unstale":"2024-09-19T08:37:19.774939+0000","last_undegraded":"2024-09-19T08:37:19.774939+0000","last_fullsized":"2024-09-19T08:37:19.774939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:57.623546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343446+0000","last_change":"2024-09-19T08:37:17.354272+0000","last_active":"2024-09-19T08:37:18.343446+0000","last_peered":"2024-09-19T08:37:18.343446+0000","last_clean":"2024-09-19T08:37:18.343446+0000","last_became_active":"2024-09-19T08:37:17.353914+0000","last_became_peered":"2024-09-19T08:37:17.353914+0000","last_unstale":"2024-09-19T08:37:18.343446+0000","last_undegraded":"2024-09-19T08:37:18.343446+0000","last_fullsized":"2024-09-19T08:37:18.343446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:53.074312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343607+0000","last_change":"2024-09-19T08:37:17.353588+0000","last_active":"2024-09-19T08:37:18.343607+0000","last_peered":"2024-09-19T08:37:18.343607+0000","last_clean":"2024-09-19T08:37:18.343607+0000","last_became_active":"2024-09-19T08:37:17.353202+0000","last_became_peered":"2024-09-19T08:37:17.353202+0000","last_unstale":"2024-09-19T08:37:18.343607+0000","last_undegraded":"2024-09-19T08:37:18.343607+0000","last_fullsized":"2024-09-19T08:37:18.343607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:56.423064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343044+0000","last_change":"2024-09-19T08:37:13.310656+0000","last_active":"2024-09-19T08:37:18.343044+0000","last_peered":"2024-09-19T08:37:18.343044+0000","last_clean":"2024-09-19T08:37:18.343044+0000","last_became_active":"2024-09-19T08:37:13.310365+0000","last_became_peered":"2024-09-19T08:37:13.310365+0000","last_unstale":"2024-09-19T08:37:18.343044+0000","last_undegraded":"2024-09-19T08:37:18.343044+0000","last_fullsized":"2024-09-19T08:37:18.343044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:48:56.646247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341695+0000","last_change":"2024-09-19T08:37:12.316198+0000","last_active":"2024-09-19T08:37:18.341695+0000","last_peered":"2024-09-19T08:37:18.341695+0000","last_clean":"2024-09-19T08:37:18.341695+0000","last_became_active":"2024-09-19T08:37:12.315954+0000","last_became_peered":"2024-09-19T08:37:12.315954+0000","last_unstale":"2024-09-19T08:37:18.341695+0000","last_undegraded":"2024-09-19T08:37:18.341695+0000","last_fullsized":"2024-09-19T08:37:18.341695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:04.303217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342109+0000","last_change":"2024-09-19T08:37:17.354035+0000","last_active":"2024-09-19T08:37:18.342109+0000","last_peered":"2024-09-19T08:37:18.342109+0000","last_clean":"2024-09-19T08:37:18.342109+0000","last_became_active":"2024-09-19T08:37:17.353669+0000","last_became_peered":"2024-09-19T08:37:17.353669+0000","last_unstale":"2024-09-19T08:37:18.342109+0000","last_undegraded":"2024-09-19T08:37:18.342109+0000","last_fullsized":"2024-09-19T08:37:18.342109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:12.322596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582389+0000","last_change":"2024-09-19T08:37:13.327070+0000","last_active":"2024-09-19T08:37:19.582389+0000","last_peered":"2024-09-19T08:37:19.582389+0000","last_clean":"2024-09-19T08:37:19.582389+0000","last_became_active":"2024-09-19T08:37:13.326721+0000","last_became_peered":"2024-09-19T08:37:13.326721+0000","last_unstale":"2024-09-19T08:37:19.582389+0000","last_undegraded":"2024-09-19T08:37:19.582389+0000","last_fullsized":"2024-09-19T08:37:19.582389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:57.125390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.549850+0000","last_change":"2024-09-19T08:37:12.320362+0000","last_active":"2024-09-19T08:37:19.549850+0000","last_peered":"2024-09-19T08:37:19.549850+0000","last_clean":"2024-09-19T08:37:19.549850+0000","last_became_active":"2024-09-19T08:37:12.320047+0000","last_became_peered":"2024-09-19T08:37:12.320047+0000","last_unstale":"2024-09-19T08:37:19.549850+0000","last_undegraded":"2024-09-19T08:37:19.549850+0000","last_fullsized":"2024-09-19T08:37:19.549850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:57.623546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341855+0000","last_change":"2024-09-19T08:37:12.326611+0000","last_active":"2024-09-19T08:37:18.341855+0000","last_peered":"2024-09-19T08:37:18.341855+0000","last_clean":"2024-09-19T08:37:18.341855+0000","last_became_active":"2024-09-19T08:37:12.326341+0000","last_became_peered":"2024-09-19T08:37:12.326341+0000","last_unstale":"2024-09-19T08:37:18.341855+0000","last_undegraded":"2024-09-19T08:37:18.341855+0000","last_fullsized":"2024-09-19T08:37:18.341855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:54.220657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343192+0000","last_change":"2024-09-19T08:37:13.315454+0000","last_active":"2024-09-19T08:37:18.343192+0000","last_peered":"2024-09-19T08:37:18.343192+0000","last_clean":"2024-09-19T08:37:18.343192+0000","last_became_active":"2024-09-19T08:37:13.315193+0000","last_became_peered":"2024-09-19T08:37:13.315193+0000","last_unstale":"2024-09-19T08:37:18.343192+0000","last_undegraded":"2024-09-19T08:37:18.343192+0000","last_fullsized":"2024-09-19T08:37:18.343192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:02.012602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343557+0000","last_change":"2024-09-19T08:37:17.348944+0000","last_active":"2024-09-19T08:37:18.343557+0000","last_peered":"2024-09-19T08:37:18.343557+0000","last_clean":"2024-09-19T08:37:18.343557+0000","last_became_active":"2024-09-19T08:37:17.348484+0000","last_became_peered":"2024-09-19T08:37:17.348484+0000","last_unstale":"2024-09-19T08:37:18.343557+0000","last_undegraded":"2024-09-19T08:37:18.343557+0000","last_fullsized":"2024-09-19T08:37:18.343557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:28.217244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582715+0000","last_change":"2024-09-19T08:37:12.323262+0000","last_active":"2024-09-19T08:37:19.582715+0000","last_peered":"2024-09-19T08:37:19.582715+0000","last_clean":"2024-09-19T08:37:19.582715+0000","last_became_active":"2024-09-19T08:37:12.322964+0000","last_became_peered":"2024-09-19T08:37:12.322964+0000","last_unstale":"2024-09-19T08:37:19.582715+0000","last_undegraded":"2024-09-19T08:37:19.582715+0000","last_fullsized":"2024-09-19T08:37:19.582715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:32.812065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773888+0000","last_change":"2024-09-19T08:37:13.327280+0000","last_active":"2024-09-19T08:37:19.773888+0000","last_peered":"2024-09-19T08:37:19.773888+0000","last_clean":"2024-09-19T08:37:19.773888+0000","last_became_active":"2024-09-19T08:37:13.326915+0000","last_became_peered":"2024-09-19T08:37:13.326915+0000","last_unstale":"2024-09-19T08:37:19.773888+0000","last_undegraded":"2024-09-19T08:37:19.773888+0000","last_fullsized":"2024-09-19T08:37:19.773888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:56.050383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673780+0000","last_change":"2024-09-19T08:37:17.363011+0000","last_active":"2024-09-19T08:37:18.673780+0000","last_peered":"2024-09-19T08:37:18.673780+0000","last_clean":"2024-09-19T08:37:18.673780+0000","last_became_active":"2024-09-19T08:37:17.362538+0000","last_became_peered":"2024-09-19T08:37:17.362538+0000","last_unstale":"2024-09-19T08:37:18.673780+0000","last_undegraded":"2024-09-19T08:37:18.673780+0000","last_fullsized":"2024-09-19T08:37:18.673780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:29.539457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773951+0000","last_change":"2024-09-19T08:37:13.315209+0000","last_active":"2024-09-19T08:37:19.773951+0000","last_peered":"2024-09-19T08:37:19.773951+0000","last_clean":"2024-09-19T08:37:19.773951+0000","last_became_active":"2024-09-19T08:37:13.314934+0000","last_became_peered":"2024-09-19T08:37:13.314934+0000","last_unstale":"2024-09-19T08:37:19.773951+0000","last_undegraded":"2024-09-19T08:37:19.773951+0000","last_fullsized":"2024-09-19T08:37:19.773951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:44.818129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673338+0000","last_change":"2024-09-19T08:37:13.329355+0000","last_active":"2024-09-19T08:37:18.673338+0000","last_peered":"2024-09-19T08:37:18.673338+0000","last_clean":"2024-09-19T08:37:18.673338+0000","last_became_active":"2024-09-19T08:37:13.327464+0000","last_became_peered":"2024-09-19T08:37:13.327464+0000","last_unstale":"2024-09-19T08:37:18.673338+0000","last_undegraded":"2024-09-19T08:37:18.673338+0000","last_fullsized":"2024-09-19T08:37:18.673338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:44.058583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341765+0000","last_change":"2024-09-19T08:37:13.326479+0000","last_active":"2024-09-19T08:37:18.341765+0000","last_peered":"2024-09-19T08:37:18.341765+0000","last_clean":"2024-09-19T08:37:18.341765+0000","last_became_active":"2024-09-19T08:37:13.326229+0000","last_became_peered":"2024-09-19T08:37:13.326229+0000","last_unstale":"2024-09-19T08:37:18.341765+0000","last_undegraded":"2024-09-19T08:37:18.341765+0000","last_fullsized":"2024-09-19T08:37:18.341765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:24.186202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582555+0000","last_change":"2024-09-19T08:37:13.327921+0000","last_active":"2024-09-19T08:37:19.582555+0000","last_peered":"2024-09-19T08:37:19.582555+0000","last_clean":"2024-09-19T08:37:19.582555+0000","last_became_active":"2024-09-19T08:37:13.327515+0000","last_became_peered":"2024-09-19T08:37:13.327515+0000","last_unstale":"2024-09-19T08:37:19.582555+0000","last_undegraded":"2024-09-19T08:37:19.582555+0000","last_fullsized":"2024-09-19T08:37:19.582555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:21.343680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550330+0000","last_change":"2024-09-19T08:37:13.328457+0000","last_active":"2024-09-19T08:37:19.550330+0000","last_peered":"2024-09-19T08:37:19.550330+0000","last_clean":"2024-09-19T08:37:19.550330+0000","last_became_active":"2024-09-19T08:37:13.328201+0000","last_became_peered":"2024-09-19T08:37:13.328201+0000","last_unstale":"2024-09-19T08:37:19.550330+0000","last_undegraded":"2024-09-19T08:37:19.550330+0000","last_fullsized":"2024-09-19T08:37:19.550330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:02.904237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550219+0000","last_change":"2024-09-19T08:37:13.323713+0000","last_active":"2024-09-19T08:37:19.550219+0000","last_peered":"2024-09-19T08:37:19.550219+0000","last_clean":"2024-09-19T08:37:19.550219+0000","last_became_active":"2024-09-19T08:37:13.323292+0000","last_became_peered":"2024-09-19T08:37:13.323292+0000","last_unstale":"2024-09-19T08:37:19.550219+0000","last_undegraded":"2024-09-19T08:37:19.550219+0000","last_fullsized":"2024-09-19T08:37:19.550219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:48:56.646247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774671+0000","last_change":"2024-09-19T08:37:13.324782+0000","last_active":"2024-09-19T08:37:19.774671+0000","last_peered":"2024-09-19T08:37:19.774671+0000","last_clean":"2024-09-19T08:37:19.774671+0000","last_became_active":"2024-09-19T08:37:13.324279+0000","last_became_peered":"2024-09-19T08:37:13.324279+0000","last_unstale":"2024-09-19T08:37:19.774671+0000","last_undegraded":"2024-09-19T08:37:19.774671+0000","last_fullsized":"2024-09-19T08:37:19.774671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:34.474672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582804+0000","last_change":"2024-09-19T08:37:13.331655+0000","last_active":"2024-09-19T08:37:19.582804+0000","last_peered":"2024-09-19T08:37:19.582804+0000","last_clean":"2024-09-19T08:37:19.582804+0000","last_became_active":"2024-09-19T08:37:13.331359+0000","last_became_peered":"2024-09-19T08:37:13.331359+0000","last_unstale":"2024-09-19T08:37:19.582804+0000","last_undegraded":"2024-09-19T08:37:19.582804+0000","last_fullsized":"2024-09-19T08:37:19.582804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:50.533572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341602+0000","last_change":"2024-09-19T08:37:13.328905+0000","last_active":"2024-09-19T08:37:18.341602+0000","last_peered":"2024-09-19T08:37:18.341602+0000","last_clean":"2024-09-19T08:37:18.341602+0000","last_became_active":"2024-09-19T08:37:13.328643+0000","last_became_peered":"2024-09-19T08:37:13.328643+0000","last_unstale":"2024-09-19T08:37:18.341602+0000","last_undegraded":"2024-09-19T08:37:18.341602+0000","last_fullsized":"2024-09-19T08:37:18.341602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:26.402913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582337+0000","last_change":"2024-09-19T08:37:13.325377+0000","last_active":"2024-09-19T08:37:19.582337+0000","last_peered":"2024-09-19T08:37:19.582337+0000","last_clean":"2024-09-19T08:37:19.582337+0000","last_became_active":"2024-09-19T08:37:13.325101+0000","last_became_peered":"2024-09-19T08:37:13.325101+0000","last_unstale":"2024-09-19T08:37:19.582337+0000","last_undegraded":"2024-09-19T08:37:19.582337+0000","last_fullsized":"2024-09-19T08:37:19.582337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:02.012602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773794+0000","last_change":"2024-09-19T08:37:13.313455+0000","last_active":"2024-09-19T08:37:19.773794+0000","last_peered":"2024-09-19T08:37:19.773794+0000","last_clean":"2024-09-19T08:37:19.773794+0000","last_became_active":"2024-09-19T08:37:13.313182+0000","last_became_peered":"2024-09-19T08:37:13.313182+0000","last_unstale":"2024-09-19T08:37:19.773794+0000","last_undegraded":"2024-09-19T08:37:19.773794+0000","last_fullsized":"2024-09-19T08:37:19.773794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:44.818129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343055+0000","last_change":"2024-09-19T08:37:13.314765+0000","last_active":"2024-09-19T08:37:18.343055+0000","last_peered":"2024-09-19T08:37:18.343055+0000","last_clean":"2024-09-19T08:37:18.343055+0000","last_became_active":"2024-09-19T08:37:13.314484+0000","last_became_peered":"2024-09-19T08:37:13.314484+0000","last_unstale":"2024-09-19T08:37:18.343055+0000","last_undegraded":"2024-09-19T08:37:18.343055+0000","last_fullsized":"2024-09-19T08:37:18.343055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:28.398584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775044+0000","last_change":"2024-09-19T08:37:13.321255+0000","last_active":"2024-09-19T08:37:19.775044+0000","last_peered":"2024-09-19T08:37:19.775044+0000","last_clean":"2024-09-19T08:37:19.775044+0000","last_became_active":"2024-09-19T08:37:13.320944+0000","last_became_peered":"2024-09-19T08:37:13.320944+0000","last_unstale":"2024-09-19T08:37:19.775044+0000","last_undegraded":"2024-09-19T08:37:19.775044+0000","last_fullsized":"2024-09-19T08:37:19.775044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:11.464991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342493+0000","last_change":"2024-09-19T08:37:13.321006+0000","last_active":"2024-09-19T08:37:18.342493+0000","last_peered":"2024-09-19T08:37:18.342493+0000","last_clean":"2024-09-19T08:37:18.342493+0000","last_became_active":"2024-09-19T08:37:13.320729+0000","last_became_peered":"2024-09-19T08:37:13.320729+0000","last_unstale":"2024-09-19T08:37:18.342493+0000","last_undegraded":"2024-09-19T08:37:18.342493+0000","last_fullsized":"2024-09-19T08:37:18.342493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:46.446118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673984+0000","last_change":"2024-09-19T08:37:13.326249+0000","last_active":"2024-09-19T08:37:18.673984+0000","last_peered":"2024-09-19T08:37:18.673984+0000","last_clean":"2024-09-19T08:37:18.673984+0000","last_became_active":"2024-09-19T08:37:13.325965+0000","last_became_peered":"2024-09-19T08:37:13.325965+0000","last_unstale":"2024-09-19T08:37:18.673984+0000","last_undegraded":"2024-09-19T08:37:18.673984+0000","last_fullsized":"2024-09-19T08:37:18.673984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:11.539214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342514+0000","last_change":"2024-09-19T08:37:13.325289+0000","last_active":"2024-09-19T08:37:18.342514+0000","last_peered":"2024-09-19T08:37:18.342514+0000","last_clean":"2024-09-19T08:37:18.342514+0000","last_became_active":"2024-09-19T08:37:13.322947+0000","last_became_peered":"2024-09-19T08:37:13.322947+0000","last_unstale":"2024-09-19T08:37:18.342514+0000","last_undegraded":"2024-09-19T08:37:18.342514+0000","last_fullsized":"2024-09-19T08:37:18.342514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:34.328972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341594+0000","last_change":"2024-09-19T08:37:13.323040+0000","last_active":"2024-09-19T08:37:18.341594+0000","last_peered":"2024-09-19T08:37:18.341594+0000","last_clean":"2024-09-19T08:37:18.341594+0000","last_became_active":"2024-09-19T08:37:13.322427+0000","last_became_peered":"2024-09-19T08:37:13.322427+0000","last_unstale":"2024-09-19T08:37:18.341594+0000","last_undegraded":"2024-09-19T08:37:18.341594+0000","last_fullsized":"2024-09-19T08:37:18.341594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:37.846160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582190+0000","last_change":"2024-09-19T08:37:13.330628+0000","last_active":"2024-09-19T08:37:19.582190+0000","last_peered":"2024-09-19T08:37:19.582190+0000","last_clean":"2024-09-19T08:37:19.582190+0000","last_became_active":"2024-09-19T08:37:13.330355+0000","last_became_peered":"2024-09-19T08:37:13.330355+0000","last_unstale":"2024-09-19T08:37:19.582190+0000","last_undegraded":"2024-09-19T08:37:19.582190+0000","last_fullsized":"2024-09-19T08:37:19.582190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:28.398584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550079+0000","last_change":"2024-09-19T08:37:13.322548+0000","last_active":"2024-09-19T08:37:19.550079+0000","last_peered":"2024-09-19T08:37:19.550079+0000","last_clean":"2024-09-19T08:37:19.550079+0000","last_became_active":"2024-09-19T08:37:13.322265+0000","last_became_peered":"2024-09-19T08:37:13.322265+0000","last_unstale":"2024-09-19T08:37:19.550079+0000","last_undegraded":"2024-09-19T08:37:19.550079+0000","last_fullsized":"2024-09-19T08:37:19.550079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:34.474672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550129+0000","last_change":"2024-09-19T08:37:13.329206+0000","last_active":"2024-09-19T08:37:19.550129+0000","last_peered":"2024-09-19T08:37:19.550129+0000","last_clean":"2024-09-19T08:37:19.550129+0000","last_became_active":"2024-09-19T08:37:13.328945+0000","last_became_peered":"2024-09-19T08:37:13.328945+0000","last_unstale":"2024-09-19T08:37:19.550129+0000","last_undegraded":"2024-09-19T08:37:19.550129+0000","last_fullsized":"2024-09-19T08:37:19.550129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:45.449737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774990+0000","last_change":"2024-09-19T08:37:13.321724+0000","last_active":"2024-09-19T08:37:19.774990+0000","last_peered":"2024-09-19T08:37:19.774990+0000","last_clean":"2024-09-19T08:37:19.774990+0000","last_became_active":"2024-09-19T08:37:13.321487+0000","last_became_peered":"2024-09-19T08:37:13.321487+0000","last_unstale":"2024-09-19T08:37:19.774990+0000","last_undegraded":"2024-09-19T08:37:19.774990+0000","last_fullsized":"2024-09-19T08:37:19.774990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:57.125390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774604+0000","last_change":"2024-09-19T08:37:13.326611+0000","last_active":"2024-09-19T08:37:19.774604+0000","last_peered":"2024-09-19T08:37:19.774604+0000","last_clean":"2024-09-19T08:37:19.774604+0000","last_became_active":"2024-09-19T08:37:13.326227+0000","last_became_peered":"2024-09-19T08:37:13.326227+0000","last_unstale":"2024-09-19T08:37:19.774604+0000","last_undegraded":"2024-09-19T08:37:19.774604+0000","last_fullsized":"2024-09-19T08:37:19.774604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:50.533572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774816+0000","last_change":"2024-09-19T08:37:13.322510+0000","last_active":"2024-09-19T08:37:19.774816+0000","last_peered":"2024-09-19T08:37:19.774816+0000","last_clean":"2024-09-19T08:37:19.774816+0000","last_became_active":"2024-09-19T08:37:13.322203+0000","last_became_peered":"2024-09-19T08:37:13.322203+0000","last_unstale":"2024-09-19T08:37:19.774816+0000","last_undegraded":"2024-09-19T08:37:19.774816+0000","last_fullsized":"2024-09-19T08:37:19.774816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:21.343680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774839+0000","last_change":"2024-09-19T08:37:13.318910+0000","last_active":"2024-09-19T08:37:19.774839+0000","last_peered":"2024-09-19T08:37:19.774839+0000","last_clean":"2024-09-19T08:37:19.774839+0000","last_became_active":"2024-09-19T08:37:13.318573+0000","last_became_peered":"2024-09-19T08:37:13.318573+0000","last_unstale":"2024-09-19T08:37:19.774839+0000","last_undegraded":"2024-09-19T08:37:19.774839+0000","last_fullsized":"2024-09-19T08:37:19.774839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:23.965109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582167+0000","last_change":"2024-09-19T08:37:13.331372+0000","last_active":"2024-09-19T08:37:19.582167+0000","last_peered":"2024-09-19T08:37:19.582167+0000","last_clean":"2024-09-19T08:37:19.582167+0000","last_became_active":"2024-09-19T08:37:13.330730+0000","last_became_peered":"2024-09-19T08:37:13.330730+0000","last_unstale":"2024-09-19T08:37:19.582167+0000","last_undegraded":"2024-09-19T08:37:19.582167+0000","last_fullsized":"2024-09-19T08:37:19.582167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:34.222102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775688+0000","last_change":"2024-09-19T08:37:13.324940+0000","last_active":"2024-09-19T08:37:19.775688+0000","last_peered":"2024-09-19T08:37:19.775688+0000","last_clean":"2024-09-19T08:37:19.775688+0000","last_became_active":"2024-09-19T08:37:13.324666+0000","last_became_peered":"2024-09-19T08:37:13.324666+0000","last_unstale":"2024-09-19T08:37:19.775688+0000","last_undegraded":"2024-09-19T08:37:19.775688+0000","last_fullsized":"2024-09-19T08:37:19.775688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:31.517337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774270+0000","last_change":"2024-09-19T08:37:13.319325+0000","last_active":"2024-09-19T08:37:19.774270+0000","last_peered":"2024-09-19T08:37:19.774270+0000","last_clean":"2024-09-19T08:37:19.774270+0000","last_became_active":"2024-09-19T08:37:13.318999+0000","last_became_peered":"2024-09-19T08:37:13.318999+0000","last_unstale":"2024-09-19T08:37:19.774270+0000","last_undegraded":"2024-09-19T08:37:19.774270+0000","last_fullsized":"2024-09-19T08:37:19.774270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:56.050383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774520+0000","last_change":"2024-09-19T08:37:13.328264+0000","last_active":"2024-09-19T08:37:19.774520+0000","last_peered":"2024-09-19T08:37:19.774520+0000","last_clean":"2024-09-19T08:37:19.774520+0000","last_became_active":"2024-09-19T08:37:13.327999+0000","last_became_peered":"2024-09-19T08:37:13.327999+0000","last_unstale":"2024-09-19T08:37:19.774520+0000","last_undegraded":"2024-09-19T08:37:19.774520+0000","last_fullsized":"2024-09-19T08:37:19.774520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:34.222102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773805+0000","last_change":"2024-09-19T08:37:13.315873+0000","last_active":"2024-09-19T08:37:19.773805+0000","last_peered":"2024-09-19T08:37:19.773805+0000","last_clean":"2024-09-19T08:37:19.773805+0000","last_became_active":"2024-09-19T08:37:13.315587+0000","last_became_peered":"2024-09-19T08:37:13.315587+0000","last_unstale":"2024-09-19T08:37:19.773805+0000","last_undegraded":"2024-09-19T08:37:19.773805+0000","last_fullsized":"2024-09-19T08:37:19.773805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:18.493336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582687+0000","last_change":"2024-09-19T08:37:13.329601+0000","last_active":"2024-09-19T08:37:19.582687+0000","last_peered":"2024-09-19T08:37:19.582687+0000","last_clean":"2024-09-19T08:37:19.582687+0000","last_became_active":"2024-09-19T08:37:13.328264+0000","last_became_peered":"2024-09-19T08:37:13.328264+0000","last_unstale":"2024-09-19T08:37:19.582687+0000","last_undegraded":"2024-09-19T08:37:19.582687+0000","last_fullsized":"2024-09-19T08:37:19.582687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:26.402913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582754+0000","last_change":"2024-09-19T08:37:13.327064+0000","last_active":"2024-09-19T08:37:19.582754+0000","last_peered":"2024-09-19T08:37:19.582754+0000","last_clean":"2024-09-19T08:37:19.582754+0000","last_became_active":"2024-09-19T08:37:13.326770+0000","last_became_peered":"2024-09-19T08:37:13.326770+0000","last_unstale":"2024-09-19T08:37:19.582754+0000","last_undegraded":"2024-09-19T08:37:19.582754+0000","last_fullsized":"2024-09-19T08:37:19.582754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:25.894361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775126+0000","last_change":"2024-09-19T08:37:13.330656+0000","last_active":"2024-09-19T08:37:19.775126+0000","last_peered":"2024-09-19T08:37:19.775126+0000","last_clean":"2024-09-19T08:37:19.775126+0000","last_became_active":"2024-09-19T08:37:13.330120+0000","last_became_peered":"2024-09-19T08:37:13.330120+0000","last_unstale":"2024-09-19T08:37:19.775126+0000","last_undegraded":"2024-09-19T08:37:19.775126+0000","last_fullsized":"2024-09-19T08:37:19.775126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:51.787710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":105614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":696074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":696052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":105738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:37:37.558 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:37:37.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.691+0000 7f79c95a6640 1 Processor -- start 2024-09-19T08:37:37.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.691+0000 7f79c95a6640 1 -- start start 2024-09-19T08:37:37.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.692+0000 7f79c95a6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c409b100 0x7f79c40d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:37.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.692+0000 7f79c95a6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79c40cd030 con 0x7f79c415c3c0 2024-09-19T08:37:37.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.692+0000 7f79c95a6640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79c40cd310 con 0x7f79c40d0790 2024-09-19T08:37:37.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.692+0000 7f79c95a6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f79c40cd5f0 con 0x7f79c409b100 2024-09-19T08:37:37.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.692+0000 7f79c2ffd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f79c415c3c0 0x7f79c40cddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:54910/0 (socket says 172.21.15.117:54910) 2024-09-19T08:37:37.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.692+0000 7f79c2ffd640 1 -- 172.21.15.117:0/2347445366 learned_addr learned my addr 172.21.15.117:0/2347445366 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:37.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c1ffb640 1 -- 172.21.15.117:0/2347445366 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2005486132 0 0) 0x7f79c40cd030 con 0x7f79c415c3c0 2024-09-19T08:37:37.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c1ffb640 1 -- 172.21.15.117:0/2347445366 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79b0003520 con 0x7f79c415c3c0 2024-09-19T08:37:37.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c37fe640 1 --2- 172.21.15.117:0/2347445366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c409b100 0x7f79c40d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:37.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c1ffb640 1 -- 172.21.15.117:0/2347445366 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 365992353 0 0) 0x7f79b0003520 con 0x7f79c415c3c0 2024-09-19T08:37:37.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c1ffb640 1 -- 172.21.15.117:0/2347445366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c409b100 msgr2=0x7f79c40d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:37.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c1ffb640 1 --2- 172.21.15.117:0/2347445366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c409b100 0x7f79c40d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c1ffb640 1 -- 172.21.15.117:0/2347445366 >> v1:172.21.15.146:6789/0 conn(0x7f79c40d0790 legacy=0x7f79c409a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c1ffb640 1 -- 172.21.15.117:0/2347445366 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c40cd8d0 con 0x7f79c415c3c0 2024-09-19T08:37:37.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c1ffb640 1 -- 172.21.15.117:0/2347445366 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f79b40019f0 con 0x7f79c415c3c0 2024-09-19T08:37:37.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c1ffb640 1 -- 172.21.15.117:0/2347445366 >> v1:172.21.15.117:6789/0 conn(0x7f79c415c3c0 legacy=0x7f79c40cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c1ffb640 1 --2- 172.21.15.117:0/2347445366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79b00039e0 0x7f79b0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:37.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c1ffb640 1 --2- 172.21.15.117:0/2347445366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c409b100 0x7f79b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:37.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c1ffb640 1 --2- 172.21.15.117:0/2347445366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79b0004d40 0x7f79b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:37.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c1ffb640 1 -- 172.21.15.117:0/2347445366 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f79c40cd5f0 con 0x7f79b00039e0 2024-09-19T08:37:37.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c1ffb640 1 -- 172.21.15.117:0/2347445366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f79b000baa0 con 0x7f79b0004d40 2024-09-19T08:37:37.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c1ffb640 1 -- 172.21.15.117:0/2347445366 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f79b000bca0 con 0x7f79c409b100 2024-09-19T08:37:37.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c2ffd640 1 --2- 172.21.15.117:0/2347445366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79b00039e0 0x7f79b0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:37.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c27fc640 1 --2- 172.21.15.117:0/2347445366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c409b100 0x7f79b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:37.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c37fe640 1 --2- 172.21.15.117:0/2347445366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79b0004d40 0x7f79b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:37.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c2ffd640 1 -- 172.21.15.117:0/2347445366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c409b100 msgr2=0x7f79b0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:37.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c2ffd640 1 --2- 172.21.15.117:0/2347445366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c409b100 0x7f79b0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c2ffd640 1 -- 172.21.15.117:0/2347445366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79b0004d40 msgr2=0x7f79b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:37.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c2ffd640 1 --2- 172.21.15.117:0/2347445366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79b0004d40 0x7f79b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.693+0000 7f79c2ffd640 1 -- 172.21.15.117:0/2347445366 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b0003520 con 0x7f79b00039e0 2024-09-19T08:37:37.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.694+0000 7f79c2ffd640 1 --2- 172.21.15.117:0/2347445366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79b00039e0 0x7f79b0003e00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f79b4002230 tx=0x7f79b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2f1c8a6d3cf24c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:37.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.694+0000 7f79c1ffb640 1 -- 172.21.15.117:0/2347445366 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b400a4a0 con 0x7f79b00039e0 2024-09-19T08:37:37.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.694+0000 7f79c1ffb640 1 -- 172.21.15.117:0/2347445366 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b402f070 con 0x7f79b00039e0 2024-09-19T08:37:37.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.694+0000 7f79c1ffb640 1 -- 172.21.15.117:0/2347445366 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b402bcb0 con 0x7f79b00039e0 2024-09-19T08:37:37.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.695+0000 7f79c95a6640 1 -- 172.21.15.117:0/2347445366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79b00039e0 msgr2=0x7f79b0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.695+0000 7f79c95a6640 1 --2- 172.21.15.117:0/2347445366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79b00039e0 0x7f79b0003e00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f79b4002230 tx=0x7f79b0005830 comp rx=0 tx=0).stop 2024-09-19T08:37:37.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.695+0000 7f79c37fe640 1 -- 172.21.15.117:0/2347445366 reap_dead start 2024-09-19T08:37:37.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.695+0000 7f79c95a6640 1 -- 172.21.15.117:0/2347445366 shutdown_connections 2024-09-19T08:37:37.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.695+0000 7f79c95a6640 1 -- 172.21.15.117:0/2347445366 >> 172.21.15.117:0/2347445366 conn(0x7f79c40b3ca0 msgr2=0x7f79c40b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:37.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.695+0000 7f79c95a6640 1 -- 172.21.15.117:0/2347445366 shutdown_connections 2024-09-19T08:37:37.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.695+0000 7f79c95a6640 1 -- 172.21.15.117:0/2347445366 wait complete. 2024-09-19T08:37:37.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.696+0000 7f79c95a6640 1 Processor -- start 2024-09-19T08:37:37.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.696+0000 7f79c95a6640 1 -- start start 2024-09-19T08:37:37.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.697+0000 7f79c95a6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79b00039e0 0x7f79c4157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:37.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.697+0000 7f79c95a6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79c40b6160 0x7f79c40b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:37.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.697+0000 7f79c95a6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c4155040 0x7f79c41554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:37.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.697+0000 7f79c95a6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f79c40ccdd0 con 0x7f79b00039e0 2024-09-19T08:37:37.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.697+0000 7f79c95a6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f79c40ccc50 con 0x7f79c40b6160 2024-09-19T08:37:37.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.697+0000 7f79c95a6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f79c40d0c20 con 0x7f79c4155040 2024-09-19T08:37:37.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.697+0000 7f79c2ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79b00039e0 0x7f79c4157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:37.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.697+0000 7f79c2ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79b00039e0 0x7f79c4157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34944/0 (socket says 172.21.15.117:34944) 2024-09-19T08:37:37.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.697+0000 7f79c2ffd640 1 -- 172.21.15.117:0/1289471716 learned_addr learned my addr 172.21.15.117:0/1289471716 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:37.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.697+0000 7f79c37fe640 1 --2- 172.21.15.117:0/1289471716 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c4155040 0x7f79c41554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:37.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.697+0000 7f79c27fc640 1 --2- 172.21.15.117:0/1289471716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79c40b6160 0x7f79c40b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:37.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.697+0000 7f79c2ffd640 1 -- 172.21.15.117:0/1289471716 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c4155040 msgr2=0x7f79c41554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.697+0000 7f79c2ffd640 1 --2- 172.21.15.117:0/1289471716 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c4155040 0x7f79c41554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.697+0000 7f79c2ffd640 1 -- 172.21.15.117:0/1289471716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79c40b6160 msgr2=0x7f79c40b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.697+0000 7f79c2ffd640 1 --2- 172.21.15.117:0/1289471716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79c40b6160 0x7f79c40b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.697+0000 7f79c2ffd640 1 -- 172.21.15.117:0/1289471716 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c4157720 con 0x7f79b00039e0 2024-09-19T08:37:37.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.697+0000 7f79c2ffd640 1 --2- 172.21.15.117:0/1289471716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79b00039e0 0x7f79c4157ee0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f79b400a910 tx=0x7f79b4001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:37.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.698+0000 7f79bb7fe640 1 -- 172.21.15.117:0/1289471716 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b4034670 con 0x7f79b00039e0 2024-09-19T08:37:37.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.698+0000 7f79bb7fe640 1 -- 172.21.15.117:0/1289471716 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b4044070 con 0x7f79b00039e0 2024-09-19T08:37:37.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.698+0000 7f79c95a6640 1 -- 172.21.15.117:0/1289471716 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c40b6cd0 con 0x7f79b00039e0 2024-09-19T08:37:37.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.698+0000 7f79bb7fe640 1 -- 172.21.15.117:0/1289471716 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b4034a70 con 0x7f79b00039e0 2024-09-19T08:37:37.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.698+0000 7f79c95a6640 1 -- 172.21.15.117:0/1289471716 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c40b7290 con 0x7f79b00039e0 2024-09-19T08:37:37.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.699+0000 7f79c95a6640 1 -- 172.21.15.117:0/1289471716 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79c40cd030 con 0x7f79b00039e0 2024-09-19T08:37:37.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.699+0000 7f79bb7fe640 1 -- 172.21.15.117:0/1289471716 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f79b4034c10 con 0x7f79b00039e0 2024-09-19T08:37:37.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.700+0000 7f79bb7fe640 1 --2- 172.21.15.117:0/1289471716 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f79a406c2b0 0x7f79a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:37.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.700+0000 7f79bb7fe640 1 -- 172.21.15.117:0/1289471716 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f79b40abe40 con 0x7f79b00039e0 2024-09-19T08:37:37.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.700+0000 7f79c27fc640 1 --2- 172.21.15.117:0/1289471716 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f79a406c2b0 0x7f79a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:37.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.700+0000 7f79c27fc640 1 --2- 172.21.15.117:0/1289471716 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f79a406c2b0 0x7f79a406e770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f79c40b4bb0 tx=0x7f79ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:37.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.704+0000 7f79bb7fe640 1 -- 172.21.15.117:0/1289471716 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f79b407a3c0 con 0x7f79b00039e0 2024-09-19T08:37:37.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.866+0000 7f79c95a6640 1 -- 172.21.15.117:0/1289471716 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f79c4154e00 con 0x7f79a406c2b0 2024-09-19T08:37:37.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.874+0000 7f79bb7fe640 1 -- 172.21.15.117:0/1289471716 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332530 (secure 0 0 0) 0x7f79c4154e00 con 0x7f79a406c2b0 2024-09-19T08:37:37.878 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:37.879 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-09-19T08:37:37.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.878+0000 7f79c95a6640 1 -- 172.21.15.117:0/1289471716 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f79a406c2b0 msgr2=0x7f79a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.878+0000 7f79c95a6640 1 --2- 172.21.15.117:0/1289471716 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f79a406c2b0 0x7f79a406e770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f79c40b4bb0 tx=0x7f79ac009040 comp rx=0 tx=0).stop 2024-09-19T08:37:37.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.878+0000 7f79c95a6640 1 -- 172.21.15.117:0/1289471716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79b00039e0 msgr2=0x7f79c4157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:37.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.878+0000 7f79c95a6640 1 --2- 172.21.15.117:0/1289471716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79b00039e0 0x7f79c4157ee0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f79b400a910 tx=0x7f79b4001dc0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.878+0000 7f79c95a6640 1 -- 172.21.15.117:0/1289471716 shutdown_connections 2024-09-19T08:37:37.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.878+0000 7f79c95a6640 1 --2- 172.21.15.117:0/1289471716 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f79a406c2b0 0x7f79a406e770 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.878+0000 7f79c95a6640 1 --2- 172.21.15.117:0/1289471716 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c4155040 0x7f79c41554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.878+0000 7f79c95a6640 1 --2- 172.21.15.117:0/1289471716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79c40b6160 0x7f79c40b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.878+0000 7f79c95a6640 1 --2- 172.21.15.117:0/1289471716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79b00039e0 0x7f79c4157ee0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:37.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.878+0000 7f79c95a6640 1 -- 172.21.15.117:0/1289471716 >> 172.21.15.117:0/1289471716 conn(0x7f79c40b3ca0 msgr2=0x7f79c4070c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:37.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.878+0000 7f79c95a6640 1 -- 172.21.15.117:0/1289471716 shutdown_connections 2024-09-19T08:37:37.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:37.878+0000 7f79c95a6640 1 -- 172.21.15.117:0/1289471716 wait complete. 2024-09-19T08:37:37.889 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-19T08:37:37.852258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3416064,"data_stored":2034932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003545"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343917+0000","last_change":"2024-09-19T08:37:12.321838+0000","last_active":"2024-09-19T08:37:18.343917+0000","last_peered":"2024-09-19T08:37:18.343917+0000","last_clean":"2024-09-19T08:37:18.343917+0000","last_became_active":"2024-09-19T08:37:12.321488+0000","last_became_peered":"2024-09-19T08:37:12.321488+0000","last_unstale":"2024-09-19T08:37:18.343917+0000","last_undegraded":"2024-09-19T08:37:18.343917+0000","last_fullsized":"2024-09-19T08:37:18.343917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:04.303217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582954+0000","last_change":"2024-09-19T08:37:13.326422+0000","last_active":"2024-09-19T08:37:19.582954+0000","last_peered":"2024-09-19T08:37:19.582954+0000","last_clean":"2024-09-19T08:37:19.582954+0000","last_became_active":"2024-09-19T08:37:13.326165+0000","last_became_peered":"2024-09-19T08:37:13.326165+0000","last_unstale":"2024-09-19T08:37:19.582954+0000","last_undegraded":"2024-09-19T08:37:19.582954+0000","last_fullsized":"2024-09-19T08:37:19.582954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:37.846160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673419+0000","last_change":"2024-09-19T08:37:17.363683+0000","last_active":"2024-09-19T08:37:18.673419+0000","last_peered":"2024-09-19T08:37:18.673419+0000","last_clean":"2024-09-19T08:37:18.673419+0000","last_became_active":"2024-09-19T08:37:17.363290+0000","last_became_peered":"2024-09-19T08:37:17.363290+0000","last_unstale":"2024-09-19T08:37:18.673419+0000","last_undegraded":"2024-09-19T08:37:18.673419+0000","last_fullsized":"2024-09-19T08:37:18.673419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:42.065833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.583087+0000","last_change":"2024-09-19T08:37:12.322967+0000","last_active":"2024-09-19T08:37:19.583087+0000","last_peered":"2024-09-19T08:37:19.583087+0000","last_clean":"2024-09-19T08:37:19.583087+0000","last_became_active":"2024-09-19T08:37:12.322465+0000","last_became_peered":"2024-09-19T08:37:12.322465+0000","last_unstale":"2024-09-19T08:37:19.583087+0000","last_undegraded":"2024-09-19T08:37:19.583087+0000","last_fullsized":"2024-09-19T08:37:19.583087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:12.811398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582952+0000","last_change":"2024-09-19T08:37:13.331535+0000","last_active":"2024-09-19T08:37:19.582952+0000","last_peered":"2024-09-19T08:37:19.582952+0000","last_clean":"2024-09-19T08:37:19.582952+0000","last_became_active":"2024-09-19T08:37:13.331292+0000","last_became_peered":"2024-09-19T08:37:13.331292+0000","last_unstale":"2024-09-19T08:37:19.582952+0000","last_undegraded":"2024-09-19T08:37:19.582952+0000","last_fullsized":"2024-09-19T08:37:19.582952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:51.787710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773777+0000","last_change":"2024-09-19T08:37:17.349230+0000","last_active":"2024-09-19T08:37:19.773777+0000","last_peered":"2024-09-19T08:37:19.773777+0000","last_clean":"2024-09-19T08:37:19.773777+0000","last_became_active":"2024-09-19T08:37:17.348844+0000","last_became_peered":"2024-09-19T08:37:17.348844+0000","last_unstale":"2024-09-19T08:37:19.773777+0000","last_undegraded":"2024-09-19T08:37:19.773777+0000","last_fullsized":"2024-09-19T08:37:19.773777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:54.564614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774843+0000","last_change":"2024-09-19T08:37:12.318109+0000","last_active":"2024-09-19T08:37:19.774843+0000","last_peered":"2024-09-19T08:37:19.774843+0000","last_clean":"2024-09-19T08:37:19.774843+0000","last_became_active":"2024-09-19T08:37:12.316698+0000","last_became_peered":"2024-09-19T08:37:12.316698+0000","last_unstale":"2024-09-19T08:37:19.774843+0000","last_undegraded":"2024-09-19T08:37:19.774843+0000","last_fullsized":"2024-09-19T08:37:19.774843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:04.303217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774313+0000","last_change":"2024-09-19T08:37:13.323402+0000","last_active":"2024-09-19T08:37:19.774313+0000","last_peered":"2024-09-19T08:37:19.774313+0000","last_clean":"2024-09-19T08:37:19.774313+0000","last_became_active":"2024-09-19T08:37:13.322905+0000","last_became_peered":"2024-09-19T08:37:13.322905+0000","last_unstale":"2024-09-19T08:37:19.774313+0000","last_undegraded":"2024-09-19T08:37:19.774313+0000","last_fullsized":"2024-09-19T08:37:19.774313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:18.493336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775330+0000","last_change":"2024-09-19T08:37:17.357692+0000","last_active":"2024-09-19T08:37:19.775330+0000","last_peered":"2024-09-19T08:37:19.775330+0000","last_clean":"2024-09-19T08:37:19.775330+0000","last_became_active":"2024-09-19T08:37:17.357312+0000","last_became_peered":"2024-09-19T08:37:17.357312+0000","last_unstale":"2024-09-19T08:37:19.775330+0000","last_undegraded":"2024-09-19T08:37:19.775330+0000","last_fullsized":"2024-09-19T08:37:19.775330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:30.433955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775152+0000","last_change":"2024-09-19T08:37:12.316361+0000","last_active":"2024-09-19T08:37:19.775152+0000","last_peered":"2024-09-19T08:37:19.775152+0000","last_clean":"2024-09-19T08:37:19.775152+0000","last_became_active":"2024-09-19T08:37:12.315959+0000","last_became_peered":"2024-09-19T08:37:12.315959+0000","last_unstale":"2024-09-19T08:37:19.775152+0000","last_undegraded":"2024-09-19T08:37:19.775152+0000","last_fullsized":"2024-09-19T08:37:19.775152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:55.041313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342336+0000","last_change":"2024-09-19T08:37:13.321643+0000","last_active":"2024-09-19T08:37:18.342336+0000","last_peered":"2024-09-19T08:37:18.342336+0000","last_clean":"2024-09-19T08:37:18.342336+0000","last_became_active":"2024-09-19T08:37:13.321386+0000","last_became_peered":"2024-09-19T08:37:13.321386+0000","last_unstale":"2024-09-19T08:37:18.342336+0000","last_undegraded":"2024-09-19T08:37:18.342336+0000","last_fullsized":"2024-09-19T08:37:18.342336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:26:14.554195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774176+0000","last_change":"2024-09-19T08:37:17.353843+0000","last_active":"2024-09-19T08:37:19.774176+0000","last_peered":"2024-09-19T08:37:19.774176+0000","last_clean":"2024-09-19T08:37:19.774176+0000","last_became_active":"2024-09-19T08:37:17.352102+0000","last_became_peered":"2024-09-19T08:37:17.352102+0000","last_unstale":"2024-09-19T08:37:19.774176+0000","last_undegraded":"2024-09-19T08:37:19.774176+0000","last_fullsized":"2024-09-19T08:37:19.774176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:29.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341743+0000","last_change":"2024-09-19T08:37:13.320341+0000","last_active":"2024-09-19T08:37:18.341743+0000","last_peered":"2024-09-19T08:37:18.341743+0000","last_clean":"2024-09-19T08:37:18.341743+0000","last_became_active":"2024-09-19T08:37:13.319040+0000","last_became_peered":"2024-09-19T08:37:13.319040+0000","last_unstale":"2024-09-19T08:37:18.341743+0000","last_undegraded":"2024-09-19T08:37:18.341743+0000","last_fullsized":"2024-09-19T08:37:18.341743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:52.392022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342025+0000","last_change":"2024-09-19T08:37:12.323275+0000","last_active":"2024-09-19T08:37:18.342025+0000","last_peered":"2024-09-19T08:37:18.342025+0000","last_clean":"2024-09-19T08:37:18.342025+0000","last_became_active":"2024-09-19T08:37:12.322994+0000","last_became_peered":"2024-09-19T08:37:12.322994+0000","last_unstale":"2024-09-19T08:37:18.342025+0000","last_undegraded":"2024-09-19T08:37:18.342025+0000","last_fullsized":"2024-09-19T08:37:18.342025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:43.809060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342234+0000","last_change":"2024-09-19T08:37:17.356994+0000","last_active":"2024-09-19T08:37:18.342234+0000","last_peered":"2024-09-19T08:37:18.342234+0000","last_clean":"2024-09-19T08:37:18.342234+0000","last_became_active":"2024-09-19T08:37:17.356598+0000","last_became_peered":"2024-09-19T08:37:17.356598+0000","last_unstale":"2024-09-19T08:37:18.342234+0000","last_undegraded":"2024-09-19T08:37:18.342234+0000","last_fullsized":"2024-09-19T08:37:18.342234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:18.052908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673510+0000","last_change":"2024-09-19T08:37:13.326437+0000","last_active":"2024-09-19T08:37:18.673510+0000","last_peered":"2024-09-19T08:37:18.673510+0000","last_clean":"2024-09-19T08:37:18.673510+0000","last_became_active":"2024-09-19T08:37:13.326165+0000","last_became_peered":"2024-09-19T08:37:13.326165+0000","last_unstale":"2024-09-19T08:37:18.673510+0000","last_undegraded":"2024-09-19T08:37:18.673510+0000","last_fullsized":"2024-09-19T08:37:18.673510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:42.492725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550317+0000","last_change":"2024-09-19T08:37:12.321145+0000","last_active":"2024-09-19T08:37:19.550317+0000","last_peered":"2024-09-19T08:37:19.550317+0000","last_clean":"2024-09-19T08:37:19.550317+0000","last_became_active":"2024-09-19T08:37:12.320846+0000","last_became_peered":"2024-09-19T08:37:12.320846+0000","last_unstale":"2024-09-19T08:37:19.550317+0000","last_undegraded":"2024-09-19T08:37:19.550317+0000","last_fullsized":"2024-09-19T08:37:19.550317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:48.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774766+0000","last_change":"2024-09-19T08:37:17.355922+0000","last_active":"2024-09-19T08:37:19.774766+0000","last_peered":"2024-09-19T08:37:19.774766+0000","last_clean":"2024-09-19T08:37:19.774766+0000","last_became_active":"2024-09-19T08:37:17.355537+0000","last_became_peered":"2024-09-19T08:37:17.355537+0000","last_unstale":"2024-09-19T08:37:19.774766+0000","last_undegraded":"2024-09-19T08:37:19.774766+0000","last_fullsized":"2024-09-19T08:37:19.774766+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:25.565544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342913+0000","last_change":"2024-09-19T08:37:13.317754+0000","last_active":"2024-09-19T08:37:18.342913+0000","last_peered":"2024-09-19T08:37:18.342913+0000","last_clean":"2024-09-19T08:37:18.342913+0000","last_became_active":"2024-09-19T08:37:13.317483+0000","last_became_peered":"2024-09-19T08:37:13.317483+0000","last_unstale":"2024-09-19T08:37:18.342913+0000","last_undegraded":"2024-09-19T08:37:18.342913+0000","last_fullsized":"2024-09-19T08:37:18.342913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:34.222102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343157+0000","last_change":"2024-09-19T08:37:12.319094+0000","last_active":"2024-09-19T08:37:18.343157+0000","last_peered":"2024-09-19T08:37:18.343157+0000","last_clean":"2024-09-19T08:37:18.343157+0000","last_became_active":"2024-09-19T08:37:12.318782+0000","last_became_peered":"2024-09-19T08:37:12.318782+0000","last_unstale":"2024-09-19T08:37:18.343157+0000","last_undegraded":"2024-09-19T08:37:18.343157+0000","last_fullsized":"2024-09-19T08:37:18.343157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:08.631783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.674052+0000","last_change":"2024-09-19T08:37:17.362678+0000","last_active":"2024-09-19T08:37:18.674052+0000","last_peered":"2024-09-19T08:37:18.674052+0000","last_clean":"2024-09-19T08:37:18.674052+0000","last_became_active":"2024-09-19T08:37:17.362281+0000","last_became_peered":"2024-09-19T08:37:17.362281+0000","last_unstale":"2024-09-19T08:37:18.674052+0000","last_undegraded":"2024-09-19T08:37:18.674052+0000","last_fullsized":"2024-09-19T08:37:18.674052+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:37.134018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341605+0000","last_change":"2024-09-19T08:37:13.328741+0000","last_active":"2024-09-19T08:37:18.341605+0000","last_peered":"2024-09-19T08:37:18.341605+0000","last_clean":"2024-09-19T08:37:18.341605+0000","last_became_active":"2024-09-19T08:37:13.328156+0000","last_became_peered":"2024-09-19T08:37:13.328156+0000","last_unstale":"2024-09-19T08:37:18.341605+0000","last_undegraded":"2024-09-19T08:37:18.341605+0000","last_fullsized":"2024-09-19T08:37:18.341605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:21.534501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773822+0000","last_change":"2024-09-19T08:37:12.314762+0000","last_active":"2024-09-19T08:37:19.773822+0000","last_peered":"2024-09-19T08:37:19.773822+0000","last_clean":"2024-09-19T08:37:19.773822+0000","last_became_active":"2024-09-19T08:37:12.314471+0000","last_became_peered":"2024-09-19T08:37:12.314471+0000","last_unstale":"2024-09-19T08:37:19.773822+0000","last_undegraded":"2024-09-19T08:37:19.773822+0000","last_fullsized":"2024-09-19T08:37:19.773822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:08.631783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774584+0000","last_change":"2024-09-19T08:37:17.353677+0000","last_active":"2024-09-19T08:37:19.774584+0000","last_peered":"2024-09-19T08:37:19.774584+0000","last_clean":"2024-09-19T08:37:19.774584+0000","last_became_active":"2024-09-19T08:37:17.353311+0000","last_became_peered":"2024-09-19T08:37:17.353311+0000","last_unstale":"2024-09-19T08:37:19.774584+0000","last_undegraded":"2024-09-19T08:37:19.774584+0000","last_fullsized":"2024-09-19T08:37:19.774584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:55.818752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343663+0000","last_change":"2024-09-19T08:37:13.322046+0000","last_active":"2024-09-19T08:37:18.343663+0000","last_peered":"2024-09-19T08:37:18.343663+0000","last_clean":"2024-09-19T08:37:18.343663+0000","last_became_active":"2024-09-19T08:37:13.321632+0000","last_became_peered":"2024-09-19T08:37:13.321632+0000","last_unstale":"2024-09-19T08:37:18.343663+0000","last_undegraded":"2024-09-19T08:37:18.343663+0000","last_fullsized":"2024-09-19T08:37:18.343663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:31.517337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342528+0000","last_change":"2024-09-19T08:37:12.326667+0000","last_active":"2024-09-19T08:37:18.342528+0000","last_peered":"2024-09-19T08:37:18.342528+0000","last_clean":"2024-09-19T08:37:18.342528+0000","last_became_active":"2024-09-19T08:37:12.326400+0000","last_became_peered":"2024-09-19T08:37:12.326400+0000","last_unstale":"2024-09-19T08:37:18.342528+0000","last_undegraded":"2024-09-19T08:37:18.342528+0000","last_fullsized":"2024-09-19T08:37:18.342528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:17.484267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774094+0000","last_change":"2024-09-19T08:37:17.353015+0000","last_active":"2024-09-19T08:37:19.774094+0000","last_peered":"2024-09-19T08:37:19.774094+0000","last_clean":"2024-09-19T08:37:19.774094+0000","last_became_active":"2024-09-19T08:37:17.352080+0000","last_became_peered":"2024-09-19T08:37:17.352080+0000","last_unstale":"2024-09-19T08:37:19.774094+0000","last_undegraded":"2024-09-19T08:37:19.774094+0000","last_fullsized":"2024-09-19T08:37:19.774094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:25.374722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343778+0000","last_change":"2024-09-19T08:37:13.315155+0000","last_active":"2024-09-19T08:37:18.343778+0000","last_peered":"2024-09-19T08:37:18.343778+0000","last_clean":"2024-09-19T08:37:18.343778+0000","last_became_active":"2024-09-19T08:37:13.314853+0000","last_became_peered":"2024-09-19T08:37:13.314853+0000","last_unstale":"2024-09-19T08:37:18.343778+0000","last_undegraded":"2024-09-19T08:37:18.343778+0000","last_fullsized":"2024-09-19T08:37:18.343778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:57.125390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343814+0000","last_change":"2024-09-19T08:37:12.307577+0000","last_active":"2024-09-19T08:37:18.343814+0000","last_peered":"2024-09-19T08:37:18.343814+0000","last_clean":"2024-09-19T08:37:18.343814+0000","last_became_active":"2024-09-19T08:37:12.307011+0000","last_became_peered":"2024-09-19T08:37:12.307011+0000","last_unstale":"2024-09-19T08:37:18.343814+0000","last_undegraded":"2024-09-19T08:37:18.343814+0000","last_fullsized":"2024-09-19T08:37:18.343814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:12.811398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342993+0000","last_change":"2024-09-19T08:37:17.350495+0000","last_active":"2024-09-19T08:37:18.342993+0000","last_peered":"2024-09-19T08:37:18.342993+0000","last_clean":"2024-09-19T08:37:18.342993+0000","last_became_active":"2024-09-19T08:37:17.349314+0000","last_became_peered":"2024-09-19T08:37:17.349314+0000","last_unstale":"2024-09-19T08:37:18.342993+0000","last_undegraded":"2024-09-19T08:37:18.342993+0000","last_fullsized":"2024-09-19T08:37:18.342993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:30.433955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550444+0000","last_change":"2024-09-19T08:37:13.326384+0000","last_active":"2024-09-19T08:37:19.550444+0000","last_peered":"2024-09-19T08:37:19.550444+0000","last_clean":"2024-09-19T08:37:19.550444+0000","last_became_active":"2024-09-19T08:37:13.326109+0000","last_became_peered":"2024-09-19T08:37:13.326109+0000","last_unstale":"2024-09-19T08:37:19.550444+0000","last_undegraded":"2024-09-19T08:37:19.550444+0000","last_fullsized":"2024-09-19T08:37:19.550444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:39.528322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342580+0000","last_change":"2024-09-19T08:37:12.323115+0000","last_active":"2024-09-19T08:37:18.342580+0000","last_peered":"2024-09-19T08:37:18.342580+0000","last_clean":"2024-09-19T08:37:18.342580+0000","last_became_active":"2024-09-19T08:37:12.322685+0000","last_became_peered":"2024-09-19T08:37:12.322685+0000","last_unstale":"2024-09-19T08:37:18.342580+0000","last_undegraded":"2024-09-19T08:37:18.342580+0000","last_fullsized":"2024-09-19T08:37:18.342580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:44.440667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550017+0000","last_change":"2024-09-19T08:37:17.358072+0000","last_active":"2024-09-19T08:37:19.550017+0000","last_peered":"2024-09-19T08:37:19.550017+0000","last_clean":"2024-09-19T08:37:19.550017+0000","last_became_active":"2024-09-19T08:37:17.357595+0000","last_became_peered":"2024-09-19T08:37:17.357595+0000","last_unstale":"2024-09-19T08:37:19.550017+0000","last_undegraded":"2024-09-19T08:37:19.550017+0000","last_fullsized":"2024-09-19T08:37:19.550017+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:29.925404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775441+0000","last_change":"2024-09-19T08:37:13.319823+0000","last_active":"2024-09-19T08:37:19.775441+0000","last_peered":"2024-09-19T08:37:19.775441+0000","last_clean":"2024-09-19T08:37:19.775441+0000","last_became_active":"2024-09-19T08:37:13.319552+0000","last_became_peered":"2024-09-19T08:37:13.319552+0000","last_unstale":"2024-09-19T08:37:19.775441+0000","last_undegraded":"2024-09-19T08:37:19.775441+0000","last_fullsized":"2024-09-19T08:37:19.775441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:23.965109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582542+0000","last_change":"2024-09-19T08:37:12.320429+0000","last_active":"2024-09-19T08:37:19.582542+0000","last_peered":"2024-09-19T08:37:19.582542+0000","last_clean":"2024-09-19T08:37:19.582542+0000","last_became_active":"2024-09-19T08:37:12.320136+0000","last_became_peered":"2024-09-19T08:37:12.320136+0000","last_unstale":"2024-09-19T08:37:19.582542+0000","last_undegraded":"2024-09-19T08:37:19.582542+0000","last_fullsized":"2024-09-19T08:37:19.582542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:48.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.549893+0000","last_change":"2024-09-19T08:37:17.351017+0000","last_active":"2024-09-19T08:37:19.549893+0000","last_peered":"2024-09-19T08:37:19.549893+0000","last_clean":"2024-09-19T08:37:19.549893+0000","last_became_active":"2024-09-19T08:37:17.350612+0000","last_became_peered":"2024-09-19T08:37:17.350612+0000","last_unstale":"2024-09-19T08:37:19.549893+0000","last_undegraded":"2024-09-19T08:37:19.549893+0000","last_fullsized":"2024-09-19T08:37:19.549893+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:25.374722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774665+0000","last_change":"2024-09-19T08:37:13.322685+0000","last_active":"2024-09-19T08:37:19.774665+0000","last_peered":"2024-09-19T08:37:19.774665+0000","last_clean":"2024-09-19T08:37:19.774665+0000","last_became_active":"2024-09-19T08:37:13.322422+0000","last_became_peered":"2024-09-19T08:37:13.322422+0000","last_unstale":"2024-09-19T08:37:19.774665+0000","last_undegraded":"2024-09-19T08:37:19.774665+0000","last_fullsized":"2024-09-19T08:37:19.774665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:32.352238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341955+0000","last_change":"2024-09-19T08:37:12.321407+0000","last_active":"2024-09-19T08:37:18.341955+0000","last_peered":"2024-09-19T08:37:18.341955+0000","last_clean":"2024-09-19T08:37:18.341955+0000","last_became_active":"2024-09-19T08:37:12.321129+0000","last_became_peered":"2024-09-19T08:37:12.321129+0000","last_unstale":"2024-09-19T08:37:18.341955+0000","last_undegraded":"2024-09-19T08:37:18.341955+0000","last_fullsized":"2024-09-19T08:37:18.341955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:03.696329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550190+0000","last_change":"2024-09-19T08:37:17.358653+0000","last_active":"2024-09-19T08:37:19.550190+0000","last_peered":"2024-09-19T08:37:19.550190+0000","last_clean":"2024-09-19T08:37:19.550190+0000","last_became_active":"2024-09-19T08:37:17.357509+0000","last_became_peered":"2024-09-19T08:37:17.357509+0000","last_unstale":"2024-09-19T08:37:19.550190+0000","last_undegraded":"2024-09-19T08:37:19.550190+0000","last_fullsized":"2024-09-19T08:37:19.550190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:55.818752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582178+0000","last_change":"2024-09-19T08:37:13.327783+0000","last_active":"2024-09-19T08:37:19.582178+0000","last_peered":"2024-09-19T08:37:19.582178+0000","last_clean":"2024-09-19T08:37:19.582178+0000","last_became_active":"2024-09-19T08:37:13.327296+0000","last_became_peered":"2024-09-19T08:37:13.327296+0000","last_unstale":"2024-09-19T08:37:19.582178+0000","last_undegraded":"2024-09-19T08:37:19.582178+0000","last_fullsized":"2024-09-19T08:37:19.582178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:31.517337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673483+0000","last_change":"2024-09-19T08:37:12.318619+0000","last_active":"2024-09-19T08:37:18.673483+0000","last_peered":"2024-09-19T08:37:18.673483+0000","last_clean":"2024-09-19T08:37:18.673483+0000","last_became_active":"2024-09-19T08:37:12.318299+0000","last_became_peered":"2024-09-19T08:37:12.318299+0000","last_unstale":"2024-09-19T08:37:18.673483+0000","last_undegraded":"2024-09-19T08:37:18.673483+0000","last_fullsized":"2024-09-19T08:37:18.673483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:20.563149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550435+0000","last_change":"2024-09-19T08:37:17.353727+0000","last_active":"2024-09-19T08:37:19.550435+0000","last_peered":"2024-09-19T08:37:19.550435+0000","last_clean":"2024-09-19T08:37:19.550435+0000","last_became_active":"2024-09-19T08:37:17.353180+0000","last_became_peered":"2024-09-19T08:37:17.353180+0000","last_unstale":"2024-09-19T08:37:19.550435+0000","last_undegraded":"2024-09-19T08:37:19.550435+0000","last_fullsized":"2024-09-19T08:37:19.550435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:41.877203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.549807+0000","last_change":"2024-09-19T08:37:13.323403+0000","last_active":"2024-09-19T08:37:19.549807+0000","last_peered":"2024-09-19T08:37:19.549807+0000","last_clean":"2024-09-19T08:37:19.549807+0000","last_became_active":"2024-09-19T08:37:13.323125+0000","last_became_peered":"2024-09-19T08:37:13.323125+0000","last_unstale":"2024-09-19T08:37:19.549807+0000","last_undegraded":"2024-09-19T08:37:19.549807+0000","last_fullsized":"2024-09-19T08:37:19.549807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:04.705399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341725+0000","last_change":"2024-09-19T08:37:12.325472+0000","last_active":"2024-09-19T08:37:18.341725+0000","last_peered":"2024-09-19T08:37:18.341725+0000","last_clean":"2024-09-19T08:37:18.341725+0000","last_became_active":"2024-09-19T08:37:12.325213+0000","last_became_peered":"2024-09-19T08:37:12.325213+0000","last_unstale":"2024-09-19T08:37:18.341725+0000","last_undegraded":"2024-09-19T08:37:18.341725+0000","last_fullsized":"2024-09-19T08:37:18.341725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:55.041313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582821+0000","last_change":"2024-09-19T08:37:17.354723+0000","last_active":"2024-09-19T08:37:19.582821+0000","last_peered":"2024-09-19T08:37:19.582821+0000","last_clean":"2024-09-19T08:37:19.582821+0000","last_became_active":"2024-09-19T08:37:17.354349+0000","last_became_peered":"2024-09-19T08:37:17.354349+0000","last_unstale":"2024-09-19T08:37:19.582821+0000","last_undegraded":"2024-09-19T08:37:19.582821+0000","last_fullsized":"2024-09-19T08:37:19.582821+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:26:18.585237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343346+0000","last_change":"2024-09-19T08:37:13.314451+0000","last_active":"2024-09-19T08:37:18.343346+0000","last_peered":"2024-09-19T08:37:18.343346+0000","last_clean":"2024-09-19T08:37:18.343346+0000","last_became_active":"2024-09-19T08:37:13.314082+0000","last_became_peered":"2024-09-19T08:37:13.314082+0000","last_unstale":"2024-09-19T08:37:18.343346+0000","last_undegraded":"2024-09-19T08:37:18.343346+0000","last_fullsized":"2024-09-19T08:37:18.343346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:39.528322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342148+0000","last_change":"2024-09-19T08:37:12.321328+0000","last_active":"2024-09-19T08:37:18.342148+0000","last_peered":"2024-09-19T08:37:18.342148+0000","last_clean":"2024-09-19T08:37:18.342148+0000","last_became_active":"2024-09-19T08:37:12.321069+0000","last_became_peered":"2024-09-19T08:37:12.321069+0000","last_unstale":"2024-09-19T08:37:18.342148+0000","last_undegraded":"2024-09-19T08:37:18.342148+0000","last_fullsized":"2024-09-19T08:37:18.342148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:22.956039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774403+0000","last_change":"2024-09-19T08:37:04.479071+0000","last_active":"2024-09-19T08:37:19.774403+0000","last_peered":"2024-09-19T08:37:19.774403+0000","last_clean":"2024-09-19T08:37:19.774403+0000","last_became_active":"2024-09-19T08:37:04.478199+0000","last_became_peered":"2024-09-19T08:37:04.478199+0000","last_unstale":"2024-09-19T08:37:19.774403+0000","last_undegraded":"2024-09-19T08:37:19.774403+0000","last_fullsized":"2024-09-19T08:37:19.774403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_clean_scrub_stamp":"2024-09-19T08:37:02.519738+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:32.963748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342489+0000","last_change":"2024-09-19T08:37:17.360235+0000","last_active":"2024-09-19T08:37:18.342489+0000","last_peered":"2024-09-19T08:37:18.342489+0000","last_clean":"2024-09-19T08:37:18.342489+0000","last_became_active":"2024-09-19T08:37:17.359875+0000","last_became_peered":"2024-09-19T08:37:17.359875+0000","last_unstale":"2024-09-19T08:37:18.342489+0000","last_undegraded":"2024-09-19T08:37:18.342489+0000","last_fullsized":"2024-09-19T08:37:18.342489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:02.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342407+0000","last_change":"2024-09-19T08:37:13.318739+0000","last_active":"2024-09-19T08:37:18.342407+0000","last_peered":"2024-09-19T08:37:18.342407+0000","last_clean":"2024-09-19T08:37:18.342407+0000","last_became_active":"2024-09-19T08:37:13.318487+0000","last_became_peered":"2024-09-19T08:37:13.318487+0000","last_unstale":"2024-09-19T08:37:18.342407+0000","last_undegraded":"2024-09-19T08:37:18.342407+0000","last_fullsized":"2024-09-19T08:37:18.342407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:50.571163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550463+0000","last_change":"2024-09-19T08:37:12.321017+0000","last_active":"2024-09-19T08:37:19.550463+0000","last_peered":"2024-09-19T08:37:19.550463+0000","last_clean":"2024-09-19T08:37:19.550463+0000","last_became_active":"2024-09-19T08:37:12.320498+0000","last_became_peered":"2024-09-19T08:37:12.320498+0000","last_unstale":"2024-09-19T08:37:19.550463+0000","last_undegraded":"2024-09-19T08:37:19.550463+0000","last_fullsized":"2024-09-19T08:37:19.550463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:37.272613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774252+0000","last_change":"2024-09-19T08:37:17.351391+0000","last_active":"2024-09-19T08:37:19.774252+0000","last_peered":"2024-09-19T08:37:19.774252+0000","last_clean":"2024-09-19T08:37:19.774252+0000","last_became_active":"2024-09-19T08:37:17.350957+0000","last_became_peered":"2024-09-19T08:37:17.350957+0000","last_unstale":"2024-09-19T08:37:19.774252+0000","last_undegraded":"2024-09-19T08:37:19.774252+0000","last_fullsized":"2024-09-19T08:37:19.774252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:36.383281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775081+0000","last_change":"2024-09-19T08:37:13.323759+0000","last_active":"2024-09-19T08:37:19.775081+0000","last_peered":"2024-09-19T08:37:19.775081+0000","last_clean":"2024-09-19T08:37:19.775081+0000","last_became_active":"2024-09-19T08:37:13.322021+0000","last_became_peered":"2024-09-19T08:37:13.322021+0000","last_unstale":"2024-09-19T08:37:19.775081+0000","last_undegraded":"2024-09-19T08:37:19.775081+0000","last_fullsized":"2024-09-19T08:37:19.775081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:26.402913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582801+0000","last_change":"2024-09-19T08:37:12.321535+0000","last_active":"2024-09-19T08:37:19.582801+0000","last_peered":"2024-09-19T08:37:19.582801+0000","last_clean":"2024-09-19T08:37:19.582801+0000","last_became_active":"2024-09-19T08:37:12.321158+0000","last_became_peered":"2024-09-19T08:37:12.321158+0000","last_unstale":"2024-09-19T08:37:19.582801+0000","last_undegraded":"2024-09-19T08:37:19.582801+0000","last_fullsized":"2024-09-19T08:37:19.582801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:08.631783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582645+0000","last_change":"2024-09-19T08:37:17.355898+0000","last_active":"2024-09-19T08:37:19.582645+0000","last_peered":"2024-09-19T08:37:19.582645+0000","last_clean":"2024-09-19T08:37:19.582645+0000","last_became_active":"2024-09-19T08:37:17.355518+0000","last_became_peered":"2024-09-19T08:37:17.355518+0000","last_unstale":"2024-09-19T08:37:19.582645+0000","last_undegraded":"2024-09-19T08:37:19.582645+0000","last_fullsized":"2024-09-19T08:37:19.582645+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:54.602206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775159+0000","last_change":"2024-09-19T08:37:13.317412+0000","last_active":"2024-09-19T08:37:19.775159+0000","last_peered":"2024-09-19T08:37:19.775159+0000","last_clean":"2024-09-19T08:37:19.775159+0000","last_became_active":"2024-09-19T08:37:13.317158+0000","last_became_peered":"2024-09-19T08:37:13.317158+0000","last_unstale":"2024-09-19T08:37:19.775159+0000","last_undegraded":"2024-09-19T08:37:19.775159+0000","last_fullsized":"2024-09-19T08:37:19.775159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:37.846160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343804+0000","last_change":"2024-09-19T08:37:12.318485+0000","last_active":"2024-09-19T08:37:18.343804+0000","last_peered":"2024-09-19T08:37:18.343804+0000","last_clean":"2024-09-19T08:37:18.343804+0000","last_became_active":"2024-09-19T08:37:12.318173+0000","last_became_peered":"2024-09-19T08:37:12.318173+0000","last_unstale":"2024-09-19T08:37:18.343804+0000","last_undegraded":"2024-09-19T08:37:18.343804+0000","last_fullsized":"2024-09-19T08:37:18.343804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:32.812065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341486+0000","last_change":"2024-09-19T08:37:17.351969+0000","last_active":"2024-09-19T08:37:18.341486+0000","last_peered":"2024-09-19T08:37:18.341486+0000","last_clean":"2024-09-19T08:37:18.341486+0000","last_became_active":"2024-09-19T08:37:17.351602+0000","last_became_peered":"2024-09-19T08:37:17.351602+0000","last_unstale":"2024-09-19T08:37:18.341486+0000","last_undegraded":"2024-09-19T08:37:18.341486+0000","last_fullsized":"2024-09-19T08:37:18.341486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:07.810509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774839+0000","last_change":"2024-09-19T08:37:13.316790+0000","last_active":"2024-09-19T08:37:19.774839+0000","last_peered":"2024-09-19T08:37:19.774839+0000","last_clean":"2024-09-19T08:37:19.774839+0000","last_became_active":"2024-09-19T08:37:13.315664+0000","last_became_peered":"2024-09-19T08:37:13.315664+0000","last_unstale":"2024-09-19T08:37:19.774839+0000","last_undegraded":"2024-09-19T08:37:19.774839+0000","last_fullsized":"2024-09-19T08:37:19.774839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:55.229727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775212+0000","last_change":"2024-09-19T08:37:12.322929+0000","last_active":"2024-09-19T08:37:19.775212+0000","last_peered":"2024-09-19T08:37:19.775212+0000","last_clean":"2024-09-19T08:37:19.775212+0000","last_became_active":"2024-09-19T08:37:12.322679+0000","last_became_peered":"2024-09-19T08:37:12.322679+0000","last_unstale":"2024-09-19T08:37:19.775212+0000","last_undegraded":"2024-09-19T08:37:19.775212+0000","last_fullsized":"2024-09-19T08:37:19.775212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:12.811398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775212+0000","last_change":"2024-09-19T08:37:17.356653+0000","last_active":"2024-09-19T08:37:19.775212+0000","last_peered":"2024-09-19T08:37:19.775212+0000","last_clean":"2024-09-19T08:37:19.775212+0000","last_became_active":"2024-09-19T08:37:17.356295+0000","last_became_peered":"2024-09-19T08:37:17.356295+0000","last_unstale":"2024-09-19T08:37:19.775212+0000","last_undegraded":"2024-09-19T08:37:19.775212+0000","last_fullsized":"2024-09-19T08:37:19.775212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:59.260769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341570+0000","last_change":"2024-09-19T08:37:13.328997+0000","last_active":"2024-09-19T08:37:18.341570+0000","last_peered":"2024-09-19T08:37:18.341570+0000","last_clean":"2024-09-19T08:37:18.341570+0000","last_became_active":"2024-09-19T08:37:13.328496+0000","last_became_peered":"2024-09-19T08:37:13.328496+0000","last_unstale":"2024-09-19T08:37:18.341570+0000","last_undegraded":"2024-09-19T08:37:18.341570+0000","last_fullsized":"2024-09-19T08:37:18.341570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:11.464991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343175+0000","last_change":"2024-09-19T08:37:12.316395+0000","last_active":"2024-09-19T08:37:18.343175+0000","last_peered":"2024-09-19T08:37:18.343175+0000","last_clean":"2024-09-19T08:37:18.343175+0000","last_became_active":"2024-09-19T08:37:12.315734+0000","last_became_peered":"2024-09-19T08:37:12.315734+0000","last_unstale":"2024-09-19T08:37:18.343175+0000","last_undegraded":"2024-09-19T08:37:18.343175+0000","last_fullsized":"2024-09-19T08:37:18.343175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:48.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582970+0000","last_change":"2024-09-19T08:37:17.351618+0000","last_active":"2024-09-19T08:37:19.582970+0000","last_peered":"2024-09-19T08:37:19.582970+0000","last_clean":"2024-09-19T08:37:19.582970+0000","last_became_active":"2024-09-19T08:37:17.351235+0000","last_became_peered":"2024-09-19T08:37:17.351235+0000","last_unstale":"2024-09-19T08:37:19.582970+0000","last_undegraded":"2024-09-19T08:37:19.582970+0000","last_fullsized":"2024-09-19T08:37:19.582970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:50.477160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774327+0000","last_change":"2024-09-19T08:37:13.328281+0000","last_active":"2024-09-19T08:37:19.774327+0000","last_peered":"2024-09-19T08:37:19.774327+0000","last_clean":"2024-09-19T08:37:19.774327+0000","last_became_active":"2024-09-19T08:37:13.327925+0000","last_became_peered":"2024-09-19T08:37:13.327925+0000","last_unstale":"2024-09-19T08:37:19.774327+0000","last_undegraded":"2024-09-19T08:37:19.774327+0000","last_fullsized":"2024-09-19T08:37:19.774327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:05.312287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775776+0000","last_change":"2024-09-19T08:37:12.321424+0000","last_active":"2024-09-19T08:37:19.775776+0000","last_peered":"2024-09-19T08:37:19.775776+0000","last_clean":"2024-09-19T08:37:19.775776+0000","last_became_active":"2024-09-19T08:37:12.321176+0000","last_became_peered":"2024-09-19T08:37:12.321176+0000","last_unstale":"2024-09-19T08:37:19.775776+0000","last_undegraded":"2024-09-19T08:37:19.775776+0000","last_fullsized":"2024-09-19T08:37:19.775776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:32.812065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.583004+0000","last_change":"2024-09-19T08:37:17.349545+0000","last_active":"2024-09-19T08:37:19.583004+0000","last_peered":"2024-09-19T08:37:19.583004+0000","last_clean":"2024-09-19T08:37:19.583004+0000","last_became_active":"2024-09-19T08:37:17.349192+0000","last_became_peered":"2024-09-19T08:37:17.349192+0000","last_unstale":"2024-09-19T08:37:19.583004+0000","last_undegraded":"2024-09-19T08:37:19.583004+0000","last_fullsized":"2024-09-19T08:37:19.583004+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:38.360015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341839+0000","last_change":"2024-09-19T08:37:13.322205+0000","last_active":"2024-09-19T08:37:18.341839+0000","last_peered":"2024-09-19T08:37:18.341839+0000","last_clean":"2024-09-19T08:37:18.341839+0000","last_became_active":"2024-09-19T08:37:13.321483+0000","last_became_peered":"2024-09-19T08:37:13.321483+0000","last_unstale":"2024-09-19T08:37:18.341839+0000","last_undegraded":"2024-09-19T08:37:18.341839+0000","last_fullsized":"2024-09-19T08:37:18.341839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:49.043269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341935+0000","last_change":"2024-09-19T08:37:12.325272+0000","last_active":"2024-09-19T08:37:18.341935+0000","last_peered":"2024-09-19T08:37:18.341935+0000","last_clean":"2024-09-19T08:37:18.341935+0000","last_became_active":"2024-09-19T08:37:12.325028+0000","last_became_peered":"2024-09-19T08:37:12.325028+0000","last_unstale":"2024-09-19T08:37:18.341935+0000","last_undegraded":"2024-09-19T08:37:18.341935+0000","last_fullsized":"2024-09-19T08:37:18.341935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:33.465602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550181+0000","last_change":"2024-09-19T08:37:17.355589+0000","last_active":"2024-09-19T08:37:19.550181+0000","last_peered":"2024-09-19T08:37:19.550181+0000","last_clean":"2024-09-19T08:37:19.550181+0000","last_became_active":"2024-09-19T08:37:17.353243+0000","last_became_peered":"2024-09-19T08:37:17.353243+0000","last_unstale":"2024-09-19T08:37:19.550181+0000","last_undegraded":"2024-09-19T08:37:19.550181+0000","last_fullsized":"2024-09-19T08:37:19.550181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:36.383281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550216+0000","last_change":"2024-09-19T08:37:13.325522+0000","last_active":"2024-09-19T08:37:19.550216+0000","last_peered":"2024-09-19T08:37:19.550216+0000","last_clean":"2024-09-19T08:37:19.550216+0000","last_became_active":"2024-09-19T08:37:13.324792+0000","last_became_peered":"2024-09-19T08:37:13.324792+0000","last_unstale":"2024-09-19T08:37:19.550216+0000","last_undegraded":"2024-09-19T08:37:19.550216+0000","last_fullsized":"2024-09-19T08:37:19.550216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:55.229727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673680+0000","last_change":"2024-09-19T08:37:12.322147+0000","last_active":"2024-09-19T08:37:18.673680+0000","last_peered":"2024-09-19T08:37:18.673680+0000","last_clean":"2024-09-19T08:37:18.673680+0000","last_became_active":"2024-09-19T08:37:12.321849+0000","last_became_peered":"2024-09-19T08:37:12.321849+0000","last_unstale":"2024-09-19T08:37:18.673680+0000","last_undegraded":"2024-09-19T08:37:18.673680+0000","last_fullsized":"2024-09-19T08:37:18.673680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:13.052644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342312+0000","last_change":"2024-09-19T08:37:17.359818+0000","last_active":"2024-09-19T08:37:18.342312+0000","last_peered":"2024-09-19T08:37:18.342312+0000","last_clean":"2024-09-19T08:37:18.342312+0000","last_became_active":"2024-09-19T08:37:17.359442+0000","last_became_peered":"2024-09-19T08:37:17.359442+0000","last_unstale":"2024-09-19T08:37:18.342312+0000","last_undegraded":"2024-09-19T08:37:18.342312+0000","last_fullsized":"2024-09-19T08:37:18.342312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:23.916499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774686+0000","last_change":"2024-09-19T08:37:13.320385+0000","last_active":"2024-09-19T08:37:19.774686+0000","last_peered":"2024-09-19T08:37:19.774686+0000","last_clean":"2024-09-19T08:37:19.774686+0000","last_became_active":"2024-09-19T08:37:13.320121+0000","last_became_peered":"2024-09-19T08:37:13.320121+0000","last_unstale":"2024-09-19T08:37:19.774686+0000","last_undegraded":"2024-09-19T08:37:19.774686+0000","last_fullsized":"2024-09-19T08:37:19.774686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:25.894361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:22.767373+0000","last_change":"2024-09-19T08:37:12.317329+0000","last_active":"2024-09-19T08:37:22.767373+0000","last_peered":"2024-09-19T08:37:22.767373+0000","last_clean":"2024-09-19T08:37:22.767373+0000","last_became_active":"2024-09-19T08:37:12.317062+0000","last_became_peered":"2024-09-19T08:37:12.317062+0000","last_unstale":"2024-09-19T08:37:22.767373+0000","last_undegraded":"2024-09-19T08:37:22.767373+0000","last_fullsized":"2024-09-19T08:37:22.767373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:05.334179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343234+0000","last_change":"2024-09-19T08:37:17.351632+0000","last_active":"2024-09-19T08:37:18.343234+0000","last_peered":"2024-09-19T08:37:18.343234+0000","last_clean":"2024-09-19T08:37:18.343234+0000","last_became_active":"2024-09-19T08:37:17.351246+0000","last_became_peered":"2024-09-19T08:37:17.351246+0000","last_unstale":"2024-09-19T08:37:18.343234+0000","last_undegraded":"2024-09-19T08:37:18.343234+0000","last_fullsized":"2024-09-19T08:37:18.343234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:15.496034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341958+0000","last_change":"2024-09-19T08:37:13.328541+0000","last_active":"2024-09-19T08:37:18.341958+0000","last_peered":"2024-09-19T08:37:18.341958+0000","last_clean":"2024-09-19T08:37:18.341958+0000","last_became_active":"2024-09-19T08:37:13.328285+0000","last_became_peered":"2024-09-19T08:37:13.328285+0000","last_unstale":"2024-09-19T08:37:18.341958+0000","last_undegraded":"2024-09-19T08:37:18.341958+0000","last_fullsized":"2024-09-19T08:37:18.341958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:13.920583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673858+0000","last_change":"2024-09-19T08:37:12.318230+0000","last_active":"2024-09-19T08:37:18.673858+0000","last_peered":"2024-09-19T08:37:18.673858+0000","last_clean":"2024-09-19T08:37:18.673858+0000","last_became_active":"2024-09-19T08:37:12.317739+0000","last_became_peered":"2024-09-19T08:37:12.317739+0000","last_unstale":"2024-09-19T08:37:18.673858+0000","last_undegraded":"2024-09-19T08:37:18.673858+0000","last_fullsized":"2024-09-19T08:37:18.673858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:50.275215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775001+0000","last_change":"2024-09-19T08:37:17.353397+0000","last_active":"2024-09-19T08:37:19.775001+0000","last_peered":"2024-09-19T08:37:19.775001+0000","last_clean":"2024-09-19T08:37:19.775001+0000","last_became_active":"2024-09-19T08:37:17.352532+0000","last_became_peered":"2024-09-19T08:37:17.352532+0000","last_unstale":"2024-09-19T08:37:19.775001+0000","last_undegraded":"2024-09-19T08:37:19.775001+0000","last_fullsized":"2024-09-19T08:37:19.775001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:41.877203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.583030+0000","last_change":"2024-09-19T08:37:13.330183+0000","last_active":"2024-09-19T08:37:19.583030+0000","last_peered":"2024-09-19T08:37:19.583030+0000","last_clean":"2024-09-19T08:37:19.583030+0000","last_became_active":"2024-09-19T08:37:13.329810+0000","last_became_peered":"2024-09-19T08:37:13.329810+0000","last_unstale":"2024-09-19T08:37:19.583030+0000","last_undegraded":"2024-09-19T08:37:19.583030+0000","last_fullsized":"2024-09-19T08:37:19.583030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:32.352238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775009+0000","last_change":"2024-09-19T08:37:12.318995+0000","last_active":"2024-09-19T08:37:19.775009+0000","last_peered":"2024-09-19T08:37:19.775009+0000","last_clean":"2024-09-19T08:37:19.775009+0000","last_became_active":"2024-09-19T08:37:12.318707+0000","last_became_peered":"2024-09-19T08:37:12.318707+0000","last_unstale":"2024-09-19T08:37:19.775009+0000","last_undegraded":"2024-09-19T08:37:19.775009+0000","last_fullsized":"2024-09-19T08:37:19.775009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:43.809060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673308+0000","last_change":"2024-09-19T08:37:17.363394+0000","last_active":"2024-09-19T08:37:18.673308+0000","last_peered":"2024-09-19T08:37:18.673308+0000","last_clean":"2024-09-19T08:37:18.673308+0000","last_became_active":"2024-09-19T08:37:17.362912+0000","last_became_peered":"2024-09-19T08:37:17.362912+0000","last_unstale":"2024-09-19T08:37:18.673308+0000","last_undegraded":"2024-09-19T08:37:18.673308+0000","last_fullsized":"2024-09-19T08:37:18.673308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:04.239525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774754+0000","last_change":"2024-09-19T08:37:13.324283+0000","last_active":"2024-09-19T08:37:19.774754+0000","last_peered":"2024-09-19T08:37:19.774754+0000","last_clean":"2024-09-19T08:37:19.774754+0000","last_became_active":"2024-09-19T08:37:13.323386+0000","last_became_peered":"2024-09-19T08:37:13.323386+0000","last_unstale":"2024-09-19T08:37:19.774754+0000","last_undegraded":"2024-09-19T08:37:19.774754+0000","last_fullsized":"2024-09-19T08:37:19.774754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:04.705399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774939+0000","last_change":"2024-09-19T08:37:12.320151+0000","last_active":"2024-09-19T08:37:19.774939+0000","last_peered":"2024-09-19T08:37:19.774939+0000","last_clean":"2024-09-19T08:37:19.774939+0000","last_became_active":"2024-09-19T08:37:12.319848+0000","last_became_peered":"2024-09-19T08:37:12.319848+0000","last_unstale":"2024-09-19T08:37:19.774939+0000","last_undegraded":"2024-09-19T08:37:19.774939+0000","last_fullsized":"2024-09-19T08:37:19.774939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:57.623546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343446+0000","last_change":"2024-09-19T08:37:17.354272+0000","last_active":"2024-09-19T08:37:18.343446+0000","last_peered":"2024-09-19T08:37:18.343446+0000","last_clean":"2024-09-19T08:37:18.343446+0000","last_became_active":"2024-09-19T08:37:17.353914+0000","last_became_peered":"2024-09-19T08:37:17.353914+0000","last_unstale":"2024-09-19T08:37:18.343446+0000","last_undegraded":"2024-09-19T08:37:18.343446+0000","last_fullsized":"2024-09-19T08:37:18.343446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:53.074312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343607+0000","last_change":"2024-09-19T08:37:17.353588+0000","last_active":"2024-09-19T08:37:18.343607+0000","last_peered":"2024-09-19T08:37:18.343607+0000","last_clean":"2024-09-19T08:37:18.343607+0000","last_became_active":"2024-09-19T08:37:17.353202+0000","last_became_peered":"2024-09-19T08:37:17.353202+0000","last_unstale":"2024-09-19T08:37:18.343607+0000","last_undegraded":"2024-09-19T08:37:18.343607+0000","last_fullsized":"2024-09-19T08:37:18.343607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:56.423064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343044+0000","last_change":"2024-09-19T08:37:13.310656+0000","last_active":"2024-09-19T08:37:18.343044+0000","last_peered":"2024-09-19T08:37:18.343044+0000","last_clean":"2024-09-19T08:37:18.343044+0000","last_became_active":"2024-09-19T08:37:13.310365+0000","last_became_peered":"2024-09-19T08:37:13.310365+0000","last_unstale":"2024-09-19T08:37:18.343044+0000","last_undegraded":"2024-09-19T08:37:18.343044+0000","last_fullsized":"2024-09-19T08:37:18.343044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:48:56.646247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341695+0000","last_change":"2024-09-19T08:37:12.316198+0000","last_active":"2024-09-19T08:37:18.341695+0000","last_peered":"2024-09-19T08:37:18.341695+0000","last_clean":"2024-09-19T08:37:18.341695+0000","last_became_active":"2024-09-19T08:37:12.315954+0000","last_became_peered":"2024-09-19T08:37:12.315954+0000","last_unstale":"2024-09-19T08:37:18.341695+0000","last_undegraded":"2024-09-19T08:37:18.341695+0000","last_fullsized":"2024-09-19T08:37:18.341695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:04.303217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342109+0000","last_change":"2024-09-19T08:37:17.354035+0000","last_active":"2024-09-19T08:37:18.342109+0000","last_peered":"2024-09-19T08:37:18.342109+0000","last_clean":"2024-09-19T08:37:18.342109+0000","last_became_active":"2024-09-19T08:37:17.353669+0000","last_became_peered":"2024-09-19T08:37:17.353669+0000","last_unstale":"2024-09-19T08:37:18.342109+0000","last_undegraded":"2024-09-19T08:37:18.342109+0000","last_fullsized":"2024-09-19T08:37:18.342109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:12.322596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582389+0000","last_change":"2024-09-19T08:37:13.327070+0000","last_active":"2024-09-19T08:37:19.582389+0000","last_peered":"2024-09-19T08:37:19.582389+0000","last_clean":"2024-09-19T08:37:19.582389+0000","last_became_active":"2024-09-19T08:37:13.326721+0000","last_became_peered":"2024-09-19T08:37:13.326721+0000","last_unstale":"2024-09-19T08:37:19.582389+0000","last_undegraded":"2024-09-19T08:37:19.582389+0000","last_fullsized":"2024-09-19T08:37:19.582389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:57.125390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.549850+0000","last_change":"2024-09-19T08:37:12.320362+0000","last_active":"2024-09-19T08:37:19.549850+0000","last_peered":"2024-09-19T08:37:19.549850+0000","last_clean":"2024-09-19T08:37:19.549850+0000","last_became_active":"2024-09-19T08:37:12.320047+0000","last_became_peered":"2024-09-19T08:37:12.320047+0000","last_unstale":"2024-09-19T08:37:19.549850+0000","last_undegraded":"2024-09-19T08:37:19.549850+0000","last_fullsized":"2024-09-19T08:37:19.549850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:57.623546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341855+0000","last_change":"2024-09-19T08:37:12.326611+0000","last_active":"2024-09-19T08:37:18.341855+0000","last_peered":"2024-09-19T08:37:18.341855+0000","last_clean":"2024-09-19T08:37:18.341855+0000","last_became_active":"2024-09-19T08:37:12.326341+0000","last_became_peered":"2024-09-19T08:37:12.326341+0000","last_unstale":"2024-09-19T08:37:18.341855+0000","last_undegraded":"2024-09-19T08:37:18.341855+0000","last_fullsized":"2024-09-19T08:37:18.341855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:54.220657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343192+0000","last_change":"2024-09-19T08:37:13.315454+0000","last_active":"2024-09-19T08:37:18.343192+0000","last_peered":"2024-09-19T08:37:18.343192+0000","last_clean":"2024-09-19T08:37:18.343192+0000","last_became_active":"2024-09-19T08:37:13.315193+0000","last_became_peered":"2024-09-19T08:37:13.315193+0000","last_unstale":"2024-09-19T08:37:18.343192+0000","last_undegraded":"2024-09-19T08:37:18.343192+0000","last_fullsized":"2024-09-19T08:37:18.343192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:02.012602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343557+0000","last_change":"2024-09-19T08:37:17.348944+0000","last_active":"2024-09-19T08:37:18.343557+0000","last_peered":"2024-09-19T08:37:18.343557+0000","last_clean":"2024-09-19T08:37:18.343557+0000","last_became_active":"2024-09-19T08:37:17.348484+0000","last_became_peered":"2024-09-19T08:37:17.348484+0000","last_unstale":"2024-09-19T08:37:18.343557+0000","last_undegraded":"2024-09-19T08:37:18.343557+0000","last_fullsized":"2024-09-19T08:37:18.343557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:28.217244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582715+0000","last_change":"2024-09-19T08:37:12.323262+0000","last_active":"2024-09-19T08:37:19.582715+0000","last_peered":"2024-09-19T08:37:19.582715+0000","last_clean":"2024-09-19T08:37:19.582715+0000","last_became_active":"2024-09-19T08:37:12.322964+0000","last_became_peered":"2024-09-19T08:37:12.322964+0000","last_unstale":"2024-09-19T08:37:19.582715+0000","last_undegraded":"2024-09-19T08:37:19.582715+0000","last_fullsized":"2024-09-19T08:37:19.582715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:11.283504+0000","last_clean_scrub_stamp":"2024-09-19T08:37:11.283504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:32.812065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773888+0000","last_change":"2024-09-19T08:37:13.327280+0000","last_active":"2024-09-19T08:37:19.773888+0000","last_peered":"2024-09-19T08:37:19.773888+0000","last_clean":"2024-09-19T08:37:19.773888+0000","last_became_active":"2024-09-19T08:37:13.326915+0000","last_became_peered":"2024-09-19T08:37:13.326915+0000","last_unstale":"2024-09-19T08:37:19.773888+0000","last_undegraded":"2024-09-19T08:37:19.773888+0000","last_fullsized":"2024-09-19T08:37:19.773888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:56.050383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673780+0000","last_change":"2024-09-19T08:37:17.363011+0000","last_active":"2024-09-19T08:37:18.673780+0000","last_peered":"2024-09-19T08:37:18.673780+0000","last_clean":"2024-09-19T08:37:18.673780+0000","last_became_active":"2024-09-19T08:37:17.362538+0000","last_became_peered":"2024-09-19T08:37:17.362538+0000","last_unstale":"2024-09-19T08:37:18.673780+0000","last_undegraded":"2024-09-19T08:37:18.673780+0000","last_fullsized":"2024-09-19T08:37:18.673780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:16.323616+0000","last_clean_scrub_stamp":"2024-09-19T08:37:16.323616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:29.539457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773951+0000","last_change":"2024-09-19T08:37:13.315209+0000","last_active":"2024-09-19T08:37:19.773951+0000","last_peered":"2024-09-19T08:37:19.773951+0000","last_clean":"2024-09-19T08:37:19.773951+0000","last_became_active":"2024-09-19T08:37:13.314934+0000","last_became_peered":"2024-09-19T08:37:13.314934+0000","last_unstale":"2024-09-19T08:37:19.773951+0000","last_undegraded":"2024-09-19T08:37:19.773951+0000","last_fullsized":"2024-09-19T08:37:19.773951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:44.818129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673338+0000","last_change":"2024-09-19T08:37:13.329355+0000","last_active":"2024-09-19T08:37:18.673338+0000","last_peered":"2024-09-19T08:37:18.673338+0000","last_clean":"2024-09-19T08:37:18.673338+0000","last_became_active":"2024-09-19T08:37:13.327464+0000","last_became_peered":"2024-09-19T08:37:13.327464+0000","last_unstale":"2024-09-19T08:37:18.673338+0000","last_undegraded":"2024-09-19T08:37:18.673338+0000","last_fullsized":"2024-09-19T08:37:18.673338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:44.058583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341765+0000","last_change":"2024-09-19T08:37:13.326479+0000","last_active":"2024-09-19T08:37:18.341765+0000","last_peered":"2024-09-19T08:37:18.341765+0000","last_clean":"2024-09-19T08:37:18.341765+0000","last_became_active":"2024-09-19T08:37:13.326229+0000","last_became_peered":"2024-09-19T08:37:13.326229+0000","last_unstale":"2024-09-19T08:37:18.341765+0000","last_undegraded":"2024-09-19T08:37:18.341765+0000","last_fullsized":"2024-09-19T08:37:18.341765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:24.186202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582555+0000","last_change":"2024-09-19T08:37:13.327921+0000","last_active":"2024-09-19T08:37:19.582555+0000","last_peered":"2024-09-19T08:37:19.582555+0000","last_clean":"2024-09-19T08:37:19.582555+0000","last_became_active":"2024-09-19T08:37:13.327515+0000","last_became_peered":"2024-09-19T08:37:13.327515+0000","last_unstale":"2024-09-19T08:37:19.582555+0000","last_undegraded":"2024-09-19T08:37:19.582555+0000","last_fullsized":"2024-09-19T08:37:19.582555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:21.343680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550330+0000","last_change":"2024-09-19T08:37:13.328457+0000","last_active":"2024-09-19T08:37:19.550330+0000","last_peered":"2024-09-19T08:37:19.550330+0000","last_clean":"2024-09-19T08:37:19.550330+0000","last_became_active":"2024-09-19T08:37:13.328201+0000","last_became_peered":"2024-09-19T08:37:13.328201+0000","last_unstale":"2024-09-19T08:37:19.550330+0000","last_undegraded":"2024-09-19T08:37:19.550330+0000","last_fullsized":"2024-09-19T08:37:19.550330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:02.904237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550219+0000","last_change":"2024-09-19T08:37:13.323713+0000","last_active":"2024-09-19T08:37:19.550219+0000","last_peered":"2024-09-19T08:37:19.550219+0000","last_clean":"2024-09-19T08:37:19.550219+0000","last_became_active":"2024-09-19T08:37:13.323292+0000","last_became_peered":"2024-09-19T08:37:13.323292+0000","last_unstale":"2024-09-19T08:37:19.550219+0000","last_undegraded":"2024-09-19T08:37:19.550219+0000","last_fullsized":"2024-09-19T08:37:19.550219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:48:56.646247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774671+0000","last_change":"2024-09-19T08:37:13.324782+0000","last_active":"2024-09-19T08:37:19.774671+0000","last_peered":"2024-09-19T08:37:19.774671+0000","last_clean":"2024-09-19T08:37:19.774671+0000","last_became_active":"2024-09-19T08:37:13.324279+0000","last_became_peered":"2024-09-19T08:37:13.324279+0000","last_unstale":"2024-09-19T08:37:19.774671+0000","last_undegraded":"2024-09-19T08:37:19.774671+0000","last_fullsized":"2024-09-19T08:37:19.774671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:34.474672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582804+0000","last_change":"2024-09-19T08:37:13.331655+0000","last_active":"2024-09-19T08:37:19.582804+0000","last_peered":"2024-09-19T08:37:19.582804+0000","last_clean":"2024-09-19T08:37:19.582804+0000","last_became_active":"2024-09-19T08:37:13.331359+0000","last_became_peered":"2024-09-19T08:37:13.331359+0000","last_unstale":"2024-09-19T08:37:19.582804+0000","last_undegraded":"2024-09-19T08:37:19.582804+0000","last_fullsized":"2024-09-19T08:37:19.582804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:50.533572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341602+0000","last_change":"2024-09-19T08:37:13.328905+0000","last_active":"2024-09-19T08:37:18.341602+0000","last_peered":"2024-09-19T08:37:18.341602+0000","last_clean":"2024-09-19T08:37:18.341602+0000","last_became_active":"2024-09-19T08:37:13.328643+0000","last_became_peered":"2024-09-19T08:37:13.328643+0000","last_unstale":"2024-09-19T08:37:18.341602+0000","last_undegraded":"2024-09-19T08:37:18.341602+0000","last_fullsized":"2024-09-19T08:37:18.341602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:26.402913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582337+0000","last_change":"2024-09-19T08:37:13.325377+0000","last_active":"2024-09-19T08:37:19.582337+0000","last_peered":"2024-09-19T08:37:19.582337+0000","last_clean":"2024-09-19T08:37:19.582337+0000","last_became_active":"2024-09-19T08:37:13.325101+0000","last_became_peered":"2024-09-19T08:37:13.325101+0000","last_unstale":"2024-09-19T08:37:19.582337+0000","last_undegraded":"2024-09-19T08:37:19.582337+0000","last_fullsized":"2024-09-19T08:37:19.582337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:02.012602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773794+0000","last_change":"2024-09-19T08:37:13.313455+0000","last_active":"2024-09-19T08:37:19.773794+0000","last_peered":"2024-09-19T08:37:19.773794+0000","last_clean":"2024-09-19T08:37:19.773794+0000","last_became_active":"2024-09-19T08:37:13.313182+0000","last_became_peered":"2024-09-19T08:37:13.313182+0000","last_unstale":"2024-09-19T08:37:19.773794+0000","last_undegraded":"2024-09-19T08:37:19.773794+0000","last_fullsized":"2024-09-19T08:37:19.773794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:44.818129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.343055+0000","last_change":"2024-09-19T08:37:13.314765+0000","last_active":"2024-09-19T08:37:18.343055+0000","last_peered":"2024-09-19T08:37:18.343055+0000","last_clean":"2024-09-19T08:37:18.343055+0000","last_became_active":"2024-09-19T08:37:13.314484+0000","last_became_peered":"2024-09-19T08:37:13.314484+0000","last_unstale":"2024-09-19T08:37:18.343055+0000","last_undegraded":"2024-09-19T08:37:18.343055+0000","last_fullsized":"2024-09-19T08:37:18.343055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:28.398584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775044+0000","last_change":"2024-09-19T08:37:13.321255+0000","last_active":"2024-09-19T08:37:19.775044+0000","last_peered":"2024-09-19T08:37:19.775044+0000","last_clean":"2024-09-19T08:37:19.775044+0000","last_became_active":"2024-09-19T08:37:13.320944+0000","last_became_peered":"2024-09-19T08:37:13.320944+0000","last_unstale":"2024-09-19T08:37:19.775044+0000","last_undegraded":"2024-09-19T08:37:19.775044+0000","last_fullsized":"2024-09-19T08:37:19.775044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:11.464991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342493+0000","last_change":"2024-09-19T08:37:13.321006+0000","last_active":"2024-09-19T08:37:18.342493+0000","last_peered":"2024-09-19T08:37:18.342493+0000","last_clean":"2024-09-19T08:37:18.342493+0000","last_became_active":"2024-09-19T08:37:13.320729+0000","last_became_peered":"2024-09-19T08:37:13.320729+0000","last_unstale":"2024-09-19T08:37:18.342493+0000","last_undegraded":"2024-09-19T08:37:18.342493+0000","last_fullsized":"2024-09-19T08:37:18.342493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:46.446118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.673984+0000","last_change":"2024-09-19T08:37:13.326249+0000","last_active":"2024-09-19T08:37:18.673984+0000","last_peered":"2024-09-19T08:37:18.673984+0000","last_clean":"2024-09-19T08:37:18.673984+0000","last_became_active":"2024-09-19T08:37:13.325965+0000","last_became_peered":"2024-09-19T08:37:13.325965+0000","last_unstale":"2024-09-19T08:37:18.673984+0000","last_undegraded":"2024-09-19T08:37:18.673984+0000","last_fullsized":"2024-09-19T08:37:18.673984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:11.539214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.342514+0000","last_change":"2024-09-19T08:37:13.325289+0000","last_active":"2024-09-19T08:37:18.342514+0000","last_peered":"2024-09-19T08:37:18.342514+0000","last_clean":"2024-09-19T08:37:18.342514+0000","last_became_active":"2024-09-19T08:37:13.322947+0000","last_became_peered":"2024-09-19T08:37:13.322947+0000","last_unstale":"2024-09-19T08:37:18.342514+0000","last_undegraded":"2024-09-19T08:37:18.342514+0000","last_fullsized":"2024-09-19T08:37:18.342514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:34.328972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:18.341594+0000","last_change":"2024-09-19T08:37:13.323040+0000","last_active":"2024-09-19T08:37:18.341594+0000","last_peered":"2024-09-19T08:37:18.341594+0000","last_clean":"2024-09-19T08:37:18.341594+0000","last_became_active":"2024-09-19T08:37:13.322427+0000","last_became_peered":"2024-09-19T08:37:13.322427+0000","last_unstale":"2024-09-19T08:37:18.341594+0000","last_undegraded":"2024-09-19T08:37:18.341594+0000","last_fullsized":"2024-09-19T08:37:18.341594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:37.846160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582190+0000","last_change":"2024-09-19T08:37:13.330628+0000","last_active":"2024-09-19T08:37:19.582190+0000","last_peered":"2024-09-19T08:37:19.582190+0000","last_clean":"2024-09-19T08:37:19.582190+0000","last_became_active":"2024-09-19T08:37:13.330355+0000","last_became_peered":"2024-09-19T08:37:13.330355+0000","last_unstale":"2024-09-19T08:37:19.582190+0000","last_undegraded":"2024-09-19T08:37:19.582190+0000","last_fullsized":"2024-09-19T08:37:19.582190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:28.398584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550079+0000","last_change":"2024-09-19T08:37:13.322548+0000","last_active":"2024-09-19T08:37:19.550079+0000","last_peered":"2024-09-19T08:37:19.550079+0000","last_clean":"2024-09-19T08:37:19.550079+0000","last_became_active":"2024-09-19T08:37:13.322265+0000","last_became_peered":"2024-09-19T08:37:13.322265+0000","last_unstale":"2024-09-19T08:37:19.550079+0000","last_undegraded":"2024-09-19T08:37:19.550079+0000","last_fullsized":"2024-09-19T08:37:19.550079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:34.474672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.550129+0000","last_change":"2024-09-19T08:37:13.329206+0000","last_active":"2024-09-19T08:37:19.550129+0000","last_peered":"2024-09-19T08:37:19.550129+0000","last_clean":"2024-09-19T08:37:19.550129+0000","last_became_active":"2024-09-19T08:37:13.328945+0000","last_became_peered":"2024-09-19T08:37:13.328945+0000","last_unstale":"2024-09-19T08:37:19.550129+0000","last_undegraded":"2024-09-19T08:37:19.550129+0000","last_fullsized":"2024-09-19T08:37:19.550129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:45.449737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774990+0000","last_change":"2024-09-19T08:37:13.321724+0000","last_active":"2024-09-19T08:37:19.774990+0000","last_peered":"2024-09-19T08:37:19.774990+0000","last_clean":"2024-09-19T08:37:19.774990+0000","last_became_active":"2024-09-19T08:37:13.321487+0000","last_became_peered":"2024-09-19T08:37:13.321487+0000","last_unstale":"2024-09-19T08:37:19.774990+0000","last_undegraded":"2024-09-19T08:37:19.774990+0000","last_fullsized":"2024-09-19T08:37:19.774990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:57.125390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774604+0000","last_change":"2024-09-19T08:37:13.326611+0000","last_active":"2024-09-19T08:37:19.774604+0000","last_peered":"2024-09-19T08:37:19.774604+0000","last_clean":"2024-09-19T08:37:19.774604+0000","last_became_active":"2024-09-19T08:37:13.326227+0000","last_became_peered":"2024-09-19T08:37:13.326227+0000","last_unstale":"2024-09-19T08:37:19.774604+0000","last_undegraded":"2024-09-19T08:37:19.774604+0000","last_fullsized":"2024-09-19T08:37:19.774604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:50.533572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774816+0000","last_change":"2024-09-19T08:37:13.322510+0000","last_active":"2024-09-19T08:37:19.774816+0000","last_peered":"2024-09-19T08:37:19.774816+0000","last_clean":"2024-09-19T08:37:19.774816+0000","last_became_active":"2024-09-19T08:37:13.322203+0000","last_became_peered":"2024-09-19T08:37:13.322203+0000","last_unstale":"2024-09-19T08:37:19.774816+0000","last_undegraded":"2024-09-19T08:37:19.774816+0000","last_fullsized":"2024-09-19T08:37:19.774816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:21.343680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774839+0000","last_change":"2024-09-19T08:37:13.318910+0000","last_active":"2024-09-19T08:37:19.774839+0000","last_peered":"2024-09-19T08:37:19.774839+0000","last_clean":"2024-09-19T08:37:19.774839+0000","last_became_active":"2024-09-19T08:37:13.318573+0000","last_became_peered":"2024-09-19T08:37:13.318573+0000","last_unstale":"2024-09-19T08:37:19.774839+0000","last_undegraded":"2024-09-19T08:37:19.774839+0000","last_fullsized":"2024-09-19T08:37:19.774839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:23.965109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582167+0000","last_change":"2024-09-19T08:37:13.331372+0000","last_active":"2024-09-19T08:37:19.582167+0000","last_peered":"2024-09-19T08:37:19.582167+0000","last_clean":"2024-09-19T08:37:19.582167+0000","last_became_active":"2024-09-19T08:37:13.330730+0000","last_became_peered":"2024-09-19T08:37:13.330730+0000","last_unstale":"2024-09-19T08:37:19.582167+0000","last_undegraded":"2024-09-19T08:37:19.582167+0000","last_fullsized":"2024-09-19T08:37:19.582167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:34.222102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775688+0000","last_change":"2024-09-19T08:37:13.324940+0000","last_active":"2024-09-19T08:37:19.775688+0000","last_peered":"2024-09-19T08:37:19.775688+0000","last_clean":"2024-09-19T08:37:19.775688+0000","last_became_active":"2024-09-19T08:37:13.324666+0000","last_became_peered":"2024-09-19T08:37:13.324666+0000","last_unstale":"2024-09-19T08:37:19.775688+0000","last_undegraded":"2024-09-19T08:37:19.775688+0000","last_fullsized":"2024-09-19T08:37:19.775688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:31.517337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774270+0000","last_change":"2024-09-19T08:37:13.319325+0000","last_active":"2024-09-19T08:37:19.774270+0000","last_peered":"2024-09-19T08:37:19.774270+0000","last_clean":"2024-09-19T08:37:19.774270+0000","last_became_active":"2024-09-19T08:37:13.318999+0000","last_became_peered":"2024-09-19T08:37:13.318999+0000","last_unstale":"2024-09-19T08:37:19.774270+0000","last_undegraded":"2024-09-19T08:37:19.774270+0000","last_fullsized":"2024-09-19T08:37:19.774270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:56.050383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.774520+0000","last_change":"2024-09-19T08:37:13.328264+0000","last_active":"2024-09-19T08:37:19.774520+0000","last_peered":"2024-09-19T08:37:19.774520+0000","last_clean":"2024-09-19T08:37:19.774520+0000","last_became_active":"2024-09-19T08:37:13.327999+0000","last_became_peered":"2024-09-19T08:37:13.327999+0000","last_unstale":"2024-09-19T08:37:19.774520+0000","last_undegraded":"2024-09-19T08:37:19.774520+0000","last_fullsized":"2024-09-19T08:37:19.774520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:34.222102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.773805+0000","last_change":"2024-09-19T08:37:13.315873+0000","last_active":"2024-09-19T08:37:19.773805+0000","last_peered":"2024-09-19T08:37:19.773805+0000","last_clean":"2024-09-19T08:37:19.773805+0000","last_became_active":"2024-09-19T08:37:13.315587+0000","last_became_peered":"2024-09-19T08:37:13.315587+0000","last_unstale":"2024-09-19T08:37:19.773805+0000","last_undegraded":"2024-09-19T08:37:19.773805+0000","last_fullsized":"2024-09-19T08:37:19.773805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:18.493336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582687+0000","last_change":"2024-09-19T08:37:13.329601+0000","last_active":"2024-09-19T08:37:19.582687+0000","last_peered":"2024-09-19T08:37:19.582687+0000","last_clean":"2024-09-19T08:37:19.582687+0000","last_became_active":"2024-09-19T08:37:13.328264+0000","last_became_peered":"2024-09-19T08:37:13.328264+0000","last_unstale":"2024-09-19T08:37:19.582687+0000","last_undegraded":"2024-09-19T08:37:19.582687+0000","last_fullsized":"2024-09-19T08:37:19.582687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:26.402913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.582754+0000","last_change":"2024-09-19T08:37:13.327064+0000","last_active":"2024-09-19T08:37:19.582754+0000","last_peered":"2024-09-19T08:37:19.582754+0000","last_clean":"2024-09-19T08:37:19.582754+0000","last_became_active":"2024-09-19T08:37:13.326770+0000","last_became_peered":"2024-09-19T08:37:13.326770+0000","last_unstale":"2024-09-19T08:37:19.582754+0000","last_undegraded":"2024-09-19T08:37:19.582754+0000","last_fullsized":"2024-09-19T08:37:19.582754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:25.894361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-19T08:37:19.775126+0000","last_change":"2024-09-19T08:37:13.330656+0000","last_active":"2024-09-19T08:37:19.775126+0000","last_peered":"2024-09-19T08:37:19.775126+0000","last_clean":"2024-09-19T08:37:19.775126+0000","last_became_active":"2024-09-19T08:37:13.330120+0000","last_became_peered":"2024-09-19T08:37:13.330120+0000","last_unstale":"2024-09-19T08:37:19.775126+0000","last_undegraded":"2024-09-19T08:37:19.775126+0000","last_fullsized":"2024-09-19T08:37:19.775126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:12.292574+0000","last_clean_scrub_stamp":"2024-09-19T08:37:12.292574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:51.787710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":105614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":696074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":696052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":105738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:37:37.894 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T08:37:37.894 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T08:37:37.894 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-19T08:37:37.894 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-19T08:37:38.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.025+0000 7eff679b0640 1 Processor -- start 2024-09-19T08:37:38.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.025+0000 7eff679b0640 1 -- start start 2024-09-19T08:37:38.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.026+0000 7eff679b0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7eff6015e680 0x7eff600cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.026+0000 7eff679b0640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7eff600d0010 0x7eff600d4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.026+0000 7eff679b0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff600d1880 con 0x7eff6015e2a0 2024-09-19T08:37:38.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.026+0000 7eff679b0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7eff600d1b60 con 0x7eff6015e680 2024-09-19T08:37:38.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.026+0000 7eff679b0640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7eff600cf2d0 con 0x7eff600d0010 2024-09-19T08:37:38.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.026+0000 7eff6574c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7eff6015e2a0 0x7eff6006d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:54922/0 (socket says 172.21.15.117:54922) 2024-09-19T08:37:38.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.026+0000 7eff6574c640 1 -- 172.21.15.117:0/3733852297 learned_addr learned my addr 172.21.15.117:0/3733852297 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:38.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.026+0000 7eff64f4b640 1 --2- 172.21.15.117:0/3733852297 >> v2:172.21.15.117:3300/0 conn(0x7eff6015e680 0x7eff600cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.027+0000 7eff65f4d640 1 --2- 172.21.15.117:0/3733852297 >> v2:172.21.15.146:3300/0 conn(0x7eff600d0010 0x7eff600d4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.027+0000 7eff64f4b640 1 -- 172.21.15.117:0/3733852297 >> v2:172.21.15.146:3300/0 conn(0x7eff600d0010 msgr2=0x7eff600d4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:38.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.027+0000 7eff64f4b640 1 --2- 172.21.15.117:0/3733852297 >> v2:172.21.15.146:3300/0 conn(0x7eff600d0010 0x7eff600d4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.027+0000 7eff64f4b640 1 -- 172.21.15.117:0/3733852297 >> v1:172.21.15.117:6789/0 conn(0x7eff6015e2a0 legacy=0x7eff6006d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:38.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.027+0000 7eff64f4b640 1 -- 172.21.15.117:0/3733852297 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff600cf5b0 con 0x7eff6015e680 2024-09-19T08:37:38.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.027+0000 7eff65f4d640 1 --2- 172.21.15.117:0/3733852297 >> v2:172.21.15.146:3300/0 conn(0x7eff600d0010 0x7eff600d4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:38.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.027+0000 7eff64f4b640 1 --2- 172.21.15.117:0/3733852297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff6015e680 0x7eff600cfad0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7eff60163050 tx=0x7eff5402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24764921119daf3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:38.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.027+0000 7eff5ffff640 1 -- 172.21.15.117:0/3733852297 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff54037070 con 0x7eff6015e680 2024-09-19T08:37:38.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.028+0000 7eff5ffff640 1 -- 172.21.15.117:0/3733852297 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff54032440 con 0x7eff6015e680 2024-09-19T08:37:38.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.028+0000 7eff5ffff640 1 -- 172.21.15.117:0/3733852297 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5402ae60 con 0x7eff6015e680 2024-09-19T08:37:38.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.028+0000 7eff679b0640 1 -- 172.21.15.117:0/3733852297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff6015e680 msgr2=0x7eff600cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:38.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.028+0000 7eff679b0640 1 --2- 172.21.15.117:0/3733852297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff6015e680 0x7eff600cfad0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7eff60163050 tx=0x7eff5402a110 comp rx=0 tx=0).stop 2024-09-19T08:37:38.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.028+0000 7eff679b0640 1 -- 172.21.15.117:0/3733852297 shutdown_connections 2024-09-19T08:37:38.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.028+0000 7eff679b0640 1 --2- 172.21.15.117:0/3733852297 >> v2:172.21.15.146:3300/0 conn(0x7eff600d0010 0x7eff600d4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.028+0000 7eff679b0640 1 --2- 172.21.15.117:0/3733852297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff6015e680 0x7eff600cfad0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.028+0000 7eff679b0640 1 -- 172.21.15.117:0/3733852297 >> 172.21.15.117:0/3733852297 conn(0x7eff6009d760 msgr2=0x7eff6008bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:38.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.028+0000 7eff679b0640 1 -- 172.21.15.117:0/3733852297 shutdown_connections 2024-09-19T08:37:38.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.028+0000 7eff679b0640 1 -- 172.21.15.117:0/3733852297 wait complete. 2024-09-19T08:37:38.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.029+0000 7eff679b0640 1 Processor -- start 2024-09-19T08:37:38.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.029+0000 7eff679b0640 1 -- start start 2024-09-19T08:37:38.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.030+0000 7eff679b0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff600d0010 0x7eff600c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.030+0000 7eff679b0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff6015e2a0 0x7eff600b1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.030+0000 7eff679b0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff6015e680 0x7eff600b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.030+0000 7eff679b0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7eff6006dcb0 con 0x7eff6015e680 2024-09-19T08:37:38.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.030+0000 7eff679b0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7eff6006db30 con 0x7eff600d0010 2024-09-19T08:37:38.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.030+0000 7eff679b0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7eff600d48b0 con 0x7eff6015e2a0 2024-09-19T08:37:38.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.030+0000 7eff65f4d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff6015e680 0x7eff600b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.030+0000 7eff65f4d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff6015e680 0x7eff600b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34958/0 (socket says 172.21.15.117:34958) 2024-09-19T08:37:38.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.030+0000 7eff65f4d640 1 -- 172.21.15.117:0/2941446940 learned_addr learned my addr 172.21.15.117:0/2941446940 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:38.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.030+0000 7eff6574c640 1 --2- 172.21.15.117:0/2941446940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff600d0010 0x7eff600c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.030+0000 7eff64f4b640 1 --2- 172.21.15.117:0/2941446940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff6015e2a0 0x7eff600b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.030+0000 7eff65f4d640 1 -- 172.21.15.117:0/2941446940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff6015e2a0 msgr2=0x7eff600b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:38.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.030+0000 7eff65f4d640 1 --2- 172.21.15.117:0/2941446940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff6015e2a0 0x7eff600b1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.030+0000 7eff65f4d640 1 -- 172.21.15.117:0/2941446940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff600d0010 msgr2=0x7eff600c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:38.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.030+0000 7eff65f4d640 1 --2- 172.21.15.117:0/2941446940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff600d0010 0x7eff600c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.030+0000 7eff65f4d640 1 -- 172.21.15.117:0/2941446940 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff600b1ea0 con 0x7eff6015e680 2024-09-19T08:37:38.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.031+0000 7eff65f4d640 1 --2- 172.21.15.117:0/2941446940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff6015e680 0x7eff600b3750 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7eff5800c7f0 tx=0x7eff5800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:38.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.031+0000 7eff5dffb640 1 -- 172.21.15.117:0/2941446940 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff58015070 con 0x7eff6015e680 2024-09-19T08:37:38.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.031+0000 7eff5dffb640 1 -- 172.21.15.117:0/2941446940 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff58007820 con 0x7eff6015e680 2024-09-19T08:37:38.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.031+0000 7eff679b0640 1 -- 172.21.15.117:0/2941446940 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff600c9f00 con 0x7eff6015e680 2024-09-19T08:37:38.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.031+0000 7eff5dffb640 1 -- 172.21.15.117:0/2941446940 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff58007c50 con 0x7eff6015e680 2024-09-19T08:37:38.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.031+0000 7eff679b0640 1 -- 172.21.15.117:0/2941446940 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff600ca4c0 con 0x7eff6015e680 2024-09-19T08:37:38.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.032+0000 7eff679b0640 1 -- 172.21.15.117:0/2941446940 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff600d4c70 con 0x7eff6015e680 2024-09-19T08:37:38.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.032+0000 7eff5dffb640 1 -- 172.21.15.117:0/2941446940 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7eff58018070 con 0x7eff6015e680 2024-09-19T08:37:38.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.033+0000 7eff5dffb640 1 --2- 172.21.15.117:0/2941446940 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7eff4c06c2e0 0x7eff4c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.033+0000 7eff5dffb640 1 -- 172.21.15.117:0/2941446940 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7eff5808b770 con 0x7eff6015e680 2024-09-19T08:37:38.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.033+0000 7eff6574c640 1 --2- 172.21.15.117:0/2941446940 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7eff4c06c2e0 0x7eff4c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.033+0000 7eff6574c640 1 --2- 172.21.15.117:0/2941446940 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7eff4c06c2e0 0x7eff4c06e7a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7eff500012e0 tx=0x7eff50001a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:38.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.037+0000 7eff5dffb640 1 -- 172.21.15.117:0/2941446940 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7eff580595e0 con 0x7eff6015e680 2024-09-19T08:37:38.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.239+0000 7eff679b0640 1 -- 172.21.15.117:0/2941446940 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7eff6006cf90 con 0x7eff6015e680 2024-09-19T08:37:38.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.239+0000 7eff5dffb640 1 -- 172.21.15.117:0/2941446940 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7eff5805d8e0 con 0x7eff6015e680 2024-09-19T08:37:38.239 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:38.240 INFO:teuthology.orchestra.run.smithi117.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T08:37:38.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.241+0000 7eff679b0640 1 -- 172.21.15.117:0/2941446940 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7eff4c06c2e0 msgr2=0x7eff4c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:38.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.241+0000 7eff679b0640 1 --2- 172.21.15.117:0/2941446940 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7eff4c06c2e0 0x7eff4c06e7a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7eff500012e0 tx=0x7eff50001a30 comp rx=0 tx=0).stop 2024-09-19T08:37:38.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.241+0000 7eff679b0640 1 -- 172.21.15.117:0/2941446940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff6015e680 msgr2=0x7eff600b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:38.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.241+0000 7eff679b0640 1 --2- 172.21.15.117:0/2941446940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff6015e680 0x7eff600b3750 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7eff5800c7f0 tx=0x7eff5800ccb0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.241+0000 7eff679b0640 1 -- 172.21.15.117:0/2941446940 shutdown_connections 2024-09-19T08:37:38.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.241+0000 7eff679b0640 1 --2- 172.21.15.117:0/2941446940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff6015e680 0x7eff600b3750 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.241+0000 7eff679b0640 1 --2- 172.21.15.117:0/2941446940 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7eff4c06c2e0 0x7eff4c06e7a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.241+0000 7eff679b0640 1 --2- 172.21.15.117:0/2941446940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff6015e2a0 0x7eff600b1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.241+0000 7eff679b0640 1 --2- 172.21.15.117:0/2941446940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff600d0010 0x7eff600c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.241+0000 7eff679b0640 1 -- 172.21.15.117:0/2941446940 >> 172.21.15.117:0/2941446940 conn(0x7eff6009d760 msgr2=0x7eff600d3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:38.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.242+0000 7eff679b0640 1 -- 172.21.15.117:0/2941446940 shutdown_connections 2024-09-19T08:37:38.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.242+0000 7eff679b0640 1 -- 172.21.15.117:0/2941446940 wait complete. 2024-09-19T08:37:38.252 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-19T08:37:38.252 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:37:38.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.349+0000 7f6b6e21e640 1 Processor -- start 2024-09-19T08:37:38.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.349+0000 7f6b6e21e640 1 -- start start 2024-09-19T08:37:38.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.350+0000 7f6b6e21e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6b68161eb0 0x7f6b681622f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.350+0000 7f6b6e21e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6b681425e0 0x7f6b68142a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.350+0000 7f6b6e21e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b68162b70 con 0x7f6b6806cd20 2024-09-19T08:37:38.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.350+0000 7f6b6e21e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6b68162e50 con 0x7f6b68161eb0 2024-09-19T08:37:38.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.350+0000 7f6b6e21e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f6b68142150 con 0x7f6b681425e0 2024-09-19T08:37:38.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.350+0000 7f6b66ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6b68161eb0 0x7f6b681622f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.350+0000 7f6b66ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6b68161eb0 0x7f6b681622f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34972/0 (socket says 172.21.15.117:34972) 2024-09-19T08:37:38.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.350+0000 7f6b66ffd640 1 -- 172.21.15.117:0/2321684911 learned_addr learned my addr 172.21.15.117:0/2321684911 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:38.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.351+0000 7f6b67fff640 1 --2- 172.21.15.117:0/2321684911 >> v2:172.21.15.146:3300/0 conn(0x7f6b681425e0 0x7f6b68142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.351+0000 7f6b66ffd640 1 -- 172.21.15.117:0/2321684911 >> v2:172.21.15.146:3300/0 conn(0x7f6b681425e0 msgr2=0x7f6b68142a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:38.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.351+0000 7f6b66ffd640 1 --2- 172.21.15.117:0/2321684911 >> v2:172.21.15.146:3300/0 conn(0x7f6b681425e0 0x7f6b68142a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.351+0000 7f6b66ffd640 1 -- 172.21.15.117:0/2321684911 >> v1:172.21.15.146:6789/0 conn(0x7f6b6806cd20 legacy=0x7f6b6806d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:38.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.351+0000 7f6b66ffd640 1 -- 172.21.15.117:0/2321684911 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b68141b00 con 0x7f6b68161eb0 2024-09-19T08:37:38.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.351+0000 7f6b66ffd640 1 --2- 172.21.15.117:0/2321684911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b68161eb0 0x7f6b681622f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6b680cc840 tx=0x7f6b5c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4d2acd35385745 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:38.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.352+0000 7f6b667fc640 1 -- 172.21.15.117:0/2321684911 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c037070 con 0x7f6b68161eb0 2024-09-19T08:37:38.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.352+0000 7f6b667fc640 1 -- 172.21.15.117:0/2321684911 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5c032440 con 0x7f6b68161eb0 2024-09-19T08:37:38.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.352+0000 7f6b667fc640 1 -- 172.21.15.117:0/2321684911 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c032810 con 0x7f6b68161eb0 2024-09-19T08:37:38.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.352+0000 7f6b6e21e640 1 -- 172.21.15.117:0/2321684911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b68161eb0 msgr2=0x7f6b681622f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:38.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.352+0000 7f6b6e21e640 1 --2- 172.21.15.117:0/2321684911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b68161eb0 0x7f6b681622f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6b680cc840 tx=0x7f6b5c02a1a0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.352+0000 7f6b6e21e640 1 -- 172.21.15.117:0/2321684911 shutdown_connections 2024-09-19T08:37:38.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.352+0000 7f6b6e21e640 1 --2- 172.21.15.117:0/2321684911 >> v2:172.21.15.146:3300/0 conn(0x7f6b681425e0 0x7f6b68142a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.352+0000 7f6b6e21e640 1 --2- 172.21.15.117:0/2321684911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b68161eb0 0x7f6b681622f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.352+0000 7f6b6e21e640 1 -- 172.21.15.117:0/2321684911 >> 172.21.15.117:0/2321684911 conn(0x7f6b680b3ed0 msgr2=0x7f6b680b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:38.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.352+0000 7f6b6e21e640 1 -- 172.21.15.117:0/2321684911 shutdown_connections 2024-09-19T08:37:38.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.352+0000 7f6b6e21e640 1 -- 172.21.15.117:0/2321684911 wait complete. 2024-09-19T08:37:38.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.353+0000 7f6b6e21e640 1 Processor -- start 2024-09-19T08:37:38.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.354+0000 7f6b6e21e640 1 -- start start 2024-09-19T08:37:38.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.354+0000 7f6b6e21e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b6806cd20 0x7f6b6813ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.354+0000 7f6b6e21e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b681425e0 0x7f6b6815ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.354+0000 7f6b6e21e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b68161eb0 0x7f6b6815b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.354+0000 7f6b6e21e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6b68141600 con 0x7f6b68161eb0 2024-09-19T08:37:38.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.354+0000 7f6b6e21e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6b68162830 con 0x7f6b681425e0 2024-09-19T08:37:38.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.354+0000 7f6b6e21e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f6b68142fb0 con 0x7f6b6806cd20 2024-09-19T08:37:38.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.354+0000 7f6b67fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b68161eb0 0x7f6b6815b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.354+0000 7f6b67fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b68161eb0 0x7f6b6815b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34978/0 (socket says 172.21.15.117:34978) 2024-09-19T08:37:38.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.354+0000 7f6b67fff640 1 -- 172.21.15.117:0/1980548560 learned_addr learned my addr 172.21.15.117:0/1980548560 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:38.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.354+0000 7f6b66ffd640 1 --2- 172.21.15.117:0/1980548560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b681425e0 0x7f6b6815ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.355+0000 7f6b677fe640 1 --2- 172.21.15.117:0/1980548560 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b6806cd20 0x7f6b6813ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.355+0000 7f6b67fff640 1 -- 172.21.15.117:0/1980548560 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b6806cd20 msgr2=0x7f6b6813ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:38.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.355+0000 7f6b67fff640 1 --2- 172.21.15.117:0/1980548560 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b6806cd20 0x7f6b6813ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.355+0000 7f6b67fff640 1 -- 172.21.15.117:0/1980548560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b681425e0 msgr2=0x7f6b6815ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:38.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.355+0000 7f6b67fff640 1 --2- 172.21.15.117:0/1980548560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b681425e0 0x7f6b6815ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.355+0000 7f6b67fff640 1 -- 172.21.15.117:0/1980548560 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b68159480 con 0x7f6b68161eb0 2024-09-19T08:37:38.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.355+0000 7f6b67fff640 1 --2- 172.21.15.117:0/1980548560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b68161eb0 0x7f6b6815b1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6b60007e40 tx=0x7f6b6000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:38.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.355+0000 7f6b4ffff640 1 -- 172.21.15.117:0/1980548560 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b60014620 con 0x7f6b68161eb0 2024-09-19T08:37:38.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.355+0000 7f6b4ffff640 1 -- 172.21.15.117:0/1980548560 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b60019070 con 0x7f6b68161eb0 2024-09-19T08:37:38.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.355+0000 7f6b4ffff640 1 -- 172.21.15.117:0/1980548560 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b60014a20 con 0x7f6b68161eb0 2024-09-19T08:37:38.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.355+0000 7f6b6e21e640 1 -- 172.21.15.117:0/1980548560 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b6815b9c0 con 0x7f6b68161eb0 2024-09-19T08:37:38.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.355+0000 7f6b6e21e640 1 -- 172.21.15.117:0/1980548560 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b6815b6e0 con 0x7f6b68161eb0 2024-09-19T08:37:38.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.356+0000 7f6b6e21e640 1 -- 172.21.15.117:0/1980548560 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b68142a70 con 0x7f6b68161eb0 2024-09-19T08:37:38.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.357+0000 7f6b4ffff640 1 -- 172.21.15.117:0/1980548560 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6b60014bc0 con 0x7f6b68161eb0 2024-09-19T08:37:38.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.357+0000 7f6b4ffff640 1 --2- 172.21.15.117:0/1980548560 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6b5406c2b0 0x7f6b5406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.357+0000 7f6b4ffff640 1 -- 172.21.15.117:0/1980548560 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6b6008c080 con 0x7f6b68161eb0 2024-09-19T08:37:38.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.357+0000 7f6b677fe640 1 --2- 172.21.15.117:0/1980548560 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6b5406c2b0 0x7f6b5406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.358+0000 7f6b677fe640 1 --2- 172.21.15.117:0/1980548560 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6b5406c2b0 0x7f6b5406e770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6b58004ea0 tx=0x7f6b58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:38.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.361+0000 7f6b4ffff640 1 -- 172.21.15.117:0/1980548560 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6b6005a4b0 con 0x7f6b68161eb0 2024-09-19T08:37:38.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.560+0000 7f6b6e21e640 1 -- 172.21.15.117:0/1980548560 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b680690c0 con 0x7f6b68161eb0 2024-09-19T08:37:38.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.561+0000 7f6b4ffff640 1 -- 172.21.15.117:0/1980548560 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7f6b60059db0 con 0x7f6b68161eb0 2024-09-19T08:37:38.561 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:38.561 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":9,"btime":"2024-09-19T08:37:32:382208+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2592540396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2592540396},{"type":"v1","addr":"172.21.15.117:6833","nonce":2592540396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3561335184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3561335184},{"type":"v1","addr":"172.21.15.117:6835","nonce":3561335184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/2623207604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2623207604},{"type":"v1","addr":"172.21.15.146:6837","nonce":2623207604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:37:12.640173+0000","modified":"2024-09-19T08:37:31.712060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6836/2942334805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2942334805},{"type":"v1","addr":"172.21.15.146:6836","nonce":2942334805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4303,"qdb_cluster":[4303]},"id":1}]} 2024-09-19T08:37:38.561 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 9 2024-09-19T08:37:38.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.563+0000 7f6b6e21e640 1 -- 172.21.15.117:0/1980548560 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6b5406c2b0 msgr2=0x7f6b5406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:38.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.563+0000 7f6b6e21e640 1 --2- 172.21.15.117:0/1980548560 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6b5406c2b0 0x7f6b5406e770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6b58004ea0 tx=0x7f6b58009040 comp rx=0 tx=0).stop 2024-09-19T08:37:38.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.563+0000 7f6b6e21e640 1 -- 172.21.15.117:0/1980548560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b68161eb0 msgr2=0x7f6b6815b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:38.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.563+0000 7f6b6e21e640 1 --2- 172.21.15.117:0/1980548560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b68161eb0 0x7f6b6815b1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6b60007e40 tx=0x7f6b6000e4b0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.563+0000 7f6b6e21e640 1 -- 172.21.15.117:0/1980548560 shutdown_connections 2024-09-19T08:37:38.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.563+0000 7f6b6e21e640 1 --2- 172.21.15.117:0/1980548560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b68161eb0 0x7f6b6815b1a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.563+0000 7f6b6e21e640 1 --2- 172.21.15.117:0/1980548560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b681425e0 0x7f6b6815ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.563+0000 7f6b6e21e640 1 --2- 172.21.15.117:0/1980548560 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6b5406c2b0 0x7f6b5406e770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.563+0000 7f6b6e21e640 1 --2- 172.21.15.117:0/1980548560 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b6806cd20 0x7f6b6813ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.563+0000 7f6b6e21e640 1 -- 172.21.15.117:0/1980548560 >> 172.21.15.117:0/1980548560 conn(0x7f6b680b3ed0 msgr2=0x7f6b6815e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:38.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.563+0000 7f6b6e21e640 1 -- 172.21.15.117:0/1980548560 shutdown_connections 2024-09-19T08:37:38.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.563+0000 7f6b6e21e640 1 -- 172.21.15.117:0/1980548560 wait complete. 2024-09-19T08:37:38.574 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:37:38.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.671+0000 7f9a54911640 1 Processor -- start 2024-09-19T08:37:38.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.671+0000 7f9a54911640 1 -- start start 2024-09-19T08:37:38.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.672+0000 7f9a54911640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9a500add30 0x7f9a500ae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.672+0000 7f9a54911640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a500ae650 con 0x7f9a5015e4f0 2024-09-19T08:37:38.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.672+0000 7f9a54911640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a50070ea0 con 0x7f9a50070930 2024-09-19T08:37:38.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.672+0000 7f9a54911640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f9a5006e8c0 con 0x7f9a500add30 2024-09-19T08:37:38.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.672+0000 7f9a4dd9b640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f9a5015e4f0 0x7f9a500b5050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:54934/0 (socket says 172.21.15.117:54934) 2024-09-19T08:37:38.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.672+0000 7f9a4dd9b640 1 -- 172.21.15.117:0/3499085802 learned_addr learned my addr 172.21.15.117:0/3499085802 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:38.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.672+0000 7f9a4e59c640 1 --2- 172.21.15.117:0/3499085802 >> v2:172.21.15.146:3300/0 conn(0x7f9a500add30 0x7f9a500ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.672+0000 7f9a4d59a640 1 -- 172.21.15.117:0/3499085802 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 538784139 0 0) 0x7f9a500ae650 con 0x7f9a5015e4f0 2024-09-19T08:37:38.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.672+0000 7f9a4d59a640 1 -- 172.21.15.117:0/3499085802 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a3c003520 con 0x7f9a5015e4f0 2024-09-19T08:37:38.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4d59a640 1 -- 172.21.15.117:0/3499085802 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1925163612 0 0) 0x7f9a50070ea0 con 0x7f9a50070930 2024-09-19T08:37:38.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4d59a640 1 -- 172.21.15.117:0/3499085802 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a500ae650 con 0x7f9a50070930 2024-09-19T08:37:38.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4d59a640 1 -- 172.21.15.117:0/3499085802 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3649444535 0 0) 0x7f9a3c003520 con 0x7f9a5015e4f0 2024-09-19T08:37:38.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4d59a640 1 -- 172.21.15.117:0/3499085802 >> v2:172.21.15.146:3300/0 conn(0x7f9a500add30 msgr2=0x7f9a500ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:38.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4d59a640 1 --2- 172.21.15.117:0/3499085802 >> v2:172.21.15.146:3300/0 conn(0x7f9a500add30 0x7f9a500ae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4d59a640 1 -- 172.21.15.117:0/3499085802 >> v1:172.21.15.146:6789/0 conn(0x7f9a50070930 legacy=0x7f9a500b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:38.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4d59a640 1 -- 172.21.15.117:0/3499085802 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a5006eba0 con 0x7f9a5015e4f0 2024-09-19T08:37:38.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4d59a640 1 -- 172.21.15.117:0/3499085802 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f9a38001670 con 0x7f9a5015e4f0 2024-09-19T08:37:38.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4d59a640 1 -- 172.21.15.117:0/3499085802 >> v1:172.21.15.117:6789/0 conn(0x7f9a5015e4f0 legacy=0x7f9a500b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:38.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4d59a640 1 --2- 172.21.15.117:0/3499085802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3c003b40 0x7f9a3c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4d59a640 1 --2- 172.21.15.117:0/3499085802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a3c004800 0x7f9a3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4d59a640 1 --2- 172.21.15.117:0/3499085802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a3c0051c0 0x7f9a3c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4d59a640 1 -- 172.21.15.117:0/3499085802 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5006e8c0 con 0x7f9a3c003b40 2024-09-19T08:37:38.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4d59a640 1 -- 172.21.15.117:0/3499085802 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c00c040 con 0x7f9a3c0051c0 2024-09-19T08:37:38.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4d59a640 1 -- 172.21.15.117:0/3499085802 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f9a3c00c240 con 0x7f9a3c004800 2024-09-19T08:37:38.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4e59c640 1 --2- 172.21.15.117:0/3499085802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3c003b40 0x7f9a3c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4dd9b640 1 --2- 172.21.15.117:0/3499085802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a3c004800 0x7f9a3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4ed9d640 1 --2- 172.21.15.117:0/3499085802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a3c0051c0 0x7f9a3c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4e59c640 1 -- 172.21.15.117:0/3499085802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a3c004800 msgr2=0x7f9a3c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:38.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4e59c640 1 --2- 172.21.15.117:0/3499085802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a3c004800 0x7f9a3c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4e59c640 1 -- 172.21.15.117:0/3499085802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a3c0051c0 msgr2=0x7f9a3c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:38.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4e59c640 1 --2- 172.21.15.117:0/3499085802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a3c0051c0 0x7f9a3c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4e59c640 1 -- 172.21.15.117:0/3499085802 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3c003520 con 0x7f9a3c003b40 2024-09-19T08:37:38.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4ed9d640 1 --2- 172.21.15.117:0/3499085802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a3c0051c0 0x7f9a3c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:38.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.673+0000 7f9a4ed9d640 1 -- 172.21.15.117:0/3499085802 reap_dead start 2024-09-19T08:37:38.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.674+0000 7f9a4e59c640 1 --2- 172.21.15.117:0/3499085802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3c003b40 0x7f9a3c003f40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009fc0 tx=0x7f9a3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134141db7590b15a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:38.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.674+0000 7f9a4d59a640 1 -- 172.21.15.117:0/3499085802 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a40009c10 con 0x7f9a3c003b40 2024-09-19T08:37:38.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.674+0000 7f9a4d59a640 1 -- 172.21.15.117:0/3499085802 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a40036070 con 0x7f9a3c003b40 2024-09-19T08:37:38.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.674+0000 7f9a4d59a640 1 -- 172.21.15.117:0/3499085802 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a40031880 con 0x7f9a3c003b40 2024-09-19T08:37:38.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.674+0000 7f9a54911640 1 -- 172.21.15.117:0/3499085802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3c003b40 msgr2=0x7f9a3c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:38.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.674+0000 7f9a54911640 1 --2- 172.21.15.117:0/3499085802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3c003b40 0x7f9a3c003f40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009fc0 tx=0x7f9a3c005830 comp rx=0 tx=0).stop 2024-09-19T08:37:38.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.675+0000 7f9a54911640 1 -- 172.21.15.117:0/3499085802 shutdown_connections 2024-09-19T08:37:38.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.675+0000 7f9a54911640 1 --2- 172.21.15.117:0/3499085802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a3c003b40 0x7f9a3c003f40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.675+0000 7f9a54911640 1 -- 172.21.15.117:0/3499085802 >> 172.21.15.117:0/3499085802 conn(0x7f9a5006bc10 msgr2=0x7f9a5006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:38.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.675+0000 7f9a54911640 1 -- 172.21.15.117:0/3499085802 shutdown_connections 2024-09-19T08:37:38.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.675+0000 7f9a54911640 1 -- 172.21.15.117:0/3499085802 wait complete. 2024-09-19T08:37:38.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.676+0000 7f9a54911640 1 Processor -- start 2024-09-19T08:37:38.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.676+0000 7f9a54911640 1 -- start start 2024-09-19T08:37:38.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a54911640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a3c003b40 0x7f9a5014d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a54911640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a501606e0 0x7f9a500b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a54911640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a50160b60 0x7f9a500b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a54911640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9a500ae290 con 0x7f9a50160b60 2024-09-19T08:37:38.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a54911640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9a500ae110 con 0x7f9a3c003b40 2024-09-19T08:37:38.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a54911640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f9a500ae410 con 0x7f9a501606e0 2024-09-19T08:37:38.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a4ed9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a50160b60 0x7f9a500b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a4ed9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a50160b60 0x7f9a500b61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34988/0 (socket says 172.21.15.117:34988) 2024-09-19T08:37:38.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a4ed9d640 1 -- 172.21.15.117:0/541644821 learned_addr learned my addr 172.21.15.117:0/541644821 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:38.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a4e59c640 1 --2- 172.21.15.117:0/541644821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a3c003b40 0x7f9a5014d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a4dd9b640 1 --2- 172.21.15.117:0/541644821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a501606e0 0x7f9a500b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a4ed9d640 1 -- 172.21.15.117:0/541644821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a501606e0 msgr2=0x7f9a500b5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:38.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a4ed9d640 1 --2- 172.21.15.117:0/541644821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a501606e0 0x7f9a500b5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a4ed9d640 1 -- 172.21.15.117:0/541644821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a3c003b40 msgr2=0x7f9a5014d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:38.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a4ed9d640 1 --2- 172.21.15.117:0/541644821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a3c003b40 0x7f9a5014d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a4ed9d640 1 -- 172.21.15.117:0/541644821 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a5015aae0 con 0x7f9a50160b60 2024-09-19T08:37:38.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a4ed9d640 1 --2- 172.21.15.117:0/541644821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a50160b60 0x7f9a500b61c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9a500cd0f0 tx=0x7f9a4800e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:38.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a46ffd640 1 -- 172.21.15.117:0/541644821 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a48019070 con 0x7f9a50160b60 2024-09-19T08:37:38.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a46ffd640 1 -- 172.21.15.117:0/541644821 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a480052e0 con 0x7f9a50160b60 2024-09-19T08:37:38.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a46ffd640 1 -- 172.21.15.117:0/541644821 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a48003830 con 0x7f9a50160b60 2024-09-19T08:37:38.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a54911640 1 -- 172.21.15.117:0/541644821 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a5015adc0 con 0x7f9a50160b60 2024-09-19T08:37:38.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.677+0000 7f9a54911640 1 -- 172.21.15.117:0/541644821 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a5015b380 con 0x7f9a50160b60 2024-09-19T08:37:38.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.678+0000 7f9a54911640 1 -- 172.21.15.117:0/541644821 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a500b00f0 con 0x7f9a50160b60 2024-09-19T08:37:38.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.679+0000 7f9a46ffd640 1 -- 172.21.15.117:0/541644821 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9a4801c070 con 0x7f9a50160b60 2024-09-19T08:37:38.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.679+0000 7f9a46ffd640 1 --2- 172.21.15.117:0/541644821 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9a3006c2b0 0x7f9a3006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.680+0000 7f9a46ffd640 1 -- 172.21.15.117:0/541644821 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9a4808ac20 con 0x7f9a50160b60 2024-09-19T08:37:38.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.680+0000 7f9a4e59c640 1 --2- 172.21.15.117:0/541644821 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9a3006c2b0 0x7f9a3006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.680+0000 7f9a4e59c640 1 --2- 172.21.15.117:0/541644821 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9a3006c2b0 0x7f9a3006e770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9a40035000 tx=0x7f9a4002f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:38.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.684+0000 7f9a46ffd640 1 -- 172.21.15.117:0/541644821 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9a48058a00 con 0x7f9a50160b60 2024-09-19T08:37:38.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.884+0000 7f9a54911640 1 -- 172.21.15.117:0/541644821 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a500b05b0 con 0x7f9a50160b60 2024-09-19T08:37:38.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.884+0000 7f9a46ffd640 1 -- 172.21.15.117:0/541644821 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7f9a4805cd00 con 0x7f9a50160b60 2024-09-19T08:37:38.885 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:38.885 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":9,"btime":"2024-09-19T08:37:32:382208+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2592540396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2592540396},{"type":"v1","addr":"172.21.15.117:6833","nonce":2592540396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3561335184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3561335184},{"type":"v1","addr":"172.21.15.117:6835","nonce":3561335184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/2623207604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2623207604},{"type":"v1","addr":"172.21.15.146:6837","nonce":2623207604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:37:12.640173+0000","modified":"2024-09-19T08:37:31.712060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6836/2942334805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2942334805},{"type":"v1","addr":"172.21.15.146:6836","nonce":2942334805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4303,"qdb_cluster":[4303]},"id":1}]} 2024-09-19T08:37:38.885 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 9 2024-09-19T08:37:38.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.887+0000 7f9a54911640 1 -- 172.21.15.117:0/541644821 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9a3006c2b0 msgr2=0x7f9a3006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:38.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.887+0000 7f9a54911640 1 --2- 172.21.15.117:0/541644821 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9a3006c2b0 0x7f9a3006e770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9a40035000 tx=0x7f9a4002f000 comp rx=0 tx=0).stop 2024-09-19T08:37:38.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.887+0000 7f9a54911640 1 -- 172.21.15.117:0/541644821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a50160b60 msgr2=0x7f9a500b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:38.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.887+0000 7f9a54911640 1 --2- 172.21.15.117:0/541644821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a50160b60 0x7f9a500b61c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9a500cd0f0 tx=0x7f9a4800e890 comp rx=0 tx=0).stop 2024-09-19T08:37:38.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.887+0000 7f9a54911640 1 -- 172.21.15.117:0/541644821 shutdown_connections 2024-09-19T08:37:38.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.887+0000 7f9a54911640 1 --2- 172.21.15.117:0/541644821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a50160b60 0x7f9a500b61c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.887+0000 7f9a54911640 1 --2- 172.21.15.117:0/541644821 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9a3006c2b0 0x7f9a3006e770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.887+0000 7f9a54911640 1 --2- 172.21.15.117:0/541644821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a501606e0 0x7f9a500b5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.887+0000 7f9a54911640 1 --2- 172.21.15.117:0/541644821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a3c003b40 0x7f9a5014d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.887+0000 7f9a54911640 1 -- 172.21.15.117:0/541644821 >> 172.21.15.117:0/541644821 conn(0x7f9a5006bc10 msgr2=0x7f9a500b0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:38.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.887+0000 7f9a54911640 1 -- 172.21.15.117:0/541644821 shutdown_connections 2024-09-19T08:37:38.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.887+0000 7f9a54911640 1 -- 172.21.15.117:0/541644821 wait complete. 2024-09-19T08:37:38.897 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:37:38.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.996+0000 7f7302e7b640 1 Processor -- start 2024-09-19T08:37:38.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.996+0000 7f7302e7b640 1 -- start start 2024-09-19T08:37:38.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.997+0000 7f7302e7b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f72fc06cd20 0x7f72fc06d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.997+0000 7f7302e7b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f72fc1425e0 0x7f72fc142a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:38.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.997+0000 7f7302e7b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72fc06d640 con 0x7f72fc161eb0 2024-09-19T08:37:38.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.997+0000 7f7302e7b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f72fc162e50 con 0x7f72fc06cd20 2024-09-19T08:37:38.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.997+0000 7f7302e7b640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f72fc142150 con 0x7f72fc1425e0 2024-09-19T08:37:38.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.997+0000 7f7300c17640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f72fc06cd20 0x7f72fc06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.997+0000 7f7300c17640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f72fc06cd20 0x7f72fc06d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35004/0 (socket says 172.21.15.117:35004) 2024-09-19T08:37:38.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.997+0000 7f72fbfff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f72fc161eb0 0x7f72fc1622f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:54944/0 (socket says 172.21.15.117:54944) 2024-09-19T08:37:38.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.997+0000 7f7300c17640 1 -- 172.21.15.117:0/693973515 learned_addr learned my addr 172.21.15.117:0/693973515 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:38.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.997+0000 7f7301418640 1 --2- 172.21.15.117:0/693973515 >> v2:172.21.15.146:3300/0 conn(0x7f72fc1425e0 0x7f72fc142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:38.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.997+0000 7f7300c17640 1 -- 172.21.15.117:0/693973515 >> v2:172.21.15.146:3300/0 conn(0x7f72fc1425e0 msgr2=0x7f72fc142a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:38.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.997+0000 7f7300c17640 1 --2- 172.21.15.117:0/693973515 >> v2:172.21.15.146:3300/0 conn(0x7f72fc1425e0 0x7f72fc142a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:38.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.997+0000 7f7300c17640 1 -- 172.21.15.117:0/693973515 >> v1:172.21.15.117:6789/0 conn(0x7f72fc161eb0 legacy=0x7f72fc1622f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:38.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.997+0000 7f7300c17640 1 -- 172.21.15.117:0/693973515 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72fc162b70 con 0x7f72fc06cd20 2024-09-19T08:37:38.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.997+0000 7f72fb7fe640 1 -- 172.21.15.117:0/693973515 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3319627116 0 0) 0x7f72fc06d640 con 0x7f72fc161eb0 2024-09-19T08:37:39.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.998+0000 7f7300c17640 1 --2- 172.21.15.117:0/693973515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc06cd20 0x7f72fc06d100 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f72fc15c490 tx=0x7f72e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9289eecaf4ad30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:39.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.998+0000 7f72fb7fe640 1 -- 172.21.15.117:0/693973515 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4037070 con 0x7f72fc06cd20 2024-09-19T08:37:39.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.998+0000 7f72fb7fe640 1 -- 172.21.15.117:0/693973515 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e4032440 con 0x7f72fc06cd20 2024-09-19T08:37:39.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.998+0000 7f72fb7fe640 1 -- 172.21.15.117:0/693973515 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4032810 con 0x7f72fc06cd20 2024-09-19T08:37:39.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.998+0000 7f7302e7b640 1 -- 172.21.15.117:0/693973515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc06cd20 msgr2=0x7f72fc06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:39.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.998+0000 7f7302e7b640 1 --2- 172.21.15.117:0/693973515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc06cd20 0x7f72fc06d100 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f72fc15c490 tx=0x7f72e402a1e0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.998+0000 7f7302e7b640 1 -- 172.21.15.117:0/693973515 shutdown_connections 2024-09-19T08:37:39.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.998+0000 7f7302e7b640 1 --2- 172.21.15.117:0/693973515 >> v2:172.21.15.146:3300/0 conn(0x7f72fc1425e0 0x7f72fc142a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.998+0000 7f7302e7b640 1 --2- 172.21.15.117:0/693973515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc06cd20 0x7f72fc06d100 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.998+0000 7f7302e7b640 1 -- 172.21.15.117:0/693973515 >> 172.21.15.117:0/693973515 conn(0x7f72fc0b3ed0 msgr2=0x7f72fc0b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:39.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.999+0000 7f7302e7b640 1 -- 172.21.15.117:0/693973515 shutdown_connections 2024-09-19T08:37:39.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:38.999+0000 7f7302e7b640 1 -- 172.21.15.117:0/693973515 wait complete. 2024-09-19T08:37:39.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.000+0000 7f7302e7b640 1 Processor -- start 2024-09-19T08:37:39.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.000+0000 7f7302e7b640 1 -- start start 2024-09-19T08:37:39.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.000+0000 7f7302e7b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72fc06cd20 0x7f72fc140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:39.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.000+0000 7f7302e7b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc1425e0 0x7f72fc0d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:39.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.000+0000 7f7302e7b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72fc161eb0 0x7f72fc13fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:39.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.001+0000 7f7302e7b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc141600 con 0x7f72fc1425e0 2024-09-19T08:37:39.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.001+0000 7f7302e7b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc141de0 con 0x7f72fc161eb0 2024-09-19T08:37:39.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.001+0000 7f7302e7b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f72fc142fb0 con 0x7f72fc06cd20 2024-09-19T08:37:39.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.001+0000 7f72fbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc1425e0 0x7f72fc0d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:39.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.001+0000 7f72fbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc1425e0 0x7f72fc0d15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35008/0 (socket says 172.21.15.117:35008) 2024-09-19T08:37:39.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.001+0000 7f72fbfff640 1 -- 172.21.15.117:0/1804619648 learned_addr learned my addr 172.21.15.117:0/1804619648 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:39.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.001+0000 7f7301418640 1 --2- 172.21.15.117:0/1804619648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72fc161eb0 0x7f72fc13fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:39.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.001+0000 7f7300c17640 1 --2- 172.21.15.117:0/1804619648 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72fc06cd20 0x7f72fc140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:39.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.001+0000 7f72fbfff640 1 -- 172.21.15.117:0/1804619648 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72fc06cd20 msgr2=0x7f72fc140e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:39.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.001+0000 7f72fbfff640 1 --2- 172.21.15.117:0/1804619648 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72fc06cd20 0x7f72fc140e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.001+0000 7f72fbfff640 1 -- 172.21.15.117:0/1804619648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72fc161eb0 msgr2=0x7f72fc13fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:39.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.001+0000 7f72fbfff640 1 --2- 172.21.15.117:0/1804619648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72fc161eb0 0x7f72fc13fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.001+0000 7f72fbfff640 1 -- 172.21.15.117:0/1804619648 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72fc15b7a0 con 0x7f72fc1425e0 2024-09-19T08:37:39.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.001+0000 7f72fbfff640 1 --2- 172.21.15.117:0/1804619648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc1425e0 0x7f72fc0d15e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f72ec00c7c0 tx=0x7f72ec00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:39.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.001+0000 7f72f97fa640 1 -- 172.21.15.117:0/1804619648 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec018070 con 0x7f72fc1425e0 2024-09-19T08:37:39.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.001+0000 7f72f97fa640 1 -- 172.21.15.117:0/1804619648 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ec00a640 con 0x7f72fc1425e0 2024-09-19T08:37:39.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.001+0000 7f7302e7b640 1 -- 172.21.15.117:0/1804619648 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72fc15ba80 con 0x7f72fc1425e0 2024-09-19T08:37:39.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.001+0000 7f72f97fa640 1 -- 172.21.15.117:0/1804619648 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec00aa30 con 0x7f72fc1425e0 2024-09-19T08:37:39.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.001+0000 7f7302e7b640 1 -- 172.21.15.117:0/1804619648 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72fc140ae0 con 0x7f72fc1425e0 2024-09-19T08:37:39.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.002+0000 7f7302e7b640 1 -- 172.21.15.117:0/1804619648 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72fc142a70 con 0x7f72fc1425e0 2024-09-19T08:37:39.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.003+0000 7f72f97fa640 1 -- 172.21.15.117:0/1804619648 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f72ec01b070 con 0x7f72fc1425e0 2024-09-19T08:37:39.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.003+0000 7f72f97fa640 1 --2- 172.21.15.117:0/1804619648 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f72dc06c2b0 0x7f72dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:39.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.003+0000 7f72f97fa640 1 -- 172.21.15.117:0/1804619648 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f72ec08ac90 con 0x7f72fc1425e0 2024-09-19T08:37:39.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.004+0000 7f7300c17640 1 --2- 172.21.15.117:0/1804619648 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f72dc06c2b0 0x7f72dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:39.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.004+0000 7f7300c17640 1 --2- 172.21.15.117:0/1804619648 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f72dc06c2b0 0x7f72dc06e770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f72e4034000 tx=0x7f72e402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:39.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.008+0000 7f72f97fa640 1 -- 172.21.15.117:0/1804619648 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f72ec058b00 con 0x7f72fc1425e0 2024-09-19T08:37:39.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.174+0000 7f7302e7b640 1 -- 172.21.15.117:0/1804619648 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72fc0690c0 con 0x7f72fc1425e0 2024-09-19T08:37:39.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.175+0000 7f72f97fa640 1 -- 172.21.15.117:0/1804619648 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18650 (secure 0 0 0) 0x7f72ec05ce00 con 0x7f72fc1425e0 2024-09-19T08:37:39.175 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:39.175 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":26,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:37:17.670150+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:37:10.463000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:37:11.619440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:37:15.342435+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:37:39.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.177+0000 7f7302e7b640 1 -- 172.21.15.117:0/1804619648 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f72dc06c2b0 msgr2=0x7f72dc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:39.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.177+0000 7f7302e7b640 1 --2- 172.21.15.117:0/1804619648 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f72dc06c2b0 0x7f72dc06e770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f72e4034000 tx=0x7f72e402e000 comp rx=0 tx=0).stop 2024-09-19T08:37:39.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.177+0000 7f7302e7b640 1 -- 172.21.15.117:0/1804619648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc1425e0 msgr2=0x7f72fc0d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:39.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.177+0000 7f7302e7b640 1 --2- 172.21.15.117:0/1804619648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc1425e0 0x7f72fc0d15e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f72ec00c7c0 tx=0x7f72ec00cc80 comp rx=0 tx=0).stop 2024-09-19T08:37:39.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.177+0000 7f7302e7b640 1 -- 172.21.15.117:0/1804619648 shutdown_connections 2024-09-19T08:37:39.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.177+0000 7f7302e7b640 1 --2- 172.21.15.117:0/1804619648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72fc161eb0 0x7f72fc13fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.177+0000 7f7302e7b640 1 --2- 172.21.15.117:0/1804619648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc1425e0 0x7f72fc0d15e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.177+0000 7f7302e7b640 1 --2- 172.21.15.117:0/1804619648 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f72dc06c2b0 0x7f72dc06e770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.177+0000 7f7302e7b640 1 --2- 172.21.15.117:0/1804619648 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72fc06cd20 0x7f72fc140e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.177+0000 7f7302e7b640 1 -- 172.21.15.117:0/1804619648 >> 172.21.15.117:0/1804619648 conn(0x7f72fc0b3ed0 msgr2=0x7f72fc15fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:39.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.177+0000 7f7302e7b640 1 -- 172.21.15.117:0/1804619648 shutdown_connections 2024-09-19T08:37:39.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.177+0000 7f7302e7b640 1 -- 172.21.15.117:0/1804619648 wait complete. 2024-09-19T08:37:39.190 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:37:39.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.289+0000 7f87af64c640 1 Processor -- start 2024-09-19T08:37:39.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.289+0000 7f87af64c640 1 -- start start 2024-09-19T08:37:39.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.290+0000 7f87af64c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f87a815e680 0x7f87a80cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:39.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.290+0000 7f87af64c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f87a80d0010 0x7f87a80d4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:39.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.290+0000 7f87af64c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87a80d1880 con 0x7f87a815e2a0 2024-09-19T08:37:39.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.290+0000 7f87af64c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f87a80d1b60 con 0x7f87a80d0010 2024-09-19T08:37:39.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.290+0000 7f87af64c640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f87a80cf2d0 con 0x7f87a815e680 2024-09-19T08:37:39.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.290+0000 7f87adbe9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f87a80d0010 0x7f87a80d4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:39.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.290+0000 7f87adbe9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f87a80d0010 0x7f87a80d4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35010/0 (socket says 172.21.15.117:35010) 2024-09-19T08:37:39.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.290+0000 7f87ad3e8640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f87a815e2a0 0x7f87a806d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:54958/0 (socket says 172.21.15.117:54958) 2024-09-19T08:37:39.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.290+0000 7f87adbe9640 1 -- 172.21.15.117:0/2475956682 learned_addr learned my addr 172.21.15.117:0/2475956682 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:39.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.290+0000 7f87acbe7640 1 --2- 172.21.15.117:0/2475956682 >> v2:172.21.15.146:3300/0 conn(0x7f87a815e680 0x7f87a80cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:39.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.290+0000 7f87adbe9640 1 -- 172.21.15.117:0/2475956682 >> v2:172.21.15.146:3300/0 conn(0x7f87a815e680 msgr2=0x7f87a80cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:39.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.290+0000 7f87adbe9640 1 --2- 172.21.15.117:0/2475956682 >> v2:172.21.15.146:3300/0 conn(0x7f87a815e680 0x7f87a80cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.290+0000 7f87adbe9640 1 -- 172.21.15.117:0/2475956682 >> v1:172.21.15.117:6789/0 conn(0x7f87a815e2a0 legacy=0x7f87a806d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:39.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.290+0000 7f87adbe9640 1 -- 172.21.15.117:0/2475956682 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a80cf5b0 con 0x7f87a80d0010 2024-09-19T08:37:39.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.291+0000 7f87adbe9640 1 --2- 172.21.15.117:0/2475956682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87a80d0010 0x7f87a80d4370 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f87a80a22a0 tx=0x7f87a002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69c305155e2c6a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:39.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.291+0000 7f879ffff640 1 -- 172.21.15.117:0/2475956682 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a0036070 con 0x7f87a80d0010 2024-09-19T08:37:39.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.291+0000 7f879ffff640 1 -- 172.21.15.117:0/2475956682 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a0031600 con 0x7f87a80d0010 2024-09-19T08:37:39.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.291+0000 7f879ffff640 1 -- 172.21.15.117:0/2475956682 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a00319d0 con 0x7f87a80d0010 2024-09-19T08:37:39.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.292+0000 7f87af64c640 1 -- 172.21.15.117:0/2475956682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87a80d0010 msgr2=0x7f87a80d4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:39.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.292+0000 7f87af64c640 1 --2- 172.21.15.117:0/2475956682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87a80d0010 0x7f87a80d4370 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f87a80a22a0 tx=0x7f87a002a6a0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.292+0000 7f87af64c640 1 -- 172.21.15.117:0/2475956682 shutdown_connections 2024-09-19T08:37:39.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.292+0000 7f87af64c640 1 --2- 172.21.15.117:0/2475956682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87a80d0010 0x7f87a80d4370 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.292+0000 7f87af64c640 1 --2- 172.21.15.117:0/2475956682 >> v2:172.21.15.146:3300/0 conn(0x7f87a815e680 0x7f87a80cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.292+0000 7f87af64c640 1 -- 172.21.15.117:0/2475956682 >> 172.21.15.117:0/2475956682 conn(0x7f87a809d760 msgr2=0x7f87a808bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:39.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.292+0000 7f87af64c640 1 -- 172.21.15.117:0/2475956682 shutdown_connections 2024-09-19T08:37:39.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.292+0000 7f87af64c640 1 -- 172.21.15.117:0/2475956682 wait complete. 2024-09-19T08:37:39.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.293+0000 7f87af64c640 1 Processor -- start 2024-09-19T08:37:39.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.293+0000 7f87af64c640 1 -- start start 2024-09-19T08:37:39.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f87af64c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87a80d0010 0x7f87a81528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:39.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f87af64c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87a815e2a0 0x7f87a80c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:39.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f87af64c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87a815e680 0x7f87a815fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:39.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f87af64c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f87a806dcb0 con 0x7f87a80d0010 2024-09-19T08:37:39.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f87af64c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f87a806db30 con 0x7f87a815e680 2024-09-19T08:37:39.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f87af64c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f87a80d48b0 con 0x7f87a815e2a0 2024-09-19T08:37:39.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f87ad3e8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87a80d0010 0x7f87a81528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:39.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f87ad3e8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87a80d0010 0x7f87a81528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35026/0 (socket says 172.21.15.117:35026) 2024-09-19T08:37:39.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f87ad3e8640 1 -- 172.21.15.117:0/2002195182 learned_addr learned my addr 172.21.15.117:0/2002195182 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:39.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f87acbe7640 1 --2- 172.21.15.117:0/2002195182 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87a815e2a0 0x7f87a80c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:39.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f87adbe9640 1 --2- 172.21.15.117:0/2002195182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87a815e680 0x7f87a815fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:39.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f87ad3e8640 1 -- 172.21.15.117:0/2002195182 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87a815e2a0 msgr2=0x7f87a80c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:39.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f87ad3e8640 1 --2- 172.21.15.117:0/2002195182 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87a815e2a0 0x7f87a80c9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f87ad3e8640 1 -- 172.21.15.117:0/2002195182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87a815e680 msgr2=0x7f87a815fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:39.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f87ad3e8640 1 --2- 172.21.15.117:0/2002195182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87a815e680 0x7f87a815fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f87ad3e8640 1 -- 172.21.15.117:0/2002195182 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a80ca510 con 0x7f87a80d0010 2024-09-19T08:37:39.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f87acbe7640 1 --2- 172.21.15.117:0/2002195182 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87a815e2a0 0x7f87a80c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:39.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f87adbe9640 1 --2- 172.21.15.117:0/2002195182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87a815e680 0x7f87a815fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:39.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f87ad3e8640 1 --2- 172.21.15.117:0/2002195182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87a80d0010 0x7f87a81528f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f87a400c400 tx=0x7f87a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:39.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f879dffb640 1 -- 172.21.15.117:0/2002195182 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a40074e0 con 0x7f87a80d0010 2024-09-19T08:37:39.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f879dffb640 1 -- 172.21.15.117:0/2002195182 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a4007680 con 0x7f87a80d0010 2024-09-19T08:37:39.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f87af64c640 1 -- 172.21.15.117:0/2002195182 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87a80ca7f0 con 0x7f87a80d0010 2024-09-19T08:37:39.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f879dffb640 1 -- 172.21.15.117:0/2002195182 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a4004a00 con 0x7f87a80d0010 2024-09-19T08:37:39.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.294+0000 7f87af64c640 1 -- 172.21.15.117:0/2002195182 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87a80cadb0 con 0x7f87a80d0010 2024-09-19T08:37:39.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.295+0000 7f87af64c640 1 -- 172.21.15.117:0/2002195182 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87a80d4c70 con 0x7f87a80d0010 2024-09-19T08:37:39.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.296+0000 7f879dffb640 1 -- 172.21.15.117:0/2002195182 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f87a401a020 con 0x7f87a80d0010 2024-09-19T08:37:39.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.296+0000 7f879dffb640 1 --2- 172.21.15.117:0/2002195182 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f878c06c2b0 0x7f878c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:39.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.296+0000 7f879dffb640 1 -- 172.21.15.117:0/2002195182 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f87a408af40 con 0x7f87a80d0010 2024-09-19T08:37:39.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.296+0000 7f87acbe7640 1 --2- 172.21.15.117:0/2002195182 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f878c06c2b0 0x7f878c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:39.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.297+0000 7f87acbe7640 1 --2- 172.21.15.117:0/2002195182 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f878c06c2b0 0x7f878c06e770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8798006fd0 tx=0x7f8798008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:39.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.300+0000 7f879dffb640 1 -- 172.21.15.117:0/2002195182 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f87a4059400 con 0x7f87a80d0010 2024-09-19T08:37:39.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.499+0000 7f87af64c640 1 -- 172.21.15.117:0/2002195182 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87a80c7c90 con 0x7f87a80d0010 2024-09-19T08:37:39.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.500+0000 7f879dffb640 1 -- 172.21.15.117:0/2002195182 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7f87a4058d00 con 0x7f87a80d0010 2024-09-19T08:37:39.501 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:39.501 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":9,"btime":"2024-09-19T08:37:32:382208+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2592540396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2592540396},{"type":"v1","addr":"172.21.15.117:6833","nonce":2592540396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3561335184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3561335184},{"type":"v1","addr":"172.21.15.117:6835","nonce":3561335184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/2623207604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2623207604},{"type":"v1","addr":"172.21.15.146:6837","nonce":2623207604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:37:12.640173+0000","modified":"2024-09-19T08:37:31.712060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6836/2942334805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2942334805},{"type":"v1","addr":"172.21.15.146:6836","nonce":2942334805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4303,"qdb_cluster":[4303]},"id":1}]} 2024-09-19T08:37:39.502 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 9 2024-09-19T08:37:39.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.502+0000 7f87af64c640 1 -- 172.21.15.117:0/2002195182 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f878c06c2b0 msgr2=0x7f878c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:39.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.502+0000 7f87af64c640 1 --2- 172.21.15.117:0/2002195182 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f878c06c2b0 0x7f878c06e770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8798006fd0 tx=0x7f8798008040 comp rx=0 tx=0).stop 2024-09-19T08:37:39.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.502+0000 7f87af64c640 1 -- 172.21.15.117:0/2002195182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87a80d0010 msgr2=0x7f87a81528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:39.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.502+0000 7f87af64c640 1 --2- 172.21.15.117:0/2002195182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87a80d0010 0x7f87a81528f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f87a400c400 tx=0x7f87a400c8c0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.502+0000 7f87af64c640 1 -- 172.21.15.117:0/2002195182 shutdown_connections 2024-09-19T08:37:39.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.502+0000 7f87af64c640 1 --2- 172.21.15.117:0/2002195182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87a815e680 0x7f87a815fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.502+0000 7f87af64c640 1 --2- 172.21.15.117:0/2002195182 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f878c06c2b0 0x7f878c06e770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.502+0000 7f87af64c640 1 --2- 172.21.15.117:0/2002195182 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87a815e2a0 0x7f87a80c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.502+0000 7f87af64c640 1 --2- 172.21.15.117:0/2002195182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87a80d0010 0x7f87a81528f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:39.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.502+0000 7f87af64c640 1 -- 172.21.15.117:0/2002195182 >> 172.21.15.117:0/2002195182 conn(0x7f87a809d760 msgr2=0x7f87a8161020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:39.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.502+0000 7f87af64c640 1 -- 172.21.15.117:0/2002195182 shutdown_connections 2024-09-19T08:37:39.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:39.502+0000 7f87af64c640 1 -- 172.21.15.117:0/2002195182 wait complete. 2024-09-19T08:37:39.916 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T08:37:12.640173+0000', 'modified': '2024-09-19T08:37:31.712060+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4303}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4303': {'gid': 4303, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6836/2942334805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 2942334805}, {'type': 'v1', 'addr': '172.21.15.146:6836', 'nonce': 2942334805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4303, 'qdb_cluster': [4303]} 2024-09-19T08:37:39.916 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T08:37:39.916 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-19T08:37:40.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.016+0000 7f0018680640 1 Processor -- start 2024-09-19T08:37:40.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.016+0000 7f0018680640 1 -- start start 2024-09-19T08:37:40.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.017+0000 7f0018680640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0010141680 0x7f00100cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.017+0000 7f0018680640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0010142170 0x7f001013f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.017+0000 7f0018680640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f001015d710 con 0x7f00100d0370 2024-09-19T08:37:40.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.017+0000 7f0018680640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f00100d07b0 con 0x7f0010142170 2024-09-19T08:37:40.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.017+0000 7f0018680640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f001015c6f0 con 0x7f0010141680 2024-09-19T08:37:40.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.017+0000 7f001641c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0010141680 0x7f00100cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.017+0000 7f0016c1d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0010142170 0x7f001013f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.017+0000 7f0015c1b640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f00100d0370 0x7f0010141a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.117:43656/0 (socket says 172.21.15.117:43656) 2024-09-19T08:37:40.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.017+0000 7f0015c1b640 1 -- 172.21.15.117:0/1563353879 learned_addr learned my addr 172.21.15.117:0/1563353879 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:40.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.017+0000 7f001541a640 1 -- 172.21.15.117:0/1563353879 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2190019983 0 0) 0x7f001015d710 con 0x7f00100d0370 2024-09-19T08:37:40.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.018+0000 7f001541a640 1 -- 172.21.15.117:0/1563353879 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efffc003520 con 0x7f00100d0370 2024-09-19T08:37:40.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.018+0000 7f0016c1d640 1 -- 172.21.15.117:0/1563353879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0010141680 msgr2=0x7f00100cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:40.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.018+0000 7f0016c1d640 1 --2- 172.21.15.117:0/1563353879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0010141680 0x7f00100cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.018+0000 7f0016c1d640 1 -- 172.21.15.117:0/1563353879 >> v1:172.21.15.146:6789/0 conn(0x7f00100d0370 legacy=0x7f0010141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:40.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.018+0000 7f0016c1d640 1 -- 172.21.15.117:0/1563353879 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0010142600 con 0x7f0010142170 2024-09-19T08:37:40.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.018+0000 7f001641c640 1 --2- 172.21.15.117:0/1563353879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0010141680 0x7f00100cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:37:40.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.018+0000 7f0016c1d640 1 --2- 172.21.15.117:0/1563353879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0010142170 0x7f001013f8b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0008009d90 tx=0x7f000802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34e6aecb562162e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:40.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.018+0000 7f001541a640 1 -- 172.21.15.117:0/1563353879 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0008007740 con 0x7f0010142170 2024-09-19T08:37:40.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.019+0000 7f001541a640 1 -- 172.21.15.117:0/1563353879 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00080078e0 con 0x7f0010142170 2024-09-19T08:37:40.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.019+0000 7f001541a640 1 -- 172.21.15.117:0/1563353879 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0008007c90 con 0x7f0010142170 2024-09-19T08:37:40.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.019+0000 7f0018680640 1 -- 172.21.15.117:0/1563353879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0010142170 msgr2=0x7f001013f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:40.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.019+0000 7f0018680640 1 --2- 172.21.15.117:0/1563353879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0010142170 0x7f001013f8b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0008009d90 tx=0x7f000802a660 comp rx=0 tx=0).stop 2024-09-19T08:37:40.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.019+0000 7f0018680640 1 -- 172.21.15.117:0/1563353879 shutdown_connections 2024-09-19T08:37:40.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.019+0000 7f0018680640 1 --2- 172.21.15.117:0/1563353879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0010142170 0x7f001013f8b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.019+0000 7f0018680640 1 --2- 172.21.15.117:0/1563353879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0010141680 0x7f00100cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.019+0000 7f0018680640 1 -- 172.21.15.117:0/1563353879 >> 172.21.15.117:0/1563353879 conn(0x7f00100b3ed0 msgr2=0x7f00100b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:40.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.019+0000 7f0018680640 1 -- 172.21.15.117:0/1563353879 shutdown_connections 2024-09-19T08:37:40.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.019+0000 7f0018680640 1 -- 172.21.15.117:0/1563353879 wait complete. 2024-09-19T08:37:40.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.020+0000 7f0018680640 1 Processor -- start 2024-09-19T08:37:40.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.020+0000 7f0018680640 1 -- start start 2024-09-19T08:37:40.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.021+0000 7f0018680640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00100d0370 0x7f00100ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.021+0000 7f0018680640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0010141680 0x7f001015b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.021+0000 7f0018680640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0010142170 0x7f00101570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.021+0000 7f0018680640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f001015cf10 con 0x7f00100d0370 2024-09-19T08:37:40.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.021+0000 7f0018680640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f001015cc30 con 0x7f0010142170 2024-09-19T08:37:40.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.021+0000 7f0018680640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f001015d1f0 con 0x7f0010141680 2024-09-19T08:37:40.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.021+0000 7f001641c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00100d0370 0x7f00100ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.021+0000 7f001641c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00100d0370 0x7f00100ca0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35034/0 (socket says 172.21.15.117:35034) 2024-09-19T08:37:40.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.021+0000 7f001641c640 1 -- 172.21.15.117:0/1960691357 learned_addr learned my addr 172.21.15.117:0/1960691357 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:40.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.021+0000 7f0016c1d640 1 --2- 172.21.15.117:0/1960691357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0010142170 0x7f00101570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.021+0000 7f0015c1b640 1 --2- 172.21.15.117:0/1960691357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0010141680 0x7f001015b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.021+0000 7f001641c640 1 -- 172.21.15.117:0/1960691357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0010141680 msgr2=0x7f001015b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:40.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.021+0000 7f001641c640 1 --2- 172.21.15.117:0/1960691357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0010141680 0x7f001015b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.021+0000 7f001641c640 1 -- 172.21.15.117:0/1960691357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0010142170 msgr2=0x7f00101570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:40.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.021+0000 7f001641c640 1 --2- 172.21.15.117:0/1960691357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0010142170 0x7f00101570a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.026 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.021+0000 7f001641c640 1 -- 172.21.15.117:0/1960691357 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001015bef0 con 0x7f00100d0370 2024-09-19T08:37:40.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.022+0000 7f001641c640 1 --2- 172.21.15.117:0/1960691357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00100d0370 0x7f00100ca0a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f000c00ec10 tx=0x7f000c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:40.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.022+0000 7f0006ffd640 1 -- 172.21.15.117:0/1960691357 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c017070 con 0x7f00100d0370 2024-09-19T08:37:40.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.022+0000 7f0006ffd640 1 -- 172.21.15.117:0/1960691357 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000c00cc30 con 0x7f00100d0370 2024-09-19T08:37:40.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.022+0000 7f0018680640 1 -- 172.21.15.117:0/1960691357 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00100ca7a0 con 0x7f00100d0370 2024-09-19T08:37:40.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.022+0000 7f0006ffd640 1 -- 172.21.15.117:0/1960691357 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c013470 con 0x7f00100d0370 2024-09-19T08:37:40.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.022+0000 7f0018680640 1 -- 172.21.15.117:0/1960691357 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00100cad60 con 0x7f00100d0370 2024-09-19T08:37:40.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.023+0000 7f0006ffd640 1 -- 172.21.15.117:0/1960691357 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f000c01a070 con 0x7f00100d0370 2024-09-19T08:37:40.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.024+0000 7f0006ffd640 1 --2- 172.21.15.117:0/1960691357 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7efff406c2b0 0x7efff406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.024+0000 7f0006ffd640 1 -- 172.21.15.117:0/1960691357 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f000c08b730 con 0x7f00100d0370 2024-09-19T08:37:40.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.024+0000 7f0015c1b640 1 --2- 172.21.15.117:0/1960691357 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7efff406c2b0 0x7efff406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.024+0000 7f0015c1b640 1 --2- 172.21.15.117:0/1960691357 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7efff406c2b0 0x7efff406e770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f00101f5280 tx=0x7f0000009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:40.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.025+0000 7f001b414740 1 Processor -- start 2024-09-19T08:37:40.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.025+0000 7f001b414740 1 -- start start 2024-09-19T08:37:40.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.025+0000 7f001b414740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5806bd2c0 0x55a580702a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.025+0000 7f001b414740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806baa80 0x55a5806bd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.025+0000 7f001b414740 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a5806bea50 0x55a5806b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.025+0000 7f001b414740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a58061f520 con 0x55a5806baa80 2024-09-19T08:37:40.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.025+0000 7f001b414740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a5805c73e0 con 0x55a5806bd2c0 2024-09-19T08:37:40.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.025+0000 7f001b414740 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x55a58061b4e0 con 0x55a5806bea50 2024-09-19T08:37:40.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.026+0000 7f0015c1b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806baa80 0x55a5806bd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.026+0000 7f0015c1b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806baa80 0x55a5806bd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35042/0 (socket says 172.21.15.117:35042) 2024-09-19T08:37:40.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.026+0000 7f0015c1b640 1 -- 172.21.15.117:0/1818516350 learned_addr learned my addr 172.21.15.117:0/1818516350 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:40.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.026+0000 7f001641c640 1 --2- 172.21.15.117:0/1818516350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5806bd2c0 0x55a580702a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.026+0000 7f0016c1d640 1 --2- 172.21.15.117:0/1818516350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a5806bea50 0x55a5806b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.026+0000 7f0015c1b640 1 -- 172.21.15.117:0/1818516350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a5806bea50 msgr2=0x55a5806b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:40.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.026+0000 7f0015c1b640 1 --2- 172.21.15.117:0/1818516350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a5806bea50 0x55a5806b78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.026+0000 7f0015c1b640 1 -- 172.21.15.117:0/1818516350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5806bd2c0 msgr2=0x55a580702a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:40.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.026+0000 7f0015c1b640 1 --2- 172.21.15.117:0/1818516350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5806bd2c0 0x55a580702a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.026+0000 7f0015c1b640 1 -- 172.21.15.117:0/1818516350 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5805e22f0 con 0x55a5806baa80 2024-09-19T08:37:40.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.026+0000 7f0016c1d640 1 --2- 172.21.15.117:0/1818516350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a5806bea50 0x55a5806b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:40.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.026+0000 7f0015c1b640 1 --2- 172.21.15.117:0/1818516350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806baa80 0x55a5806bd6a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0000005c30 tx=0x7f0000010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b796d0853e6a4db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:40.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.026+0000 7efff3fff640 1 -- 172.21.15.117:0/1818516350 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0000005c60 con 0x55a5806baa80 2024-09-19T08:37:40.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.026+0000 7efff3fff640 1 -- 172.21.15.117:0/1818516350 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0000005e00 con 0x55a5806baa80 2024-09-19T08:37:40.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.026+0000 7efff3fff640 1 -- 172.21.15.117:0/1818516350 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0000014bb0 con 0x55a5806baa80 2024-09-19T08:37:40.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.027+0000 7f001b414740 1 -- 172.21.15.117:0/1818516350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806baa80 msgr2=0x55a5806bd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:40.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.027+0000 7f001b414740 1 --2- 172.21.15.117:0/1818516350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806baa80 0x55a5806bd6a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0000005c30 tx=0x7f0000010000 comp rx=0 tx=0).stop 2024-09-19T08:37:40.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.027+0000 7f001b414740 1 -- 172.21.15.117:0/1818516350 shutdown_connections 2024-09-19T08:37:40.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.027+0000 7f001b414740 1 --2- 172.21.15.117:0/1818516350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a5806bea50 0x55a5806b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.027+0000 7f001b414740 1 --2- 172.21.15.117:0/1818516350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806baa80 0x55a5806bd6a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.027+0000 7f001b414740 1 --2- 172.21.15.117:0/1818516350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5806bd2c0 0x55a580702a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.027+0000 7f001b414740 1 -- 172.21.15.117:0/1818516350 >> 172.21.15.117:0/1818516350 conn(0x55a5806b9a80 msgr2=0x55a580701f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:40.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.027+0000 7f001b414740 1 -- 172.21.15.117:0/1818516350 shutdown_connections 2024-09-19T08:37:40.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.027+0000 7f001b414740 1 -- 172.21.15.117:0/1818516350 wait complete. 2024-09-19T08:37:40.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.027+0000 7f001b414740 1 -- start start 2024-09-19T08:37:40.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.027+0000 7f001b414740 1 Processor -- start 2024-09-19T08:37:40.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.028+0000 7f001b414740 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a5806bd2c0 0x55a5806e7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.028+0000 7f001b414740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5806bea50 0x55a5806db2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.028+0000 7f001b414740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806dbdd0 0x55a5806b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.028+0000 7f001b414740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a5806b8f20 con 0x55a5806dbdd0 2024-09-19T08:37:40.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.028+0000 7f001b414740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a5805a8450 con 0x55a5806bea50 2024-09-19T08:37:40.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.028+0000 7f001b414740 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x55a580703290 con 0x55a5806bd2c0 2024-09-19T08:37:40.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.028+0000 7f001b414740 10 client.0 _ll_register_callbacks cb 0x55a580331ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:37:40.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.028+0000 7f0016c1d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806dbdd0 0x55a5806b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.028+0000 7f0016c1d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806dbdd0 0x55a5806b67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35054/0 (socket says 172.21.15.117:35054) 2024-09-19T08:37:40.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.028+0000 7f0016c1d640 1 -- 172.21.15.117:0/4107764580 learned_addr learned my addr 172.21.15.117:0/4107764580 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:40.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.029+0000 7f0015c1b640 1 --2- 172.21.15.117:0/4107764580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5806bea50 0x55a5806db2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.029+0000 7f001641c640 1 --2- 172.21.15.117:0/4107764580 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a5806bd2c0 0x55a5806e7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.029+0000 7f0016c1d640 1 -- 172.21.15.117:0/4107764580 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a5806bd2c0 msgr2=0x55a5806e7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:40.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.029+0000 7f0016c1d640 1 --2- 172.21.15.117:0/4107764580 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a5806bd2c0 0x55a5806e7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.029+0000 7f0016c1d640 1 -- 172.21.15.117:0/4107764580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5806bea50 msgr2=0x55a5806db2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:40.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.029+0000 7f0016c1d640 1 --2- 172.21.15.117:0/4107764580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5806bea50 0x55a5806db2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.029+0000 7f0016c1d640 1 -- 172.21.15.117:0/4107764580 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5803322d0 con 0x55a5806dbdd0 2024-09-19T08:37:40.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.029+0000 7f0016c1d640 1 --2- 172.21.15.117:0/4107764580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806dbdd0 0x55a5806b67d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f000802ac50 tx=0x7f0008004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cdec5ac378d7d2a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:40.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.029+0000 7efff17fa640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-19T08:37:40.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.029+0000 7efff17fa640 1 -- 172.21.15.117:0/4107764580 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0008009450 con 0x55a5806dbdd0 2024-09-19T08:37:40.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.029+0000 7efff17fa640 1 -- 172.21.15.117:0/4107764580 <== mon.0 v2:172.21.15.117:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f000803d430 con 0x55a5806dbdd0 2024-09-19T08:37:40.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.029+0000 7f001b414740 1 -- 172.21.15.117:0/4107764580 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0000005e00 con 0x55a5806dbdd0 2024-09-19T08:37:40.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.029+0000 7efff17fa640 1 -- 172.21.15.117:0/4107764580 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f0008009a30 con 0x55a5806dbdd0 2024-09-19T08:37:40.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.029+0000 7f001b414740 10 client.4677 fetch_fsmap learned FSMap version 9 2024-09-19T08:37:40.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.029+0000 7f001b414740 1 -- 172.21.15.117:0/4107764580 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a5803fc6b0 con 0x55a5806dbdd0 2024-09-19T08:37:40.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.029+0000 7efff17fa640 1 -- 172.21.15.117:0/4107764580 <== mon.0 v2:172.21.15.117:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0000005e00 con 0x55a5806dbdd0 2024-09-19T08:37:40.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.029+0000 7efff17fa640 1 -- 172.21.15.117:0/4107764580 <== mon.0 v2:172.21.15.117:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f000803d630 con 0x55a5806dbdd0 2024-09-19T08:37:40.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.029+0000 7f001b414740 10 client.4677 fetch_fsmap finished waiting for FSMap version 9 2024-09-19T08:37:40.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.030+0000 7f001b414740 10 client.4677 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:37:40.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.030+0000 7f001b414740 20 client.4677 populate_metadata read hostname 'smithi117' 2024-09-19T08:37:40.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.030+0000 7f001b414740 1 --2- 172.21.15.117:0/4107764580 >> [v2:172.21.15.146:6834/2942334805,v1:172.21.15.146:6836/2942334805] conn(0x55a5806dca50 0x55a5806dce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.030+0000 7f001b414740 4 client.4677 mds_command: new command op to 4303 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:37:40.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.030+0000 7f001b414740 1 -- 172.21.15.117:0/4107764580 --> [v2:172.21.15.146:6834/2942334805,v1:172.21.15.146:6836/2942334805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a58062cc50 con 0x55a5806dca50 2024-09-19T08:37:40.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.030+0000 7f001641c640 1 --2- 172.21.15.117:0/4107764580 >> [v2:172.21.15.146:6834/2942334805,v1:172.21.15.146:6836/2942334805] conn(0x55a5806dca50 0x55a5806dce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.030+0000 7f001641c640 1 --2- 172.21.15.117:0/4107764580 >> [v2:172.21.15.146:6834/2942334805,v1:172.21.15.146:6836/2942334805] conn(0x55a5806dca50 0x55a5806dce30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d97fcc0b446e755 server_cookie=e365934eb5c17b94 in_seq=0 out_seq=0 2024-09-19T08:37:40.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.030+0000 7efff17fa640 10 client.4677 ms_handle_connect on v2:172.21.15.146:6834/2942334805 2024-09-19T08:37:40.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.031+0000 7efff17fa640 1 -- 172.21.15.117:0/4107764580 <== mds.0 v2:172.21.15.146:6834/2942334805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a58062cc50 con 0x55a5806dca50 2024-09-19T08:37:40.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.031+0000 7efff17fa640 10 client.4677 handle_command_reply: tid=0 2024-09-19T08:37:40.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.031+0000 7f001b414740 1 client.4677 shutdown 2024-09-19T08:37:40.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.031+0000 7f001b414740 1 -- 172.21.15.117:0/4107764580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806dbdd0 msgr2=0x55a5806b67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:40.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.031+0000 7f001b414740 1 --2- 172.21.15.117:0/4107764580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806dbdd0 0x55a5806b67d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f000802ac50 tx=0x7f0008004ab0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.031+0000 7f001b414740 1 -- 172.21.15.117:0/4107764580 shutdown_connections 2024-09-19T08:37:40.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.031+0000 7f001b414740 1 --2- 172.21.15.117:0/4107764580 >> [v2:172.21.15.146:6834/2942334805,v1:172.21.15.146:6836/2942334805] conn(0x55a5806dca50 0x55a5806dce30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.031+0000 7f001b414740 1 --2- 172.21.15.117:0/4107764580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806dbdd0 0x55a5806b67d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.031+0000 7f001b414740 1 --2- 172.21.15.117:0/4107764580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5806bea50 0x55a5806db2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.031+0000 7f001b414740 1 --2- 172.21.15.117:0/4107764580 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a5806bd2c0 0x55a5806e7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.031+0000 7efff17fa640 0 client.4677 ms_handle_reset on v2:172.21.15.146:6834/2942334805 2024-09-19T08:37:40.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.031+0000 7f001b414740 1 -- 172.21.15.117:0/4107764580 >> 172.21.15.117:0/4107764580 conn(0x55a5806baa80 msgr2=0x55a580700dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:40.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.031+0000 7f001b414740 1 -- 172.21.15.117:0/4107764580 shutdown_connections 2024-09-19T08:37:40.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.031+0000 7f001b414740 1 -- 172.21.15.117:0/4107764580 wait complete. 2024-09-19T08:37:40.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.031+0000 7f001b414740 20 client.4677 trim_cache size 0 max 16384 2024-09-19T08:37:40.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.049+0000 7f001b414740 1 Processor -- start 2024-09-19T08:37:40.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.049+0000 7f001b414740 1 -- start start 2024-09-19T08:37:40.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.049+0000 7f001b414740 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a5806bd2c0 0x55a5806bc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.049+0000 7f001b414740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5806bea50 0x55a5806daeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.049+0000 7f001b414740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806dbdd0 0x55a5806db3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.049+0000 7f001b414740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f00101fec00 con 0x55a5806dbdd0 2024-09-19T08:37:40.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.049+0000 7f001b414740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f00101fdf00 con 0x55a5806bea50 2024-09-19T08:37:40.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.049+0000 7f001b414740 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f00101fe550 con 0x55a5806bd2c0 2024-09-19T08:37:40.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.050+0000 7f0016c1d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806dbdd0 0x55a5806db3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.050+0000 7f0016c1d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806dbdd0 0x55a5806db3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35066/0 (socket says 172.21.15.117:35066) 2024-09-19T08:37:40.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.050+0000 7f0016c1d640 1 -- 172.21.15.117:0/1348314526 learned_addr learned my addr 172.21.15.117:0/1348314526 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:40.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.050+0000 7f0016c1d640 1 -- 172.21.15.117:0/1348314526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a5806bd2c0 msgr2=0x55a5806bc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:40.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.050+0000 7f0016c1d640 1 --2- 172.21.15.117:0/1348314526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a5806bd2c0 0x55a5806bc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.050+0000 7f0016c1d640 1 -- 172.21.15.117:0/1348314526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5806bea50 msgr2=0x55a5806daeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:40.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.050+0000 7f0016c1d640 1 --2- 172.21.15.117:0/1348314526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5806bea50 0x55a5806daeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.050+0000 7f0016c1d640 1 -- 172.21.15.117:0/1348314526 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5806b6b40 con 0x55a5806dbdd0 2024-09-19T08:37:40.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.050+0000 7f0016c1d640 1 --2- 172.21.15.117:0/1348314526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806dbdd0 0x55a5806db3f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0008009d10 tx=0x7f000803f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d079fe46b2e54f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:40.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.050+0000 7efff37fe640 1 -- 172.21.15.117:0/1348314526 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0008055070 con 0x55a5806dbdd0 2024-09-19T08:37:40.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.050+0000 7efff37fe640 1 -- 172.21.15.117:0/1348314526 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0008007dd0 con 0x55a5806dbdd0 2024-09-19T08:37:40.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.050+0000 7efff37fe640 1 -- 172.21.15.117:0/1348314526 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0008009450 con 0x55a5806dbdd0 2024-09-19T08:37:40.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.051+0000 7f001b414740 1 -- 172.21.15.117:0/1348314526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806dbdd0 msgr2=0x55a5806db3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:40.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.051+0000 7f001b414740 1 --2- 172.21.15.117:0/1348314526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806dbdd0 0x55a5806db3f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0008009d10 tx=0x7f000803f070 comp rx=0 tx=0).stop 2024-09-19T08:37:40.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.051+0000 7f001b414740 1 -- 172.21.15.117:0/1348314526 shutdown_connections 2024-09-19T08:37:40.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.051+0000 7f001b414740 1 --2- 172.21.15.117:0/1348314526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806dbdd0 0x55a5806db3f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.051+0000 7f001b414740 1 --2- 172.21.15.117:0/1348314526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5806bea50 0x55a5806daeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.051+0000 7f001b414740 1 --2- 172.21.15.117:0/1348314526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a5806bd2c0 0x55a5806bc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.051+0000 7f001b414740 1 -- 172.21.15.117:0/1348314526 >> 172.21.15.117:0/1348314526 conn(0x55a5806baa80 msgr2=0x55a5806decb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:40.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.051+0000 7f001b414740 1 -- 172.21.15.117:0/1348314526 shutdown_connections 2024-09-19T08:37:40.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.051+0000 7f001b414740 1 -- 172.21.15.117:0/1348314526 wait complete. 2024-09-19T08:37:40.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.051+0000 7f001b414740 1 -- start start 2024-09-19T08:37:40.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.051+0000 7f001b414740 1 Processor -- start 2024-09-19T08:37:40.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.052+0000 7f001b414740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806bd2c0 0x55a5806fe570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.052+0000 7f001b414740 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a5806bea50 0x55a5806b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.052+0000 7f001b414740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5806dbdd0 0x55a5806d85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.052+0000 7f001b414740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a5806b7360 con 0x55a5806bd2c0 2024-09-19T08:37:40.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.052+0000 7f001b414740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a5806e7620 con 0x55a5806dbdd0 2024-09-19T08:37:40.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.052+0000 7f001b414740 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x55a580705560 con 0x55a5806bea50 2024-09-19T08:37:40.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.052+0000 7f001b414740 10 client.0 _ll_register_callbacks cb 0x7efffc0036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:37:40.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.052+0000 7f001641c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806bd2c0 0x55a5806fe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.052+0000 7f001641c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806bd2c0 0x55a5806fe570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35074/0 (socket says 172.21.15.117:35074) 2024-09-19T08:37:40.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.052+0000 7f001641c640 1 -- 172.21.15.117:0/3278810176 learned_addr learned my addr 172.21.15.117:0/3278810176 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:40.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7f0015c1b640 1 --2- 172.21.15.117:0/3278810176 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a5806bea50 0x55a5806b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7f0016c1d640 1 --2- 172.21.15.117:0/3278810176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5806dbdd0 0x55a5806d85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7f001641c640 1 -- 172.21.15.117:0/3278810176 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a5806bea50 msgr2=0x55a5806b7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:40.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7f001641c640 1 --2- 172.21.15.117:0/3278810176 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a5806bea50 0x55a5806b7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7f001641c640 1 -- 172.21.15.117:0/3278810176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5806dbdd0 msgr2=0x55a5806d85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:40.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7f001641c640 1 --2- 172.21.15.117:0/3278810176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5806dbdd0 0x55a5806d85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7f001641c640 1 -- 172.21.15.117:0/3278810176 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5806bda10 con 0x55a5806bd2c0 2024-09-19T08:37:40.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7f0015c1b640 1 --2- 172.21.15.117:0/3278810176 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a5806bea50 0x55a5806b7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:40.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7f0016c1d640 1 --2- 172.21.15.117:0/3278810176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5806dbdd0 0x55a5806d85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:40.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7f001641c640 1 --2- 172.21.15.117:0/3278810176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806bd2c0 0x55a5806fe570 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f000c016000 tx=0x7f000c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a59154573a375bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:40.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7efff17fa640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-19T08:37:40.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7efff17fa640 1 -- 172.21.15.117:0/3278810176 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c021040 con 0x55a5806bd2c0 2024-09-19T08:37:40.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7efff17fa640 1 -- 172.21.15.117:0/3278810176 <== mon.0 v2:172.21.15.117:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f000c055ad0 con 0x55a5806bd2c0 2024-09-19T08:37:40.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7f001b414740 1 -- 172.21.15.117:0/3278810176 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0008007dd0 con 0x55a5806bd2c0 2024-09-19T08:37:40.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7efff17fa640 1 -- 172.21.15.117:0/3278810176 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f000c062040 con 0x55a5806bd2c0 2024-09-19T08:37:40.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7f001b414740 10 client.4683 fetch_fsmap learned FSMap version 9 2024-09-19T08:37:40.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7f001b414740 1 -- 172.21.15.117:0/3278810176 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a5806b8430 con 0x55a5806bd2c0 2024-09-19T08:37:40.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7efff17fa640 1 -- 172.21.15.117:0/3278810176 <== mon.0 v2:172.21.15.117:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0008007dd0 con 0x55a5806bd2c0 2024-09-19T08:37:40.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7efff17fa640 1 -- 172.21.15.117:0/3278810176 <== mon.0 v2:172.21.15.117:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f000c024060 con 0x55a5806bd2c0 2024-09-19T08:37:40.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7f001b414740 10 client.4683 fetch_fsmap finished waiting for FSMap version 9 2024-09-19T08:37:40.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7f001b414740 10 client.4683 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:37:40.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7f001b414740 20 client.4683 populate_metadata read hostname 'smithi117' 2024-09-19T08:37:40.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7f001b414740 1 --2- 172.21.15.117:0/3278810176 >> [v2:172.21.15.146:6834/2942334805,v1:172.21.15.146:6836/2942334805] conn(0x55a58078b8e0 0x55a58078bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7f001b414740 4 client.4683 mds_command: new command op to 4303 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:37:40.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7f001b414740 1 -- 172.21.15.117:0/3278810176 --> [v2:172.21.15.146:6834/2942334805,v1:172.21.15.146:6836/2942334805] -- command(tid 0: {"prefix": "status"}) -- 0x55a580626fa0 con 0x55a58078b8e0 2024-09-19T08:37:40.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.053+0000 7f0015c1b640 1 --2- 172.21.15.117:0/3278810176 >> [v2:172.21.15.146:6834/2942334805,v1:172.21.15.146:6836/2942334805] conn(0x55a58078b8e0 0x55a58078bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.054+0000 7efff17fa640 10 client.4683 ms_handle_connect on v2:172.21.15.146:6834/2942334805 2024-09-19T08:37:40.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.054+0000 7f0015c1b640 1 --2- 172.21.15.117:0/3278810176 >> [v2:172.21.15.146:6834/2942334805,v1:172.21.15.146:6836/2942334805] conn(0x55a58078b8e0 0x55a58078bcc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b03bb2bf7dd6525 server_cookie=bcf4cef964b04fa2 in_seq=0 out_seq=0 2024-09-19T08:37:40.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.054+0000 7efff17fa640 1 -- 172.21.15.117:0/3278810176 <== mds.0 v2:172.21.15.146:6834/2942334805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55a580626fa0 con 0x55a58078b8e0 2024-09-19T08:37:40.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.054+0000 7efff17fa640 10 client.4683 handle_command_reply: tid=0 2024-09-19T08:37:40.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.054+0000 7f001b414740 1 client.4683 shutdown 2024-09-19T08:37:40.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.054+0000 7f001b414740 1 -- 172.21.15.117:0/3278810176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806bd2c0 msgr2=0x55a5806fe570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:40.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.054+0000 7f001b414740 1 --2- 172.21.15.117:0/3278810176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806bd2c0 0x55a5806fe570 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f000c016000 tx=0x7f000c000bc0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.054+0000 7f001b414740 1 -- 172.21.15.117:0/3278810176 shutdown_connections 2024-09-19T08:37:40.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.054+0000 7f001b414740 1 --2- 172.21.15.117:0/3278810176 >> [v2:172.21.15.146:6834/2942334805,v1:172.21.15.146:6836/2942334805] conn(0x55a58078b8e0 0x55a58078bcc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.054+0000 7f001b414740 1 --2- 172.21.15.117:0/3278810176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5806dbdd0 0x55a5806d85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.054+0000 7f001b414740 1 --2- 172.21.15.117:0/3278810176 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a5806bea50 0x55a5806b7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.054+0000 7f001b414740 1 --2- 172.21.15.117:0/3278810176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a5806bd2c0 0x55a5806fe570 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.054+0000 7efff17fa640 0 client.4683 ms_handle_reset on v2:172.21.15.146:6834/2942334805 2024-09-19T08:37:40.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.054+0000 7f001b414740 1 -- 172.21.15.117:0/3278810176 >> 172.21.15.117:0/3278810176 conn(0x55a5806baa80 msgr2=0x55a5806dada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:40.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.054+0000 7f001b414740 1 -- 172.21.15.117:0/3278810176 shutdown_connections 2024-09-19T08:37:40.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.054+0000 7f001b414740 1 -- 172.21.15.117:0/3278810176 wait complete. 2024-09-19T08:37:40.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.054+0000 7f001b414740 20 client.4683 trim_cache size 0 max 16384 2024-09-19T08:37:40.061 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T08:37:40.061 INFO:teuthology.orchestra.run.smithi117.stdout: "cluster_fsid": "3be30853-f236-48ec-b905-15ecac86fc3f", 2024-09-19T08:37:40.061 INFO:teuthology.orchestra.run.smithi117.stdout: "whoami": 0, 2024-09-19T08:37:40.061 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 4303, 2024-09-19T08:37:40.062 INFO:teuthology.orchestra.run.smithi117.stdout: "want_state": "up:active", 2024-09-19T08:37:40.062 INFO:teuthology.orchestra.run.smithi117.stdout: "state": "up:active", 2024-09-19T08:37:40.062 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs", 2024-09-19T08:37:40.062 INFO:teuthology.orchestra.run.smithi117.stdout: "rank_uptime": 26.753382833, 2024-09-19T08:37:40.062 INFO:teuthology.orchestra.run.smithi117.stdout: "mdsmap_epoch": 9, 2024-09-19T08:37:40.062 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_epoch": 26, 2024-09-19T08:37:40.062 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_epoch_barrier": 26, 2024-09-19T08:37:40.062 INFO:teuthology.orchestra.run.smithi117.stdout: "uptime": 32.765442958000001 2024-09-19T08:37:40.062 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T08:37:40.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.055+0000 7f0018680640 1 -- 172.21.15.117:0/1960691357 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7efff406c2b0 msgr2=0x7efff406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:40.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.055+0000 7f0018680640 1 --2- 172.21.15.117:0/1960691357 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7efff406c2b0 0x7efff406e770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f00101f5280 tx=0x7f0000009040 comp rx=0 tx=0).stop 2024-09-19T08:37:40.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.055+0000 7f0018680640 1 -- 172.21.15.117:0/1960691357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00100d0370 msgr2=0x7f00100ca0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:40.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.055+0000 7f0018680640 1 --2- 172.21.15.117:0/1960691357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00100d0370 0x7f00100ca0a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f000c00ec10 tx=0x7f000c00c520 comp rx=0 tx=0).stop 2024-09-19T08:37:40.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.055+0000 7f0018680640 1 -- 172.21.15.117:0/1960691357 shutdown_connections 2024-09-19T08:37:40.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.055+0000 7f0018680640 1 --2- 172.21.15.117:0/1960691357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0010142170 0x7f00101570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.055+0000 7f0018680640 1 --2- 172.21.15.117:0/1960691357 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7efff406c2b0 0x7efff406e770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.055+0000 7f0018680640 1 --2- 172.21.15.117:0/1960691357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0010141680 0x7f001015b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.055+0000 7f0018680640 1 --2- 172.21.15.117:0/1960691357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00100d0370 0x7f00100ca0a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.055+0000 7f0018680640 1 -- 172.21.15.117:0/1960691357 >> 172.21.15.117:0/1960691357 conn(0x7f00100b3ed0 msgr2=0x7f00101401c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:40.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.055+0000 7f0018680640 1 -- 172.21.15.117:0/1960691357 shutdown_connections 2024-09-19T08:37:40.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.055+0000 7f0018680640 1 -- 172.21.15.117:0/1960691357 wait complete. 2024-09-19T08:37:40.066 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T08:37:40.077 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T08:37:40.077 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T08:37:40.077 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T08:37:40.077 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-19T08:37:40.124 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-19T08:37:40.125 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-19T08:37:40.125 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-19T08:37:40.125 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T08:37:40.125 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T08:37:40.125 INFO:tasks.ceph_fuse:client.2 config is {} 2024-09-19T08:37:40.125 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T08:37:40.126 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-19T08:37:40.126 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-19T08:37:40.126 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T08:37:40.126 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T08:37:40.126 INFO:tasks.ceph_fuse:client.3 config is {} 2024-09-19T08:37:40.126 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T08:37:40.126 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-19T08:37:40.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:40.127 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-09-19T08:37:40.143 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-19T08:37:40.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:40.143 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T08:37:40.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:40.208 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2024-09-19T08:37:40.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:40.319 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-19T08:37:40.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:40.339 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2024-09-19T08:37:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:Cannot find device "ceph-brx" 2024-09-19T08:37:40.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:37:40.417 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-19T08:37:40.417 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-19T08:37:40.418 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T08:37:40.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.518+0000 7f5828c0e640 1 Processor -- start 2024-09-19T08:37:40.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.518+0000 7f5828c0e640 1 -- start start 2024-09-19T08:37:40.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.519+0000 7f5828c0e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f582415bee0 0x7f58240d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.519+0000 7f5828c0e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f582415c2c0 0x7f58240d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.519+0000 7f5828c0e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58240cf200 0x7f58240cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.519+0000 7f5828c0e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f58240ceaf0 con 0x7f582415bee0 2024-09-19T08:37:40.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.519+0000 7f5828c0e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f58240cdee0 con 0x7f582415c2c0 2024-09-19T08:37:40.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.519+0000 7f5828c0e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f58240ce1c0 con 0x7f58240cf200 2024-09-19T08:37:40.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.520+0000 7f582259c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f582415bee0 0x7f58240d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.520+0000 7f582259c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f582415bee0 0x7f58240d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35082/0 (socket says 172.21.15.117:35082) 2024-09-19T08:37:40.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.520+0000 7f582259c640 1 -- 172.21.15.117:0/3320472307 learned_addr learned my addr 172.21.15.117:0/3320472307 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:40.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.520+0000 7f5821d9b640 1 --2- 172.21.15.117:0/3320472307 >> v2:172.21.15.146:3300/0 conn(0x7f582415c2c0 0x7f58240d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.520+0000 7f5822d9d640 1 --2- 172.21.15.117:0/3320472307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58240cf200 0x7f58240cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.520+0000 7f582259c640 1 -- 172.21.15.117:0/3320472307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58240cf200 msgr2=0x7f58240cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:40.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.520+0000 7f582259c640 1 --2- 172.21.15.117:0/3320472307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58240cf200 0x7f58240cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.520+0000 7f582259c640 1 -- 172.21.15.117:0/3320472307 >> v2:172.21.15.146:3300/0 conn(0x7f582415c2c0 msgr2=0x7f58240d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:40.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.520+0000 7f582259c640 1 --2- 172.21.15.117:0/3320472307 >> v2:172.21.15.146:3300/0 conn(0x7f582415c2c0 0x7f58240d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.520+0000 7f582259c640 1 -- 172.21.15.117:0/3320472307 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58240ce4a0 con 0x7f582415bee0 2024-09-19T08:37:40.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.520+0000 7f5822d9d640 1 --2- 172.21.15.117:0/3320472307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58240cf200 0x7f58240cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:40.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.521+0000 7f582259c640 1 --2- 172.21.15.117:0/3320472307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f582415bee0 0x7f58240d04b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f58240cadd0 tx=0x7f581402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e60b818c6603d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:40.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.521+0000 7f582159a640 1 -- 172.21.15.117:0/3320472307 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5814037070 con 0x7f582415bee0 2024-09-19T08:37:40.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.521+0000 7f582159a640 1 -- 172.21.15.117:0/3320472307 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5814032440 con 0x7f582415bee0 2024-09-19T08:37:40.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.521+0000 7f582159a640 1 -- 172.21.15.117:0/3320472307 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5814032810 con 0x7f582415bee0 2024-09-19T08:37:40.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.521+0000 7f5828c0e640 1 -- 172.21.15.117:0/3320472307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f582415bee0 msgr2=0x7f58240d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:40.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.521+0000 7f5828c0e640 1 --2- 172.21.15.117:0/3320472307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f582415bee0 0x7f58240d04b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f58240cadd0 tx=0x7f581402a1e0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.521+0000 7f5828c0e640 1 -- 172.21.15.117:0/3320472307 shutdown_connections 2024-09-19T08:37:40.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.521+0000 7f5828c0e640 1 --2- 172.21.15.117:0/3320472307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58240cf200 0x7f58240cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.521+0000 7f5828c0e640 1 --2- 172.21.15.117:0/3320472307 >> v2:172.21.15.146:3300/0 conn(0x7f582415c2c0 0x7f58240d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.521+0000 7f5828c0e640 1 --2- 172.21.15.117:0/3320472307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f582415bee0 0x7f58240d04b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.521+0000 7f5828c0e640 1 -- 172.21.15.117:0/3320472307 >> 172.21.15.117:0/3320472307 conn(0x7f582406bdf0 msgr2=0x7f582406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:40.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.521+0000 7f5828c0e640 1 -- 172.21.15.117:0/3320472307 shutdown_connections 2024-09-19T08:37:40.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.521+0000 7f5828c0e640 1 -- 172.21.15.117:0/3320472307 wait complete. 2024-09-19T08:37:40.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.523+0000 7f5828c0e640 1 Processor -- start 2024-09-19T08:37:40.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.523+0000 7f5828c0e640 1 -- start start 2024-09-19T08:37:40.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.523+0000 7f5828c0e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58240cf200 0x7f58241f12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.523+0000 7f5828c0e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f582415bee0 0x7f582415c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.523+0000 7f5828c0e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f582415c2c0 0x7f58240b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.523+0000 7f5828c0e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f582415fd40 con 0x7f58240cf200 2024-09-19T08:37:40.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.523+0000 7f5828c0e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f58240cfbd0 con 0x7f582415bee0 2024-09-19T08:37:40.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.523+0000 7f5828c0e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f582415fec0 con 0x7f582415c2c0 2024-09-19T08:37:40.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.523+0000 7f582259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58240cf200 0x7f58241f12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.524+0000 7f582259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58240cf200 0x7f58241f12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35096/0 (socket says 172.21.15.117:35096) 2024-09-19T08:37:40.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.524+0000 7f582259c640 1 -- 172.21.15.117:0/2846656458 learned_addr learned my addr 172.21.15.117:0/2846656458 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:40.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.524+0000 7f582259c640 1 -- 172.21.15.117:0/2846656458 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f582415c2c0 msgr2=0x7f58240b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:40.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.524+0000 7f582259c640 1 --2- 172.21.15.117:0/2846656458 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f582415c2c0 0x7f58240b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.524+0000 7f582259c640 1 -- 172.21.15.117:0/2846656458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f582415bee0 msgr2=0x7f582415c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:40.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.524+0000 7f582259c640 1 --2- 172.21.15.117:0/2846656458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f582415bee0 0x7f582415c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.524+0000 7f582259c640 1 -- 172.21.15.117:0/2846656458 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58241f1b10 con 0x7f58240cf200 2024-09-19T08:37:40.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.524+0000 7f582259c640 1 --2- 172.21.15.117:0/2846656458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58240cf200 0x7f58241f12f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f581402a220 tx=0x7f58140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:40.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.524+0000 7f581affd640 1 -- 172.21.15.117:0/2846656458 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5814037040 con 0x7f58240cf200 2024-09-19T08:37:40.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.524+0000 7f581affd640 1 -- 172.21.15.117:0/2846656458 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5814042070 con 0x7f58240cf200 2024-09-19T08:37:40.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.524+0000 7f581affd640 1 -- 172.21.15.117:0/2846656458 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5814030bd0 con 0x7f58240cf200 2024-09-19T08:37:40.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.524+0000 7f5828c0e640 1 -- 172.21.15.117:0/2846656458 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58241f1df0 con 0x7f58240cf200 2024-09-19T08:37:40.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.524+0000 7f5828c0e640 1 -- 172.21.15.117:0/2846656458 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58241f23b0 con 0x7f58240cf200 2024-09-19T08:37:40.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.525+0000 7f5828c0e640 1 -- 172.21.15.117:0/2846656458 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58240cf690 con 0x7f58240cf200 2024-09-19T08:37:40.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.526+0000 7f581affd640 1 -- 172.21.15.117:0/2846656458 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5814047460 con 0x7f58240cf200 2024-09-19T08:37:40.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.526+0000 7f581affd640 1 --2- 172.21.15.117:0/2846656458 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f580406c2b0 0x7f580406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:40.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.526+0000 7f581affd640 1 -- 172.21.15.117:0/2846656458 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f58140ac390 con 0x7f58240cf200 2024-09-19T08:37:40.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.526+0000 7f5821d9b640 1 --2- 172.21.15.117:0/2846656458 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f580406c2b0 0x7f580406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:40.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.527+0000 7f5821d9b640 1 --2- 172.21.15.117:0/2846656458 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f580406c2b0 0x7f580406e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f580c006b10 tx=0x7f580c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:40.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.531+0000 7f581affd640 1 -- 172.21.15.117:0/2846656458 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5814045360 con 0x7f58240cf200 2024-09-19T08:37:40.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.732+0000 7f5828c0e640 1 -- 172.21.15.117:0/2846656458 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f582406c5d0 con 0x7f58240cf200 2024-09-19T08:37:40.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.733+0000 7f581affd640 1 -- 172.21.15.117:0/2846656458 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f581407a850 con 0x7f58240cf200 2024-09-19T08:37:40.733 INFO:teuthology.orchestra.run.smithi117.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T08:37:40.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.735+0000 7f5828c0e640 1 -- 172.21.15.117:0/2846656458 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f580406c2b0 msgr2=0x7f580406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:40.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.735+0000 7f5828c0e640 1 --2- 172.21.15.117:0/2846656458 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f580406c2b0 0x7f580406e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f580c006b10 tx=0x7f580c008040 comp rx=0 tx=0).stop 2024-09-19T08:37:40.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.735+0000 7f5828c0e640 1 -- 172.21.15.117:0/2846656458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58240cf200 msgr2=0x7f58241f12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:40.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.735+0000 7f5828c0e640 1 --2- 172.21.15.117:0/2846656458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58240cf200 0x7f58241f12f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f581402a220 tx=0x7f58140046c0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.735+0000 7f5828c0e640 1 -- 172.21.15.117:0/2846656458 shutdown_connections 2024-09-19T08:37:40.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.735+0000 7f5828c0e640 1 --2- 172.21.15.117:0/2846656458 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f580406c2b0 0x7f580406e770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.735+0000 7f5828c0e640 1 --2- 172.21.15.117:0/2846656458 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f582415c2c0 0x7f58240b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.735+0000 7f5828c0e640 1 --2- 172.21.15.117:0/2846656458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f582415bee0 0x7f582415c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.735+0000 7f5828c0e640 1 --2- 172.21.15.117:0/2846656458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58240cf200 0x7f58241f12f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:40.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.735+0000 7f5828c0e640 1 -- 172.21.15.117:0/2846656458 >> 172.21.15.117:0/2846656458 conn(0x7f582406bdf0 msgr2=0x7f582415a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:40.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.735+0000 7f5828c0e640 1 -- 172.21.15.117:0/2846656458 shutdown_connections 2024-09-19T08:37:40.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40.735+0000 7f5828c0e640 1 -- 172.21.15.117:0/2846656458 wait complete. 2024-09-19T08:37:40.745 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T08:37:40.745 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T08:37:40.745 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2024-09-19T08:37:40.746 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T08:37:40.746 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T08:37:40.746 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T08:37:40.746 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T08:37:40.746 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T08:37:40.746 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T08:37:40.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:40.746 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2024-09-19T08:37:40.762 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T08:37:40.762 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T08:37:40.762 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T08:37:40.762 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:40.762 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-09-19T08:37:40.762 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:40.762 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:37:40.763 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:40.763 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2024-09-19T08:37:40.763 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:37:40.763 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:40.763 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2024-09-19T08:37:40.763 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:37:40.763 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:40.763 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T08:37:40.763 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:40.764 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T08:37:40.764 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42768sec preferred_lft 42768sec 2024-09-19T08:37:40.764 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link noprefixroute 2024-09-19T08:37:40.764 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:40.764 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T08:37:40.764 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:40.764 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-09-19T08:37:40.764 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add name ceph-brx type bridge 2024-09-19T08:37:40.764 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr flush dev ceph-brx 2024-09-19T08:37:40.765 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set ceph-brx up 2024-09-19T08:37:40.765 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T08:37:40.765 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-09-19T08:37:40.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:40.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:40.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:40.901 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T08:37:40.923 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-09-19T08:37:40.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:40.925 DEBUG:teuthology.orchestra.run.smithi117:> route 2024-09-19T08:37:40.982 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2024-09-19T08:37:40.982 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T08:37:40.982 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T08:37:40.983 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T08:37:40.983 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T08:37:40.983 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:40.983 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-09-19T08:37:40.983 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T08:37:40.983 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T08:37:40.983 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T08:37:40.983 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-09-19T08:37:41.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:41.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:41.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:41.109 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-09-19T08:37:41.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:41.126 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list-id 2024-09-19T08:37:41.181 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:41.181 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-09-19T08:37:41.181 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:37:41.181 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T08:37:41.182 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-09-19T08:37:41.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:41.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:41.298 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T08:37:41.298 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:41.298 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-09-19T08:37:41.299 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T08:37:41.299 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T08:37:41.299 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T08:37:41.299 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T08:37:41.299 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T08:37:41.299 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-09-19T08:37:41.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:41.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:41.412 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:41.412 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-09-19T08:37:41.412 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2024-09-19T08:37:41.413 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T08:37:41.413 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-09-19T08:37:41.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:41.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:41.489 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-19T08:37:41.489 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:37:41.489 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T08:37:41.504 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T08:37:41.505 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:37:41.505 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T08:37:41.561 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-09-19T08:37:41.626 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T08:37:41.683 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-09-19T08:37:41.683 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-09-19T08:37:41.683 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-09-19T08:37:41.684 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-09-19T08:37:41.684 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-09-19T08:37:41.684 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-09-19T08:37:41.684 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-09-19T08:37:41.684 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-09-19T08:37:41.684 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-09-19T08:37:41.684 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-09-19T08:37:41.684 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-09-19T08:37:41.684 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-09-19T08:37:41.684 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:37:41.684 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-09-19T08:37:41.684 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-09-19T08:37:41.684 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-09-19T08:37:41.685 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-09-19T08:37:41.685 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-09-19T08:37:41.685 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T08:37:41.685 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-09-19T08:37:41.685 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T08:37:41.685 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T08:37:41.685 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T08:37:41.685 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-09-19T08:37:41.685 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-09-19T08:37:41.685 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T08:37:41.685 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T08:37:41.685 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T08:37:41.685 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T08:37:41.686 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-09-19T08:37:41.686 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:37:41.686 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:37:41.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:41.686 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-09-19T08:37:41.739 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T08:37:41.739 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-19T08:37:41.782 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-09-19T08:37:41.807 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T08:37:41.864 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi117.stderr:2024-09-19T08:37:41.864+0000 7f9f67a69480 -1 init, newargv = 0x55570d085920 newargc=15 2024-09-19T08:37:41.864 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi117.stderr:ceph-fuse[45892]: starting ceph client 2024-09-19T08:37:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-09-19T08:37:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-09-19T08:37:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-09-19T08:37:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-09-19T08:37:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-09-19T08:37:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-09-19T08:37:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-09-19T08:37:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-09-19T08:37:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-09-19T08:37:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-09-19T08:37:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-09-19T08:37:41.866 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-09-19T08:37:41.866 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:37:41.866 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-09-19T08:37:41.866 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-09-19T08:37:41.866 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-09-19T08:37:41.866 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-09-19T08:37:41.866 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-09-19T08:37:41.866 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T08:37:41.866 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-09-19T08:37:41.866 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T08:37:41.866 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T08:37:41.867 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T08:37:41.867 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-09-19T08:37:41.867 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-09-19T08:37:41.867 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T08:37:41.867 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T08:37:41.867 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T08:37:41.867 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T08:37:41.867 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-09-19T08:37:41.867 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:37:41.867 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:37:41.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:41.869 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-09-19T08:37:41.869 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi117.stderr:ceph-fuse[45892]: starting fuse 2024-09-19T08:37:41.925 INFO:teuthology.orchestra.run.smithi117.stdout:41 2024-09-19T08:37:41.926 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-19T08:37:41.926 DEBUG:teuthology.orchestra.run.smithi117:> sudo stdin-killer -- python3 -c ' 2024-09-19T08:37:41.926 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2024-09-19T08:37:41.926 DEBUG:teuthology.orchestra.run.smithi117:> import re 2024-09-19T08:37:41.927 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-09-19T08:37:41.927 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2024-09-19T08:37:41.927 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:37:41.927 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2024-09-19T08:37:41.927 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T08:37:41.927 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2024-09-19T08:37:41.927 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T08:37:41.928 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:37:41.928 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2024-09-19T08:37:41.928 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2024-09-19T08:37:41.929 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2024-09-19T08:37:41.929 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2024-09-19T08:37:41.929 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:37:41.930 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2024-09-19T08:37:41.930 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T08:37:41.930 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T08:37:41.930 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T08:37:41.930 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2024-09-19T08:37:41.930 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2024-09-19T08:37:41.930 DEBUG:teuthology.orchestra.run.smithi117:> return f 2024-09-19T08:37:41.930 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T08:37:41.930 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:37:41.930 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.0")) 2024-09-19T08:37:41.930 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-09-19T08:37:42.043 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.0.45892.asok 2024-09-19T08:37:42.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:42.054 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45892.asok 2024-09-19T08:37:42.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:42.054 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45892.asok status 2024-09-19T08:37:42.190 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T08:37:42.191 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2024-09-19T08:37:42.191 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T08:37:42.191 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:37:42.191 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "0", 2024-09-19T08:37:42.191 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2024-09-19T08:37:42.191 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T08:37:42.191 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "45892", 2024-09-19T08:37:42.191 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2024-09-19T08:37:42.191 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:37:42.191 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2024-09-19T08:37:42.191 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2024-09-19T08:37:42.192 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 4695, 2024-09-19T08:37:42.192 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2024-09-19T08:37:42.192 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2024-09-19T08:37:42.192 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2024-09-19T08:37:42.192 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 4695 2024-09-19T08:37:42.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:37:42.192 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-09-19T08:37:42.192 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-09-19T08:37:42.192 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-09-19T08:37:42.192 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 107542146 2024-09-19T08:37:42.192 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:37:42.192 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:37:42.193 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-09-19T08:37:42.193 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-09-19T08:37:42.193 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-09-19T08:37:42.193 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 107542146 2024-09-19T08:37:42.193 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:37:42.193 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.4695 192.168.0.1:0/107542146", 2024-09-19T08:37:42.193 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/107542146", 2024-09-19T08:37:42.193 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2024-09-19T08:37:42.193 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 9, 2024-09-19T08:37:42.193 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 26, 2024-09-19T08:37:42.193 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2024-09-19T08:37:42.193 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2024-09-19T08:37:42.193 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2024-09-19T08:37:42.194 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T08:37:42.199 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-19T08:37:42.199 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T08:37:42.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.300+0000 7f695b55b640 1 Processor -- start 2024-09-19T08:37:42.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.300+0000 7f695b55b640 1 -- start start 2024-09-19T08:37:42.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.301+0000 7f695b55b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f695415b120 0x7f695406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:42.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.301+0000 7f695b55b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f695406dec0 0x7f695406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:42.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.301+0000 7f695b55b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f695415b500 con 0x7f69540d04b0 2024-09-19T08:37:42.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.301+0000 7f695b55b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f695406e940 con 0x7f695415b120 2024-09-19T08:37:42.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.301+0000 7f695b55b640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f695406ec20 con 0x7f695406dec0 2024-09-19T08:37:42.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.301+0000 7f69592f7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f695415b120 0x7f695406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:42.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.301+0000 7f6959af8640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f69540d04b0 0x7f69540c5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:54962/0 (socket says 172.21.15.117:54962) 2024-09-19T08:37:42.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.301+0000 7f6959af8640 1 -- 172.21.15.117:0/2560236409 learned_addr learned my addr 172.21.15.117:0/2560236409 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:42.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.301+0000 7f6958af6640 1 --2- 172.21.15.117:0/2560236409 >> v2:172.21.15.146:3300/0 conn(0x7f695406dec0 0x7f695406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:42.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.301+0000 7f69592f7640 1 -- 172.21.15.117:0/2560236409 >> v2:172.21.15.146:3300/0 conn(0x7f695406dec0 msgr2=0x7f695406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:42.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.301+0000 7f69592f7640 1 --2- 172.21.15.117:0/2560236409 >> v2:172.21.15.146:3300/0 conn(0x7f695406dec0 0x7f695406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:42.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.301+0000 7f694bfff640 1 -- 172.21.15.117:0/2560236409 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3079183859 0 0) 0x7f695415b500 con 0x7f69540d04b0 2024-09-19T08:37:42.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.301+0000 7f69592f7640 1 -- 172.21.15.117:0/2560236409 >> v1:172.21.15.117:6789/0 conn(0x7f69540d04b0 legacy=0x7f69540c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:42.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.301+0000 7f69592f7640 1 -- 172.21.15.117:0/2560236409 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695406ef00 con 0x7f695415b120 2024-09-19T08:37:42.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.302+0000 7f69592f7640 1 --2- 172.21.15.117:0/2560236409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f695415b120 0x7f695406f9e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f695406dcd0 tx=0x7f695002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aea9574f24ac224 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:42.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.302+0000 7f694bfff640 1 -- 172.21.15.117:0/2560236409 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6950037070 con 0x7f695415b120 2024-09-19T08:37:42.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.302+0000 7f694bfff640 1 -- 172.21.15.117:0/2560236409 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6950032440 con 0x7f695415b120 2024-09-19T08:37:42.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.302+0000 7f694bfff640 1 -- 172.21.15.117:0/2560236409 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6950032810 con 0x7f695415b120 2024-09-19T08:37:42.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.303+0000 7f695b55b640 1 -- 172.21.15.117:0/2560236409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f695415b120 msgr2=0x7f695406f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:42.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.303+0000 7f695b55b640 1 --2- 172.21.15.117:0/2560236409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f695415b120 0x7f695406f9e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f695406dcd0 tx=0x7f695002a1a0 comp rx=0 tx=0).stop 2024-09-19T08:37:42.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.303+0000 7f695b55b640 1 -- 172.21.15.117:0/2560236409 shutdown_connections 2024-09-19T08:37:42.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.303+0000 7f695b55b640 1 --2- 172.21.15.117:0/2560236409 >> v2:172.21.15.146:3300/0 conn(0x7f695406dec0 0x7f695406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:42.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.303+0000 7f695b55b640 1 --2- 172.21.15.117:0/2560236409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f695415b120 0x7f695406f9e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:42.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.303+0000 7f695b55b640 1 -- 172.21.15.117:0/2560236409 >> 172.21.15.117:0/2560236409 conn(0x7f695406bdf0 msgr2=0x7f695406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:42.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.303+0000 7f695b55b640 1 -- 172.21.15.117:0/2560236409 shutdown_connections 2024-09-19T08:37:42.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.303+0000 7f695b55b640 1 -- 172.21.15.117:0/2560236409 wait complete. 2024-09-19T08:37:42.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.304+0000 7f695b55b640 1 Processor -- start 2024-09-19T08:37:42.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.304+0000 7f695b55b640 1 -- start start 2024-09-19T08:37:42.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.305+0000 7f695b55b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f695406dec0 0x7f69540c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:42.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.305+0000 7f695b55b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69540d04b0 0x7f69540b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:42.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.305+0000 7f695b55b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f695415b120 0x7f695414b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:42.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.305+0000 7f695b55b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f69540ce060 con 0x7f695415b120 2024-09-19T08:37:42.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.305+0000 7f695b55b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f695406f4c0 con 0x7f69540d04b0 2024-09-19T08:37:42.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.305+0000 7f695b55b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f69540d0900 con 0x7f695406dec0 2024-09-19T08:37:42.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.305+0000 7f6959af8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f695415b120 0x7f695414b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:42.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.305+0000 7f6959af8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f695415b120 0x7f695414b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35110/0 (socket says 172.21.15.117:35110) 2024-09-19T08:37:42.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.305+0000 7f6959af8640 1 -- 172.21.15.117:0/3019880259 learned_addr learned my addr 172.21.15.117:0/3019880259 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:42.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.305+0000 7f6958af6640 1 --2- 172.21.15.117:0/3019880259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69540d04b0 0x7f69540b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:42.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.305+0000 7f69592f7640 1 --2- 172.21.15.117:0/3019880259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f695406dec0 0x7f69540c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:42.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.305+0000 7f6959af8640 1 -- 172.21.15.117:0/3019880259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f695406dec0 msgr2=0x7f69540c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:42.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.305+0000 7f6959af8640 1 --2- 172.21.15.117:0/3019880259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f695406dec0 0x7f69540c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:42.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.305+0000 7f6959af8640 1 -- 172.21.15.117:0/3019880259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69540d04b0 msgr2=0x7f69540b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:42.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.305+0000 7f6959af8640 1 --2- 172.21.15.117:0/3019880259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69540d04b0 0x7f69540b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:42.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.305+0000 7f6959af8640 1 -- 172.21.15.117:0/3019880259 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695415c2f0 con 0x7f695415b120 2024-09-19T08:37:42.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.305+0000 7f6958af6640 1 --2- 172.21.15.117:0/3019880259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69540d04b0 0x7f69540b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:42.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.305+0000 7f6959af8640 1 --2- 172.21.15.117:0/3019880259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f695415b120 0x7f695414b650 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f694c00c7e0 tx=0x7f694c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:42.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.306+0000 7f6949ffb640 1 -- 172.21.15.117:0/3019880259 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c018070 con 0x7f695415b120 2024-09-19T08:37:42.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.306+0000 7f6949ffb640 1 -- 172.21.15.117:0/3019880259 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694c00a640 con 0x7f695415b120 2024-09-19T08:37:42.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.306+0000 7f695b55b640 1 -- 172.21.15.117:0/3019880259 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69540b0d10 con 0x7f695415b120 2024-09-19T08:37:42.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.306+0000 7f6949ffb640 1 -- 172.21.15.117:0/3019880259 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c00aa30 con 0x7f695415b120 2024-09-19T08:37:42.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.306+0000 7f695b55b640 1 -- 172.21.15.117:0/3019880259 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69540b1290 con 0x7f695415b120 2024-09-19T08:37:42.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.307+0000 7f695b55b640 1 -- 172.21.15.117:0/3019880259 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69540d0cd0 con 0x7f695415b120 2024-09-19T08:37:42.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.308+0000 7f6949ffb640 1 -- 172.21.15.117:0/3019880259 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f694c01b070 con 0x7f695415b120 2024-09-19T08:37:42.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.308+0000 7f6949ffb640 1 --2- 172.21.15.117:0/3019880259 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f693806c2e0 0x7f693806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:42.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.308+0000 7f6949ffb640 1 -- 172.21.15.117:0/3019880259 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f694c08ad50 con 0x7f695415b120 2024-09-19T08:37:42.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.309+0000 7f69592f7640 1 --2- 172.21.15.117:0/3019880259 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f693806c2e0 0x7f693806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:42.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.309+0000 7f69592f7640 1 --2- 172.21.15.117:0/3019880259 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f693806c2e0 0x7f693806e7a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6950034000 tx=0x7f695002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:42.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.313+0000 7f6949ffb640 1 -- 172.21.15.117:0/3019880259 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f694c08e030 con 0x7f695415b120 2024-09-19T08:37:42.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.522+0000 7f695b55b640 1 -- 172.21.15.117:0/3019880259 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f695406ce20 con 0x7f695415b120 2024-09-19T08:37:42.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.523+0000 7f6949ffb640 1 -- 172.21.15.117:0/3019880259 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f695415c2f0 con 0x7f695415b120 2024-09-19T08:37:42.523 INFO:teuthology.orchestra.run.smithi117.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T08:37:42.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.525+0000 7f695b55b640 1 -- 172.21.15.117:0/3019880259 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f693806c2e0 msgr2=0x7f693806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:42.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.525+0000 7f695b55b640 1 --2- 172.21.15.117:0/3019880259 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f693806c2e0 0x7f693806e7a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6950034000 tx=0x7f695002e000 comp rx=0 tx=0).stop 2024-09-19T08:37:42.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.525+0000 7f695b55b640 1 -- 172.21.15.117:0/3019880259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f695415b120 msgr2=0x7f695414b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:42.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.525+0000 7f695b55b640 1 --2- 172.21.15.117:0/3019880259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f695415b120 0x7f695414b650 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f694c00c7e0 tx=0x7f694c00cca0 comp rx=0 tx=0).stop 2024-09-19T08:37:42.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.525+0000 7f695b55b640 1 -- 172.21.15.117:0/3019880259 shutdown_connections 2024-09-19T08:37:42.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.525+0000 7f695b55b640 1 --2- 172.21.15.117:0/3019880259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f695415b120 0x7f695414b650 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:42.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.525+0000 7f695b55b640 1 --2- 172.21.15.117:0/3019880259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69540d04b0 0x7f69540b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:42.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.525+0000 7f695b55b640 1 --2- 172.21.15.117:0/3019880259 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f693806c2e0 0x7f693806e7a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:42.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.525+0000 7f695b55b640 1 --2- 172.21.15.117:0/3019880259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f695406dec0 0x7f69540c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:42.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.525+0000 7f695b55b640 1 -- 172.21.15.117:0/3019880259 >> 172.21.15.117:0/3019880259 conn(0x7f695406bdf0 msgr2=0x7f6954072330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:42.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.525+0000 7f695b55b640 1 -- 172.21.15.117:0/3019880259 shutdown_connections 2024-09-19T08:37:42.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42.525+0000 7f695b55b640 1 -- 172.21.15.117:0/3019880259 wait complete. 2024-09-19T08:37:42.535 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T08:37:42.535 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T08:37:42.535 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2024-09-19T08:37:42.535 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-19T08:37:42.535 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-19T08:37:42.536 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T08:37:42.536 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T08:37:42.536 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T08:37:42.536 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-19T08:37:42.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:42.536 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2024-09-19T08:37:42.551 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T08:37:42.551 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T08:37:42.551 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T08:37:42.551 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:42.552 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-09-19T08:37:42.552 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:42.552 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:37:42.552 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:42.552 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2024-09-19T08:37:42.552 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:37:42.552 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:42.552 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2024-09-19T08:37:42.552 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:37:42.552 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:42.552 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T08:37:42.552 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:42.553 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T08:37:42.553 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42766sec preferred_lft 42766sec 2024-09-19T08:37:42.553 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link noprefixroute 2024-09-19T08:37:42.553 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:42.553 INFO:teuthology.orchestra.run.smithi117.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T08:37:42.553 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 3e:bb:c2:de:61:b2 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:42.553 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T08:37:42.553 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:42.553 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c454:b1ff:fe51:4d57/64 scope link 2024-09-19T08:37:42.553 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:42.553 INFO:teuthology.orchestra.run.smithi117.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T08:37:42.553 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 3e:bb:c2:de:61:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:37:42.553 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::3cbb:c2ff:fede:61b2/64 scope link tentative 2024-09-19T08:37:42.554 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:42.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:42.554 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T08:37:42.616 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-09-19T08:37:42.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:42.618 DEBUG:teuthology.orchestra.run.smithi117:> route 2024-09-19T08:37:42.675 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2024-09-19T08:37:42.675 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T08:37:42.675 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T08:37:42.675 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T08:37:42.676 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T08:37:42.676 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:42.676 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-09-19T08:37:42.676 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T08:37:42.676 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T08:37:42.676 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T08:37:42.676 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-09-19T08:37:42.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:42.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:42.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:42.804 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-09-19T08:37:42.820 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T08:37:42.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:42.821 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list-id 2024-09-19T08:37:42.877 INFO:teuthology.orchestra.run.smithi117.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-19T08:37:42.877 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:42.877 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-09-19T08:37:42.877 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T08:37:42.877 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-19T08:37:42.877 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-09-19T08:37:42.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:42.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:42.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:42.993 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-19T08:37:43.017 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T08:37:43.017 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T08:37:43.017 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T08:37:43.017 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:43.018 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-09-19T08:37:43.018 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:43.018 INFO:teuthology.orchestra.run.smithi117.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T08:37:43.018 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:5a:8e:36:2a:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-19T08:37:43.018 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-19T08:37:43.018 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:43.018 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::5a:8eff:fe36:2ab6/64 scope link 2024-09-19T08:37:43.018 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:43.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:43.019 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-19T08:37:43.084 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T08:37:43.084 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T08:37:43.084 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T08:37:43.084 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:43.084 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-09-19T08:37:43.084 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:43.084 INFO:teuthology.orchestra.run.smithi117.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T08:37:43.084 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:5a:8e:36:2a:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-19T08:37:43.085 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-19T08:37:43.085 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:43.085 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::5a:8eff:fe36:2ab6/64 scope link 2024-09-19T08:37:43.085 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:43.086 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-19T08:37:43.086 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:43.086 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-09-19T08:37:43.086 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-19T08:37:43.086 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-19T08:37:43.086 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-19T08:37:43.087 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-19T08:37:43.087 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-19T08:37:43.087 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-09-19T08:37:43.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:43.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:43.238 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:43.238 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-09-19T08:37:43.238 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.1 up 2024-09-19T08:37:43.238 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set dev brx.1 master ceph-brx 2024-09-19T08:37:43.238 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-09-19T08:37:43.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:43.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:43.316 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-09-19T08:37:43.316 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:37:43.316 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-19T08:37:43.333 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-19T08:37:43.333 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:37:43.333 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-19T08:37:43.388 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-09-19T08:37:43.454 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T08:37:43.512 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-09-19T08:37:43.513 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-09-19T08:37:43.513 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-09-19T08:37:43.513 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-09-19T08:37:43.513 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-09-19T08:37:43.513 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-09-19T08:37:43.513 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-09-19T08:37:43.513 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-09-19T08:37:43.513 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-09-19T08:37:43.513 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-09-19T08:37:43.513 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-09-19T08:37:43.513 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-09-19T08:37:43.513 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:37:43.514 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-09-19T08:37:43.514 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-09-19T08:37:43.514 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-09-19T08:37:43.514 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-09-19T08:37:43.514 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-09-19T08:37:43.514 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T08:37:43.514 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-09-19T08:37:43.514 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T08:37:43.514 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T08:37:43.514 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T08:37:43.514 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-09-19T08:37:43.514 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-09-19T08:37:43.514 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T08:37:43.515 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T08:37:43.515 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T08:37:43.515 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T08:37:43.515 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-09-19T08:37:43.515 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:37:43.515 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:37:43.515 INFO:teuthology.orchestra.run.smithi117.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T08:37:43.515 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T08:37:43.515 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T08:37:43.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:43.515 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-09-19T08:37:43.568 INFO:teuthology.orchestra.run.smithi117.stdout:41 2024-09-19T08:37:43.569 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-09-19T08:37:43.569 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-09-19T08:37:43.611 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-09-19T08:37:43.636 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T08:37:43.693 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-09-19T08:37:43.694 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-09-19T08:37:43.694 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-09-19T08:37:43.694 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-09-19T08:37:43.694 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-09-19T08:37:43.694 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-09-19T08:37:43.694 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-09-19T08:37:43.694 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-09-19T08:37:43.694 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-09-19T08:37:43.694 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-09-19T08:37:43.694 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-09-19T08:37:43.694 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-09-19T08:37:43.695 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:37:43.695 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-09-19T08:37:43.695 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-09-19T08:37:43.695 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-09-19T08:37:43.695 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-09-19T08:37:43.695 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-09-19T08:37:43.695 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T08:37:43.695 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-09-19T08:37:43.695 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T08:37:43.695 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T08:37:43.696 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T08:37:43.696 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-09-19T08:37:43.696 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-09-19T08:37:43.696 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T08:37:43.696 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T08:37:43.696 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T08:37:43.696 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T08:37:43.696 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-09-19T08:37:43.696 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:37:43.696 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:37:43.696 INFO:teuthology.orchestra.run.smithi117.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T08:37:43.696 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T08:37:43.696 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T08:37:43.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:43.697 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-09-19T08:37:43.701 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi117.stderr:2024-09-19T08:37:43.693+0000 7fc624e22480 -1 init, newargv = 0x55e477ba9030 newargc=15 2024-09-19T08:37:43.701 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi117.stderr:ceph-fuse[46402]: starting ceph client 2024-09-19T08:37:43.701 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi117.stderr:ceph-fuse[46402]: starting fuse 2024-09-19T08:37:43.715 INFO:teuthology.orchestra.run.smithi117.stdout:41 2024-09-19T08:37:43.715 INFO:teuthology.orchestra.run.smithi117.stdout:44 2024-09-19T08:37:43.716 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-09-19T08:37:43.716 DEBUG:teuthology.orchestra.run.smithi117:> sudo stdin-killer -- python3 -c ' 2024-09-19T08:37:43.716 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2024-09-19T08:37:43.716 DEBUG:teuthology.orchestra.run.smithi117:> import re 2024-09-19T08:37:43.716 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-09-19T08:37:43.716 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2024-09-19T08:37:43.716 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:37:43.716 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2024-09-19T08:37:43.716 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-09-19T08:37:43.716 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2024-09-19T08:37:43.717 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-09-19T08:37:43.717 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:37:43.717 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2024-09-19T08:37:43.717 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2024-09-19T08:37:43.717 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2024-09-19T08:37:43.717 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2024-09-19T08:37:43.717 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:37:43.717 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2024-09-19T08:37:43.717 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T08:37:43.717 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T08:37:43.717 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T08:37:43.717 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2024-09-19T08:37:43.717 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2024-09-19T08:37:43.717 DEBUG:teuthology.orchestra.run.smithi117:> return f 2024-09-19T08:37:43.717 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T08:37:43.718 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:37:43.718 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.2")) 2024-09-19T08:37:43.718 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-09-19T08:37:43.832 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.2.46402.asok 2024-09-19T08:37:43.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:43.842 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.46402.asok 2024-09-19T08:37:43.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:43.843 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.46402.asok status 2024-09-19T08:37:43.976 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T08:37:43.976 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2024-09-19T08:37:43.976 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T08:37:43.977 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:37:43.977 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "2", 2024-09-19T08:37:43.977 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2024-09-19T08:37:43.977 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-09-19T08:37:43.977 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "46402", 2024-09-19T08:37:43.977 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2024-09-19T08:37:43.977 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:37:43.977 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2024-09-19T08:37:43.977 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2024-09-19T08:37:43.977 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 4710, 2024-09-19T08:37:43.977 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2024-09-19T08:37:43.977 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2024-09-19T08:37:43.977 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2024-09-19T08:37:43.977 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 4710 2024-09-19T08:37:43.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:37:43.978 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-09-19T08:37:43.978 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-09-19T08:37:43.978 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.2:0", 2024-09-19T08:37:43.978 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2933993602 2024-09-19T08:37:43.978 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:37:43.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:37:43.978 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-09-19T08:37:43.978 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-09-19T08:37:43.978 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.2:0", 2024-09-19T08:37:43.978 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2933993602 2024-09-19T08:37:43.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:37:43.978 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.4710 192.168.0.2:0/2933993602", 2024-09-19T08:37:43.978 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.2:0/2933993602", 2024-09-19T08:37:43.978 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2024-09-19T08:37:43.979 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 9, 2024-09-19T08:37:43.979 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 26, 2024-09-19T08:37:43.979 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2024-09-19T08:37:43.979 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2024-09-19T08:37:43.979 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2024-09-19T08:37:43.979 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T08:37:43.984 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-19T08:37:43.985 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T08:37:44.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.082+0000 7fc0b8074640 1 Processor -- start 2024-09-19T08:37:44.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.083+0000 7fc0b8074640 1 -- start start 2024-09-19T08:37:44.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.083+0000 7fc0b8074640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc0b015f0d0 0x7fc0b015f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:44.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.083+0000 7fc0b8074640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc0b00d0070 0x7fc0b00d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:44.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.083+0000 7fc0b8074640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0b00d1940 0x7fc0b00d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:44.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.083+0000 7fc0b8074640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc0b00cf2b0 con 0x7fc0b015f0d0 2024-09-19T08:37:44.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.083+0000 7fc0b8074640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fc0b00cf590 con 0x7fc0b00d0070 2024-09-19T08:37:44.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.083+0000 7fc0b8074640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fc0b00cf870 con 0x7fc0b00d1940 2024-09-19T08:37:44.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.083+0000 7fc0b5e10640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc0b015f0d0 0x7fc0b015f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:44.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.084+0000 7fc0b5e10640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc0b015f0d0 0x7fc0b015f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35124/0 (socket says 172.21.15.117:35124) 2024-09-19T08:37:44.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.084+0000 7fc0b5e10640 1 -- 172.21.15.117:0/1143494818 learned_addr learned my addr 172.21.15.117:0/1143494818 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:44.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.084+0000 7fc0b5e10640 1 -- 172.21.15.117:0/1143494818 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0b00d1940 msgr2=0x7fc0b00d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:44.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.084+0000 7fc0b5e10640 1 --2- 172.21.15.117:0/1143494818 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0b00d1940 0x7fc0b00d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:44.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.084+0000 7fc0b5e10640 1 -- 172.21.15.117:0/1143494818 >> v2:172.21.15.146:3300/0 conn(0x7fc0b00d0070 msgr2=0x7fc0b00d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:44.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.084+0000 7fc0b560f640 1 --2- 172.21.15.117:0/1143494818 >> v2:172.21.15.146:3300/0 conn(0x7fc0b00d0070 0x7fc0b00d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:44.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.084+0000 7fc0b5e10640 1 --2- 172.21.15.117:0/1143494818 >> v2:172.21.15.146:3300/0 conn(0x7fc0b00d0070 0x7fc0b00d1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:44.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.084+0000 7fc0b5e10640 1 -- 172.21.15.117:0/1143494818 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b00cfb50 con 0x7fc0b015f0d0 2024-09-19T08:37:44.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.084+0000 7fc0b5e10640 1 --2- 172.21.15.117:0/1143494818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b015f0d0 0x7fc0b015f4b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0162fc0 tx=0x7fc0a002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e714b49c66b2ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:44.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.085+0000 7fc0b4e0e640 1 -- 172.21.15.117:0/1143494818 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0036070 con 0x7fc0b015f0d0 2024-09-19T08:37:44.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.085+0000 7fc0b4e0e640 1 -- 172.21.15.117:0/1143494818 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0a0031600 con 0x7fc0b015f0d0 2024-09-19T08:37:44.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.085+0000 7fc0b4e0e640 1 -- 172.21.15.117:0/1143494818 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a00319d0 con 0x7fc0b015f0d0 2024-09-19T08:37:44.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.085+0000 7fc0b8074640 1 -- 172.21.15.117:0/1143494818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b015f0d0 msgr2=0x7fc0b015f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:44.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.085+0000 7fc0b8074640 1 --2- 172.21.15.117:0/1143494818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b015f0d0 0x7fc0b015f4b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0162fc0 tx=0x7fc0a002a610 comp rx=0 tx=0).stop 2024-09-19T08:37:44.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.085+0000 7fc0b8074640 1 -- 172.21.15.117:0/1143494818 shutdown_connections 2024-09-19T08:37:44.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.085+0000 7fc0b8074640 1 --2- 172.21.15.117:0/1143494818 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0b00d1940 0x7fc0b00d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:44.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.085+0000 7fc0b8074640 1 --2- 172.21.15.117:0/1143494818 >> v2:172.21.15.146:3300/0 conn(0x7fc0b00d0070 0x7fc0b00d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:44.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.085+0000 7fc0b8074640 1 --2- 172.21.15.117:0/1143494818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b015f0d0 0x7fc0b015f4b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:44.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.085+0000 7fc0b8074640 1 -- 172.21.15.117:0/1143494818 >> 172.21.15.117:0/1143494818 conn(0x7fc0b009d760 msgr2=0x7fc0b008bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:44.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.085+0000 7fc0b8074640 1 -- 172.21.15.117:0/1143494818 shutdown_connections 2024-09-19T08:37:44.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.085+0000 7fc0b8074640 1 -- 172.21.15.117:0/1143494818 wait complete. 2024-09-19T08:37:44.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.086+0000 7fc0b8074640 1 Processor -- start 2024-09-19T08:37:44.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.086+0000 7fc0b8074640 1 -- start start 2024-09-19T08:37:44.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.087+0000 7fc0b8074640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0b00d0070 0x7fc0b00b9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:44.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.087+0000 7fc0b8074640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b00d1940 0x7fc0b0154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:44.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.087+0000 7fc0b8074640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0b015f0d0 0x7fc0b00b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:44.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.087+0000 7fc0b8074640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b00d47f0 con 0x7fc0b00d1940 2024-09-19T08:37:44.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.087+0000 7fc0b8074640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b00d4670 con 0x7fc0b00d0070 2024-09-19T08:37:44.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.087+0000 7fc0b8074640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fc0b00d4970 con 0x7fc0b015f0d0 2024-09-19T08:37:44.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.087+0000 7fc0b560f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b00d1940 0x7fc0b0154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:44.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.087+0000 7fc0b560f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b00d1940 0x7fc0b0154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35132/0 (socket says 172.21.15.117:35132) 2024-09-19T08:37:44.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.087+0000 7fc0b560f640 1 -- 172.21.15.117:0/201871262 learned_addr learned my addr 172.21.15.117:0/201871262 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:44.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.087+0000 7fc0b5e10640 1 --2- 172.21.15.117:0/201871262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0b00d0070 0x7fc0b00b9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:44.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.087+0000 7fc0b6611640 1 --2- 172.21.15.117:0/201871262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0b015f0d0 0x7fc0b00b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:44.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.088+0000 7fc0b560f640 1 -- 172.21.15.117:0/201871262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0b015f0d0 msgr2=0x7fc0b00b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:44.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.088+0000 7fc0b560f640 1 --2- 172.21.15.117:0/201871262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0b015f0d0 0x7fc0b00b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:44.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.088+0000 7fc0b560f640 1 -- 172.21.15.117:0/201871262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0b00d0070 msgr2=0x7fc0b00b9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:44.090 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.088+0000 7fc0b560f640 1 --2- 172.21.15.117:0/201871262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0b00d0070 0x7fc0b00b9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:44.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.088+0000 7fc0b560f640 1 -- 172.21.15.117:0/201871262 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b00cc680 con 0x7fc0b00d1940 2024-09-19T08:37:44.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.088+0000 7fc0b5e10640 1 --2- 172.21.15.117:0/201871262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0b00d0070 0x7fc0b00b9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:44.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.088+0000 7fc0b6611640 1 --2- 172.21.15.117:0/201871262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0b015f0d0 0x7fc0b00b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:44.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.088+0000 7fc0b560f640 1 --2- 172.21.15.117:0/201871262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b00d1940 0x7fc0b0154a10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400c820 tx=0x7fc0a400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:44.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.088+0000 7fc0ae7fc640 1 -- 172.21.15.117:0/201871262 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4015070 con 0x7fc0b00d1940 2024-09-19T08:37:44.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.088+0000 7fc0ae7fc640 1 -- 172.21.15.117:0/201871262 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0a4004020 con 0x7fc0b00d1940 2024-09-19T08:37:44.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.088+0000 7fc0ae7fc640 1 -- 172.21.15.117:0/201871262 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a40043f0 con 0x7fc0b00d1940 2024-09-19T08:37:44.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.088+0000 7fc0b8074640 1 -- 172.21.15.117:0/201871262 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b00cc8f0 con 0x7fc0b00d1940 2024-09-19T08:37:44.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.088+0000 7fc0b8074640 1 -- 172.21.15.117:0/201871262 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b00cceb0 con 0x7fc0b00d1940 2024-09-19T08:37:44.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.089+0000 7fc0b8074640 1 -- 172.21.15.117:0/201871262 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b00d1400 con 0x7fc0b00d1940 2024-09-19T08:37:44.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.089+0000 7fc0ae7fc640 1 -- 172.21.15.117:0/201871262 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc0a40077d0 con 0x7fc0b00d1940 2024-09-19T08:37:44.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.090+0000 7fc0ae7fc640 1 --2- 172.21.15.117:0/201871262 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc09c06c2b0 0x7fc09c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:44.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.090+0000 7fc0ae7fc640 1 -- 172.21.15.117:0/201871262 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc0a408b4b0 con 0x7fc0b00d1940 2024-09-19T08:37:44.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.090+0000 7fc0b5e10640 1 --2- 172.21.15.117:0/201871262 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc09c06c2b0 0x7fc09c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:44.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.091+0000 7fc0b5e10640 1 --2- 172.21.15.117:0/201871262 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc09c06c2b0 0x7fc09c06e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0033000 tx=0x7fc0a0009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:44.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.094+0000 7fc0ae7fc640 1 -- 172.21.15.117:0/201871262 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc0a40598e0 con 0x7fc0b00d1940 2024-09-19T08:37:44.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.295+0000 7fc0b8074640 1 -- 172.21.15.117:0/201871262 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc0b006e0b0 con 0x7fc0b00d1940 2024-09-19T08:37:44.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.295+0000 7fc0ae7fc640 1 -- 172.21.15.117:0/201871262 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fc0a40591e0 con 0x7fc0b00d1940 2024-09-19T08:37:44.295 INFO:teuthology.orchestra.run.smithi117.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T08:37:44.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.297+0000 7fc0b8074640 1 -- 172.21.15.117:0/201871262 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc09c06c2b0 msgr2=0x7fc09c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:44.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.297+0000 7fc0b8074640 1 --2- 172.21.15.117:0/201871262 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc09c06c2b0 0x7fc09c06e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0033000 tx=0x7fc0a0009000 comp rx=0 tx=0).stop 2024-09-19T08:37:44.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.297+0000 7fc0b8074640 1 -- 172.21.15.117:0/201871262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b00d1940 msgr2=0x7fc0b0154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:44.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.297+0000 7fc0b8074640 1 --2- 172.21.15.117:0/201871262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b00d1940 0x7fc0b0154a10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400c820 tx=0x7fc0a400cce0 comp rx=0 tx=0).stop 2024-09-19T08:37:44.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.297+0000 7fc0b8074640 1 -- 172.21.15.117:0/201871262 shutdown_connections 2024-09-19T08:37:44.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.297+0000 7fc0b8074640 1 --2- 172.21.15.117:0/201871262 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc09c06c2b0 0x7fc09c06e770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:44.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.297+0000 7fc0b8074640 1 --2- 172.21.15.117:0/201871262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0b015f0d0 0x7fc0b00b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:44.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.297+0000 7fc0b8074640 1 --2- 172.21.15.117:0/201871262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b00d1940 0x7fc0b0154a10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:44.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.297+0000 7fc0b8074640 1 --2- 172.21.15.117:0/201871262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0b00d0070 0x7fc0b00b9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:44.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.297+0000 7fc0b8074640 1 -- 172.21.15.117:0/201871262 >> 172.21.15.117:0/201871262 conn(0x7fc0b009d760 msgr2=0x7fc0b008bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:44.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.297+0000 7fc0b8074640 1 -- 172.21.15.117:0/201871262 shutdown_connections 2024-09-19T08:37:44.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:44.297+0000 7fc0b8074640 1 -- 172.21.15.117:0/201871262 wait complete. 2024-09-19T08:37:44.308 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T08:37:44.308 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T08:37:44.308 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-09-19T08:37:44.308 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-19T08:37:44.308 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T08:37:44.308 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T08:37:44.308 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T08:37:44.308 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T08:37:44.308 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T08:37:44.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:44.309 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-09-19T08:37:44.328 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T08:37:44.329 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T08:37:44.329 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T08:37:44.329 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:44.329 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-19T08:37:44.329 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:44.329 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:37:44.329 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:44.329 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-09-19T08:37:44.329 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:37:44.329 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:44.329 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-09-19T08:37:44.329 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:37:44.330 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:44.330 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T08:37:44.330 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:44.330 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T08:37:44.330 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42774sec preferred_lft 42774sec 2024-09-19T08:37:44.330 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2024-09-19T08:37:44.330 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:44.330 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T08:37:44.330 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:44.330 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-19T08:37:44.331 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add name ceph-brx type bridge 2024-09-19T08:37:44.331 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr flush dev ceph-brx 2024-09-19T08:37:44.331 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set ceph-brx up 2024-09-19T08:37:44.331 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T08:37:44.331 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-19T08:37:44.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:37:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:44.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:37:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:44.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:44.662 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T08:37:44.688 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-19T08:37:44.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:44.690 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-09-19T08:37:44.788 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-09-19T08:37:44.788 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T08:37:44.789 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T08:37:44.789 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T08:37:44.789 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T08:37:44.789 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:44.789 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-19T08:37:44.789 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T08:37:44.789 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T08:37:44.789 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T08:37:44.789 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-19T08:37:44.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:37:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:45.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:37:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:45.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:45.046 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-19T08:37:45.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:45.061 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2024-09-19T08:37:45.117 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:45.117 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-19T08:37:45.117 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T08:37:45.117 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-19T08:37:45.117 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-19T08:37:45.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:37:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:45.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:37:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:45.234 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-19T08:37:45.235 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:45.235 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-19T08:37:45.235 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-19T08:37:45.235 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T08:37:45.235 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-19T08:37:45.235 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-19T08:37:45.235 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-19T08:37:45.235 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-19T08:37:45.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:37:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:45.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:37:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:45.355 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:45.355 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-19T08:37:45.355 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-09-19T08:37:45.355 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T08:37:45.355 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-19T08:37:45.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:37:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:37:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:45.431 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-19T08:37:45.432 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:37:45.432 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-19T08:37:45.446 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-19T08:37:45.447 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:37:45.447 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-19T08:37:45.502 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2024-09-19T08:37:45.567 DEBUG:teuthology.orchestra.run.smithi146:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T08:37:45.624 INFO:teuthology.orchestra.run.smithi146.stdout:/proc 2024-09-19T08:37:45.624 INFO:teuthology.orchestra.run.smithi146.stdout:/sys 2024-09-19T08:37:45.625 INFO:teuthology.orchestra.run.smithi146.stdout:/dev 2024-09-19T08:37:45.625 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/security 2024-09-19T08:37:45.625 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/shm 2024-09-19T08:37:45.625 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/pts 2024-09-19T08:37:45.625 INFO:teuthology.orchestra.run.smithi146.stdout:/run 2024-09-19T08:37:45.625 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/cgroup 2024-09-19T08:37:45.625 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/pstore 2024-09-19T08:37:45.626 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/bpf 2024-09-19T08:37:45.626 INFO:teuthology.orchestra.run.smithi146.stdout:/ 2024-09-19T08:37:45.626 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/selinux 2024-09-19T08:37:45.626 INFO:teuthology.orchestra.run.smithi146.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:37:45.626 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/hugepages 2024-09-19T08:37:45.626 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/mqueue 2024-09-19T08:37:45.626 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/debug 2024-09-19T08:37:45.626 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/tracing 2024-09-19T08:37:45.626 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/fuse/connections 2024-09-19T08:37:45.626 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/config 2024-09-19T08:37:45.627 INFO:teuthology.orchestra.run.smithi146.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T08:37:45.627 INFO:teuthology.orchestra.run.smithi146.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T08:37:45.627 INFO:teuthology.orchestra.run.smithi146.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T08:37:45.627 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T08:37:45.627 INFO:teuthology.orchestra.run.smithi146.stdout:/run/user/1000 2024-09-19T08:37:45.627 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph 2024-09-19T08:37:45.627 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-4 2024-09-19T08:37:45.627 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-5 2024-09-19T08:37:45.627 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-6 2024-09-19T08:37:45.627 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-7 2024-09-19T08:37:45.627 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns 2024-09-19T08:37:45.627 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T08:37:45.627 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T08:37:45.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:45.628 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2024-09-19T08:37:45.680 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T08:37:45.681 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-19T08:37:45.723 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2024-09-19T08:37:45.747 DEBUG:teuthology.orchestra.run.smithi146:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T08:37:45.805 INFO:teuthology.orchestra.run.smithi146.stdout:/proc 2024-09-19T08:37:45.805 INFO:teuthology.orchestra.run.smithi146.stdout:/sys 2024-09-19T08:37:45.805 INFO:teuthology.orchestra.run.smithi146.stdout:/dev 2024-09-19T08:37:45.805 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/security 2024-09-19T08:37:45.805 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/shm 2024-09-19T08:37:45.805 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/pts 2024-09-19T08:37:45.805 INFO:teuthology.orchestra.run.smithi146.stdout:/run 2024-09-19T08:37:45.805 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/cgroup 2024-09-19T08:37:45.805 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/pstore 2024-09-19T08:37:45.806 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/bpf 2024-09-19T08:37:45.806 INFO:teuthology.orchestra.run.smithi146.stdout:/ 2024-09-19T08:37:45.806 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/selinux 2024-09-19T08:37:45.806 INFO:teuthology.orchestra.run.smithi146.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:37:45.806 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/hugepages 2024-09-19T08:37:45.806 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/mqueue 2024-09-19T08:37:45.806 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/debug 2024-09-19T08:37:45.806 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/tracing 2024-09-19T08:37:45.806 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/fuse/connections 2024-09-19T08:37:45.806 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/config 2024-09-19T08:37:45.806 INFO:teuthology.orchestra.run.smithi146.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T08:37:45.807 INFO:teuthology.orchestra.run.smithi146.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T08:37:45.807 INFO:teuthology.orchestra.run.smithi146.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T08:37:45.807 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T08:37:45.807 INFO:teuthology.orchestra.run.smithi146.stdout:/run/user/1000 2024-09-19T08:37:45.807 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph 2024-09-19T08:37:45.807 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-4 2024-09-19T08:37:45.807 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-5 2024-09-19T08:37:45.807 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-6 2024-09-19T08:37:45.807 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-7 2024-09-19T08:37:45.807 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns 2024-09-19T08:37:45.807 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T08:37:45.807 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T08:37:45.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:45.808 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2024-09-19T08:37:45.815 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi146.stderr:2024-09-19T08:37:45.815+0000 7f0108029480 -1 init, newargv = 0x5626c404b840 newargc=15 2024-09-19T08:37:45.816 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi146.stderr:ceph-fuse[42596]: starting ceph client 2024-09-19T08:37:45.820 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi146.stderr:ceph-fuse[42596]: starting fuse 2024-09-19T08:37:45.830 INFO:teuthology.orchestra.run.smithi146.stdout:41 2024-09-19T08:37:45.831 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-19T08:37:45.831 DEBUG:teuthology.orchestra.run.smithi146:> sudo stdin-killer -- python3 -c ' 2024-09-19T08:37:45.831 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2024-09-19T08:37:45.831 DEBUG:teuthology.orchestra.run.smithi146:> import re 2024-09-19T08:37:45.831 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-09-19T08:37:45.831 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2024-09-19T08:37:45.831 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-19T08:37:45.831 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2024-09-19T08:37:45.831 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-19T08:37:45.832 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2024-09-19T08:37:45.832 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-19T08:37:45.832 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-19T08:37:45.832 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2024-09-19T08:37:45.832 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2024-09-19T08:37:45.832 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2024-09-19T08:37:45.832 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2024-09-19T08:37:45.832 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-19T08:37:45.832 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2024-09-19T08:37:45.832 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T08:37:45.832 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T08:37:45.832 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T08:37:45.832 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2024-09-19T08:37:45.833 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2024-09-19T08:37:45.833 DEBUG:teuthology.orchestra.run.smithi146:> return f 2024-09-19T08:37:45.833 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T08:37:45.833 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-19T08:37:45.833 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.1")) 2024-09-19T08:37:45.833 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-09-19T08:37:45.948 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.1.42596.asok 2024-09-19T08:37:45.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:37:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:45.957 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.42596.asok 2024-09-19T08:37:45.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:45.958 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.42596.asok status 2024-09-19T08:37:46.090 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-19T08:37:46.091 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2024-09-19T08:37:46.091 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T08:37:46.091 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:37:46.091 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "1", 2024-09-19T08:37:46.091 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2024-09-19T08:37:46.091 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-19T08:37:46.091 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "42596", 2024-09-19T08:37:46.091 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2024-09-19T08:37:46.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-19T08:37:46.091 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2024-09-19T08:37:46.092 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2024-09-19T08:37:46.092 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4660, 2024-09-19T08:37:46.092 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2024-09-19T08:37:46.092 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2024-09-19T08:37:46.092 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2024-09-19T08:37:46.092 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 4660 2024-09-19T08:37:46.092 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-19T08:37:46.092 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2024-09-19T08:37:46.092 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2024-09-19T08:37:46.092 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2024-09-19T08:37:46.092 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 1237475626 2024-09-19T08:37:46.093 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-19T08:37:46.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-19T08:37:46.093 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2024-09-19T08:37:46.093 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2024-09-19T08:37:46.093 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2024-09-19T08:37:46.093 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 1237475626 2024-09-19T08:37:46.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-19T08:37:46.093 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.4660 192.168.0.1:0/1237475626", 2024-09-19T08:37:46.093 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "192.168.0.1:0/1237475626", 2024-09-19T08:37:46.093 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2024-09-19T08:37:46.093 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 9, 2024-09-19T08:37:46.094 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 26, 2024-09-19T08:37:46.094 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2024-09-19T08:37:46.094 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2024-09-19T08:37:46.094 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2024-09-19T08:37:46.094 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-19T08:37:46.099 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-19T08:37:46.100 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T08:37:46.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.211+0000 7f68b1a53640 1 Processor -- start 2024-09-19T08:37:46.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.211+0000 7f68b1a53640 1 -- start start 2024-09-19T08:37:46.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.212+0000 7f68b1a53640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68ac15f0d0 0x7f68ac15f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:46.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.212+0000 7f68b1a53640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68ac0d1b10 con 0x7f68ac0d0070 2024-09-19T08:37:46.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.212+0000 7f68b1a53640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68ac0cf2b0 con 0x7f68ac0d4130 2024-09-19T08:37:46.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.212+0000 7f68b1a53640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f68ac0cf590 con 0x7f68ac15f0d0 2024-09-19T08:37:46.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.212+0000 7f68aa7fc640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f68ac0d0070 0x7f68ac0d1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:39974/0 (socket says 172.21.15.117:39974) 2024-09-19T08:37:46.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.212+0000 7f68aa7fc640 1 -- 172.21.15.117:0/2527746356 learned_addr learned my addr 172.21.15.117:0/2527746356 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:46.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.212+0000 7f68a9ffb640 1 -- 172.21.15.117:0/2527746356 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2699945361 0 0) 0x7f68ac0d1b10 con 0x7f68ac0d0070 2024-09-19T08:37:46.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.212+0000 7f68aaffd640 1 --2- 172.21.15.117:0/2527746356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68ac15f0d0 0x7f68ac15f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:46.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.212+0000 7f68a9ffb640 1 -- 172.21.15.117:0/2527746356 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6894003520 con 0x7f68ac0d0070 2024-09-19T08:37:46.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68a9ffb640 1 -- 172.21.15.117:0/2527746356 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3392508848 0 0) 0x7f6894003520 con 0x7f68ac0d0070 2024-09-19T08:37:46.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68a9ffb640 1 -- 172.21.15.117:0/2527746356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68ac15f0d0 msgr2=0x7f68ac15f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:46.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68a9ffb640 1 --2- 172.21.15.117:0/2527746356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68ac15f0d0 0x7f68ac15f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:46.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68a9ffb640 1 -- 172.21.15.117:0/2527746356 >> v1:172.21.15.146:6789/0 conn(0x7f68ac0d4130 legacy=0x7f68ac0d45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:46.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68a9ffb640 1 -- 172.21.15.117:0/2527746356 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68ac0cf870 con 0x7f68ac0d0070 2024-09-19T08:37:46.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68a9ffb640 1 -- 172.21.15.117:0/2527746356 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f68a0001670 con 0x7f68ac0d0070 2024-09-19T08:37:46.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68a9ffb640 1 -- 172.21.15.117:0/2527746356 >> v1:172.21.15.117:6789/0 conn(0x7f68ac0d0070 legacy=0x7f68ac0d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:46.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68a9ffb640 1 --2- 172.21.15.117:0/2527746356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68940039e0 0x7f6894003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:46.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68a9ffb640 1 --2- 172.21.15.117:0/2527746356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6894004390 0x7f6894004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:46.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68a9ffb640 1 --2- 172.21.15.117:0/2527746356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68ac15f0d0 0x7f6894005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:46.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68a9ffb640 1 -- 172.21.15.117:0/2527746356 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f68ac0cf590 con 0x7f6894004390 2024-09-19T08:37:46.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68a9ffb640 1 -- 172.21.15.117:0/2527746356 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f689400ba70 con 0x7f68940039e0 2024-09-19T08:37:46.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68a9ffb640 1 -- 172.21.15.117:0/2527746356 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f689400bc70 con 0x7f68ac15f0d0 2024-09-19T08:37:46.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68aa7fc640 1 --2- 172.21.15.117:0/2527746356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6894004390 0x7f6894004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:46.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68ab7fe640 1 --2- 172.21.15.117:0/2527746356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68ac15f0d0 0x7f6894005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:46.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68aaffd640 1 --2- 172.21.15.117:0/2527746356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68940039e0 0x7f6894003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:46.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68aa7fc640 1 -- 172.21.15.117:0/2527746356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68ac15f0d0 msgr2=0x7f6894005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:46.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68aa7fc640 1 --2- 172.21.15.117:0/2527746356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68ac15f0d0 0x7f6894005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:46.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68aa7fc640 1 -- 172.21.15.117:0/2527746356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68940039e0 msgr2=0x7f6894003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:46.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68aa7fc640 1 --2- 172.21.15.117:0/2527746356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68940039e0 0x7f6894003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:46.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68aa7fc640 1 -- 172.21.15.117:0/2527746356 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6894003520 con 0x7f6894004390 2024-09-19T08:37:46.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.213+0000 7f68ab7fe640 1 --2- 172.21.15.117:0/2527746356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68ac15f0d0 0x7f6894005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:37:46.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.214+0000 7f68aa7fc640 1 --2- 172.21.15.117:0/2527746356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6894004390 0x7f6894004860 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f68a0007fd0 tx=0x7f6894005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b69b05cc1f48e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:46.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.214+0000 7f68a9ffb640 1 -- 172.21.15.117:0/2527746356 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a0007d50 con 0x7f6894004390 2024-09-19T08:37:46.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.214+0000 7f68a9ffb640 1 -- 172.21.15.117:0/2527746356 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a00058d0 con 0x7f6894004390 2024-09-19T08:37:46.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.214+0000 7f68a9ffb640 1 -- 172.21.15.117:0/2527746356 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a0005ce0 con 0x7f6894004390 2024-09-19T08:37:46.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.215+0000 7f68b1a53640 1 -- 172.21.15.117:0/2527746356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6894004390 msgr2=0x7f6894004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:46.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.215+0000 7f68b1a53640 1 --2- 172.21.15.117:0/2527746356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6894004390 0x7f6894004860 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f68a0007fd0 tx=0x7f6894005830 comp rx=0 tx=0).stop 2024-09-19T08:37:46.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.215+0000 7f68ab7fe640 1 -- 172.21.15.117:0/2527746356 reap_dead start 2024-09-19T08:37:46.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.215+0000 7f68b1a53640 1 -- 172.21.15.117:0/2527746356 shutdown_connections 2024-09-19T08:37:46.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.215+0000 7f68b1a53640 1 -- 172.21.15.117:0/2527746356 >> 172.21.15.117:0/2527746356 conn(0x7f68ac09d760 msgr2=0x7f68ac08bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:46.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.215+0000 7f68b1a53640 1 -- 172.21.15.117:0/2527746356 shutdown_connections 2024-09-19T08:37:46.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.215+0000 7f68b1a53640 1 -- 172.21.15.117:0/2527746356 wait complete. 2024-09-19T08:37:46.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.216+0000 7f68b1a53640 1 Processor -- start 2024-09-19T08:37:46.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.216+0000 7f68b1a53640 1 -- start start 2024-09-19T08:37:46.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.217+0000 7f68b1a53640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6894004390 0x7f68ac0ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:46.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.217+0000 7f68b1a53640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68ac09e0d0 0x7f68ac14f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:46.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.217+0000 7f68b1a53640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68ac09faa0 0x7f68ac0cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:46.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.217+0000 7f68b1a53640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f68ac15f4b0 con 0x7f68ac09e0d0 2024-09-19T08:37:46.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.217+0000 7f68b1a53640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f68ac0cef60 con 0x7f68ac09faa0 2024-09-19T08:37:46.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.217+0000 7f68b1a53640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f68ac15f630 con 0x7f6894004390 2024-09-19T08:37:46.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.217+0000 7f68aa7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68ac09e0d0 0x7f68ac14f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:46.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.217+0000 7f68aa7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68ac09e0d0 0x7f68ac14f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52574/0 (socket says 172.21.15.117:52574) 2024-09-19T08:37:46.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.217+0000 7f68aa7fc640 1 -- 172.21.15.117:0/2569781887 learned_addr learned my addr 172.21.15.117:0/2569781887 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:46.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.217+0000 7f68aaffd640 1 --2- 172.21.15.117:0/2569781887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6894004390 0x7f68ac0ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:46.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.217+0000 7f68ab7fe640 1 --2- 172.21.15.117:0/2569781887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68ac09faa0 0x7f68ac0cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:46.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.217+0000 7f68aa7fc640 1 -- 172.21.15.117:0/2569781887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6894004390 msgr2=0x7f68ac0ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:46.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.217+0000 7f68aa7fc640 1 --2- 172.21.15.117:0/2569781887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6894004390 0x7f68ac0ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:46.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.217+0000 7f68aa7fc640 1 -- 172.21.15.117:0/2569781887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68ac09faa0 msgr2=0x7f68ac0cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:46.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.217+0000 7f68aa7fc640 1 --2- 172.21.15.117:0/2569781887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68ac09faa0 0x7f68ac0cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:46.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.217+0000 7f68aa7fc640 1 -- 172.21.15.117:0/2569781887 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68ac0cb9a0 con 0x7f68ac09e0d0 2024-09-19T08:37:46.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.217+0000 7f68aaffd640 1 --2- 172.21.15.117:0/2569781887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6894004390 0x7f68ac0ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:37:46.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.218+0000 7f68aa7fc640 1 --2- 172.21.15.117:0/2569781887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68ac09e0d0 0x7f68ac14f5f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f68a000c380 tx=0x7f68a0001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:46.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.218+0000 7f6893fff640 1 -- 172.21.15.117:0/2569781887 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a0041020 con 0x7f68ac09e0d0 2024-09-19T08:37:46.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.218+0000 7f6893fff640 1 -- 172.21.15.117:0/2569781887 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a00047e0 con 0x7f68ac09e0d0 2024-09-19T08:37:46.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.218+0000 7f68b1a53640 1 -- 172.21.15.117:0/2569781887 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68ac0cbc80 con 0x7f68ac09e0d0 2024-09-19T08:37:46.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.218+0000 7f6893fff640 1 -- 172.21.15.117:0/2569781887 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a0038040 con 0x7f68ac09e0d0 2024-09-19T08:37:46.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.218+0000 7f68b1a53640 1 -- 172.21.15.117:0/2569781887 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68ac0cd810 con 0x7f68ac09e0d0 2024-09-19T08:37:46.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.219+0000 7f68b1a53640 1 -- 172.21.15.117:0/2569781887 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68ac0d45e0 con 0x7f68ac09e0d0 2024-09-19T08:37:46.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.219+0000 7f6893fff640 1 -- 172.21.15.117:0/2569781887 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f68a0044020 con 0x7f68ac09e0d0 2024-09-19T08:37:46.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.220+0000 7f6893fff640 1 --2- 172.21.15.117:0/2569781887 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f689806c2b0 0x7f689806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:46.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.220+0000 7f6893fff640 1 -- 172.21.15.117:0/2569781887 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f68a00ab410 con 0x7f68ac09e0d0 2024-09-19T08:37:46.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.220+0000 7f68aaffd640 1 --2- 172.21.15.117:0/2569781887 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f689806c2b0 0x7f689806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:46.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.220+0000 7f68aaffd640 1 --2- 172.21.15.117:0/2569781887 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f689806c2b0 0x7f689806e770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f689c009fd0 tx=0x7f689c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:46.224 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.224+0000 7f6893fff640 1 -- 172.21.15.117:0/2569781887 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f68a004b030 con 0x7f68ac09e0d0 2024-09-19T08:37:46.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.426+0000 7f68b1a53640 1 -- 172.21.15.117:0/2569781887 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f68ac06cf30 con 0x7f68ac09e0d0 2024-09-19T08:37:46.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.426+0000 7f6893fff640 1 -- 172.21.15.117:0/2569781887 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f68a00798d0 con 0x7f68ac09e0d0 2024-09-19T08:37:46.426 INFO:teuthology.orchestra.run.smithi117.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T08:37:46.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.428+0000 7f68b1a53640 1 -- 172.21.15.117:0/2569781887 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f689806c2b0 msgr2=0x7f689806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:46.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.428+0000 7f68b1a53640 1 --2- 172.21.15.117:0/2569781887 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f689806c2b0 0x7f689806e770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f689c009fd0 tx=0x7f689c00b040 comp rx=0 tx=0).stop 2024-09-19T08:37:46.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.428+0000 7f68b1a53640 1 -- 172.21.15.117:0/2569781887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68ac09e0d0 msgr2=0x7f68ac14f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:46.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.428+0000 7f68b1a53640 1 --2- 172.21.15.117:0/2569781887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68ac09e0d0 0x7f68ac14f5f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f68a000c380 tx=0x7f68a0001a40 comp rx=0 tx=0).stop 2024-09-19T08:37:46.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.428+0000 7f68b1a53640 1 -- 172.21.15.117:0/2569781887 shutdown_connections 2024-09-19T08:37:46.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.428+0000 7f68b1a53640 1 --2- 172.21.15.117:0/2569781887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68ac09faa0 0x7f68ac0cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:46.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.428+0000 7f68b1a53640 1 --2- 172.21.15.117:0/2569781887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68ac09e0d0 0x7f68ac14f5f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:46.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.428+0000 7f68b1a53640 1 --2- 172.21.15.117:0/2569781887 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f689806c2b0 0x7f689806e770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:46.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.428+0000 7f68b1a53640 1 --2- 172.21.15.117:0/2569781887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6894004390 0x7f68ac0ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:46.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.428+0000 7f68b1a53640 1 -- 172.21.15.117:0/2569781887 >> 172.21.15.117:0/2569781887 conn(0x7f68ac09d760 msgr2=0x7f68ac15a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:46.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.428+0000 7f68b1a53640 1 -- 172.21.15.117:0/2569781887 shutdown_connections 2024-09-19T08:37:46.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:46.428+0000 7f68b1a53640 1 -- 172.21.15.117:0/2569781887 wait complete. 2024-09-19T08:37:46.439 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T08:37:46.439 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T08:37:46.439 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-09-19T08:37:46.439 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-19T08:37:46.439 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-19T08:37:46.439 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T08:37:46.439 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T08:37:46.439 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T08:37:46.439 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-19T08:37:46.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:46.440 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-09-19T08:37:46.456 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T08:37:46.456 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T08:37:46.457 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T08:37:46.457 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:46.457 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-19T08:37:46.457 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:46.457 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:37:46.457 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:46.457 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-09-19T08:37:46.457 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:37:46.457 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:46.457 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-09-19T08:37:46.457 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:37:46.457 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:46.457 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T08:37:46.458 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:46.458 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T08:37:46.458 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42771sec preferred_lft 42771sec 2024-09-19T08:37:46.458 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2024-09-19T08:37:46.458 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:46.459 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T08:37:46.459 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether ae:b4:a8:6f:31:fa brd ff:ff:ff:ff:ff:ff 2024-09-19T08:37:46.459 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T08:37:46.459 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:46.459 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::4091:58ff:fe40:5ae0/64 scope link 2024-09-19T08:37:46.459 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:46.459 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T08:37:46.459 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether ae:b4:a8:6f:31:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T08:37:46.459 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::acb4:a8ff:fe6f:31fa/64 scope link tentative 2024-09-19T08:37:46.459 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:46.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:46.460 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T08:37:46.520 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-19T08:37:46.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:46.522 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-09-19T08:37:46.579 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-09-19T08:37:46.579 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T08:37:46.579 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T08:37:46.580 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T08:37:46.580 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T08:37:46.580 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:46.580 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-19T08:37:46.580 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T08:37:46.580 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T08:37:46.580 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T08:37:46.580 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-19T08:37:46.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:37:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:46.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:37:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:46.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:46.705 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-19T08:37:46.720 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-19T08:37:46.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:46.721 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2024-09-19T08:37:46.777 INFO:teuthology.orchestra.run.smithi146.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-19T08:37:46.778 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:46.778 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-19T08:37:46.778 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T08:37:46.778 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-19T08:37:46.778 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-19T08:37:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:37:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:46.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:37:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:46.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:46.894 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-19T08:37:46.919 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T08:37:46.919 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T08:37:46.919 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T08:37:46.919 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:46.919 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-19T08:37:46.919 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:46.919 INFO:teuthology.orchestra.run.smithi146.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T08:37:46.920 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:53:4e:33:21:b5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-19T08:37:46.920 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-19T08:37:46.920 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:46.920 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1053:4eff:fe33:21b5/64 scope link tentative 2024-09-19T08:37:46.920 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:46.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:46.921 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-19T08:37:46.986 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T08:37:46.986 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T08:37:46.986 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T08:37:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-19T08:37:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:46.987 INFO:teuthology.orchestra.run.smithi146.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T08:37:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:53:4e:33:21:b5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-19T08:37:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-19T08:37:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1053:4eff:fe33:21b5/64 scope link tentative 2024-09-19T08:37:46.987 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:37:46.988 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-19T08:37:46.988 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:46.989 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-19T08:37:46.989 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-19T08:37:46.989 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-19T08:37:46.989 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-19T08:37:46.989 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-19T08:37:46.989 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-19T08:37:46.989 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-19T08:37:47.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:37:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:47.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:37:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:47.141 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:37:47.141 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-19T08:37:47.141 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.1 up 2024-09-19T08:37:47.141 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.1 master ceph-brx 2024-09-19T08:37:47.141 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-19T08:37:47.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:37:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:37:47.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:37:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:47.218 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-09-19T08:37:47.218 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:37:47.218 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-19T08:37:47.245 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-19T08:37:47.245 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:37:47.245 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-19T08:37:47.301 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2024-09-19T08:37:47.367 DEBUG:teuthology.orchestra.run.smithi146:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T08:37:47.424 INFO:teuthology.orchestra.run.smithi146.stdout:/proc 2024-09-19T08:37:47.424 INFO:teuthology.orchestra.run.smithi146.stdout:/sys 2024-09-19T08:37:47.424 INFO:teuthology.orchestra.run.smithi146.stdout:/dev 2024-09-19T08:37:47.424 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/security 2024-09-19T08:37:47.424 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/shm 2024-09-19T08:37:47.425 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/pts 2024-09-19T08:37:47.425 INFO:teuthology.orchestra.run.smithi146.stdout:/run 2024-09-19T08:37:47.425 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/cgroup 2024-09-19T08:37:47.425 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/pstore 2024-09-19T08:37:47.425 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/bpf 2024-09-19T08:37:47.425 INFO:teuthology.orchestra.run.smithi146.stdout:/ 2024-09-19T08:37:47.425 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/selinux 2024-09-19T08:37:47.425 INFO:teuthology.orchestra.run.smithi146.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:37:47.425 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/hugepages 2024-09-19T08:37:47.425 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/mqueue 2024-09-19T08:37:47.425 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/debug 2024-09-19T08:37:47.425 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/tracing 2024-09-19T08:37:47.425 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/fuse/connections 2024-09-19T08:37:47.426 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/config 2024-09-19T08:37:47.426 INFO:teuthology.orchestra.run.smithi146.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T08:37:47.426 INFO:teuthology.orchestra.run.smithi146.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T08:37:47.426 INFO:teuthology.orchestra.run.smithi146.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T08:37:47.426 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T08:37:47.426 INFO:teuthology.orchestra.run.smithi146.stdout:/run/user/1000 2024-09-19T08:37:47.426 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph 2024-09-19T08:37:47.426 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-4 2024-09-19T08:37:47.426 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-5 2024-09-19T08:37:47.426 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-6 2024-09-19T08:37:47.426 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-7 2024-09-19T08:37:47.426 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns 2024-09-19T08:37:47.426 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T08:37:47.426 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T08:37:47.426 INFO:teuthology.orchestra.run.smithi146.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-19T08:37:47.427 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T08:37:47.427 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T08:37:47.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:47.427 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2024-09-19T08:37:47.480 INFO:teuthology.orchestra.run.smithi146.stdout:41 2024-09-19T08:37:47.481 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-09-19T08:37:47.481 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-09-19T08:37:47.523 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2024-09-19T08:37:47.548 DEBUG:teuthology.orchestra.run.smithi146:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T08:37:47.604 INFO:teuthology.orchestra.run.smithi146.stdout:/proc 2024-09-19T08:37:47.604 INFO:teuthology.orchestra.run.smithi146.stdout:/sys 2024-09-19T08:37:47.604 INFO:teuthology.orchestra.run.smithi146.stdout:/dev 2024-09-19T08:37:47.604 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/security 2024-09-19T08:37:47.604 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/shm 2024-09-19T08:37:47.604 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/pts 2024-09-19T08:37:47.604 INFO:teuthology.orchestra.run.smithi146.stdout:/run 2024-09-19T08:37:47.604 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/cgroup 2024-09-19T08:37:47.604 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/pstore 2024-09-19T08:37:47.605 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/bpf 2024-09-19T08:37:47.605 INFO:teuthology.orchestra.run.smithi146.stdout:/ 2024-09-19T08:37:47.605 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/selinux 2024-09-19T08:37:47.605 INFO:teuthology.orchestra.run.smithi146.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:37:47.605 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/hugepages 2024-09-19T08:37:47.605 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/mqueue 2024-09-19T08:37:47.605 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/debug 2024-09-19T08:37:47.605 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/tracing 2024-09-19T08:37:47.605 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/fs/fuse/connections 2024-09-19T08:37:47.605 INFO:teuthology.orchestra.run.smithi146.stdout:/sys/kernel/config 2024-09-19T08:37:47.605 INFO:teuthology.orchestra.run.smithi146.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T08:37:47.605 INFO:teuthology.orchestra.run.smithi146.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T08:37:47.605 INFO:teuthology.orchestra.run.smithi146.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T08:37:47.606 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T08:37:47.606 INFO:teuthology.orchestra.run.smithi146.stdout:/run/user/1000 2024-09-19T08:37:47.606 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph 2024-09-19T08:37:47.606 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-4 2024-09-19T08:37:47.606 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-5 2024-09-19T08:37:47.606 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-6 2024-09-19T08:37:47.606 INFO:teuthology.orchestra.run.smithi146.stdout:/var/lib/ceph/osd/ceph-7 2024-09-19T08:37:47.606 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns 2024-09-19T08:37:47.606 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T08:37:47.606 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T08:37:47.606 INFO:teuthology.orchestra.run.smithi146.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-19T08:37:47.606 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T08:37:47.606 INFO:teuthology.orchestra.run.smithi146.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T08:37:47.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:47.607 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2024-09-19T08:37:47.608 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi146.stderr:2024-09-19T08:37:47.604+0000 7f53c1482480 -1 init, newargv = 0x5567df11c9a0 newargc=15 2024-09-19T08:37:47.608 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi146.stderr:ceph-fuse[43048]: starting ceph client 2024-09-19T08:37:47.610 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi146.stderr:ceph-fuse[43048]: starting fuse 2024-09-19T08:37:47.623 INFO:teuthology.orchestra.run.smithi146.stdout:41 2024-09-19T08:37:47.623 INFO:teuthology.orchestra.run.smithi146.stdout:44 2024-09-19T08:37:47.623 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-09-19T08:37:47.624 DEBUG:teuthology.orchestra.run.smithi146:> sudo stdin-killer -- python3 -c ' 2024-09-19T08:37:47.624 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2024-09-19T08:37:47.624 DEBUG:teuthology.orchestra.run.smithi146:> import re 2024-09-19T08:37:47.624 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-09-19T08:37:47.624 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2024-09-19T08:37:47.624 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-19T08:37:47.624 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2024-09-19T08:37:47.624 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-09-19T08:37:47.624 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2024-09-19T08:37:47.624 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-09-19T08:37:47.624 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-19T08:37:47.624 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2024-09-19T08:37:47.625 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2024-09-19T08:37:47.625 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2024-09-19T08:37:47.625 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2024-09-19T08:37:47.625 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-19T08:37:47.625 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2024-09-19T08:37:47.625 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T08:37:47.625 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T08:37:47.625 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T08:37:47.625 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2024-09-19T08:37:47.625 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2024-09-19T08:37:47.625 DEBUG:teuthology.orchestra.run.smithi146:> return f 2024-09-19T08:37:47.625 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T08:37:47.625 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-19T08:37:47.625 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.3")) 2024-09-19T08:37:47.625 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-09-19T08:37:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.3.43048.asok 2024-09-19T08:37:47.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-19T08:37:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:37:47.750 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.43048.asok 2024-09-19T08:37:47.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:47.751 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.43048.asok status 2024-09-19T08:37:47.884 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-19T08:37:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2024-09-19T08:37:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T08:37:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:37:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "3", 2024-09-19T08:37:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2024-09-19T08:37:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-09-19T08:37:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "43048", 2024-09-19T08:37:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2024-09-19T08:37:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-19T08:37:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2024-09-19T08:37:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2024-09-19T08:37:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4675, 2024-09-19T08:37:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2024-09-19T08:37:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2024-09-19T08:37:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2024-09-19T08:37:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 4675 2024-09-19T08:37:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-19T08:37:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2024-09-19T08:37:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2024-09-19T08:37:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.2:0", 2024-09-19T08:37:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 2225891937 2024-09-19T08:37:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-19T08:37:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-19T08:37:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2024-09-19T08:37:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2024-09-19T08:37:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.2:0", 2024-09-19T08:37:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 2225891937 2024-09-19T08:37:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-19T08:37:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.4675 192.168.0.2:0/2225891937", 2024-09-19T08:37:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "192.168.0.2:0/2225891937", 2024-09-19T08:37:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2024-09-19T08:37:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 9, 2024-09-19T08:37:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 26, 2024-09-19T08:37:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2024-09-19T08:37:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2024-09-19T08:37:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2024-09-19T08:37:47.887 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-19T08:37:47.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:47.893 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2024-09-19T08:37:47.893 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T08:37:47.913 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2024-09-19T08:37:47.913 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T08:37:47.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:47.914 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T08:37:47.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:47.984 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2024-09-19T08:37:47.984 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.2 2024-09-19T08:37:48.042 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2024-09-19T08:37:48.042 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-09-19T08:37:48.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:48.043 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-19T08:37:48.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:48.111 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2024-09-19T08:37:48.111 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-19T08:37:48.128 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2024-09-19T08:37:48.128 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-19T08:37:48.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:48.128 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-19T08:37:48.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:48.194 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2024-09-19T08:37:48.194 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.3 2024-09-19T08:37:48.251 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2024-09-19T08:37:48.251 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-09-19T08:37:48.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:48.252 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-19T08:37:48.317 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-19T08:37:48.356 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-09-19T08:37:48.357 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:37:48.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.470+0000 7f14fd40e640 1 Processor -- start 2024-09-19T08:37:48.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.470+0000 7f14fd40e640 1 -- start start 2024-09-19T08:37:48.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.471+0000 7f14fd40e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14f8161af0 0x7f14f8162c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:48.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.471+0000 7f14fd40e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f14f809a9f0 0x7f14f809aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:48.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.471+0000 7f14fd40e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14f80d05e0 con 0x7f14f80b47c0 2024-09-19T08:37:48.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.471+0000 7f14fd40e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f14f80d03b0 con 0x7f14f809a9f0 2024-09-19T08:37:48.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.471+0000 7f14fd40e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f14f8163150 con 0x7f14f8161af0 2024-09-19T08:37:48.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.471+0000 7f14f77fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f14f809a9f0 0x7f14f809aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:48.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.471+0000 7f14f77fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f14f809a9f0 0x7f14f809aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52586/0 (socket says 172.21.15.117:52586) 2024-09-19T08:37:48.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.471+0000 7f14f77fe640 1 -- 172.21.15.117:0/1589067073 learned_addr learned my addr 172.21.15.117:0/1589067073 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:48.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.471+0000 7f14f6ffd640 1 --2- 172.21.15.117:0/1589067073 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14f8161af0 0x7f14f8162c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:48.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.472+0000 7f14f77fe640 1 -- 172.21.15.117:0/1589067073 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14f8161af0 msgr2=0x7f14f8162c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:48.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.472+0000 7f14f77fe640 1 --2- 172.21.15.117:0/1589067073 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14f8161af0 0x7f14f8162c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:48.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.472+0000 7f14f77fe640 1 -- 172.21.15.117:0/1589067073 >> v1:172.21.15.146:6789/0 conn(0x7f14f80b47c0 legacy=0x7f14f80d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:48.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.472+0000 7f14f77fe640 1 -- 172.21.15.117:0/1589067073 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f80d08c0 con 0x7f14f809a9f0 2024-09-19T08:37:48.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.472+0000 7f14f77fe640 1 --2- 172.21.15.117:0/1589067073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14f809a9f0 0x7f14f809aea0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f14f00098a0 tx=0x7f14f002a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4144b3c5097ce9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:48.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.472+0000 7f14f5ffb640 1 -- 172.21.15.117:0/1589067073 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f0037070 con 0x7f14f809a9f0 2024-09-19T08:37:48.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.473+0000 7f14f5ffb640 1 -- 172.21.15.117:0/1589067073 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f0032640 con 0x7f14f809a9f0 2024-09-19T08:37:48.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.473+0000 7f14f5ffb640 1 -- 172.21.15.117:0/1589067073 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f0032a10 con 0x7f14f809a9f0 2024-09-19T08:37:48.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.473+0000 7f14fd40e640 1 -- 172.21.15.117:0/1589067073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14f809a9f0 msgr2=0x7f14f809aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:48.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.473+0000 7f14fd40e640 1 --2- 172.21.15.117:0/1589067073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14f809a9f0 0x7f14f809aea0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f14f00098a0 tx=0x7f14f002a320 comp rx=0 tx=0).stop 2024-09-19T08:37:48.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.473+0000 7f14fd40e640 1 -- 172.21.15.117:0/1589067073 shutdown_connections 2024-09-19T08:37:48.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.473+0000 7f14fd40e640 1 --2- 172.21.15.117:0/1589067073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14f809a9f0 0x7f14f809aea0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:48.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.473+0000 7f14fd40e640 1 --2- 172.21.15.117:0/1589067073 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14f8161af0 0x7f14f8162c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:48.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.473+0000 7f14fd40e640 1 -- 172.21.15.117:0/1589067073 >> 172.21.15.117:0/1589067073 conn(0x7f14f80b3ca0 msgr2=0x7f14f80b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:48.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.473+0000 7f14fd40e640 1 -- 172.21.15.117:0/1589067073 shutdown_connections 2024-09-19T08:37:48.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.473+0000 7f14fd40e640 1 -- 172.21.15.117:0/1589067073 wait complete. 2024-09-19T08:37:48.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.474+0000 7f14fd40e640 1 Processor -- start 2024-09-19T08:37:48.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.474+0000 7f14fd40e640 1 -- start start 2024-09-19T08:37:48.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.475+0000 7f14fd40e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14f809a9f0 0x7f14f815d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:48.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.475+0000 7f14fd40e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14f80b47c0 0x7f14f8150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:48.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.475+0000 7f14fd40e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14f8161af0 0x7f14f81e9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:48.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.475+0000 7f14fd40e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f14f80d1160 con 0x7f14f80b47c0 2024-09-19T08:37:48.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.475+0000 7f14fd40e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f14f80d0e80 con 0x7f14f8161af0 2024-09-19T08:37:48.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.475+0000 7f14fd40e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f14f8161ed0 con 0x7f14f809a9f0 2024-09-19T08:37:48.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.475+0000 7f14f67fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14f80b47c0 0x7f14f8150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:48.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.475+0000 7f14f67fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14f80b47c0 0x7f14f8150630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52602/0 (socket says 172.21.15.117:52602) 2024-09-19T08:37:48.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.475+0000 7f14f67fc640 1 -- 172.21.15.117:0/322233046 learned_addr learned my addr 172.21.15.117:0/322233046 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:48.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.475+0000 7f14f6ffd640 1 --2- 172.21.15.117:0/322233046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14f809a9f0 0x7f14f815d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:48.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.475+0000 7f14f77fe640 1 --2- 172.21.15.117:0/322233046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14f8161af0 0x7f14f81e9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:48.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.476+0000 7f14f67fc640 1 -- 172.21.15.117:0/322233046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14f809a9f0 msgr2=0x7f14f815d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:48.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.476+0000 7f14f67fc640 1 --2- 172.21.15.117:0/322233046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14f809a9f0 0x7f14f815d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:48.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.476+0000 7f14f67fc640 1 -- 172.21.15.117:0/322233046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14f8161af0 msgr2=0x7f14f81e9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:48.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.476+0000 7f14f67fc640 1 --2- 172.21.15.117:0/322233046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14f8161af0 0x7f14f81e9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:48.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.476+0000 7f14f67fc640 1 -- 172.21.15.117:0/322233046 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f8150b70 con 0x7f14f80b47c0 2024-09-19T08:37:48.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.476+0000 7f14f67fc640 1 --2- 172.21.15.117:0/322233046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14f80b47c0 0x7f14f8150630 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00c440 tx=0x7f14ec00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:48.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.476+0000 7f14df7fe640 1 -- 172.21.15.117:0/322233046 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ec0052d0 con 0x7f14f80b47c0 2024-09-19T08:37:48.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.476+0000 7f14df7fe640 1 -- 172.21.15.117:0/322233046 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14ec005470 con 0x7f14f80b47c0 2024-09-19T08:37:48.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.476+0000 7f14fd40e640 1 -- 172.21.15.117:0/322233046 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f81ea2b0 con 0x7f14f80b47c0 2024-09-19T08:37:48.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.476+0000 7f14df7fe640 1 -- 172.21.15.117:0/322233046 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ec007260 con 0x7f14f80b47c0 2024-09-19T08:37:48.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.476+0000 7f14fd40e640 1 -- 172.21.15.117:0/322233046 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f81ea870 con 0x7f14f80b47c0 2024-09-19T08:37:48.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.477+0000 7f14fd40e640 1 -- 172.21.15.117:0/322233046 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14f81eaa40 con 0x7f14f80b47c0 2024-09-19T08:37:48.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.478+0000 7f14df7fe640 1 -- 172.21.15.117:0/322233046 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f14ec007400 con 0x7f14f80b47c0 2024-09-19T08:37:48.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.478+0000 7f14df7fe640 1 --2- 172.21.15.117:0/322233046 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f14e406c2b0 0x7f14e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:48.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.478+0000 7f14df7fe640 1 -- 172.21.15.117:0/322233046 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f14ec08aad0 con 0x7f14f80b47c0 2024-09-19T08:37:48.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.478+0000 7f14f6ffd640 1 --2- 172.21.15.117:0/322233046 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f14e406c2b0 0x7f14e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:48.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.479+0000 7f14f6ffd640 1 --2- 172.21.15.117:0/322233046 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f14e406c2b0 0x7f14e406e770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f14f81f7c90 tx=0x7f14e8009830 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:48.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.482+0000 7f14df7fe640 1 -- 172.21.15.117:0/322233046 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f14f8150b70 con 0x7f14f80b47c0 2024-09-19T08:37:48.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.649+0000 7f14fd40e640 1 -- 172.21.15.117:0/322233046 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14f809b850 con 0x7f14f80b47c0 2024-09-19T08:37:48.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.651+0000 7f14df7fe640 1 -- 172.21.15.117:0/322233046 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18650 (secure 0 0 0) 0x7f14ec0588b0 con 0x7f14f80b47c0 2024-09-19T08:37:48.651 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:48.651 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":26,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:37:17.670150+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:37:10.463000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:37:11.619440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:37:15.342435+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:37:48.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.653+0000 7f14fd40e640 1 -- 172.21.15.117:0/322233046 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f14e406c2b0 msgr2=0x7f14e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:48.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.653+0000 7f14fd40e640 1 --2- 172.21.15.117:0/322233046 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f14e406c2b0 0x7f14e406e770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f14f81f7c90 tx=0x7f14e8009830 comp rx=0 tx=0).stop 2024-09-19T08:37:48.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.653+0000 7f14fd40e640 1 -- 172.21.15.117:0/322233046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14f80b47c0 msgr2=0x7f14f8150630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:48.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.653+0000 7f14fd40e640 1 --2- 172.21.15.117:0/322233046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14f80b47c0 0x7f14f8150630 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00c440 tx=0x7f14ec00c900 comp rx=0 tx=0).stop 2024-09-19T08:37:48.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.653+0000 7f14fd40e640 1 -- 172.21.15.117:0/322233046 shutdown_connections 2024-09-19T08:37:48.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.653+0000 7f14fd40e640 1 --2- 172.21.15.117:0/322233046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14f8161af0 0x7f14f81e9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:48.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.653+0000 7f14fd40e640 1 --2- 172.21.15.117:0/322233046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14f80b47c0 0x7f14f8150630 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:48.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.653+0000 7f14fd40e640 1 --2- 172.21.15.117:0/322233046 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f14e406c2b0 0x7f14e406e770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:48.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.653+0000 7f14fd40e640 1 --2- 172.21.15.117:0/322233046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14f809a9f0 0x7f14f815d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:48.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.653+0000 7f14fd40e640 1 -- 172.21.15.117:0/322233046 >> 172.21.15.117:0/322233046 conn(0x7f14f80b3ca0 msgr2=0x7f14f80b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:48.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.653+0000 7f14fd40e640 1 -- 172.21.15.117:0/322233046 shutdown_connections 2024-09-19T08:37:48.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.653+0000 7f14fd40e640 1 -- 172.21.15.117:0/322233046 wait complete. 2024-09-19T08:37:48.664 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:37:01.875773+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T08:37:10.463000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T08:37:11.619440+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-19T08:37:15.342435+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-19T08:37:48.665 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T08:37:48.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.766+0000 7f351042e640 1 Processor -- start 2024-09-19T08:37:48.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.766+0000 7f351042e640 1 -- start start 2024-09-19T08:37:48.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.767+0000 7f351042e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35080b0a80 0x7f35080cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:48.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.767+0000 7f351042e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3508161d90 0x7f35080cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:48.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.767+0000 7f351042e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f350806c990 con 0x7f35081619b0 2024-09-19T08:37:48.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.767+0000 7f351042e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f35080cec10 con 0x7f35080b0a80 2024-09-19T08:37:48.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.767+0000 7f351042e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f35080ce930 con 0x7f3508161d90 2024-09-19T08:37:48.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.767+0000 7f350e9cb640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3508161d90 0x7f35080cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:48.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.767+0000 7f350e9cb640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3508161d90 0x7f35080cc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.117:33964/0 (socket says 172.21.15.117:33964) 2024-09-19T08:37:48.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.767+0000 7f350d9c9640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35080b0a80 0x7f35080cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:48.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.767+0000 7f350e9cb640 1 -- 172.21.15.117:0/3064586923 learned_addr learned my addr 172.21.15.117:0/3064586923 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:48.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.768+0000 7f350e9cb640 1 -- 172.21.15.117:0/3064586923 >> v2:172.21.15.146:3300/0 conn(0x7f35080b0a80 msgr2=0x7f35080cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:48.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.768+0000 7f350e9cb640 1 --2- 172.21.15.117:0/3064586923 >> v2:172.21.15.146:3300/0 conn(0x7f35080b0a80 0x7f35080cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:48.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.768+0000 7f350e9cb640 1 -- 172.21.15.117:0/3064586923 >> v1:172.21.15.146:6789/0 conn(0x7f35081619b0 legacy=0x7f35080d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:48.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.768+0000 7f350e9cb640 1 -- 172.21.15.117:0/3064586923 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35080b0540 con 0x7f3508161d90 2024-09-19T08:37:48.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.768+0000 7f350e9cb640 1 --2- 172.21.15.117:0/3064586923 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3508161d90 0x7f35080cc210 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3500009e50 tx=0x7f350002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98dd544e7220f289 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:48.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.769+0000 7f350d1c8640 1 -- 172.21.15.117:0/3064586923 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3500036070 con 0x7f3508161d90 2024-09-19T08:37:48.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.769+0000 7f350d1c8640 1 -- 172.21.15.117:0/3064586923 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3500031600 con 0x7f3508161d90 2024-09-19T08:37:48.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.769+0000 7f350d1c8640 1 -- 172.21.15.117:0/3064586923 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35000319d0 con 0x7f3508161d90 2024-09-19T08:37:48.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.769+0000 7f351042e640 1 -- 172.21.15.117:0/3064586923 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3508161d90 msgr2=0x7f35080cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:48.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.769+0000 7f351042e640 1 --2- 172.21.15.117:0/3064586923 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3508161d90 0x7f35080cc210 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3500009e50 tx=0x7f350002a710 comp rx=0 tx=0).stop 2024-09-19T08:37:48.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.769+0000 7f351042e640 1 -- 172.21.15.117:0/3064586923 shutdown_connections 2024-09-19T08:37:48.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.769+0000 7f351042e640 1 --2- 172.21.15.117:0/3064586923 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3508161d90 0x7f35080cc210 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:48.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.769+0000 7f351042e640 1 --2- 172.21.15.117:0/3064586923 >> v2:172.21.15.146:3300/0 conn(0x7f35080b0a80 0x7f35080cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:48.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.769+0000 7f351042e640 1 -- 172.21.15.117:0/3064586923 >> 172.21.15.117:0/3064586923 conn(0x7f350809a9f0 msgr2=0x7f35080b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:48.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.769+0000 7f351042e640 1 -- 172.21.15.117:0/3064586923 shutdown_connections 2024-09-19T08:37:48.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.769+0000 7f351042e640 1 -- 172.21.15.117:0/3064586923 wait complete. 2024-09-19T08:37:48.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.770+0000 7f351042e640 1 Processor -- start 2024-09-19T08:37:48.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.770+0000 7f351042e640 1 -- start start 2024-09-19T08:37:48.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.771+0000 7f351042e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35080b0a80 0x7f35080cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:48.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.771+0000 7f351042e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35081619b0 0x7f350814f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:48.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.771+0000 7f351042e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3508161d90 0x7f35080d17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:48.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.771+0000 7f351042e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f35080cd330 con 0x7f35080b0a80 2024-09-19T08:37:48.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.771+0000 7f351042e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f350806c620 con 0x7f3508161d90 2024-09-19T08:37:48.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.771+0000 7f351042e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f35080cd4b0 con 0x7f35081619b0 2024-09-19T08:37:48.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.771+0000 7f350e1ca640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35080b0a80 0x7f35080cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:48.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.771+0000 7f350e1ca640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35080b0a80 0x7f35080cac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52616/0 (socket says 172.21.15.117:52616) 2024-09-19T08:37:48.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.771+0000 7f350e1ca640 1 -- 172.21.15.117:0/381969582 learned_addr learned my addr 172.21.15.117:0/381969582 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:48.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.771+0000 7f350d9c9640 1 --2- 172.21.15.117:0/381969582 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35081619b0 0x7f350814f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:48.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.771+0000 7f350e9cb640 1 --2- 172.21.15.117:0/381969582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3508161d90 0x7f35080d17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:48.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.772+0000 7f350e1ca640 1 -- 172.21.15.117:0/381969582 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35081619b0 msgr2=0x7f350814f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:48.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.772+0000 7f350e1ca640 1 --2- 172.21.15.117:0/381969582 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35081619b0 0x7f350814f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:48.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.772+0000 7f350e1ca640 1 -- 172.21.15.117:0/381969582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3508161d90 msgr2=0x7f35080d17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:48.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.772+0000 7f350e1ca640 1 --2- 172.21.15.117:0/381969582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3508161d90 0x7f35080d17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:48.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.772+0000 7f350e1ca640 1 -- 172.21.15.117:0/381969582 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350814fc30 con 0x7f35080b0a80 2024-09-19T08:37:48.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.772+0000 7f350e1ca640 1 --2- 172.21.15.117:0/381969582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35080b0a80 0x7f35080cac50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f350400c400 tx=0x7f350400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:48.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.772+0000 7f34feffd640 1 -- 172.21.15.117:0/381969582 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35040052d0 con 0x7f35080b0a80 2024-09-19T08:37:48.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.772+0000 7f34feffd640 1 -- 172.21.15.117:0/381969582 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3504005490 con 0x7f35080b0a80 2024-09-19T08:37:48.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.772+0000 7f34feffd640 1 -- 172.21.15.117:0/381969582 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3504007260 con 0x7f35080b0a80 2024-09-19T08:37:48.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.772+0000 7f351042e640 1 -- 172.21.15.117:0/381969582 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f350815b820 con 0x7f35080b0a80 2024-09-19T08:37:48.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.772+0000 7f351042e640 1 -- 172.21.15.117:0/381969582 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f350815bde0 con 0x7f35080b0a80 2024-09-19T08:37:48.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.773+0000 7f351042e640 1 -- 172.21.15.117:0/381969582 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3508070670 con 0x7f35080b0a80 2024-09-19T08:37:48.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.773+0000 7f34feffd640 1 -- 172.21.15.117:0/381969582 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3504007400 con 0x7f35080b0a80 2024-09-19T08:37:48.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.774+0000 7f34feffd640 1 --2- 172.21.15.117:0/381969582 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f34ec06c2e0 0x7f34ec06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:48.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.774+0000 7f34feffd640 1 -- 172.21.15.117:0/381969582 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f350408ac90 con 0x7f35080b0a80 2024-09-19T08:37:48.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.774+0000 7f350d9c9640 1 --2- 172.21.15.117:0/381969582 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f34ec06c2e0 0x7f34ec06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:48.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.774+0000 7f350d9c9640 1 --2- 172.21.15.117:0/381969582 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f34ec06c2e0 0x7f34ec06e7a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f35080b7530 tx=0x7f34f8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:48.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.778+0000 7f34feffd640 1 -- 172.21.15.117:0/381969582 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3508070670 con 0x7f35080b0a80 2024-09-19T08:37:48.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.945+0000 7f351042e640 1 -- 172.21.15.117:0/381969582 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f35080cce10 con 0x7f35080b0a80 2024-09-19T08:37:48.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.946+0000 7f34feffd640 1 -- 172.21.15.117:0/381969582 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f35040589e0 con 0x7f35080b0a80 2024-09-19T08:37:48.946 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 1 2024-09-19T08:37:48.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.947+0000 7f351042e640 1 -- 172.21.15.117:0/381969582 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f34ec06c2e0 msgr2=0x7f34ec06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:48.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.948+0000 7f351042e640 1 --2- 172.21.15.117:0/381969582 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f34ec06c2e0 0x7f34ec06e7a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f35080b7530 tx=0x7f34f8009190 comp rx=0 tx=0).stop 2024-09-19T08:37:48.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.948+0000 7f351042e640 1 -- 172.21.15.117:0/381969582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35080b0a80 msgr2=0x7f35080cac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:48.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.948+0000 7f351042e640 1 --2- 172.21.15.117:0/381969582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35080b0a80 0x7f35080cac50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f350400c400 tx=0x7f350400c8c0 comp rx=0 tx=0).stop 2024-09-19T08:37:48.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.948+0000 7f351042e640 1 -- 172.21.15.117:0/381969582 shutdown_connections 2024-09-19T08:37:48.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.948+0000 7f351042e640 1 --2- 172.21.15.117:0/381969582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3508161d90 0x7f35080d17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:48.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.948+0000 7f351042e640 1 --2- 172.21.15.117:0/381969582 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f34ec06c2e0 0x7f34ec06e7a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:48.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.948+0000 7f351042e640 1 --2- 172.21.15.117:0/381969582 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35081619b0 0x7f350814f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:48.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.948+0000 7f351042e640 1 --2- 172.21.15.117:0/381969582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35080b0a80 0x7f35080cac50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:48.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.948+0000 7f351042e640 1 -- 172.21.15.117:0/381969582 >> 172.21.15.117:0/381969582 conn(0x7f350809a9f0 msgr2=0x7f35080cc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:48.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.948+0000 7f351042e640 1 -- 172.21.15.117:0/381969582 shutdown_connections 2024-09-19T08:37:48.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:48.948+0000 7f351042e640 1 -- 172.21.15.117:0/381969582 wait complete. 2024-09-19T08:37:48.958 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T08:37:49.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.059+0000 7f15ac680640 1 Processor -- start 2024-09-19T08:37:49.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.059+0000 7f15ac680640 1 -- start start 2024-09-19T08:37:49.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.060+0000 7f15ac680640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f15a415a7b0 0x7f15a40c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.060+0000 7f15ac680640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f15a40cde40 0x7f15a40cc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.060+0000 7f15ac680640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15a40b4540 con 0x7f15a40cce70 2024-09-19T08:37:49.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.060+0000 7f15ac680640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f15a40b4870 con 0x7f15a415a7b0 2024-09-19T08:37:49.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.060+0000 7f15ac680640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f15a40cf9b0 con 0x7f15a40cde40 2024-09-19T08:37:49.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.060+0000 7f15aa41c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f15a415a7b0 0x7f15a40c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.060+0000 7f15aa41c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f15a415a7b0 0x7f15a40c5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52628/0 (socket says 172.21.15.117:52628) 2024-09-19T08:37:49.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.060+0000 7f15aa41c640 1 -- 172.21.15.117:0/2649074345 learned_addr learned my addr 172.21.15.117:0/2649074345 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:49.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.060+0000 7f15a9c1b640 1 --2- 172.21.15.117:0/2649074345 >> v2:172.21.15.146:3300/0 conn(0x7f15a40cde40 0x7f15a40cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.060+0000 7f15aa41c640 1 -- 172.21.15.117:0/2649074345 >> v2:172.21.15.146:3300/0 conn(0x7f15a40cde40 msgr2=0x7f15a40cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:49.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.060+0000 7f15aa41c640 1 --2- 172.21.15.117:0/2649074345 >> v2:172.21.15.146:3300/0 conn(0x7f15a40cde40 0x7f15a40cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.060+0000 7f15aa41c640 1 -- 172.21.15.117:0/2649074345 >> v1:172.21.15.146:6789/0 conn(0x7f15a40cce70 legacy=0x7f15a40c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:49.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.060+0000 7f15aa41c640 1 -- 172.21.15.117:0/2649074345 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a40cfc90 con 0x7f15a415a7b0 2024-09-19T08:37:49.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.061+0000 7f15aa41c640 1 --2- 172.21.15.117:0/2649074345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a415a7b0 0x7f15a40c5b00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f15a40cdbf0 tx=0x7f15a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5912aaa44cf62d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:49.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.061+0000 7f15a941a640 1 -- 172.21.15.117:0/2649074345 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0037070 con 0x7f15a415a7b0 2024-09-19T08:37:49.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.061+0000 7f15a941a640 1 -- 172.21.15.117:0/2649074345 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a0032440 con 0x7f15a415a7b0 2024-09-19T08:37:49.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.061+0000 7f15a941a640 1 -- 172.21.15.117:0/2649074345 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0032810 con 0x7f15a415a7b0 2024-09-19T08:37:49.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.062+0000 7f15ac680640 1 -- 172.21.15.117:0/2649074345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a415a7b0 msgr2=0x7f15a40c5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:49.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.062+0000 7f15ac680640 1 --2- 172.21.15.117:0/2649074345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a415a7b0 0x7f15a40c5b00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f15a40cdbf0 tx=0x7f15a002a270 comp rx=0 tx=0).stop 2024-09-19T08:37:49.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.062+0000 7f15ac680640 1 -- 172.21.15.117:0/2649074345 shutdown_connections 2024-09-19T08:37:49.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.062+0000 7f15ac680640 1 --2- 172.21.15.117:0/2649074345 >> v2:172.21.15.146:3300/0 conn(0x7f15a40cde40 0x7f15a40cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.062+0000 7f15ac680640 1 --2- 172.21.15.117:0/2649074345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a415a7b0 0x7f15a40c5b00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.062+0000 7f15ac680640 1 -- 172.21.15.117:0/2649074345 >> 172.21.15.117:0/2649074345 conn(0x7f15a406bdf0 msgr2=0x7f15a406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:49.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.062+0000 7f15ac680640 1 -- 172.21.15.117:0/2649074345 shutdown_connections 2024-09-19T08:37:49.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.062+0000 7f15ac680640 1 -- 172.21.15.117:0/2649074345 wait complete. 2024-09-19T08:37:49.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.063+0000 7f15ac680640 1 Processor -- start 2024-09-19T08:37:49.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.063+0000 7f15ac680640 1 -- start start 2024-09-19T08:37:49.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.063+0000 7f15ac680640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15a40cce70 0x7f15a40c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.064+0000 7f15ac680640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a40cde40 0x7f15a409cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.064+0000 7f15ac680640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15a415a7b0 0x7f15a40ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.064+0000 7f15ac680640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f15a40ca8c0 con 0x7f15a40cde40 2024-09-19T08:37:49.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.064+0000 7f15ac680640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f15a415ab90 con 0x7f15a40cce70 2024-09-19T08:37:49.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.064+0000 7f15ac680640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f15a40ce280 con 0x7f15a415a7b0 2024-09-19T08:37:49.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.064+0000 7f15a9c1b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a40cde40 0x7f15a409cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.064+0000 7f15a9c1b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a40cde40 0x7f15a409cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52642/0 (socket says 172.21.15.117:52642) 2024-09-19T08:37:49.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.064+0000 7f15a9c1b640 1 -- 172.21.15.117:0/4091080351 learned_addr learned my addr 172.21.15.117:0/4091080351 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:49.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.064+0000 7f15aa41c640 1 --2- 172.21.15.117:0/4091080351 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15a40cce70 0x7f15a40c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.064+0000 7f15aac1d640 1 --2- 172.21.15.117:0/4091080351 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15a415a7b0 0x7f15a40ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.064+0000 7f15a9c1b640 1 -- 172.21.15.117:0/4091080351 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15a415a7b0 msgr2=0x7f15a40ae1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:49.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.064+0000 7f15a9c1b640 1 --2- 172.21.15.117:0/4091080351 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15a415a7b0 0x7f15a40ae1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.064+0000 7f15a9c1b640 1 -- 172.21.15.117:0/4091080351 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15a40cce70 msgr2=0x7f15a40c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:49.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.064+0000 7f15a9c1b640 1 --2- 172.21.15.117:0/4091080351 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15a40cce70 0x7f15a40c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.064+0000 7f15a9c1b640 1 -- 172.21.15.117:0/4091080351 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a41f1960 con 0x7f15a40cde40 2024-09-19T08:37:49.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.064+0000 7f15a9c1b640 1 --2- 172.21.15.117:0/4091080351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a40cde40 0x7f15a409cb50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f159400d800 tx=0x7f159400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:49.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.064+0000 7f159affd640 1 -- 172.21.15.117:0/4091080351 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159400b6c0 con 0x7f15a40cde40 2024-09-19T08:37:49.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.064+0000 7f159affd640 1 -- 172.21.15.117:0/4091080351 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1594019070 con 0x7f15a40cde40 2024-09-19T08:37:49.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.064+0000 7f159affd640 1 -- 172.21.15.117:0/4091080351 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159400ba80 con 0x7f15a40cde40 2024-09-19T08:37:49.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.064+0000 7f15ac680640 1 -- 172.21.15.117:0/4091080351 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15a41f10c0 con 0x7f15a40cde40 2024-09-19T08:37:49.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.064+0000 7f15ac680640 1 -- 172.21.15.117:0/4091080351 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15a41f1680 con 0x7f15a40cde40 2024-09-19T08:37:49.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.065+0000 7f15ac680640 1 -- 172.21.15.117:0/4091080351 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15a40cc930 con 0x7f15a40cde40 2024-09-19T08:37:49.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.066+0000 7f159affd640 1 -- 172.21.15.117:0/4091080351 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f159400bc20 con 0x7f15a40cde40 2024-09-19T08:37:49.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.066+0000 7f159affd640 1 --2- 172.21.15.117:0/4091080351 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f158806c2b0 0x7f158806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.066+0000 7f159affd640 1 -- 172.21.15.117:0/4091080351 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f159408baf0 con 0x7f15a40cde40 2024-09-19T08:37:49.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.066+0000 7f15aa41c640 1 --2- 172.21.15.117:0/4091080351 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f158806c2b0 0x7f158806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.067+0000 7f15aa41c640 1 --2- 172.21.15.117:0/4091080351 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f158806c2b0 0x7f158806e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f15a0034000 tx=0x7f15a002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:49.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.070+0000 7f159affd640 1 -- 172.21.15.117:0/4091080351 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f15940598d0 con 0x7f15a40cde40 2024-09-19T08:37:49.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.234+0000 7f15ac680640 1 -- 172.21.15.117:0/4091080351 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f15a40c5d10 con 0x7f15a40cde40 2024-09-19T08:37:49.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.235+0000 7f159affd640 1 -- 172.21.15.117:0/4091080351 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f159405dbd0 con 0x7f15a40cde40 2024-09-19T08:37:49.235 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 32 2024-09-19T08:37:49.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.236+0000 7f15ac680640 1 -- 172.21.15.117:0/4091080351 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f158806c2b0 msgr2=0x7f158806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:49.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.236+0000 7f15ac680640 1 --2- 172.21.15.117:0/4091080351 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f158806c2b0 0x7f158806e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f15a0034000 tx=0x7f15a002e000 comp rx=0 tx=0).stop 2024-09-19T08:37:49.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.236+0000 7f15ac680640 1 -- 172.21.15.117:0/4091080351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a40cde40 msgr2=0x7f15a409cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:49.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.236+0000 7f15ac680640 1 --2- 172.21.15.117:0/4091080351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a40cde40 0x7f15a409cb50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f159400d800 tx=0x7f159400dcc0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.236+0000 7f15ac680640 1 -- 172.21.15.117:0/4091080351 shutdown_connections 2024-09-19T08:37:49.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.236+0000 7f15ac680640 1 --2- 172.21.15.117:0/4091080351 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f158806c2b0 0x7f158806e770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.236+0000 7f15ac680640 1 --2- 172.21.15.117:0/4091080351 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15a415a7b0 0x7f15a40ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.236+0000 7f15ac680640 1 --2- 172.21.15.117:0/4091080351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a40cde40 0x7f15a409cb50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.236+0000 7f15ac680640 1 --2- 172.21.15.117:0/4091080351 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15a40cce70 0x7f15a40c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.236+0000 7f15ac680640 1 -- 172.21.15.117:0/4091080351 >> 172.21.15.117:0/4091080351 conn(0x7f15a406bdf0 msgr2=0x7f15a406e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:49.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.237+0000 7f15ac680640 1 -- 172.21.15.117:0/4091080351 shutdown_connections 2024-09-19T08:37:49.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.237+0000 7f15ac680640 1 -- 172.21.15.117:0/4091080351 wait complete. 2024-09-19T08:37:49.247 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T08:37:49.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.348+0000 7ff80c18d640 1 Processor -- start 2024-09-19T08:37:49.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.348+0000 7ff80c18d640 1 -- start start 2024-09-19T08:37:49.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.349+0000 7ff80c18d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff8040add30 0x7ff8040ae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.349+0000 7ff80c18d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff80415e4f0 0x7ff8040b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.349+0000 7ff80c18d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff804070930 0x7ff8040b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.349+0000 7ff80c18d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff8040ae650 con 0x7ff80415e4f0 2024-09-19T08:37:49.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.349+0000 7ff80c18d640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7ff8040b5590 con 0x7ff8040add30 2024-09-19T08:37:49.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.349+0000 7ff80c18d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7ff804070ea0 con 0x7ff804070930 2024-09-19T08:37:49.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.349+0000 7ff809728640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff80415e4f0 0x7ff8040b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.349+0000 7ff809728640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff80415e4f0 0x7ff8040b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52644/0 (socket says 172.21.15.117:52644) 2024-09-19T08:37:49.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.349+0000 7ff809728640 1 -- 172.21.15.117:0/1800813717 learned_addr learned my addr 172.21.15.117:0/1800813717 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:49.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.349+0000 7ff809f29640 1 --2- 172.21.15.117:0/1800813717 >> v2:172.21.15.146:3300/0 conn(0x7ff8040add30 0x7ff8040ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.349+0000 7ff80a72a640 1 --2- 172.21.15.117:0/1800813717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff804070930 0x7ff8040b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.350+0000 7ff809728640 1 -- 172.21.15.117:0/1800813717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff804070930 msgr2=0x7ff8040b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:49.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.350+0000 7ff809728640 1 --2- 172.21.15.117:0/1800813717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff804070930 0x7ff8040b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.350+0000 7ff809728640 1 -- 172.21.15.117:0/1800813717 >> v2:172.21.15.146:3300/0 conn(0x7ff8040add30 msgr2=0x7ff8040ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:49.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.350+0000 7ff809728640 1 --2- 172.21.15.117:0/1800813717 >> v2:172.21.15.146:3300/0 conn(0x7ff8040add30 0x7ff8040ae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.350+0000 7ff809728640 1 -- 172.21.15.117:0/1800813717 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff80406e8c0 con 0x7ff80415e4f0 2024-09-19T08:37:49.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.350+0000 7ff809728640 1 --2- 172.21.15.117:0/1800813717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80415e4f0 0x7ff8040b5050 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff804067ed0 tx=0x7ff7f802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e647d235d157e24f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:49.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.350+0000 7ff808f27640 1 -- 172.21.15.117:0/1800813717 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8037070 con 0x7ff80415e4f0 2024-09-19T08:37:49.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.351+0000 7ff808f27640 1 -- 172.21.15.117:0/1800813717 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7f8032440 con 0x7ff80415e4f0 2024-09-19T08:37:49.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.351+0000 7ff808f27640 1 -- 172.21.15.117:0/1800813717 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8032810 con 0x7ff80415e4f0 2024-09-19T08:37:49.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.351+0000 7ff80c18d640 1 -- 172.21.15.117:0/1800813717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80415e4f0 msgr2=0x7ff8040b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:49.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.351+0000 7ff80c18d640 1 --2- 172.21.15.117:0/1800813717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80415e4f0 0x7ff8040b5050 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff804067ed0 tx=0x7ff7f802a1e0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.351+0000 7ff80c18d640 1 -- 172.21.15.117:0/1800813717 shutdown_connections 2024-09-19T08:37:49.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.351+0000 7ff80c18d640 1 --2- 172.21.15.117:0/1800813717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff804070930 0x7ff8040b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.351+0000 7ff80c18d640 1 --2- 172.21.15.117:0/1800813717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80415e4f0 0x7ff8040b5050 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.351+0000 7ff80c18d640 1 --2- 172.21.15.117:0/1800813717 >> v2:172.21.15.146:3300/0 conn(0x7ff8040add30 0x7ff8040ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.351+0000 7ff80c18d640 1 -- 172.21.15.117:0/1800813717 >> 172.21.15.117:0/1800813717 conn(0x7ff80406bc10 msgr2=0x7ff80406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:49.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.352+0000 7ff80c18d640 1 -- 172.21.15.117:0/1800813717 shutdown_connections 2024-09-19T08:37:49.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.352+0000 7ff80c18d640 1 -- 172.21.15.117:0/1800813717 wait complete. 2024-09-19T08:37:49.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.353+0000 7ff80c18d640 1 Processor -- start 2024-09-19T08:37:49.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.353+0000 7ff80c18d640 1 -- start start 2024-09-19T08:37:49.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.354+0000 7ff80c18d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff804070930 0x7ff8040cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.354+0000 7ff80c18d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8040add30 0x7ff80414d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.354+0000 7ff80c18d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80415e4f0 0x7ff804152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.354+0000 7ff80c18d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff8040b0630 con 0x7ff80415e4f0 2024-09-19T08:37:49.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.354+0000 7ff80c18d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff80406ee80 con 0x7ff804070930 2024-09-19T08:37:49.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.354+0000 7ff80c18d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7ff80406f3a0 con 0x7ff8040add30 2024-09-19T08:37:49.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.354+0000 7ff80a72a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80415e4f0 0x7ff804152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.354+0000 7ff80a72a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80415e4f0 0x7ff804152a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52656/0 (socket says 172.21.15.117:52656) 2024-09-19T08:37:49.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.354+0000 7ff80a72a640 1 -- 172.21.15.117:0/2772330878 learned_addr learned my addr 172.21.15.117:0/2772330878 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:49.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.354+0000 7ff809f29640 1 --2- 172.21.15.117:0/2772330878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff804070930 0x7ff8040cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.354+0000 7ff809728640 1 --2- 172.21.15.117:0/2772330878 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8040add30 0x7ff80414d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.354+0000 7ff80a72a640 1 -- 172.21.15.117:0/2772330878 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8040add30 msgr2=0x7ff80414d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:49.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.354+0000 7ff80a72a640 1 --2- 172.21.15.117:0/2772330878 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8040add30 0x7ff80414d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.354+0000 7ff80a72a640 1 -- 172.21.15.117:0/2772330878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff804070930 msgr2=0x7ff8040cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:49.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.354+0000 7ff80a72a640 1 --2- 172.21.15.117:0/2772330878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff804070930 0x7ff8040cd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.354+0000 7ff80a72a640 1 -- 172.21.15.117:0/2772330878 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff804155740 con 0x7ff80415e4f0 2024-09-19T08:37:49.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.354+0000 7ff80a72a640 1 --2- 172.21.15.117:0/2772330878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80415e4f0 0x7ff804152a30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc00e930 tx=0x7ff7fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:49.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.354+0000 7ff8027fc640 1 -- 172.21.15.117:0/2772330878 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc017070 con 0x7ff80415e4f0 2024-09-19T08:37:49.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.355+0000 7ff8027fc640 1 -- 172.21.15.117:0/2772330878 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7fc00c980 con 0x7ff80415e4f0 2024-09-19T08:37:49.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.355+0000 7ff80c18d640 1 -- 172.21.15.117:0/2772330878 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8040cdd80 con 0x7ff80415e4f0 2024-09-19T08:37:49.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.355+0000 7ff8027fc640 1 -- 172.21.15.117:0/2772330878 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc00cd70 con 0x7ff80415e4f0 2024-09-19T08:37:49.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.355+0000 7ff80c18d640 1 -- 172.21.15.117:0/2772330878 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8040ce340 con 0x7ff80415e4f0 2024-09-19T08:37:49.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.356+0000 7ff80c18d640 1 -- 172.21.15.117:0/2772330878 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff804155910 con 0x7ff80415e4f0 2024-09-19T08:37:49.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.356+0000 7ff8027fc640 1 -- 172.21.15.117:0/2772330878 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff7fc01a070 con 0x7ff80415e4f0 2024-09-19T08:37:49.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.357+0000 7ff8027fc640 1 --2- 172.21.15.117:0/2772330878 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff7f006c2e0 0x7ff7f006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.357+0000 7ff8027fc640 1 -- 172.21.15.117:0/2772330878 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff7fc08b600 con 0x7ff80415e4f0 2024-09-19T08:37:49.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.357+0000 7ff809f29640 1 --2- 172.21.15.117:0/2772330878 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff7f006c2e0 0x7ff7f006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.357+0000 7ff809f29640 1 --2- 172.21.15.117:0/2772330878 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff7f006c2e0 0x7ff7f006e7a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff7f40113e0 tx=0x7ff7f400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:49.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.361+0000 7ff8027fc640 1 -- 172.21.15.117:0/2772330878 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff7fc059530 con 0x7ff80415e4f0 2024-09-19T08:37:49.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.528+0000 7ff80c18d640 1 -- 172.21.15.117:0/2772330878 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff8040ae110 con 0x7ff80415e4f0 2024-09-19T08:37:49.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.528+0000 7ff8027fc640 1 -- 172.21.15.117:0/2772330878 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7ff7fc05d830 con 0x7ff80415e4f0 2024-09-19T08:37:49.529 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 64 2024-09-19T08:37:49.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.530+0000 7ff80c18d640 1 -- 172.21.15.117:0/2772330878 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff7f006c2e0 msgr2=0x7ff7f006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:49.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.530+0000 7ff80c18d640 1 --2- 172.21.15.117:0/2772330878 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff7f006c2e0 0x7ff7f006e7a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff7f40113e0 tx=0x7ff7f400b040 comp rx=0 tx=0).stop 2024-09-19T08:37:49.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.530+0000 7ff80c18d640 1 -- 172.21.15.117:0/2772330878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80415e4f0 msgr2=0x7ff804152a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:49.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.530+0000 7ff80c18d640 1 --2- 172.21.15.117:0/2772330878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80415e4f0 0x7ff804152a30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc00e930 tx=0x7ff7fc00edf0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.530+0000 7ff80c18d640 1 -- 172.21.15.117:0/2772330878 shutdown_connections 2024-09-19T08:37:49.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.530+0000 7ff80c18d640 1 --2- 172.21.15.117:0/2772330878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff80415e4f0 0x7ff804152a30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.530+0000 7ff80c18d640 1 --2- 172.21.15.117:0/2772330878 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff7f006c2e0 0x7ff7f006e7a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.530+0000 7ff80c18d640 1 --2- 172.21.15.117:0/2772330878 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8040add30 0x7ff80414d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.530+0000 7ff80c18d640 1 --2- 172.21.15.117:0/2772330878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff804070930 0x7ff8040cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.530+0000 7ff80c18d640 1 -- 172.21.15.117:0/2772330878 >> 172.21.15.117:0/2772330878 conn(0x7ff80406bc10 msgr2=0x7ff804161d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:49.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.530+0000 7ff80c18d640 1 -- 172.21.15.117:0/2772330878 shutdown_connections 2024-09-19T08:37:49.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.530+0000 7ff80c18d640 1 -- 172.21.15.117:0/2772330878 wait complete. 2024-09-19T08:37:49.541 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-19T08:37:49.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.642+0000 7fbd74082640 1 Processor -- start 2024-09-19T08:37:49.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.642+0000 7fbd74082640 1 -- start start 2024-09-19T08:37:49.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.643+0000 7fbd74082640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbd6c161eb0 0x7fbd6c1622f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.643+0000 7fbd74082640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbd6c1425e0 0x7fbd6c142a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.643+0000 7fbd74082640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd6c162b70 con 0x7fbd6c06cd20 2024-09-19T08:37:49.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.643+0000 7fbd74082640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbd6c162e50 con 0x7fbd6c1425e0 2024-09-19T08:37:49.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.643+0000 7fbd74082640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fbd6c142150 con 0x7fbd6c161eb0 2024-09-19T08:37:49.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.643+0000 7fbd7261f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbd6c1425e0 0x7fbd6c142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.643+0000 7fbd7261f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbd6c1425e0 0x7fbd6c142a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52670/0 (socket says 172.21.15.117:52670) 2024-09-19T08:37:49.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.643+0000 7fbd7261f640 1 -- 172.21.15.117:0/1296865060 learned_addr learned my addr 172.21.15.117:0/1296865060 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:49.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.643+0000 7fbd7161d640 1 --2- 172.21.15.117:0/1296865060 >> v2:172.21.15.146:3300/0 conn(0x7fbd6c161eb0 0x7fbd6c1622f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.643+0000 7fbd7261f640 1 -- 172.21.15.117:0/1296865060 >> v2:172.21.15.146:3300/0 conn(0x7fbd6c161eb0 msgr2=0x7fbd6c1622f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:49.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.643+0000 7fbd7261f640 1 --2- 172.21.15.117:0/1296865060 >> v2:172.21.15.146:3300/0 conn(0x7fbd6c161eb0 0x7fbd6c1622f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.643+0000 7fbd7261f640 1 -- 172.21.15.117:0/1296865060 >> v1:172.21.15.146:6789/0 conn(0x7fbd6c06cd20 legacy=0x7fbd6c06d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:49.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.643+0000 7fbd7261f640 1 -- 172.21.15.117:0/1296865060 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6c141b00 con 0x7fbd6c1425e0 2024-09-19T08:37:49.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.644+0000 7fbd7261f640 1 --2- 172.21.15.117:0/1296865060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd6c1425e0 0x7fbd6c142a70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c06ef00 tx=0x7fbd6402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3b2a2f59b445b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:49.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.644+0000 7fbd70e1c640 1 -- 172.21.15.117:0/1296865060 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd64036070 con 0x7fbd6c1425e0 2024-09-19T08:37:49.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.644+0000 7fbd70e1c640 1 -- 172.21.15.117:0/1296865060 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd64031600 con 0x7fbd6c1425e0 2024-09-19T08:37:49.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.644+0000 7fbd70e1c640 1 -- 172.21.15.117:0/1296865060 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd640319d0 con 0x7fbd6c1425e0 2024-09-19T08:37:49.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.645+0000 7fbd74082640 1 -- 172.21.15.117:0/1296865060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd6c1425e0 msgr2=0x7fbd6c142a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:49.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.645+0000 7fbd74082640 1 --2- 172.21.15.117:0/1296865060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd6c1425e0 0x7fbd6c142a70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c06ef00 tx=0x7fbd6402a660 comp rx=0 tx=0).stop 2024-09-19T08:37:49.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.645+0000 7fbd74082640 1 -- 172.21.15.117:0/1296865060 shutdown_connections 2024-09-19T08:37:49.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.645+0000 7fbd74082640 1 --2- 172.21.15.117:0/1296865060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd6c1425e0 0x7fbd6c142a70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.645+0000 7fbd74082640 1 --2- 172.21.15.117:0/1296865060 >> v2:172.21.15.146:3300/0 conn(0x7fbd6c161eb0 0x7fbd6c1622f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.645+0000 7fbd74082640 1 -- 172.21.15.117:0/1296865060 >> 172.21.15.117:0/1296865060 conn(0x7fbd6c0b3ed0 msgr2=0x7fbd6c0b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:49.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.645+0000 7fbd74082640 1 -- 172.21.15.117:0/1296865060 shutdown_connections 2024-09-19T08:37:49.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.645+0000 7fbd74082640 1 -- 172.21.15.117:0/1296865060 wait complete. 2024-09-19T08:37:49.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.646+0000 7fbd74082640 1 Processor -- start 2024-09-19T08:37:49.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.646+0000 7fbd74082640 1 -- start start 2024-09-19T08:37:49.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.647+0000 7fbd74082640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd6c06cd20 0x7fbd6c1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.647+0000 7fbd74082640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd6c1425e0 0x7fbd6c0b7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.647+0000 7fbd74082640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd6c161eb0 0x7fbd6c0b7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.647+0000 7fbd74082640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6c141600 con 0x7fbd6c161eb0 2024-09-19T08:37:49.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.647+0000 7fbd74082640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6c162830 con 0x7fbd6c1425e0 2024-09-19T08:37:49.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.647+0000 7fbd74082640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fbd6c142fb0 con 0x7fbd6c06cd20 2024-09-19T08:37:49.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.647+0000 7fbd7261f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd6c161eb0 0x7fbd6c0b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.647+0000 7fbd7261f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd6c161eb0 0x7fbd6c0b7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52674/0 (socket says 172.21.15.117:52674) 2024-09-19T08:37:49.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.647+0000 7fbd7261f640 1 -- 172.21.15.117:0/414727527 learned_addr learned my addr 172.21.15.117:0/414727527 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:49.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.647+0000 7fbd7161d640 1 --2- 172.21.15.117:0/414727527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd6c1425e0 0x7fbd6c0b7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.647+0000 7fbd71e1e640 1 --2- 172.21.15.117:0/414727527 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd6c06cd20 0x7fbd6c1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.647+0000 7fbd7261f640 1 -- 172.21.15.117:0/414727527 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd6c06cd20 msgr2=0x7fbd6c1563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:49.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.647+0000 7fbd7261f640 1 --2- 172.21.15.117:0/414727527 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd6c06cd20 0x7fbd6c1563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.647+0000 7fbd7261f640 1 -- 172.21.15.117:0/414727527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd6c1425e0 msgr2=0x7fbd6c0b7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:49.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.647+0000 7fbd7261f640 1 --2- 172.21.15.117:0/414727527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd6c1425e0 0x7fbd6c0b7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.647+0000 7fbd7261f640 1 -- 172.21.15.117:0/414727527 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6c156a20 con 0x7fbd6c161eb0 2024-09-19T08:37:49.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.647+0000 7fbd71e1e640 1 --2- 172.21.15.117:0/414727527 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd6c06cd20 0x7fbd6c1563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:49.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.647+0000 7fbd7261f640 1 --2- 172.21.15.117:0/414727527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd6c161eb0 0x7fbd6c0b7580 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbd64034040 tx=0x7fbd64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:49.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.648+0000 7fbd627fc640 1 -- 172.21.15.117:0/414727527 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd64036050 con 0x7fbd6c161eb0 2024-09-19T08:37:49.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.648+0000 7fbd627fc640 1 -- 172.21.15.117:0/414727527 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd64042070 con 0x7fbd6c161eb0 2024-09-19T08:37:49.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.648+0000 7fbd627fc640 1 -- 172.21.15.117:0/414727527 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd64009510 con 0x7fbd6c161eb0 2024-09-19T08:37:49.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.648+0000 7fbd74082640 1 -- 172.21.15.117:0/414727527 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd6c0cbf30 con 0x7fbd6c161eb0 2024-09-19T08:37:49.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.648+0000 7fbd74082640 1 -- 172.21.15.117:0/414727527 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd6c155b60 con 0x7fbd6c161eb0 2024-09-19T08:37:49.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.649+0000 7fbd74082640 1 -- 172.21.15.117:0/414727527 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd6c155d60 con 0x7fbd6c161eb0 2024-09-19T08:37:49.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.649+0000 7fbd627fc640 1 -- 172.21.15.117:0/414727527 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbd64007bd0 con 0x7fbd6c161eb0 2024-09-19T08:37:49.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.650+0000 7fbd627fc640 1 --2- 172.21.15.117:0/414727527 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbd5006c2b0 0x7fbd5006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.650+0000 7fbd627fc640 1 -- 172.21.15.117:0/414727527 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbd640ac6e0 con 0x7fbd6c161eb0 2024-09-19T08:37:49.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.650+0000 7fbd71e1e640 1 --2- 172.21.15.117:0/414727527 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbd5006c2b0 0x7fbd5006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.650+0000 7fbd71e1e640 1 --2- 172.21.15.117:0/414727527 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbd5006c2b0 0x7fbd5006e770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbd68001750 tx=0x7fbd68009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:49.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.654+0000 7fbd627fc640 1 -- 172.21.15.117:0/414727527 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbd6c155d60 con 0x7fbd6c161eb0 2024-09-19T08:37:49.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.820+0000 7fbd74082640 1 -- 172.21.15.117:0/414727527 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fbd6c142a70 con 0x7fbd6c161eb0 2024-09-19T08:37:49.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.820+0000 7fbd627fc640 1 -- 172.21.15.117:0/414727527 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fbd6407aa80 con 0x7fbd6c161eb0 2024-09-19T08:37:49.820 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 32 2024-09-19T08:37:49.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.822+0000 7fbd74082640 1 -- 172.21.15.117:0/414727527 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbd5006c2b0 msgr2=0x7fbd5006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:49.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.822+0000 7fbd74082640 1 --2- 172.21.15.117:0/414727527 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbd5006c2b0 0x7fbd5006e770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbd68001750 tx=0x7fbd68009040 comp rx=0 tx=0).stop 2024-09-19T08:37:49.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.822+0000 7fbd74082640 1 -- 172.21.15.117:0/414727527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd6c161eb0 msgr2=0x7fbd6c0b7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:49.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.822+0000 7fbd74082640 1 --2- 172.21.15.117:0/414727527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd6c161eb0 0x7fbd6c0b7580 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbd64034040 tx=0x7fbd64004a40 comp rx=0 tx=0).stop 2024-09-19T08:37:49.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.822+0000 7fbd74082640 1 -- 172.21.15.117:0/414727527 shutdown_connections 2024-09-19T08:37:49.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.822+0000 7fbd74082640 1 --2- 172.21.15.117:0/414727527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd6c161eb0 0x7fbd6c0b7580 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.822+0000 7fbd74082640 1 --2- 172.21.15.117:0/414727527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd6c1425e0 0x7fbd6c0b7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.822+0000 7fbd74082640 1 --2- 172.21.15.117:0/414727527 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbd5006c2b0 0x7fbd5006e770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.822+0000 7fbd74082640 1 --2- 172.21.15.117:0/414727527 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd6c06cd20 0x7fbd6c1563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.822+0000 7fbd74082640 1 -- 172.21.15.117:0/414727527 >> 172.21.15.117:0/414727527 conn(0x7fbd6c0b3ed0 msgr2=0x7fbd6c15d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:49.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.822+0000 7fbd74082640 1 -- 172.21.15.117:0/414727527 shutdown_connections 2024-09-19T08:37:49.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.822+0000 7fbd74082640 1 -- 172.21.15.117:0/414727527 wait complete. 2024-09-19T08:37:49.833 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-09-19T08:37:49.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.932+0000 7fec0283c640 1 Processor -- start 2024-09-19T08:37:49.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.932+0000 7fec0283c640 1 -- start start 2024-09-19T08:37:49.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.933+0000 7fec0283c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7febfc161d90 0x7febfc0cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.933+0000 7fec0283c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febfc06c990 con 0x7febfc0b0a80 2024-09-19T08:37:49.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.933+0000 7fec0283c640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febfc0cec10 con 0x7febfc1619b0 2024-09-19T08:37:49.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.933+0000 7fec0283c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7febfc0ce930 con 0x7febfc161d90 2024-09-19T08:37:49.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.933+0000 7fec00dd9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7febfc161d90 0x7febfc0cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.933+0000 7febfb7fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7febfc0b0a80 0x7febfc0cbcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:39986/0 (socket says 172.21.15.117:39986) 2024-09-19T08:37:49.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.933+0000 7fec00dd9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7febfc161d90 0x7febfc0cc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52678/0 (socket says 172.21.15.117:52678) 2024-09-19T08:37:49.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.933+0000 7febfb7fe640 1 -- 172.21.15.117:0/1676533118 learned_addr learned my addr 172.21.15.117:0/1676533118 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:49.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.934+0000 7fec00dd9640 1 -- 172.21.15.117:0/1676533118 >> v1:172.21.15.146:6789/0 conn(0x7febfc1619b0 legacy=0x7febfc0d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:49.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.934+0000 7fec00dd9640 1 -- 172.21.15.117:0/1676533118 >> v1:172.21.15.117:6789/0 conn(0x7febfc0b0a80 legacy=0x7febfc0cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:49.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.934+0000 7fec00dd9640 1 -- 172.21.15.117:0/1676533118 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febfc0b0540 con 0x7febfc161d90 2024-09-19T08:37:49.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.934+0000 7fec00dd9640 1 --2- 172.21.15.117:0/1676533118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febfc161d90 0x7febfc0cc3e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7febf4009d90 tx=0x7febf402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8676dea9b277f37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:49.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.935+0000 7febfaffd640 1 -- 172.21.15.117:0/1676533118 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4007740 con 0x7febfc161d90 2024-09-19T08:37:49.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.935+0000 7febfaffd640 1 -- 172.21.15.117:0/1676533118 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf40078e0 con 0x7febfc161d90 2024-09-19T08:37:49.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.935+0000 7febfaffd640 1 -- 172.21.15.117:0/1676533118 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4007cb0 con 0x7febfc161d90 2024-09-19T08:37:49.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.935+0000 7fec0283c640 1 -- 172.21.15.117:0/1676533118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febfc161d90 msgr2=0x7febfc0cc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:49.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.935+0000 7fec0283c640 1 --2- 172.21.15.117:0/1676533118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febfc161d90 0x7febfc0cc3e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7febf4009d90 tx=0x7febf402a6a0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.935+0000 7fec0283c640 1 -- 172.21.15.117:0/1676533118 shutdown_connections 2024-09-19T08:37:49.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.935+0000 7fec0283c640 1 --2- 172.21.15.117:0/1676533118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febfc161d90 0x7febfc0cc3e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.935+0000 7fec0283c640 1 -- 172.21.15.117:0/1676533118 >> 172.21.15.117:0/1676533118 conn(0x7febfc09a9f0 msgr2=0x7febfc0b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:49.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.935+0000 7fec0283c640 1 -- 172.21.15.117:0/1676533118 shutdown_connections 2024-09-19T08:37:49.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.935+0000 7fec0283c640 1 -- 172.21.15.117:0/1676533118 wait complete. 2024-09-19T08:37:49.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.936+0000 7fec0283c640 1 Processor -- start 2024-09-19T08:37:49.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.937+0000 7fec0283c640 1 -- start start 2024-09-19T08:37:49.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.937+0000 7fec0283c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febfc0b0a80 0x7febfc14e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.937+0000 7fec0283c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febfc1619b0 0x7febfc0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.937+0000 7fec0283c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febfc161d90 0x7febfc15da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.937+0000 7fec0283c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7febfc0cd330 con 0x7febfc1619b0 2024-09-19T08:37:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.937+0000 7fec0283c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7febfc06c620 con 0x7febfc0b0a80 2024-09-19T08:37:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.937+0000 7fec0283c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7febfc0cd4b0 con 0x7febfc161d90 2024-09-19T08:37:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.937+0000 7febfb7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febfc1619b0 0x7febfc0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.937+0000 7febfb7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febfc1619b0 0x7febfc0b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52684/0 (socket says 172.21.15.117:52684) 2024-09-19T08:37:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.937+0000 7febfb7fe640 1 -- 172.21.15.117:0/1042335128 learned_addr learned my addr 172.21.15.117:0/1042335128 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.938+0000 7febfb7fe640 1 -- 172.21.15.117:0/1042335128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febfc161d90 msgr2=0x7febfc15da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.938+0000 7febfb7fe640 1 --2- 172.21.15.117:0/1042335128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febfc161d90 0x7febfc15da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.938+0000 7febfb7fe640 1 -- 172.21.15.117:0/1042335128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febfc0b0a80 msgr2=0x7febfc14e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.938+0000 7febfb7fe640 1 --2- 172.21.15.117:0/1042335128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febfc0b0a80 0x7febfc14e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.938+0000 7febfb7fe640 1 -- 172.21.15.117:0/1042335128 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febfc0b4290 con 0x7febfc1619b0 2024-09-19T08:37:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.938+0000 7febfb7fe640 1 --2- 172.21.15.117:0/1042335128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febfc1619b0 0x7febfc0b5a90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7febf000c500 tx=0x7febf000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.938+0000 7febf8ff9640 1 -- 172.21.15.117:0/1042335128 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0017070 con 0x7febfc1619b0 2024-09-19T08:37:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.938+0000 7febf8ff9640 1 -- 172.21.15.117:0/1042335128 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf0005ce0 con 0x7febfc1619b0 2024-09-19T08:37:49.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.938+0000 7febf8ff9640 1 -- 172.21.15.117:0/1042335128 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf00072f0 con 0x7febfc1619b0 2024-09-19T08:37:49.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.938+0000 7fec0283c640 1 -- 172.21.15.117:0/1042335128 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febfc0b6510 con 0x7febfc1619b0 2024-09-19T08:37:49.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.938+0000 7fec0283c640 1 -- 172.21.15.117:0/1042335128 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febfc0b4830 con 0x7febfc1619b0 2024-09-19T08:37:49.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.939+0000 7fec0283c640 1 -- 172.21.15.117:0/1042335128 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febfc0d0440 con 0x7febfc1619b0 2024-09-19T08:37:49.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.939+0000 7febf8ff9640 1 -- 172.21.15.117:0/1042335128 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7febf001a070 con 0x7febfc1619b0 2024-09-19T08:37:49.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.940+0000 7febf8ff9640 1 --2- 172.21.15.117:0/1042335128 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7febe806c2b0 0x7febe806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:49.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.940+0000 7febf8ff9640 1 -- 172.21.15.117:0/1042335128 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7febf008a9f0 con 0x7febfc1619b0 2024-09-19T08:37:49.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.940+0000 7febfbfff640 1 --2- 172.21.15.117:0/1042335128 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7febe806c2b0 0x7febe806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:49.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.941+0000 7febfbfff640 1 --2- 172.21.15.117:0/1042335128 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7febe806c2b0 0x7febe806e770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7febec003cc0 tx=0x7febec0079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:49.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:49.944+0000 7febf8ff9640 1 -- 172.21.15.117:0/1042335128 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7febf00587d0 con 0x7febfc1619b0 2024-09-19T08:37:50.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.173+0000 7fec0283c640 1 -- 172.21.15.117:0/1042335128 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) -- 0x7febfc0b0320 con 0x7febfc1619b0 2024-09-19T08:37:50.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.432+0000 7febf8ff9640 1 -- 172.21.15.117:0/1042335128 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v55) ==== 145+0+0 (secure 0 0 0) 0x7febf005cad0 con 0x7febfc1619b0 2024-09-19T08:37:50.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.434+0000 7fec0283c640 1 -- 172.21.15.117:0/1042335128 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7febe806c2b0 msgr2=0x7febe806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:50.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.434+0000 7fec0283c640 1 --2- 172.21.15.117:0/1042335128 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7febe806c2b0 0x7febe806e770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7febec003cc0 tx=0x7febec0079b0 comp rx=0 tx=0).stop 2024-09-19T08:37:50.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.434+0000 7fec0283c640 1 -- 172.21.15.117:0/1042335128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febfc1619b0 msgr2=0x7febfc0b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:50.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.434+0000 7fec0283c640 1 --2- 172.21.15.117:0/1042335128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febfc1619b0 0x7febfc0b5a90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7febf000c500 tx=0x7febf000c9c0 comp rx=0 tx=0).stop 2024-09-19T08:37:50.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.434+0000 7fec0283c640 1 -- 172.21.15.117:0/1042335128 shutdown_connections 2024-09-19T08:37:50.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.434+0000 7fec0283c640 1 --2- 172.21.15.117:0/1042335128 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7febe806c2b0 0x7febe806e770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:50.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.434+0000 7fec0283c640 1 --2- 172.21.15.117:0/1042335128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febfc161d90 0x7febfc15da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:50.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.434+0000 7fec0283c640 1 --2- 172.21.15.117:0/1042335128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febfc1619b0 0x7febfc0b5a90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:50.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.434+0000 7fec0283c640 1 --2- 172.21.15.117:0/1042335128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febfc0b0a80 0x7febfc14e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:50.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.434+0000 7fec0283c640 1 -- 172.21.15.117:0/1042335128 >> 172.21.15.117:0/1042335128 conn(0x7febfc09a9f0 msgr2=0x7febfc15f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:50.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.434+0000 7fec0283c640 1 -- 172.21.15.117:0/1042335128 shutdown_connections 2024-09-19T08:37:50.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.434+0000 7fec0283c640 1 -- 172.21.15.117:0/1042335128 wait complete. 2024-09-19T08:37:50.445 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T08:37:50.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.547+0000 7f4884e8d640 1 Processor -- start 2024-09-19T08:37:50.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.547+0000 7f4884e8d640 1 -- start start 2024-09-19T08:37:50.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.547+0000 7f4884e8d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4880141680 0x7f48800cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:50.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.547+0000 7f4884e8d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f48800d0370 0x7f4880141a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:50.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.548+0000 7f4884e8d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f488015d710 con 0x7f4880141fa0 2024-09-19T08:37:50.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.548+0000 7f4884e8d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f48800d07e0 con 0x7f48800d0370 2024-09-19T08:37:50.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.548+0000 7f4884e8d640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f488015c6f0 con 0x7f4880141680 2024-09-19T08:37:50.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.548+0000 7f4875d9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f48800d0370 0x7f4880141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:50.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.548+0000 7f4875d9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f48800d0370 0x7f4880141a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52692/0 (socket says 172.21.15.117:52692) 2024-09-19T08:37:50.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.548+0000 7f4875d9b640 1 -- 172.21.15.117:0/301961567 learned_addr learned my addr 172.21.15.117:0/301961567 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:50.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.548+0000 7f487ed9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f4880141fa0 0x7f48800cec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:40000/0 (socket says 172.21.15.117:40000) 2024-09-19T08:37:50.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.548+0000 7f487e59c640 1 --2- 172.21.15.117:0/301961567 >> v2:172.21.15.146:3300/0 conn(0x7f4880141680 0x7f48800cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:50.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.548+0000 7f4875d9b640 1 -- 172.21.15.117:0/301961567 >> v2:172.21.15.146:3300/0 conn(0x7f4880141680 msgr2=0x7f48800cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:50.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.548+0000 7f4875d9b640 1 --2- 172.21.15.117:0/301961567 >> v2:172.21.15.146:3300/0 conn(0x7f4880141680 0x7f48800cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:50.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.548+0000 7f4875d9b640 1 -- 172.21.15.117:0/301961567 >> v1:172.21.15.117:6789/0 conn(0x7f4880141fa0 legacy=0x7f48800cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:50.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.548+0000 7f487dd9b640 1 -- 172.21.15.117:0/301961567 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 532527789 0 0) 0x7f488015d710 con 0x7f4880141fa0 2024-09-19T08:37:50.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.548+0000 7f4875d9b640 1 -- 172.21.15.117:0/301961567 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488015c950 con 0x7f48800d0370 2024-09-19T08:37:50.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.549+0000 7f4875d9b640 1 --2- 172.21.15.117:0/301961567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48800d0370 0x7f4880141a60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4880070fc0 tx=0x7f486802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f33b19438d21d26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:50.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.549+0000 7f487dd9b640 1 -- 172.21.15.117:0/301961567 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4868037070 con 0x7f48800d0370 2024-09-19T08:37:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.549+0000 7f487dd9b640 1 -- 172.21.15.117:0/301961567 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4868032440 con 0x7f48800d0370 2024-09-19T08:37:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.549+0000 7f487dd9b640 1 -- 172.21.15.117:0/301961567 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4868032810 con 0x7f48800d0370 2024-09-19T08:37:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.549+0000 7f4884e8d640 1 -- 172.21.15.117:0/301961567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48800d0370 msgr2=0x7f4880141a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.549+0000 7f4884e8d640 1 --2- 172.21.15.117:0/301961567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48800d0370 0x7f4880141a60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4880070fc0 tx=0x7f486802a2a0 comp rx=0 tx=0).stop 2024-09-19T08:37:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.549+0000 7f4884e8d640 1 -- 172.21.15.117:0/301961567 shutdown_connections 2024-09-19T08:37:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.549+0000 7f4884e8d640 1 --2- 172.21.15.117:0/301961567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48800d0370 0x7f4880141a60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.549+0000 7f4884e8d640 1 --2- 172.21.15.117:0/301961567 >> v2:172.21.15.146:3300/0 conn(0x7f4880141680 0x7f48800cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.549+0000 7f4884e8d640 1 -- 172.21.15.117:0/301961567 >> 172.21.15.117:0/301961567 conn(0x7f48800b3ed0 msgr2=0x7f48800b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.549+0000 7f4884e8d640 1 -- 172.21.15.117:0/301961567 shutdown_connections 2024-09-19T08:37:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.549+0000 7f4884e8d640 1 -- 172.21.15.117:0/301961567 wait complete. 2024-09-19T08:37:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.551+0000 7f4884e8d640 1 Processor -- start 2024-09-19T08:37:50.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.551+0000 7f4884e8d640 1 -- start start 2024-09-19T08:37:50.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f4884e8d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48800d0370 0x7f4880156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:50.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f4884e8d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4880141680 0x7f488013df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:50.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f4884e8d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4880141fa0 0x7f488006e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:50.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f4884e8d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f488015d1f0 con 0x7f48800d0370 2024-09-19T08:37:50.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f4884e8d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f488015cf10 con 0x7f4880141fa0 2024-09-19T08:37:50.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f4884e8d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f48801408c0 con 0x7f4880141680 2024-09-19T08:37:50.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f487e59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48800d0370 0x7f4880156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:50.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f487e59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48800d0370 0x7f4880156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52702/0 (socket says 172.21.15.117:52702) 2024-09-19T08:37:50.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f487e59c640 1 -- 172.21.15.117:0/693861027 learned_addr learned my addr 172.21.15.117:0/693861027 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:50.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f487ed9d640 1 --2- 172.21.15.117:0/693861027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4880141fa0 0x7f488006e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:50.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f4875d9b640 1 --2- 172.21.15.117:0/693861027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4880141680 0x7f488013df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:50.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f487e59c640 1 -- 172.21.15.117:0/693861027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4880141680 msgr2=0x7f488013df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:50.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f487e59c640 1 --2- 172.21.15.117:0/693861027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4880141680 0x7f488013df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:50.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f487e59c640 1 -- 172.21.15.117:0/693861027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4880141fa0 msgr2=0x7f488006e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:50.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f487e59c640 1 --2- 172.21.15.117:0/693861027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4880141fa0 0x7f488006e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:50.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f487e59c640 1 -- 172.21.15.117:0/693861027 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48800b5270 con 0x7f48800d0370 2024-09-19T08:37:50.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f487e59c640 1 --2- 172.21.15.117:0/693861027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48800d0370 0x7f4880156fe0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f487000d830 tx=0x7f487000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:50.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f48777fe640 1 -- 172.21.15.117:0/693861027 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487000b6c0 con 0x7f48800d0370 2024-09-19T08:37:50.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f48777fe640 1 -- 172.21.15.117:0/693861027 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4870019070 con 0x7f48800d0370 2024-09-19T08:37:50.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f4884e8d640 1 -- 172.21.15.117:0/693861027 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48800b5550 con 0x7f48800d0370 2024-09-19T08:37:50.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f48777fe640 1 -- 172.21.15.117:0/693861027 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487000ba80 con 0x7f48800d0370 2024-09-19T08:37:50.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.552+0000 7f4884e8d640 1 -- 172.21.15.117:0/693861027 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f488006ece0 con 0x7f48800d0370 2024-09-19T08:37:50.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.553+0000 7f4884e8d640 1 -- 172.21.15.117:0/693861027 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48801423a0 con 0x7f48800d0370 2024-09-19T08:37:50.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.554+0000 7f48777fe640 1 -- 172.21.15.117:0/693861027 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f487001e460 con 0x7f48800d0370 2024-09-19T08:37:50.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.554+0000 7f48777fe640 1 --2- 172.21.15.117:0/693861027 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f486006c2e0 0x7f486006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:50.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.554+0000 7f48777fe640 1 -- 172.21.15.117:0/693861027 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f487008bca0 con 0x7f48800d0370 2024-09-19T08:37:50.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.555+0000 7f4875d9b640 1 --2- 172.21.15.117:0/693861027 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f486006c2e0 0x7f486006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:50.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.555+0000 7f4875d9b640 1 --2- 172.21.15.117:0/693861027 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f486006c2e0 0x7f486006e7a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4868034000 tx=0x7f486802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:50.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.559+0000 7f48777fe640 1 -- 172.21.15.117:0/693861027 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4870059a80 con 0x7f48800d0370 2024-09-19T08:37:50.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.725+0000 7f4884e8d640 1 -- 172.21.15.117:0/693861027 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f48800690c0 con 0x7f48800d0370 2024-09-19T08:37:50.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.728+0000 7f48777fe640 1 -- 172.21.15.117:0/693861027 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f487005dd80 con 0x7f48800d0370 2024-09-19T08:37:50.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.730+0000 7f4884e8d640 1 -- 172.21.15.117:0/693861027 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f486006c2e0 msgr2=0x7f486006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:50.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.730+0000 7f4884e8d640 1 --2- 172.21.15.117:0/693861027 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f486006c2e0 0x7f486006e7a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4868034000 tx=0x7f486802e000 comp rx=0 tx=0).stop 2024-09-19T08:37:50.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.730+0000 7f4884e8d640 1 -- 172.21.15.117:0/693861027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48800d0370 msgr2=0x7f4880156fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.730+0000 7f4884e8d640 1 --2- 172.21.15.117:0/693861027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48800d0370 0x7f4880156fe0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f487000d830 tx=0x7f487000dcf0 comp rx=0 tx=0).stop 2024-09-19T08:37:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.730+0000 7f4884e8d640 1 -- 172.21.15.117:0/693861027 shutdown_connections 2024-09-19T08:37:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.730+0000 7f4884e8d640 1 --2- 172.21.15.117:0/693861027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4880141fa0 0x7f488006e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.730+0000 7f4884e8d640 1 --2- 172.21.15.117:0/693861027 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f486006c2e0 0x7f486006e7a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.730+0000 7f4884e8d640 1 --2- 172.21.15.117:0/693861027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4880141680 0x7f488013df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.730+0000 7f4884e8d640 1 --2- 172.21.15.117:0/693861027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48800d0370 0x7f4880156fe0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.730+0000 7f4884e8d640 1 -- 172.21.15.117:0/693861027 >> 172.21.15.117:0/693861027 conn(0x7f48800b3ed0 msgr2=0x7f488015af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.730+0000 7f4884e8d640 1 -- 172.21.15.117:0/693861027 shutdown_connections 2024-09-19T08:37:50.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:50.730+0000 7f4884e8d640 1 -- 172.21.15.117:0/693861027 wait complete. 2024-09-19T08:37:50.741 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T08:37:50.741 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T08:37:50.786 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T08:37:50.831 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T08:37:50.832 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:37:50.832 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:37:50.848 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:37:50.848 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:37:50.904 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T08:37:51.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.043+0000 7f3064549640 1 Processor -- start 2024-09-19T08:37:51.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.043+0000 7f3064549640 1 -- start start 2024-09-19T08:37:51.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.044+0000 7f3064549640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f305c15bee0 0x7f305c0d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:51.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.044+0000 7f3064549640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f305c15c2c0 0x7f305c0d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:51.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.044+0000 7f3064549640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f305c0cdee0 con 0x7f305c0cf200 2024-09-19T08:37:51.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.044+0000 7f3064549640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f305c0ceaf0 con 0x7f305c15c2c0 2024-09-19T08:37:51.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.044+0000 7f3064549640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f305c0ce1c0 con 0x7f305c15bee0 2024-09-19T08:37:51.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.044+0000 7f3061ae4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f305c15c2c0 0x7f305c0d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:51.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.044+0000 7f3061ae4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f305c15c2c0 0x7f305c0d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52706/0 (socket says 172.21.15.117:52706) 2024-09-19T08:37:51.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.044+0000 7f3061ae4640 1 -- 172.21.15.117:0/1418278220 learned_addr learned my addr 172.21.15.117:0/1418278220 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:51.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.045+0000 7f30622e5640 1 --2- 172.21.15.117:0/1418278220 >> v2:172.21.15.146:3300/0 conn(0x7f305c15bee0 0x7f305c0d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:51.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.045+0000 7f3061ae4640 1 -- 172.21.15.117:0/1418278220 >> v2:172.21.15.146:3300/0 conn(0x7f305c15bee0 msgr2=0x7f305c0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:51.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.045+0000 7f3061ae4640 1 --2- 172.21.15.117:0/1418278220 >> v2:172.21.15.146:3300/0 conn(0x7f305c15bee0 0x7f305c0d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.045+0000 7f3061ae4640 1 -- 172.21.15.117:0/1418278220 >> v1:172.21.15.146:6789/0 conn(0x7f305c0cf200 legacy=0x7f305c0cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:51.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.045+0000 7f3061ae4640 1 -- 172.21.15.117:0/1418278220 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305c0ce4a0 con 0x7f305c15c2c0 2024-09-19T08:37:51.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.045+0000 7f3061ae4640 1 --2- 172.21.15.117:0/1418278220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305c15c2c0 0x7f305c0d09f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f305c0b2f40 tx=0x7f304c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b73c2e2e4309ee16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:51.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.046+0000 7f30612e3640 1 -- 172.21.15.117:0/1418278220 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304c037070 con 0x7f305c15c2c0 2024-09-19T08:37:51.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.046+0000 7f30612e3640 1 -- 172.21.15.117:0/1418278220 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f304c032440 con 0x7f305c15c2c0 2024-09-19T08:37:51.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.046+0000 7f30612e3640 1 -- 172.21.15.117:0/1418278220 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304c032810 con 0x7f305c15c2c0 2024-09-19T08:37:51.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.046+0000 7f3064549640 1 -- 172.21.15.117:0/1418278220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305c15c2c0 msgr2=0x7f305c0d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:51.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.046+0000 7f3064549640 1 --2- 172.21.15.117:0/1418278220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305c15c2c0 0x7f305c0d09f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f305c0b2f40 tx=0x7f304c02a230 comp rx=0 tx=0).stop 2024-09-19T08:37:51.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.046+0000 7f3064549640 1 -- 172.21.15.117:0/1418278220 shutdown_connections 2024-09-19T08:37:51.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.046+0000 7f3064549640 1 --2- 172.21.15.117:0/1418278220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305c15c2c0 0x7f305c0d09f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.046+0000 7f3064549640 1 --2- 172.21.15.117:0/1418278220 >> v2:172.21.15.146:3300/0 conn(0x7f305c15bee0 0x7f305c0d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.046+0000 7f3064549640 1 -- 172.21.15.117:0/1418278220 >> 172.21.15.117:0/1418278220 conn(0x7f305c06bdf0 msgr2=0x7f305c06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:51.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.046+0000 7f3064549640 1 -- 172.21.15.117:0/1418278220 shutdown_connections 2024-09-19T08:37:51.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.046+0000 7f3064549640 1 -- 172.21.15.117:0/1418278220 wait complete. 2024-09-19T08:37:51.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.047+0000 7f3064549640 1 Processor -- start 2024-09-19T08:37:51.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.047+0000 7f3064549640 1 -- start start 2024-09-19T08:37:51.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.048+0000 7f3064549640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f305c0cf200 0x7f305c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:51.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.048+0000 7f3064549640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305c15bee0 0x7f305c0b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:51.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.048+0000 7f3064549640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f305c15c2c0 0x7f305c0c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:51.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.048+0000 7f3064549640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f305c06e040 con 0x7f305c15bee0 2024-09-19T08:37:51.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.048+0000 7f3064549640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f305c06dec0 con 0x7f305c15c2c0 2024-09-19T08:37:51.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.048+0000 7f3064549640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f305c06e1c0 con 0x7f305c0cf200 2024-09-19T08:37:51.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.048+0000 7f3061ae4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305c15bee0 0x7f305c0b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:51.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.048+0000 7f3061ae4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305c15bee0 0x7f305c0b4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52722/0 (socket says 172.21.15.117:52722) 2024-09-19T08:37:51.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.048+0000 7f3061ae4640 1 -- 172.21.15.117:0/3976423083 learned_addr learned my addr 172.21.15.117:0/3976423083 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:51.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.048+0000 7f3062ae6640 1 --2- 172.21.15.117:0/3976423083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f305c15c2c0 0x7f305c0c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:51.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.048+0000 7f30622e5640 1 --2- 172.21.15.117:0/3976423083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f305c0cf200 0x7f305c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:51.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.049+0000 7f3061ae4640 1 -- 172.21.15.117:0/3976423083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f305c0cf200 msgr2=0x7f305c0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:51.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.049+0000 7f3061ae4640 1 --2- 172.21.15.117:0/3976423083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f305c0cf200 0x7f305c0b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.049+0000 7f3061ae4640 1 -- 172.21.15.117:0/3976423083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f305c15c2c0 msgr2=0x7f305c0c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:51.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.049+0000 7f3061ae4640 1 --2- 172.21.15.117:0/3976423083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f305c15c2c0 0x7f305c0c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.049+0000 7f3061ae4640 1 -- 172.21.15.117:0/3976423083 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305c1f5800 con 0x7f305c15bee0 2024-09-19T08:37:51.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.049+0000 7f3061ae4640 1 --2- 172.21.15.117:0/3976423083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305c15bee0 0x7f305c0b4790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f304c02a270 tx=0x7f304c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.049+0000 7f3052ffd640 1 -- 172.21.15.117:0/3976423083 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304c041020 con 0x7f305c15bee0 2024-09-19T08:37:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.049+0000 7f3052ffd640 1 -- 172.21.15.117:0/3976423083 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f304c0306c0 con 0x7f305c15bee0 2024-09-19T08:37:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.049+0000 7f3064549640 1 -- 172.21.15.117:0/3976423083 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f305c1f5ae0 con 0x7f305c15bee0 2024-09-19T08:37:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.049+0000 7f3052ffd640 1 -- 172.21.15.117:0/3976423083 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304c037040 con 0x7f305c15bee0 2024-09-19T08:37:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.049+0000 7f3064549640 1 -- 172.21.15.117:0/3976423083 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f305c1f60a0 con 0x7f305c15bee0 2024-09-19T08:37:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.050+0000 7f3064549640 1 -- 172.21.15.117:0/3976423083 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f305c1f6480 con 0x7f305c15bee0 2024-09-19T08:37:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.050+0000 7f3052ffd640 1 -- 172.21.15.117:0/3976423083 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f304c044020 con 0x7f305c15bee0 2024-09-19T08:37:51.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.051+0000 7f3052ffd640 1 --2- 172.21.15.117:0/3976423083 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f304006c2b0 0x7f304006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:51.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.051+0000 7f3052ffd640 1 -- 172.21.15.117:0/3976423083 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f304c0abeb0 con 0x7f305c15bee0 2024-09-19T08:37:51.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.051+0000 7f30622e5640 1 --2- 172.21.15.117:0/3976423083 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f304006c2b0 0x7f304006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:51.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.052+0000 7f30622e5640 1 --2- 172.21.15.117:0/3976423083 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f304006c2b0 0x7f304006e770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3058006fd0 tx=0x7f3058008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:51.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.055+0000 7f3052ffd640 1 -- 172.21.15.117:0/3976423083 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f305c1f6480 con 0x7f305c15bee0 2024-09-19T08:37:51.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.230+0000 7f3064549640 1 -- 172.21.15.117:0/3976423083 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f305c0cf690 con 0x7f305c15bee0 2024-09-19T08:37:51.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.230+0000 7f3052ffd640 1 -- 172.21.15.117:0/3976423083 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f304c080020 con 0x7f305c15bee0 2024-09-19T08:37:51.230 INFO:teuthology.orchestra.run.smithi117.stderr:listed 0 entries 2024-09-19T08:37:51.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.232+0000 7f3064549640 1 -- 172.21.15.117:0/3976423083 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f304006c2b0 msgr2=0x7f304006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:51.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.232+0000 7f3064549640 1 --2- 172.21.15.117:0/3976423083 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f304006c2b0 0x7f304006e770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3058006fd0 tx=0x7f3058008040 comp rx=0 tx=0).stop 2024-09-19T08:37:51.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.232+0000 7f3064549640 1 -- 172.21.15.117:0/3976423083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305c15bee0 msgr2=0x7f305c0b4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:51.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.232+0000 7f3064549640 1 --2- 172.21.15.117:0/3976423083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305c15bee0 0x7f305c0b4790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f304c02a270 tx=0x7f304c0046c0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.232+0000 7f3064549640 1 -- 172.21.15.117:0/3976423083 shutdown_connections 2024-09-19T08:37:51.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.232+0000 7f3064549640 1 --2- 172.21.15.117:0/3976423083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f305c15c2c0 0x7f305c0c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.232+0000 7f3064549640 1 --2- 172.21.15.117:0/3976423083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f305c15bee0 0x7f305c0b4790 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.232+0000 7f3064549640 1 --2- 172.21.15.117:0/3976423083 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f304006c2b0 0x7f304006e770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.232+0000 7f3064549640 1 --2- 172.21.15.117:0/3976423083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f305c0cf200 0x7f305c0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.232+0000 7f3064549640 1 -- 172.21.15.117:0/3976423083 >> 172.21.15.117:0/3976423083 conn(0x7f305c06bdf0 msgr2=0x7f305c0b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:51.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.232+0000 7f3064549640 1 -- 172.21.15.117:0/3976423083 shutdown_connections 2024-09-19T08:37:51.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.232+0000 7f3064549640 1 -- 172.21.15.117:0/3976423083 wait complete. 2024-09-19T08:37:51.243 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:37:51.243 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:37:51.259 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T08:37:51.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.398+0000 7fa49ff49640 1 Processor -- start 2024-09-19T08:37:51.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.398+0000 7fa49ff49640 1 -- start start 2024-09-19T08:37:51.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.399+0000 7fa49ff49640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa49815b300 0x7fa4980cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:51.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.399+0000 7fa49ff49640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4980ccbd0 0x7fa4980cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:51.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.399+0000 7fa49ff49640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4980cd910 con 0x7fa49815b6e0 2024-09-19T08:37:51.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.399+0000 7fa49ff49640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fa4980cd070 con 0x7fa49815b300 2024-09-19T08:37:51.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.399+0000 7fa49ff49640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fa4980cd350 con 0x7fa4980ccbd0 2024-09-19T08:37:51.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.399+0000 7fa49dce5640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa49815b300 0x7fa4980cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:51.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.399+0000 7fa49d4e4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4980ccbd0 0x7fa4980cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:51.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.399+0000 7fa49e4e6640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa49815b6e0 0x7fa4980cf080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.117:43896/0 (socket says 172.21.15.117:43896) 2024-09-19T08:37:51.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.399+0000 7fa49dce5640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa49815b300 0x7fa4980cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.117:39424/0 (socket says 172.21.15.117:39424) 2024-09-19T08:37:51.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.399+0000 7fa49e4e6640 1 -- 172.21.15.117:0/1998204287 learned_addr learned my addr 172.21.15.117:0/1998204287 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:51.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.399+0000 7fa49dce5640 1 -- 172.21.15.117:0/1998204287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4980ccbd0 msgr2=0x7fa4980cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:51.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.399+0000 7fa49dce5640 1 --2- 172.21.15.117:0/1998204287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4980ccbd0 0x7fa4980cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.399+0000 7fa49dce5640 1 -- 172.21.15.117:0/1998204287 >> v1:172.21.15.146:6789/0 conn(0x7fa49815b6e0 legacy=0x7fa4980cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:51.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.399+0000 7fa49dce5640 1 -- 172.21.15.117:0/1998204287 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4980cd630 con 0x7fa49815b300 2024-09-19T08:37:51.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.400+0000 7fa49dce5640 1 --2- 172.21.15.117:0/1998204287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa49815b300 0x7fa4980cc690 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa4940097a0 tx=0x7fa49402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d714aee3c197d5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:51.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.400+0000 7fa49cce3640 1 -- 172.21.15.117:0/1998204287 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa494037070 con 0x7fa49815b300 2024-09-19T08:37:51.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.400+0000 7fa49cce3640 1 -- 172.21.15.117:0/1998204287 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa494032440 con 0x7fa49815b300 2024-09-19T08:37:51.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.400+0000 7fa49cce3640 1 -- 172.21.15.117:0/1998204287 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa494032810 con 0x7fa49815b300 2024-09-19T08:37:51.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.401+0000 7fa49ff49640 1 -- 172.21.15.117:0/1998204287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa49815b300 msgr2=0x7fa4980cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:51.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.401+0000 7fa49ff49640 1 --2- 172.21.15.117:0/1998204287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa49815b300 0x7fa4980cc690 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa4940097a0 tx=0x7fa49402a180 comp rx=0 tx=0).stop 2024-09-19T08:37:51.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.401+0000 7fa49ff49640 1 -- 172.21.15.117:0/1998204287 shutdown_connections 2024-09-19T08:37:51.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.401+0000 7fa49ff49640 1 --2- 172.21.15.117:0/1998204287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4980ccbd0 0x7fa4980cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.401+0000 7fa49ff49640 1 --2- 172.21.15.117:0/1998204287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa49815b300 0x7fa4980cc690 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.401+0000 7fa49ff49640 1 -- 172.21.15.117:0/1998204287 >> 172.21.15.117:0/1998204287 conn(0x7fa4980b2d10 msgr2=0x7fa4980b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:51.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.401+0000 7fa49ff49640 1 -- 172.21.15.117:0/1998204287 shutdown_connections 2024-09-19T08:37:51.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.401+0000 7fa49ff49640 1 -- 172.21.15.117:0/1998204287 wait complete. 2024-09-19T08:37:51.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.402+0000 7fa49ff49640 1 Processor -- start 2024-09-19T08:37:51.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.402+0000 7fa49ff49640 1 -- start start 2024-09-19T08:37:51.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.403+0000 7fa49ff49640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4980ccbd0 0x7fa4981488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:51.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.403+0000 7fa49ff49640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa49815b300 0x7fa498149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:51.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.403+0000 7fa49ff49640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa49815b6e0 0x7fa498149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:51.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.403+0000 7fa49ff49640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa4980b3b70 con 0x7fa49815b6e0 2024-09-19T08:37:51.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.403+0000 7fa49ff49640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa4980b39f0 con 0x7fa4980ccbd0 2024-09-19T08:37:51.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.403+0000 7fa49ff49640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fa4980b2060 con 0x7fa49815b300 2024-09-19T08:37:51.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.403+0000 7fa49e4e6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa49815b6e0 0x7fa498149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:51.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.403+0000 7fa49e4e6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa49815b6e0 0x7fa498149ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52736/0 (socket says 172.21.15.117:52736) 2024-09-19T08:37:51.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.403+0000 7fa49e4e6640 1 -- 172.21.15.117:0/3390707031 learned_addr learned my addr 172.21.15.117:0/3390707031 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:51.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.403+0000 7fa49dce5640 1 --2- 172.21.15.117:0/3390707031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4980ccbd0 0x7fa4981488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:51.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.403+0000 7fa49d4e4640 1 --2- 172.21.15.117:0/3390707031 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa49815b300 0x7fa498149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:51.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.403+0000 7fa49e4e6640 1 -- 172.21.15.117:0/3390707031 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa49815b300 msgr2=0x7fa498149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:51.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.403+0000 7fa49e4e6640 1 --2- 172.21.15.117:0/3390707031 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa49815b300 0x7fa498149580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.403+0000 7fa49e4e6640 1 -- 172.21.15.117:0/3390707031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4980ccbd0 msgr2=0x7fa4981488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:51.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.403+0000 7fa49e4e6640 1 --2- 172.21.15.117:0/3390707031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4980ccbd0 0x7fa4981488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.403+0000 7fa49e4e6640 1 -- 172.21.15.117:0/3390707031 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa498148df0 con 0x7fa49815b6e0 2024-09-19T08:37:51.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.403+0000 7fa49dce5640 1 --2- 172.21.15.117:0/3390707031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4980ccbd0 0x7fa4981488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:51.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.403+0000 7fa49e4e6640 1 --2- 172.21.15.117:0/3390707031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa49815b6e0 0x7fa498149ac0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa49000cad0 tx=0x7fa49000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:51.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.404+0000 7fa48e7fc640 1 -- 172.21.15.117:0/3390707031 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490017070 con 0x7fa49815b6e0 2024-09-19T08:37:51.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.404+0000 7fa48e7fc640 1 -- 172.21.15.117:0/3390707031 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa49000ac30 con 0x7fa49815b6e0 2024-09-19T08:37:51.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.404+0000 7fa49ff49640 1 -- 172.21.15.117:0/3390707031 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4980c89a0 con 0x7fa49815b6e0 2024-09-19T08:37:51.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.404+0000 7fa48e7fc640 1 -- 172.21.15.117:0/3390707031 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490012400 con 0x7fa49815b6e0 2024-09-19T08:37:51.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.404+0000 7fa49ff49640 1 -- 172.21.15.117:0/3390707031 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa49814d830 con 0x7fa49815b6e0 2024-09-19T08:37:51.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.405+0000 7fa49ff49640 1 -- 172.21.15.117:0/3390707031 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa49806f180 con 0x7fa49815b6e0 2024-09-19T08:37:51.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.405+0000 7fa48e7fc640 1 -- 172.21.15.117:0/3390707031 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa49001a070 con 0x7fa49815b6e0 2024-09-19T08:37:51.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.405+0000 7fa48e7fc640 1 --2- 172.21.15.117:0/3390707031 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa47c06c2b0 0x7fa47c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:51.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.406+0000 7fa48e7fc640 1 -- 172.21.15.117:0/3390707031 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa49008b310 con 0x7fa49815b6e0 2024-09-19T08:37:51.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.406+0000 7fa49dce5640 1 --2- 172.21.15.117:0/3390707031 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa47c06c2b0 0x7fa47c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:51.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.406+0000 7fa49dce5640 1 --2- 172.21.15.117:0/3390707031 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa47c06c2b0 0x7fa47c06e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa494034000 tx=0x7fa49402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:51.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.410+0000 7fa48e7fc640 1 -- 172.21.15.117:0/3390707031 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa49806f180 con 0x7fa49815b6e0 2024-09-19T08:37:51.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.586+0000 7fa49ff49640 1 -- 172.21.15.117:0/3390707031 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa4980cc690 con 0x7fa49815b6e0 2024-09-19T08:37:51.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.587+0000 7fa48e7fc640 1 -- 172.21.15.117:0/3390707031 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fa490059060 con 0x7fa49815b6e0 2024-09-19T08:37:51.587 INFO:teuthology.orchestra.run.smithi117.stderr:listed 0 entries 2024-09-19T08:37:51.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.589+0000 7fa49ff49640 1 -- 172.21.15.117:0/3390707031 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa47c06c2b0 msgr2=0x7fa47c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:51.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.589+0000 7fa49ff49640 1 --2- 172.21.15.117:0/3390707031 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa47c06c2b0 0x7fa47c06e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa494034000 tx=0x7fa49402e000 comp rx=0 tx=0).stop 2024-09-19T08:37:51.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.589+0000 7fa49ff49640 1 -- 172.21.15.117:0/3390707031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa49815b6e0 msgr2=0x7fa498149ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:51.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.589+0000 7fa49ff49640 1 --2- 172.21.15.117:0/3390707031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa49815b6e0 0x7fa498149ac0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa49000cad0 tx=0x7fa49000cf90 comp rx=0 tx=0).stop 2024-09-19T08:37:51.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.589+0000 7fa49ff49640 1 -- 172.21.15.117:0/3390707031 shutdown_connections 2024-09-19T08:37:51.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.589+0000 7fa49ff49640 1 --2- 172.21.15.117:0/3390707031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa49815b6e0 0x7fa498149ac0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.589+0000 7fa49ff49640 1 --2- 172.21.15.117:0/3390707031 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa47c06c2b0 0x7fa47c06e770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.589+0000 7fa49ff49640 1 --2- 172.21.15.117:0/3390707031 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa49815b300 0x7fa498149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.589+0000 7fa49ff49640 1 --2- 172.21.15.117:0/3390707031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4980ccbd0 0x7fa4981488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.589+0000 7fa49ff49640 1 -- 172.21.15.117:0/3390707031 >> 172.21.15.117:0/3390707031 conn(0x7fa4980b2d10 msgr2=0x7fa4980d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:51.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.589+0000 7fa49ff49640 1 -- 172.21.15.117:0/3390707031 shutdown_connections 2024-09-19T08:37:51.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.589+0000 7fa49ff49640 1 -- 172.21.15.117:0/3390707031 wait complete. 2024-09-19T08:37:51.599 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2024-09-19T08:37:51.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:51.600 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T08:37:51.625 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:37:51.626 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T08:37:51.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:51.626 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T08:37:51.681 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:37:51.681 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:37:51.701 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:37:51.701 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:37:51.761 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T08:37:51.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.861+0000 7fb1b6e4c640 1 Processor -- start 2024-09-19T08:37:51.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.861+0000 7fb1b6e4c640 1 -- start start 2024-09-19T08:37:51.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.861+0000 7fb1b6e4c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb1b00add30 0x7fb1b00ae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:51.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.861+0000 7fb1b6e4c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1b015e4f0 0x7fb1b00b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:51.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.861+0000 7fb1b6e4c640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1b00ae650 con 0x7fb1b0070930 2024-09-19T08:37:51.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.861+0000 7fb1b6e4c640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fb1b00b5590 con 0x7fb1b00add30 2024-09-19T08:37:51.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.861+0000 7fb1b6e4c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fb1b0070ea0 con 0x7fb1b015e4f0 2024-09-19T08:37:51.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.862+0000 7fb1a7fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1b015e4f0 0x7fb1b00b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:51.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.862+0000 7fb1b4be8640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb1b00add30 0x7fb1b00ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:51.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.862+0000 7fb1a7fff640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1b015e4f0 0x7fb1b00b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.117:34056/0 (socket says 172.21.15.117:34056) 2024-09-19T08:37:51.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.862+0000 7fb1a7fff640 1 -- 172.21.15.117:0/2478610615 learned_addr learned my addr 172.21.15.117:0/2478610615 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:51.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.862+0000 7fb1a7fff640 1 -- 172.21.15.117:0/2478610615 >> v2:172.21.15.146:3300/0 conn(0x7fb1b00add30 msgr2=0x7fb1b00ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:51.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.862+0000 7fb1a7fff640 1 --2- 172.21.15.117:0/2478610615 >> v2:172.21.15.146:3300/0 conn(0x7fb1b00add30 0x7fb1b00ae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.862+0000 7fb1a7fff640 1 -- 172.21.15.117:0/2478610615 >> v1:172.21.15.146:6789/0 conn(0x7fb1b0070930 legacy=0x7fb1b00b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:51.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.862+0000 7fb1a7fff640 1 -- 172.21.15.117:0/2478610615 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b006e8c0 con 0x7fb1b015e4f0 2024-09-19T08:37:51.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.862+0000 7fb1a77fe640 1 -- 172.21.15.117:0/2478610615 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3503609639 0 0) 0x7fb1b00ae650 con 0x7fb1b0070930 2024-09-19T08:37:51.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.862+0000 7fb1b4be8640 1 --2- 172.21.15.117:0/2478610615 >> v2:172.21.15.146:3300/0 conn(0x7fb1b00add30 0x7fb1b00ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:37:51.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.863+0000 7fb1a7fff640 1 --2- 172.21.15.117:0/2478610615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1b015e4f0 0x7fb1b00b5050 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009870 tx=0x7fb1a002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=899223740c64f430 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:51.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.863+0000 7fb1a77fe640 1 -- 172.21.15.117:0/2478610615 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0037070 con 0x7fb1b015e4f0 2024-09-19T08:37:51.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.863+0000 7fb1a77fe640 1 -- 172.21.15.117:0/2478610615 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1a0032440 con 0x7fb1b015e4f0 2024-09-19T08:37:51.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.863+0000 7fb1a77fe640 1 -- 172.21.15.117:0/2478610615 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0032810 con 0x7fb1b015e4f0 2024-09-19T08:37:51.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.864+0000 7fb1b6e4c640 1 -- 172.21.15.117:0/2478610615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1b015e4f0 msgr2=0x7fb1b00b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:51.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.864+0000 7fb1b6e4c640 1 --2- 172.21.15.117:0/2478610615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1b015e4f0 0x7fb1b00b5050 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009870 tx=0x7fb1a002a270 comp rx=0 tx=0).stop 2024-09-19T08:37:51.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.864+0000 7fb1b6e4c640 1 -- 172.21.15.117:0/2478610615 shutdown_connections 2024-09-19T08:37:51.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.864+0000 7fb1b6e4c640 1 --2- 172.21.15.117:0/2478610615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1b015e4f0 0x7fb1b00b5050 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.864+0000 7fb1b6e4c640 1 --2- 172.21.15.117:0/2478610615 >> v2:172.21.15.146:3300/0 conn(0x7fb1b00add30 0x7fb1b00ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.864+0000 7fb1b6e4c640 1 -- 172.21.15.117:0/2478610615 >> 172.21.15.117:0/2478610615 conn(0x7fb1b006bc10 msgr2=0x7fb1b006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:51.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.864+0000 7fb1b6e4c640 1 -- 172.21.15.117:0/2478610615 shutdown_connections 2024-09-19T08:37:51.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.864+0000 7fb1b6e4c640 1 -- 172.21.15.117:0/2478610615 wait complete. 2024-09-19T08:37:51.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.865+0000 7fb1b6e4c640 1 Processor -- start 2024-09-19T08:37:51.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.865+0000 7fb1b6e4c640 1 -- start start 2024-09-19T08:37:51.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.866+0000 7fb1b6e4c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1b0070930 0x7fb1b01f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:51.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.866+0000 7fb1b6e4c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1b00add30 0x7fb1b0159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:51.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.866+0000 7fb1b6e4c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1b015e4f0 0x7fb1b01e90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:51.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.866+0000 7fb1b6e4c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b006f3a0 con 0x7fb1b00add30 2024-09-19T08:37:51.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.866+0000 7fb1b6e4c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b006ee80 con 0x7fb1b015e4f0 2024-09-19T08:37:51.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.866+0000 7fb1b6e4c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fb1b006f520 con 0x7fb1b0070930 2024-09-19T08:37:51.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.866+0000 7fb1a7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1b00add30 0x7fb1b0159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:51.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.866+0000 7fb1a7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1b00add30 0x7fb1b0159480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52746/0 (socket says 172.21.15.117:52746) 2024-09-19T08:37:51.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.866+0000 7fb1a7fff640 1 -- 172.21.15.117:0/3789513969 learned_addr learned my addr 172.21.15.117:0/3789513969 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:51.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.866+0000 7fb1b53e9640 1 --2- 172.21.15.117:0/3789513969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1b015e4f0 0x7fb1b01e90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:51.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.866+0000 7fb1b4be8640 1 --2- 172.21.15.117:0/3789513969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1b0070930 0x7fb1b01f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:51.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.866+0000 7fb1a7fff640 1 -- 172.21.15.117:0/3789513969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1b0070930 msgr2=0x7fb1b01f3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:51.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.866+0000 7fb1a7fff640 1 --2- 172.21.15.117:0/3789513969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1b0070930 0x7fb1b01f3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.866+0000 7fb1a7fff640 1 -- 172.21.15.117:0/3789513969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1b015e4f0 msgr2=0x7fb1b01e90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:51.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.866+0000 7fb1a7fff640 1 --2- 172.21.15.117:0/3789513969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1b015e4f0 0x7fb1b01e90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:51.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.866+0000 7fb1a7fff640 1 -- 172.21.15.117:0/3789513969 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b01e8000 con 0x7fb1b00add30 2024-09-19T08:37:51.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.866+0000 7fb1b4be8640 1 --2- 172.21.15.117:0/3789513969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1b0070930 0x7fb1b01f3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:51.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.867+0000 7fb1a7fff640 1 --2- 172.21.15.117:0/3789513969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1b00add30 0x7fb1b0159480 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0035040 tx=0x7fb1a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:51.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.867+0000 7fb1a57fa640 1 -- 172.21.15.117:0/3789513969 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0037040 con 0x7fb1b00add30 2024-09-19T08:37:51.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.867+0000 7fb1a57fa640 1 -- 172.21.15.117:0/3789513969 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1a0004030 con 0x7fb1b00add30 2024-09-19T08:37:51.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.867+0000 7fb1a57fa640 1 -- 172.21.15.117:0/3789513969 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0004420 con 0x7fb1b00add30 2024-09-19T08:37:51.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.867+0000 7fb1b6e4c640 1 -- 172.21.15.117:0/3789513969 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1b01e82e0 con 0x7fb1b00add30 2024-09-19T08:37:51.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.867+0000 7fb1b6e4c640 1 -- 172.21.15.117:0/3789513969 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1b01e88a0 con 0x7fb1b00add30 2024-09-19T08:37:51.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.868+0000 7fb1b6e4c640 1 -- 172.21.15.117:0/3789513969 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1b00b5050 con 0x7fb1b00add30 2024-09-19T08:37:51.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.868+0000 7fb1a57fa640 1 -- 172.21.15.117:0/3789513969 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb1a003a070 con 0x7fb1b00add30 2024-09-19T08:37:51.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.869+0000 7fb1a57fa640 1 --2- 172.21.15.117:0/3789513969 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb19c06c2b0 0x7fb19c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:51.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.869+0000 7fb1a57fa640 1 -- 172.21.15.117:0/3789513969 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb1a00abc30 con 0x7fb1b00add30 2024-09-19T08:37:51.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.869+0000 7fb1b4be8640 1 --2- 172.21.15.117:0/3789513969 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb19c06c2b0 0x7fb19c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:51.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.869+0000 7fb1b4be8640 1 --2- 172.21.15.117:0/3789513969 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb19c06c2b0 0x7fb19c06e770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb1b01e9fd0 tx=0x7fb1ac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:51.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:51.873+0000 7fb1a57fa640 1 -- 172.21.15.117:0/3789513969 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb1a0041020 con 0x7fb1b00add30 2024-09-19T08:37:52.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.049+0000 7fb1b6e4c640 1 -- 172.21.15.117:0/3789513969 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb1b01f3da0 con 0x7fb1b00add30 2024-09-19T08:37:52.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.049+0000 7fb1a57fa640 1 -- 172.21.15.117:0/3789513969 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fb1a0079a10 con 0x7fb1b00add30 2024-09-19T08:37:52.049 INFO:teuthology.orchestra.run.smithi117.stderr:listed 0 entries 2024-09-19T08:37:52.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.051+0000 7fb1b6e4c640 1 -- 172.21.15.117:0/3789513969 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb19c06c2b0 msgr2=0x7fb19c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:52.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.051+0000 7fb1b6e4c640 1 --2- 172.21.15.117:0/3789513969 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb19c06c2b0 0x7fb19c06e770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb1b01e9fd0 tx=0x7fb1ac008040 comp rx=0 tx=0).stop 2024-09-19T08:37:52.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.051+0000 7fb1b6e4c640 1 -- 172.21.15.117:0/3789513969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1b00add30 msgr2=0x7fb1b0159480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:52.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.051+0000 7fb1b6e4c640 1 --2- 172.21.15.117:0/3789513969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1b00add30 0x7fb1b0159480 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0035040 tx=0x7fb1a00046c0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.051+0000 7fb1b6e4c640 1 -- 172.21.15.117:0/3789513969 shutdown_connections 2024-09-19T08:37:52.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.051+0000 7fb1b6e4c640 1 --2- 172.21.15.117:0/3789513969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1b015e4f0 0x7fb1b01e90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.051+0000 7fb1b6e4c640 1 --2- 172.21.15.117:0/3789513969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1b00add30 0x7fb1b0159480 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.051+0000 7fb1b6e4c640 1 --2- 172.21.15.117:0/3789513969 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb19c06c2b0 0x7fb19c06e770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.051+0000 7fb1b6e4c640 1 --2- 172.21.15.117:0/3789513969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1b0070930 0x7fb1b01f3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.051+0000 7fb1b6e4c640 1 -- 172.21.15.117:0/3789513969 >> 172.21.15.117:0/3789513969 conn(0x7fb1b006bc10 msgr2=0x7fb1b015d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:52.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.051+0000 7fb1b6e4c640 1 -- 172.21.15.117:0/3789513969 shutdown_connections 2024-09-19T08:37:52.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.051+0000 7fb1b6e4c640 1 -- 172.21.15.117:0/3789513969 wait complete. 2024-09-19T08:37:52.062 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:37:52.062 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:37:52.082 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T08:37:52.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.181+0000 7f65f562e640 1 Processor -- start 2024-09-19T08:37:52.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.181+0000 7f65f562e640 1 -- start start 2024-09-19T08:37:52.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.182+0000 7f65f562e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f65f015f0d0 0x7f65f015f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:52.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.182+0000 7f65f562e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65f00d1b10 con 0x7f65f00d0070 2024-09-19T08:37:52.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.182+0000 7f65f562e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65f00cf2b0 con 0x7f65f00d4130 2024-09-19T08:37:52.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.182+0000 7f65f562e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f65f00cf590 con 0x7f65f015f0d0 2024-09-19T08:37:52.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.182+0000 7f65eeffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f65f015f0d0 0x7f65f015f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:52.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.182+0000 7f65eeffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f65f015f0d0 0x7f65f015f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52754/0 (socket says 172.21.15.117:52754) 2024-09-19T08:37:52.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.182+0000 7f65ee7fc640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f65f00d0070 0x7f65f00d1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:40012/0 (socket says 172.21.15.117:40012) 2024-09-19T08:37:52.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.182+0000 7f65eeffd640 1 -- 172.21.15.117:0/3098056576 learned_addr learned my addr 172.21.15.117:0/3098056576 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:52.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.182+0000 7f65eeffd640 1 -- 172.21.15.117:0/3098056576 >> v1:172.21.15.146:6789/0 conn(0x7f65f00d4130 legacy=0x7f65f00d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:52.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.182+0000 7f65eeffd640 1 -- 172.21.15.117:0/3098056576 >> v1:172.21.15.117:6789/0 conn(0x7f65f00d0070 legacy=0x7f65f00d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:52.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.182+0000 7f65eeffd640 1 -- 172.21.15.117:0/3098056576 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f00cf870 con 0x7f65f015f0d0 2024-09-19T08:37:52.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.183+0000 7f65eeffd640 1 --2- 172.21.15.117:0/3098056576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f015f0d0 0x7f65f015f4b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009870 tx=0x7f65e002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73296af0fbb3fb09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:52.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.183+0000 7f65edffb640 1 -- 172.21.15.117:0/3098056576 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e0037070 con 0x7f65f015f0d0 2024-09-19T08:37:52.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.183+0000 7f65edffb640 1 -- 172.21.15.117:0/3098056576 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e0032440 con 0x7f65f015f0d0 2024-09-19T08:37:52.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.183+0000 7f65edffb640 1 -- 172.21.15.117:0/3098056576 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e0032810 con 0x7f65f015f0d0 2024-09-19T08:37:52.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.184+0000 7f65f562e640 1 -- 172.21.15.117:0/3098056576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f015f0d0 msgr2=0x7f65f015f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:52.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.184+0000 7f65f562e640 1 --2- 172.21.15.117:0/3098056576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f015f0d0 0x7f65f015f4b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009870 tx=0x7f65e002a180 comp rx=0 tx=0).stop 2024-09-19T08:37:52.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.184+0000 7f65f562e640 1 -- 172.21.15.117:0/3098056576 shutdown_connections 2024-09-19T08:37:52.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.184+0000 7f65f562e640 1 --2- 172.21.15.117:0/3098056576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f015f0d0 0x7f65f015f4b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.184+0000 7f65f562e640 1 -- 172.21.15.117:0/3098056576 >> 172.21.15.117:0/3098056576 conn(0x7f65f009d760 msgr2=0x7f65f008bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:52.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.184+0000 7f65f562e640 1 -- 172.21.15.117:0/3098056576 shutdown_connections 2024-09-19T08:37:52.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.184+0000 7f65f562e640 1 -- 172.21.15.117:0/3098056576 wait complete. 2024-09-19T08:37:52.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.185+0000 7f65f562e640 1 Processor -- start 2024-09-19T08:37:52.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.185+0000 7f65f562e640 1 -- start start 2024-09-19T08:37:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.186+0000 7f65f562e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65f00d0070 0x7f65f006dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.186+0000 7f65f562e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65f00d4130 0x7f65f00b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.186+0000 7f65f562e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f015f0d0 0x7f65f0159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.186+0000 7f65f562e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f65f00b2f70 con 0x7f65f015f0d0 2024-09-19T08:37:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.186+0000 7f65f562e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f65f00cef60 con 0x7f65f00d4130 2024-09-19T08:37:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.186+0000 7f65f562e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f65f00b30f0 con 0x7f65f00d0070 2024-09-19T08:37:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.186+0000 7f65ef7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f015f0d0 0x7f65f0159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.186+0000 7f65ef7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f015f0d0 0x7f65f0159c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52768/0 (socket says 172.21.15.117:52768) 2024-09-19T08:37:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.186+0000 7f65ef7fe640 1 -- 172.21.15.117:0/519860409 learned_addr learned my addr 172.21.15.117:0/519860409 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.186+0000 7f65eeffd640 1 --2- 172.21.15.117:0/519860409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65f00d0070 0x7f65f006dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:52.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.186+0000 7f65ee7fc640 1 --2- 172.21.15.117:0/519860409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65f00d4130 0x7f65f00b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.186+0000 7f65ef7fe640 1 -- 172.21.15.117:0/519860409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65f00d0070 msgr2=0x7f65f006dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.186+0000 7f65ef7fe640 1 --2- 172.21.15.117:0/519860409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65f00d0070 0x7f65f006dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.186+0000 7f65ef7fe640 1 -- 172.21.15.117:0/519860409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65f00d4130 msgr2=0x7f65f00b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.186+0000 7f65ef7fe640 1 --2- 172.21.15.117:0/519860409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65f00d4130 0x7f65f00b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.186+0000 7f65ef7fe640 1 -- 172.21.15.117:0/519860409 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f0160710 con 0x7f65f015f0d0 2024-09-19T08:37:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.187+0000 7f65ef7fe640 1 --2- 172.21.15.117:0/519860409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f015f0d0 0x7f65f0159c00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f65e800c780 tx=0x7f65e800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.187+0000 7f65d77fe640 1 -- 172.21.15.117:0/519860409 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e8004b60 con 0x7f65f015f0d0 2024-09-19T08:37:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.187+0000 7f65d77fe640 1 -- 172.21.15.117:0/519860409 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e8004d00 con 0x7f65f015f0d0 2024-09-19T08:37:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.187+0000 7f65f562e640 1 -- 172.21.15.117:0/519860409 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f01609f0 con 0x7f65f015f0d0 2024-09-19T08:37:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.187+0000 7f65d77fe640 1 -- 172.21.15.117:0/519860409 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e800aa90 con 0x7f65f015f0d0 2024-09-19T08:37:52.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.187+0000 7f65f562e640 1 -- 172.21.15.117:0/519860409 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f0160fb0 con 0x7f65f015f0d0 2024-09-19T08:37:52.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.188+0000 7f65f562e640 1 -- 172.21.15.117:0/519860409 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65f015f4b0 con 0x7f65f015f0d0 2024-09-19T08:37:52.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.188+0000 7f65d77fe640 1 -- 172.21.15.117:0/519860409 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f65e800ac30 con 0x7f65f015f0d0 2024-09-19T08:37:52.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.188+0000 7f65d77fe640 1 --2- 172.21.15.117:0/519860409 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f65dc06c2b0 0x7f65dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:52.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.189+0000 7f65d77fe640 1 -- 172.21.15.117:0/519860409 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f65e808bb30 con 0x7f65f015f0d0 2024-09-19T08:37:52.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.189+0000 7f65eeffd640 1 --2- 172.21.15.117:0/519860409 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f65dc06c2b0 0x7f65dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:52.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.189+0000 7f65eeffd640 1 --2- 172.21.15.117:0/519860409 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f65dc06c2b0 0x7f65dc06e770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f65e0034000 tx=0x7f65e002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:52.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.193+0000 7f65d77fe640 1 -- 172.21.15.117:0/519860409 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f65e80599a0 con 0x7f65f015f0d0 2024-09-19T08:37:52.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.372+0000 7f65f562e640 1 -- 172.21.15.117:0/519860409 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f65f006cf30 con 0x7f65f015f0d0 2024-09-19T08:37:52.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.373+0000 7f65d77fe640 1 -- 172.21.15.117:0/519860409 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f65e805dca0 con 0x7f65f015f0d0 2024-09-19T08:37:52.373 INFO:teuthology.orchestra.run.smithi117.stderr:listed 0 entries 2024-09-19T08:37:52.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.375+0000 7f65f562e640 1 -- 172.21.15.117:0/519860409 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f65dc06c2b0 msgr2=0x7f65dc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:52.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.375+0000 7f65f562e640 1 --2- 172.21.15.117:0/519860409 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f65dc06c2b0 0x7f65dc06e770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f65e0034000 tx=0x7f65e002e000 comp rx=0 tx=0).stop 2024-09-19T08:37:52.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.375+0000 7f65f562e640 1 -- 172.21.15.117:0/519860409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f015f0d0 msgr2=0x7f65f0159c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:52.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.375+0000 7f65f562e640 1 --2- 172.21.15.117:0/519860409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f015f0d0 0x7f65f0159c00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f65e800c780 tx=0x7f65e800cc40 comp rx=0 tx=0).stop 2024-09-19T08:37:52.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.375+0000 7f65f562e640 1 -- 172.21.15.117:0/519860409 shutdown_connections 2024-09-19T08:37:52.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.375+0000 7f65f562e640 1 --2- 172.21.15.117:0/519860409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65f015f0d0 0x7f65f0159c00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.375+0000 7f65f562e640 1 --2- 172.21.15.117:0/519860409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65f00d4130 0x7f65f00b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.375+0000 7f65f562e640 1 --2- 172.21.15.117:0/519860409 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f65dc06c2b0 0x7f65dc06e770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.375+0000 7f65f562e640 1 --2- 172.21.15.117:0/519860409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65f00d0070 0x7f65f006dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.375+0000 7f65f562e640 1 -- 172.21.15.117:0/519860409 >> 172.21.15.117:0/519860409 conn(0x7f65f009d760 msgr2=0x7f65f015b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:52.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.375+0000 7f65f562e640 1 -- 172.21.15.117:0/519860409 shutdown_connections 2024-09-19T08:37:52.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.375+0000 7f65f562e640 1 -- 172.21.15.117:0/519860409 wait complete. 2024-09-19T08:37:52.386 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2024-09-19T08:37:52.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:52.386 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-19T08:37:52.417 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:37:52.417 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-19T08:37:52.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:52.417 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T08:37:52.488 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:37:52.489 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:37:52.505 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:37:52.505 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:37:52.560 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T08:37:52.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.701+0000 7f32dd1e8640 1 Processor -- start 2024-09-19T08:37:52.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.701+0000 7f32dd1e8640 1 -- start start 2024-09-19T08:37:52.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.702+0000 7f32dd1e8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f32d815f0d0 0x7f32d815f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:52.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.702+0000 7f32dd1e8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d80d4130 0x7f32d80d45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:52.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.702+0000 7f32dd1e8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d80d4ae0 con 0x7f32d80d0070 2024-09-19T08:37:52.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.702+0000 7f32dd1e8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f32d80d1b10 con 0x7f32d815f0d0 2024-09-19T08:37:52.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.702+0000 7f32dd1e8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f32d80cf2b0 con 0x7f32d80d4130 2024-09-19T08:37:52.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.702+0000 7f32d6d9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f32d815f0d0 0x7f32d815f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:52.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.702+0000 7f32cffff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f32d80d0070 0x7f32d80d1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:40020/0 (socket says 172.21.15.117:40020) 2024-09-19T08:37:52.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.702+0000 7f32cffff640 1 -- 172.21.15.117:0/4267737485 learned_addr learned my addr 172.21.15.117:0/4267737485 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:52.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.702+0000 7f32d759e640 1 --2- 172.21.15.117:0/4267737485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d80d4130 0x7f32d80d45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:52.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.702+0000 7f32d6d9d640 1 -- 172.21.15.117:0/4267737485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d80d4130 msgr2=0x7f32d80d45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:52.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.702+0000 7f32d6d9d640 1 --2- 172.21.15.117:0/4267737485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d80d4130 0x7f32d80d45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.702+0000 7f32d6d9d640 1 -- 172.21.15.117:0/4267737485 >> v1:172.21.15.117:6789/0 conn(0x7f32d80d0070 legacy=0x7f32d80d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:52.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.702+0000 7f32d659c640 1 -- 172.21.15.117:0/4267737485 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3749631194 0 0) 0x7f32d80d4ae0 con 0x7f32d80d0070 2024-09-19T08:37:52.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.702+0000 7f32d6d9d640 1 -- 172.21.15.117:0/4267737485 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d80cf590 con 0x7f32d815f0d0 2024-09-19T08:37:52.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.702+0000 7f32d759e640 1 --2- 172.21.15.117:0/4267737485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d80d4130 0x7f32d80d45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:52.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.703+0000 7f32d6d9d640 1 --2- 172.21.15.117:0/4267737485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32d815f0d0 0x7f32d815f4b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f32c80097a0 tx=0x7f32c802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fee8c280cb7c0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:52.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.703+0000 7f32d659c640 1 -- 172.21.15.117:0/4267737485 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c8037070 con 0x7f32d815f0d0 2024-09-19T08:37:52.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.703+0000 7f32d659c640 1 -- 172.21.15.117:0/4267737485 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c802ae50 con 0x7f32d815f0d0 2024-09-19T08:37:52.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.703+0000 7f32d659c640 1 -- 172.21.15.117:0/4267737485 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c8032660 con 0x7f32d815f0d0 2024-09-19T08:37:52.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.703+0000 7f32dd1e8640 1 -- 172.21.15.117:0/4267737485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32d815f0d0 msgr2=0x7f32d815f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:52.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.703+0000 7f32dd1e8640 1 --2- 172.21.15.117:0/4267737485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32d815f0d0 0x7f32d815f4b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f32c80097a0 tx=0x7f32c802a100 comp rx=0 tx=0).stop 2024-09-19T08:37:52.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.704+0000 7f32dd1e8640 1 -- 172.21.15.117:0/4267737485 shutdown_connections 2024-09-19T08:37:52.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.704+0000 7f32dd1e8640 1 --2- 172.21.15.117:0/4267737485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d80d4130 0x7f32d80d45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.704+0000 7f32dd1e8640 1 --2- 172.21.15.117:0/4267737485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32d815f0d0 0x7f32d815f4b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.704+0000 7f32dd1e8640 1 -- 172.21.15.117:0/4267737485 >> 172.21.15.117:0/4267737485 conn(0x7f32d809d760 msgr2=0x7f32d808bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:52.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.704+0000 7f32dd1e8640 1 -- 172.21.15.117:0/4267737485 shutdown_connections 2024-09-19T08:37:52.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.704+0000 7f32dd1e8640 1 -- 172.21.15.117:0/4267737485 wait complete. 2024-09-19T08:37:52.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.705+0000 7f32dd1e8640 1 Processor -- start 2024-09-19T08:37:52.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.705+0000 7f32dd1e8640 1 -- start start 2024-09-19T08:37:52.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32dd1e8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32d80d0070 0x7f32d81576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:52.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32dd1e8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32d80d4130 0x7f32d8157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:52.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32dd1e8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d815f0d0 0x7f32d81609e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:52.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32dd1e8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f32d80cef60 con 0x7f32d80d0070 2024-09-19T08:37:52.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32dd1e8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f32d80cfb50 con 0x7f32d80d4130 2024-09-19T08:37:52.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32dd1e8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f32d80b2f70 con 0x7f32d815f0d0 2024-09-19T08:37:52.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32d6d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32d80d0070 0x7f32d81576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:52.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32d6d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32d80d0070 0x7f32d81576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52792/0 (socket says 172.21.15.117:52792) 2024-09-19T08:37:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32d6d9d640 1 -- 172.21.15.117:0/756780138 learned_addr learned my addr 172.21.15.117:0/756780138 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32d759e640 1 --2- 172.21.15.117:0/756780138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d815f0d0 0x7f32d81609e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32d6d9d640 1 -- 172.21.15.117:0/756780138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d815f0d0 msgr2=0x7f32d81609e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32cffff640 1 --2- 172.21.15.117:0/756780138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32d80d4130 0x7f32d8157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32d6d9d640 1 --2- 172.21.15.117:0/756780138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d815f0d0 0x7f32d81609e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32d6d9d640 1 -- 172.21.15.117:0/756780138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32d80d4130 msgr2=0x7f32d8157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32d6d9d640 1 --2- 172.21.15.117:0/756780138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32d80d4130 0x7f32d8157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32d6d9d640 1 -- 172.21.15.117:0/756780138 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d81f4530 con 0x7f32d80d0070 2024-09-19T08:37:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32d6d9d640 1 --2- 172.21.15.117:0/756780138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32d80d0070 0x7f32d81576c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f32c80097a0 tx=0x7f32c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32cf7fe640 1 -- 172.21.15.117:0/756780138 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c8037040 con 0x7f32d80d0070 2024-09-19T08:37:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32cf7fe640 1 -- 172.21.15.117:0/756780138 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c8004030 con 0x7f32d80d0070 2024-09-19T08:37:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32cf7fe640 1 -- 172.21.15.117:0/756780138 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c8004420 con 0x7f32d80d0070 2024-09-19T08:37:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32dd1e8640 1 -- 172.21.15.117:0/756780138 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d81f47d0 con 0x7f32d80d0070 2024-09-19T08:37:52.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.706+0000 7f32dd1e8640 1 -- 172.21.15.117:0/756780138 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d81f4d90 con 0x7f32d80d0070 2024-09-19T08:37:52.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.707+0000 7f32dd1e8640 1 -- 172.21.15.117:0/756780138 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32d806cf30 con 0x7f32d80d0070 2024-09-19T08:37:52.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.708+0000 7f32cf7fe640 1 -- 172.21.15.117:0/756780138 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f32c8003610 con 0x7f32d80d0070 2024-09-19T08:37:52.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.708+0000 7f32cf7fe640 1 --2- 172.21.15.117:0/756780138 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f32b806c2b0 0x7f32b806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:52.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.709+0000 7f32cf7fe640 1 -- 172.21.15.117:0/756780138 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f32c80ac610 con 0x7f32d80d0070 2024-09-19T08:37:52.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.709+0000 7f32cffff640 1 --2- 172.21.15.117:0/756780138 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f32b806c2b0 0x7f32b806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:52.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.709+0000 7f32cffff640 1 --2- 172.21.15.117:0/756780138 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f32b806c2b0 0x7f32b806e770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f32c0007fd0 tx=0x7f32c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:52.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.713+0000 7f32cf7fe640 1 -- 172.21.15.117:0/756780138 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f32c807ab60 con 0x7f32d80d0070 2024-09-19T08:37:52.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.892+0000 7f32dd1e8640 1 -- 172.21.15.117:0/756780138 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f32d806d7b0 con 0x7f32d80d0070 2024-09-19T08:37:52.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.892+0000 7f32cf7fe640 1 -- 172.21.15.117:0/756780138 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f32c807a460 con 0x7f32d80d0070 2024-09-19T08:37:52.892 INFO:teuthology.orchestra.run.smithi117.stderr:listed 0 entries 2024-09-19T08:37:52.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.894+0000 7f32dd1e8640 1 -- 172.21.15.117:0/756780138 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f32b806c2b0 msgr2=0x7f32b806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:52.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.894+0000 7f32dd1e8640 1 --2- 172.21.15.117:0/756780138 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f32b806c2b0 0x7f32b806e770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f32c0007fd0 tx=0x7f32c0009040 comp rx=0 tx=0).stop 2024-09-19T08:37:52.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.894+0000 7f32dd1e8640 1 -- 172.21.15.117:0/756780138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32d80d0070 msgr2=0x7f32d81576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:52.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.894+0000 7f32dd1e8640 1 --2- 172.21.15.117:0/756780138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32d80d0070 0x7f32d81576c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f32c80097a0 tx=0x7f32c80046c0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.894+0000 7f32dd1e8640 1 -- 172.21.15.117:0/756780138 shutdown_connections 2024-09-19T08:37:52.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.894+0000 7f32dd1e8640 1 --2- 172.21.15.117:0/756780138 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f32b806c2b0 0x7f32b806e770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.894+0000 7f32dd1e8640 1 --2- 172.21.15.117:0/756780138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d815f0d0 0x7f32d81609e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.894+0000 7f32dd1e8640 1 --2- 172.21.15.117:0/756780138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32d80d4130 0x7f32d8157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.894+0000 7f32dd1e8640 1 --2- 172.21.15.117:0/756780138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32d80d0070 0x7f32d81576c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:52.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.894+0000 7f32dd1e8640 1 -- 172.21.15.117:0/756780138 >> 172.21.15.117:0/756780138 conn(0x7f32d809d760 msgr2=0x7f32d806dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:52.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.894+0000 7f32dd1e8640 1 -- 172.21.15.117:0/756780138 shutdown_connections 2024-09-19T08:37:52.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:52.894+0000 7f32dd1e8640 1 -- 172.21.15.117:0/756780138 wait complete. 2024-09-19T08:37:52.905 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:37:52.905 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:37:52.921 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T08:37:53.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.060+0000 7f7845f33640 1 Processor -- start 2024-09-19T08:37:53.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.060+0000 7f7845f33640 1 -- start start 2024-09-19T08:37:53.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.061+0000 7f7845f33640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f784015c270 0x7f784006c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:53.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.061+0000 7f7845f33640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f78400ae270 0x7f78400cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:53.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.061+0000 7f7845f33640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78400cfda0 con 0x7f78400b36a0 2024-09-19T08:37:53.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.061+0000 7f7845f33640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f78400ccf80 con 0x7f78400ae270 2024-09-19T08:37:53.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.061+0000 7f7845f33640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f78400cd260 con 0x7f784015c270 2024-09-19T08:37:53.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.061+0000 7f783effd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f78400ae270 0x7f78400cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:53.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.061+0000 7f783effd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f78400ae270 0x7f78400cef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52808/0 (socket says 172.21.15.117:52808) 2024-09-19T08:37:53.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.061+0000 7f783effd640 1 -- 172.21.15.117:0/906361693 learned_addr learned my addr 172.21.15.117:0/906361693 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:53.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.061+0000 7f783f7fe640 1 --2- 172.21.15.117:0/906361693 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f784015c270 0x7f784006c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:53.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.061+0000 7f783effd640 1 -- 172.21.15.117:0/906361693 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f784015c270 msgr2=0x7f784006c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:53.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.061+0000 7f783effd640 1 --2- 172.21.15.117:0/906361693 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f784015c270 0x7f784006c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.061+0000 7f783effd640 1 -- 172.21.15.117:0/906361693 >> v1:172.21.15.146:6789/0 conn(0x7f78400b36a0 legacy=0x7f78400d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:53.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.061+0000 7f783effd640 1 -- 172.21.15.117:0/906361693 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78400cd540 con 0x7f78400ae270 2024-09-19T08:37:53.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.062+0000 7f783effd640 1 --2- 172.21.15.117:0/906361693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78400ae270 0x7f78400cef70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7834009870 tx=0x7f783402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4a01b98249396c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:53.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.062+0000 7f783e7fc640 1 -- 172.21.15.117:0/906361693 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834037070 con 0x7f78400ae270 2024-09-19T08:37:53.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.062+0000 7f783e7fc640 1 -- 172.21.15.117:0/906361693 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7834032440 con 0x7f78400ae270 2024-09-19T08:37:53.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.062+0000 7f783e7fc640 1 -- 172.21.15.117:0/906361693 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834032810 con 0x7f78400ae270 2024-09-19T08:37:53.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.063+0000 7f7845f33640 1 -- 172.21.15.117:0/906361693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78400ae270 msgr2=0x7f78400cef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:53.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.063+0000 7f7845f33640 1 --2- 172.21.15.117:0/906361693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78400ae270 0x7f78400cef70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7834009870 tx=0x7f783402a270 comp rx=0 tx=0).stop 2024-09-19T08:37:53.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.063+0000 7f7845f33640 1 -- 172.21.15.117:0/906361693 shutdown_connections 2024-09-19T08:37:53.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.063+0000 7f7845f33640 1 --2- 172.21.15.117:0/906361693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78400ae270 0x7f78400cef70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.063+0000 7f7845f33640 1 --2- 172.21.15.117:0/906361693 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f784015c270 0x7f784006c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.063+0000 7f7845f33640 1 -- 172.21.15.117:0/906361693 >> 172.21.15.117:0/906361693 conn(0x7f784009a9f0 msgr2=0x7f78400b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:53.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.063+0000 7f7845f33640 1 -- 172.21.15.117:0/906361693 shutdown_connections 2024-09-19T08:37:53.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.063+0000 7f7845f33640 1 -- 172.21.15.117:0/906361693 wait complete. 2024-09-19T08:37:53.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.064+0000 7f7845f33640 1 Processor -- start 2024-09-19T08:37:53.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.064+0000 7f7845f33640 1 -- start start 2024-09-19T08:37:53.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.065+0000 7f7845f33640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78400ae270 0x7f784006fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:53.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.065+0000 7f7845f33640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78400b36a0 0x7f78401e5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:53.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.065+0000 7f7845f33640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f784015c270 0x7f78400b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:53.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.065+0000 7f7845f33640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f784015c7d0 con 0x7f784015c270 2024-09-19T08:37:53.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.065+0000 7f7845f33640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f784015c650 con 0x7f78400ae270 2024-09-19T08:37:53.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.065+0000 7f7845f33640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f78400ccba0 con 0x7f78400b36a0 2024-09-19T08:37:53.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.065+0000 7f783ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f784015c270 0x7f78400b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:53.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.065+0000 7f783ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f784015c270 0x7f78400b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52814/0 (socket says 172.21.15.117:52814) 2024-09-19T08:37:53.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.065+0000 7f783ffff640 1 -- 172.21.15.117:0/3860498773 learned_addr learned my addr 172.21.15.117:0/3860498773 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:53.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.065+0000 7f783f7fe640 1 --2- 172.21.15.117:0/3860498773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78400ae270 0x7f784006fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:53.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.065+0000 7f783effd640 1 --2- 172.21.15.117:0/3860498773 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78400b36a0 0x7f78401e5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:53.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.065+0000 7f783ffff640 1 -- 172.21.15.117:0/3860498773 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78400b36a0 msgr2=0x7f78401e5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:53.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.065+0000 7f783ffff640 1 --2- 172.21.15.117:0/3860498773 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78400b36a0 0x7f78401e5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.065+0000 7f783ffff640 1 -- 172.21.15.117:0/3860498773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78400ae270 msgr2=0x7f784006fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:53.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.065+0000 7f783ffff640 1 --2- 172.21.15.117:0/3860498773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78400ae270 0x7f784006fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.065+0000 7f783ffff640 1 -- 172.21.15.117:0/3860498773 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7840158c00 con 0x7f784015c270 2024-09-19T08:37:53.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.065+0000 7f783ffff640 1 --2- 172.21.15.117:0/3860498773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f784015c270 0x7f78400b4290 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f783800c7a0 tx=0x7f783800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:53.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.066+0000 7f7827fff640 1 -- 172.21.15.117:0/3860498773 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838003b70 con 0x7f784015c270 2024-09-19T08:37:53.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.066+0000 7f7827fff640 1 -- 172.21.15.117:0/3860498773 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7838003d30 con 0x7f784015c270 2024-09-19T08:37:53.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.066+0000 7f7845f33640 1 -- 172.21.15.117:0/3860498773 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78400b4ea0 con 0x7f784015c270 2024-09-19T08:37:53.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.066+0000 7f7827fff640 1 -- 172.21.15.117:0/3860498773 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783800aa90 con 0x7f784015c270 2024-09-19T08:37:53.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.066+0000 7f7845f33640 1 -- 172.21.15.117:0/3860498773 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f784006f0b0 con 0x7f784015c270 2024-09-19T08:37:53.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.067+0000 7f7845f33640 1 -- 172.21.15.117:0/3860498773 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f784006c620 con 0x7f784015c270 2024-09-19T08:37:53.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.067+0000 7f7827fff640 1 -- 172.21.15.117:0/3860498773 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f783800ac30 con 0x7f784015c270 2024-09-19T08:37:53.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.068+0000 7f7827fff640 1 --2- 172.21.15.117:0/3860498773 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f782c06c2b0 0x7f782c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:53.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.068+0000 7f7827fff640 1 -- 172.21.15.117:0/3860498773 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f783808b4f0 con 0x7f784015c270 2024-09-19T08:37:53.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.068+0000 7f783f7fe640 1 --2- 172.21.15.117:0/3860498773 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f782c06c2b0 0x7f782c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:53.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.068+0000 7f783f7fe640 1 --2- 172.21.15.117:0/3860498773 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f782c06c2b0 0x7f782c06e770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7830009aa0 tx=0x7f7830009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:53.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.072+0000 7f7827fff640 1 -- 172.21.15.117:0/3860498773 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7840158c00 con 0x7f784015c270 2024-09-19T08:37:53.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.248+0000 7f7845f33640 1 -- 172.21.15.117:0/3860498773 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f78400d0c40 con 0x7f784015c270 2024-09-19T08:37:53.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.249+0000 7f7827fff640 1 -- 172.21.15.117:0/3860498773 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f78400cfda0 con 0x7f784015c270 2024-09-19T08:37:53.249 INFO:teuthology.orchestra.run.smithi117.stderr:listed 0 entries 2024-09-19T08:37:53.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.251+0000 7f7845f33640 1 -- 172.21.15.117:0/3860498773 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f782c06c2b0 msgr2=0x7f782c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:53.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.251+0000 7f7845f33640 1 --2- 172.21.15.117:0/3860498773 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f782c06c2b0 0x7f782c06e770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7830009aa0 tx=0x7f7830009190 comp rx=0 tx=0).stop 2024-09-19T08:37:53.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.251+0000 7f7845f33640 1 -- 172.21.15.117:0/3860498773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f784015c270 msgr2=0x7f78400b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:53.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.251+0000 7f7845f33640 1 --2- 172.21.15.117:0/3860498773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f784015c270 0x7f78400b4290 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f783800c7a0 tx=0x7f783800cc60 comp rx=0 tx=0).stop 2024-09-19T08:37:53.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.251+0000 7f7845f33640 1 -- 172.21.15.117:0/3860498773 shutdown_connections 2024-09-19T08:37:53.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.251+0000 7f7845f33640 1 --2- 172.21.15.117:0/3860498773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f784015c270 0x7f78400b4290 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.251+0000 7f7845f33640 1 --2- 172.21.15.117:0/3860498773 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f782c06c2b0 0x7f782c06e770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.251+0000 7f7845f33640 1 --2- 172.21.15.117:0/3860498773 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78400b36a0 0x7f78401e5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.251+0000 7f7845f33640 1 --2- 172.21.15.117:0/3860498773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78400ae270 0x7f784006fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.251+0000 7f7845f33640 1 -- 172.21.15.117:0/3860498773 >> 172.21.15.117:0/3860498773 conn(0x7f784009a9f0 msgr2=0x7f78400d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:53.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.251+0000 7f7845f33640 1 -- 172.21.15.117:0/3860498773 shutdown_connections 2024-09-19T08:37:53.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.251+0000 7f7845f33640 1 -- 172.21.15.117:0/3860498773 wait complete. 2024-09-19T08:37:53.262 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2024-09-19T08:37:53.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:53.262 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-09-19T08:37:53.287 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:37:53.287 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T08:37:53.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:53.288 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-19T08:37:53.343 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:37:53.343 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:37:53.362 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:37:53.362 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:37:53.422 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T08:37:53.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.521+0000 7f7c14e5e640 1 Processor -- start 2024-09-19T08:37:53.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.521+0000 7f7c14e5e640 1 -- start start 2024-09-19T08:37:53.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.522+0000 7f7c14e5e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7c1015e7f0 0x7f7c100cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:53.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.522+0000 7f7c14e5e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c100b03c0 0x7f7c100adff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:53.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.522+0000 7f7c14e5e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c100b3c10 con 0x7f7c100ae530 2024-09-19T08:37:53.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.522+0000 7f7c14e5e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f7c100cc1f0 con 0x7f7c1015e7f0 2024-09-19T08:37:53.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.522+0000 7f7c14e5e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f7c100cb900 con 0x7f7c100b03c0 2024-09-19T08:37:53.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.523+0000 7f7c0e59c640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7c1015e7f0 0x7f7c100cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:53.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.523+0000 7f7c0dd9b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c100b03c0 0x7f7c100adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:53.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.523+0000 7f7c0ed9d640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7c100ae530 0x7f7c100cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.117:43936/0 (socket says 172.21.15.117:43936) 2024-09-19T08:37:53.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.523+0000 7f7c0ed9d640 1 -- 172.21.15.117:0/654259262 learned_addr learned my addr 172.21.15.117:0/654259262 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:53.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.523+0000 7f7c0dd9b640 1 -- 172.21.15.117:0/654259262 >> v2:172.21.15.146:3300/0 conn(0x7f7c1015e7f0 msgr2=0x7f7c100cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:53.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.523+0000 7f7c0dd9b640 1 --2- 172.21.15.117:0/654259262 >> v2:172.21.15.146:3300/0 conn(0x7f7c1015e7f0 0x7f7c100cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.523+0000 7f7c0dd9b640 1 -- 172.21.15.117:0/654259262 >> v1:172.21.15.146:6789/0 conn(0x7f7c100ae530 legacy=0x7f7c100cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:53.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.523+0000 7f7c0dd9b640 1 -- 172.21.15.117:0/654259262 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c1015ebd0 con 0x7f7c100b03c0 2024-09-19T08:37:53.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.523+0000 7f7c0e59c640 1 --2- 172.21.15.117:0/654259262 >> v2:172.21.15.146:3300/0 conn(0x7f7c1015e7f0 0x7f7c100cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:37:53.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.524+0000 7f7c0dd9b640 1 --2- 172.21.15.117:0/654259262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c100b03c0 0x7f7c100adff0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7bf80097d0 tx=0x7f7bf802a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=381943e4a50c8c0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:53.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.524+0000 7f7c0d59a640 1 -- 172.21.15.117:0/654259262 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8037070 con 0x7f7c100b03c0 2024-09-19T08:37:53.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.524+0000 7f7c0d59a640 1 -- 172.21.15.117:0/654259262 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bf802ae40 con 0x7f7c100b03c0 2024-09-19T08:37:53.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.524+0000 7f7c0d59a640 1 -- 172.21.15.117:0/654259262 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8032660 con 0x7f7c100b03c0 2024-09-19T08:37:53.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.524+0000 7f7c14e5e640 1 -- 172.21.15.117:0/654259262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c100b03c0 msgr2=0x7f7c100adff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:53.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.524+0000 7f7c14e5e640 1 --2- 172.21.15.117:0/654259262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c100b03c0 0x7f7c100adff0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7bf80097d0 tx=0x7f7bf802a130 comp rx=0 tx=0).stop 2024-09-19T08:37:53.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.525+0000 7f7c14e5e640 1 -- 172.21.15.117:0/654259262 shutdown_connections 2024-09-19T08:37:53.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.525+0000 7f7c14e5e640 1 --2- 172.21.15.117:0/654259262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c100b03c0 0x7f7c100adff0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.525+0000 7f7c14e5e640 1 --2- 172.21.15.117:0/654259262 >> v2:172.21.15.146:3300/0 conn(0x7f7c1015e7f0 0x7f7c100cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.525+0000 7f7c14e5e640 1 -- 172.21.15.117:0/654259262 >> 172.21.15.117:0/654259262 conn(0x7f7c100b2d10 msgr2=0x7f7c100b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:53.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.525+0000 7f7c14e5e640 1 -- 172.21.15.117:0/654259262 shutdown_connections 2024-09-19T08:37:53.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.525+0000 7f7c14e5e640 1 -- 172.21.15.117:0/654259262 wait complete. 2024-09-19T08:37:53.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.526+0000 7f7c14e5e640 1 Processor -- start 2024-09-19T08:37:53.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.526+0000 7f7c14e5e640 1 -- start start 2024-09-19T08:37:53.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.527+0000 7f7c14e5e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c100ae530 0x7f7c100b6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:53.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.527+0000 7f7c14e5e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c100b03c0 0x7f7c100c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:53.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.527+0000 7f7c14e5e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c1015e7f0 0x7f7c100cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:53.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.527+0000 7f7c14e5e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7c100b3830 con 0x7f7c100ae530 2024-09-19T08:37:53.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.527+0000 7f7c14e5e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7c100cbe80 con 0x7f7c1015e7f0 2024-09-19T08:37:53.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.527+0000 7f7c14e5e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f7c100b39b0 con 0x7f7c100b03c0 2024-09-19T08:37:53.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.527+0000 7f7c0e59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c100ae530 0x7f7c100b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:53.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.527+0000 7f7c0e59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c100ae530 0x7f7c100b6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52830/0 (socket says 172.21.15.117:52830) 2024-09-19T08:37:53.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.527+0000 7f7c0e59c640 1 -- 172.21.15.117:0/3617582343 learned_addr learned my addr 172.21.15.117:0/3617582343 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:53.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.527+0000 7f7c0ed9d640 1 --2- 172.21.15.117:0/3617582343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c1015e7f0 0x7f7c100cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:53.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.527+0000 7f7c0dd9b640 1 --2- 172.21.15.117:0/3617582343 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c100b03c0 0x7f7c100c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:53.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.527+0000 7f7c0e59c640 1 -- 172.21.15.117:0/3617582343 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c100b03c0 msgr2=0x7f7c100c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:53.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.527+0000 7f7c0e59c640 1 --2- 172.21.15.117:0/3617582343 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c100b03c0 0x7f7c100c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.527+0000 7f7c0e59c640 1 -- 172.21.15.117:0/3617582343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c1015e7f0 msgr2=0x7f7c100cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:53.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.527+0000 7f7c0e59c640 1 --2- 172.21.15.117:0/3617582343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c1015e7f0 0x7f7c100cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.527+0000 7f7c0e59c640 1 -- 172.21.15.117:0/3617582343 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c100c9170 con 0x7f7c100ae530 2024-09-19T08:37:53.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.527+0000 7f7c0e59c640 1 --2- 172.21.15.117:0/3617582343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c100ae530 0x7f7c100b6370 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009f60 tx=0x7f7c08009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:53.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.527+0000 7f7c06ffd640 1 -- 172.21.15.117:0/3617582343 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c08018020 con 0x7f7c100ae530 2024-09-19T08:37:53.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.527+0000 7f7c06ffd640 1 -- 172.21.15.117:0/3617582343 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c08014680 con 0x7f7c100ae530 2024-09-19T08:37:53.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.527+0000 7f7c14e5e640 1 -- 172.21.15.117:0/3617582343 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c100c9440 con 0x7f7c100ae530 2024-09-19T08:37:53.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.527+0000 7f7c06ffd640 1 -- 172.21.15.117:0/3617582343 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c08014a50 con 0x7f7c100ae530 2024-09-19T08:37:53.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.528+0000 7f7c14e5e640 1 -- 172.21.15.117:0/3617582343 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c100c9a00 con 0x7f7c100ae530 2024-09-19T08:37:53.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.529+0000 7f7c14e5e640 1 -- 172.21.15.117:0/3617582343 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c100adff0 con 0x7f7c100ae530 2024-09-19T08:37:53.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.529+0000 7f7c06ffd640 1 -- 172.21.15.117:0/3617582343 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7c08005d10 con 0x7f7c100ae530 2024-09-19T08:37:53.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.529+0000 7f7c06ffd640 1 --2- 172.21.15.117:0/3617582343 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7bf006c2e0 0x7f7bf006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:53.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.530+0000 7f7c06ffd640 1 -- 172.21.15.117:0/3617582343 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7c0808c520 con 0x7f7c100ae530 2024-09-19T08:37:53.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.530+0000 7f7c0dd9b640 1 --2- 172.21.15.117:0/3617582343 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7bf006c2e0 0x7f7bf006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:53.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.530+0000 7f7c0dd9b640 1 --2- 172.21.15.117:0/3617582343 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7bf006c2e0 0x7f7bf006e7a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8034000 tx=0x7f7bf802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:53.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.534+0000 7f7c06ffd640 1 -- 172.21.15.117:0/3617582343 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7c08022030 con 0x7f7c100ae530 2024-09-19T08:37:53.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.710+0000 7f7c14e5e640 1 -- 172.21.15.117:0/3617582343 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7c100c7f60 con 0x7f7c100ae530 2024-09-19T08:37:53.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.710+0000 7f7c06ffd640 1 -- 172.21.15.117:0/3617582343 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f7c08010040 con 0x7f7c100ae530 2024-09-19T08:37:53.710 INFO:teuthology.orchestra.run.smithi117.stderr:listed 0 entries 2024-09-19T08:37:53.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.712+0000 7f7c14e5e640 1 -- 172.21.15.117:0/3617582343 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7bf006c2e0 msgr2=0x7f7bf006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:53.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.712+0000 7f7c14e5e640 1 --2- 172.21.15.117:0/3617582343 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7bf006c2e0 0x7f7bf006e7a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8034000 tx=0x7f7bf802e000 comp rx=0 tx=0).stop 2024-09-19T08:37:53.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.712+0000 7f7c14e5e640 1 -- 172.21.15.117:0/3617582343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c100ae530 msgr2=0x7f7c100b6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:53.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.712+0000 7f7c14e5e640 1 --2- 172.21.15.117:0/3617582343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c100ae530 0x7f7c100b6370 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009f60 tx=0x7f7c08009f90 comp rx=0 tx=0).stop 2024-09-19T08:37:53.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.712+0000 7f7c14e5e640 1 -- 172.21.15.117:0/3617582343 shutdown_connections 2024-09-19T08:37:53.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.712+0000 7f7c14e5e640 1 --2- 172.21.15.117:0/3617582343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c1015e7f0 0x7f7c100cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.712+0000 7f7c14e5e640 1 --2- 172.21.15.117:0/3617582343 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7bf006c2e0 0x7f7bf006e7a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.712+0000 7f7c14e5e640 1 --2- 172.21.15.117:0/3617582343 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c100b03c0 0x7f7c100c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.712+0000 7f7c14e5e640 1 --2- 172.21.15.117:0/3617582343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c100ae530 0x7f7c100b6370 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.712+0000 7f7c14e5e640 1 -- 172.21.15.117:0/3617582343 >> 172.21.15.117:0/3617582343 conn(0x7f7c100b2d10 msgr2=0x7f7c100d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:53.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.712+0000 7f7c14e5e640 1 -- 172.21.15.117:0/3617582343 shutdown_connections 2024-09-19T08:37:53.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.712+0000 7f7c14e5e640 1 -- 172.21.15.117:0/3617582343 wait complete. 2024-09-19T08:37:53.723 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:37:53.723 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:37:53.743 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T08:37:53.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.842+0000 7f9ce0749640 1 Processor -- start 2024-09-19T08:37:53.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.842+0000 7f9ce0749640 1 -- start start 2024-09-19T08:37:53.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.843+0000 7f9ce0749640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9cd8141680 0x7f9cd80cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:53.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.843+0000 7f9ce0749640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cd8142170 0x7f9cd813f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:53.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.843+0000 7f9ce0749640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd815d710 con 0x7f9cd80d0370 2024-09-19T08:37:53.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.843+0000 7f9ce0749640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f9cd80d07e0 con 0x7f9cd8141680 2024-09-19T08:37:53.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.843+0000 7f9ce0749640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd815c6f0 con 0x7f9cd8142170 2024-09-19T08:37:53.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.843+0000 7f9cddce4640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f9cd80d0370 0x7f9cd8141a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:40036/0 (socket says 172.21.15.117:40036) 2024-09-19T08:37:53.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.843+0000 7f9cddce4640 1 -- 172.21.15.117:0/4016193421 learned_addr learned my addr 172.21.15.117:0/4016193421 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:53.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.843+0000 7f9cdd4e3640 1 -- 172.21.15.117:0/4016193421 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2667575983 0 0) 0x7f9cd815d710 con 0x7f9cd80d0370 2024-09-19T08:37:53.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.843+0000 7f9cdd4e3640 1 -- 172.21.15.117:0/4016193421 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cc4003520 con 0x7f9cd80d0370 2024-09-19T08:37:53.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.843+0000 7f9cde4e5640 1 --2- 172.21.15.117:0/4016193421 >> v2:172.21.15.146:3300/0 conn(0x7f9cd8141680 0x7f9cd80cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:53.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.843+0000 7f9cdece6640 1 --2- 172.21.15.117:0/4016193421 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cd8142170 0x7f9cd813f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:53.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cdd4e3640 1 -- 172.21.15.117:0/4016193421 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2764629422 0 0) 0x7f9cc4003520 con 0x7f9cd80d0370 2024-09-19T08:37:53.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cdd4e3640 1 -- 172.21.15.117:0/4016193421 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cd8142170 msgr2=0x7f9cd813f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:53.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cdd4e3640 1 --2- 172.21.15.117:0/4016193421 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cd8142170 0x7f9cd813f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cdd4e3640 1 -- 172.21.15.117:0/4016193421 >> v2:172.21.15.146:3300/0 conn(0x7f9cd8141680 msgr2=0x7f9cd80cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:53.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cdd4e3640 1 --2- 172.21.15.117:0/4016193421 >> v2:172.21.15.146:3300/0 conn(0x7f9cd8141680 0x7f9cd80cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cdd4e3640 1 -- 172.21.15.117:0/4016193421 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd815c950 con 0x7f9cd80d0370 2024-09-19T08:37:53.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cdd4e3640 1 -- 172.21.15.117:0/4016193421 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f9cc8001690 con 0x7f9cd80d0370 2024-09-19T08:37:53.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cdd4e3640 1 -- 172.21.15.117:0/4016193421 >> v1:172.21.15.117:6789/0 conn(0x7f9cd80d0370 legacy=0x7f9cd8141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:53.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cdd4e3640 1 --2- 172.21.15.117:0/4016193421 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cd8142170 0x7f9cc40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:53.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cdd4e3640 1 --2- 172.21.15.117:0/4016193421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cc4003f60 0x7f9cc4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:53.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cdd4e3640 1 --2- 172.21.15.117:0/4016193421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc4004d40 0x7f9cc40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:53.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cdd4e3640 1 -- 172.21.15.117:0/4016193421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd80d07e0 con 0x7f9cc4003f60 2024-09-19T08:37:53.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cdd4e3640 1 -- 172.21.15.117:0/4016193421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd815c6f0 con 0x7f9cc4004d40 2024-09-19T08:37:53.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cdd4e3640 1 -- 172.21.15.117:0/4016193421 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f9cc400b9c0 con 0x7f9cd8142170 2024-09-19T08:37:53.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cddce4640 1 --2- 172.21.15.117:0/4016193421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cc4003f60 0x7f9cc4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:53.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cde4e5640 1 --2- 172.21.15.117:0/4016193421 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cd8142170 0x7f9cc40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:53.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cdece6640 1 --2- 172.21.15.117:0/4016193421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc4004d40 0x7f9cc40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:53.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cddce4640 1 -- 172.21.15.117:0/4016193421 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cd8142170 msgr2=0x7f9cc40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:53.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cddce4640 1 --2- 172.21.15.117:0/4016193421 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cd8142170 0x7f9cc40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cddce4640 1 -- 172.21.15.117:0/4016193421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc4004d40 msgr2=0x7f9cc40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:53.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cddce4640 1 --2- 172.21.15.117:0/4016193421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc4004d40 0x7f9cc40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cddce4640 1 -- 172.21.15.117:0/4016193421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc4003520 con 0x7f9cc4003f60 2024-09-19T08:37:53.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cde4e5640 1 --2- 172.21.15.117:0/4016193421 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cd8142170 0x7f9cc40039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:53.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.844+0000 7f9cdece6640 1 --2- 172.21.15.117:0/4016193421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc4004d40 0x7f9cc40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:53.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.845+0000 7f9cddce4640 1 --2- 172.21.15.117:0/4016193421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cc4003f60 0x7f9cc4004800 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9cc800c210 tx=0x7f9cc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93a01a0b99ca6ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:53.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.845+0000 7f9cdd4e3640 1 -- 172.21.15.117:0/4016193421 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8007d30 con 0x7f9cc4003f60 2024-09-19T08:37:53.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.845+0000 7f9cdd4e3640 1 -- 172.21.15.117:0/4016193421 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc80058d0 con 0x7f9cc4003f60 2024-09-19T08:37:53.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.845+0000 7f9cdd4e3640 1 -- 172.21.15.117:0/4016193421 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8005ce0 con 0x7f9cc4003f60 2024-09-19T08:37:53.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.846+0000 7f9ce0749640 1 -- 172.21.15.117:0/4016193421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cc4003f60 msgr2=0x7f9cc4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:53.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.846+0000 7f9ce0749640 1 --2- 172.21.15.117:0/4016193421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cc4003f60 0x7f9cc4004800 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9cc800c210 tx=0x7f9cc4005830 comp rx=0 tx=0).stop 2024-09-19T08:37:53.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.846+0000 7f9cdece6640 1 -- 172.21.15.117:0/4016193421 reap_dead start 2024-09-19T08:37:53.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.846+0000 7f9ce0749640 1 -- 172.21.15.117:0/4016193421 shutdown_connections 2024-09-19T08:37:53.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.846+0000 7f9ce0749640 1 -- 172.21.15.117:0/4016193421 >> 172.21.15.117:0/4016193421 conn(0x7f9cd80b3ed0 msgr2=0x7f9cd80b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:53.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.846+0000 7f9ce0749640 1 -- 172.21.15.117:0/4016193421 shutdown_connections 2024-09-19T08:37:53.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.846+0000 7f9ce0749640 1 -- 172.21.15.117:0/4016193421 wait complete. 2024-09-19T08:37:53.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.847+0000 7f9ce0749640 1 Processor -- start 2024-09-19T08:37:53.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.847+0000 7f9ce0749640 1 -- start start 2024-09-19T08:37:53.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.847+0000 7f9ce0749640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc4003f60 0x7f9cd813e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:53.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9ce0749640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cd80c7ee0 0x7f9cd813ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:53.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9ce0749640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cd80c9330 0x7f9cd80c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:53.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9ce0749640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd815d1f0 con 0x7f9cd80c7ee0 2024-09-19T08:37:53.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9ce0749640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd815cf10 con 0x7f9cc4003f60 2024-09-19T08:37:53.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9ce0749640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd81425c0 con 0x7f9cd80c9330 2024-09-19T08:37:53.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9cddce4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cd80c7ee0 0x7f9cd813ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:53.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9cddce4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cd80c7ee0 0x7f9cd813ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52858/0 (socket says 172.21.15.117:52858) 2024-09-19T08:37:53.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9cddce4640 1 -- 172.21.15.117:0/3924387113 learned_addr learned my addr 172.21.15.117:0/3924387113 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:53.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9cde4e5640 1 --2- 172.21.15.117:0/3924387113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc4003f60 0x7f9cd813e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:53.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9cdece6640 1 --2- 172.21.15.117:0/3924387113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cd80c9330 0x7f9cd80c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:53.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9cddce4640 1 -- 172.21.15.117:0/3924387113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cd80c9330 msgr2=0x7f9cd80c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:53.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9cddce4640 1 --2- 172.21.15.117:0/3924387113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cd80c9330 0x7f9cd80c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9cddce4640 1 -- 172.21.15.117:0/3924387113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc4003f60 msgr2=0x7f9cd813e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:53.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9cddce4640 1 --2- 172.21.15.117:0/3924387113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc4003f60 0x7f9cd813e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:53.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9cddce4640 1 -- 172.21.15.117:0/3924387113 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd80c7140 con 0x7f9cd80c7ee0 2024-09-19T08:37:53.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9cde4e5640 1 --2- 172.21.15.117:0/3924387113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc4003f60 0x7f9cd813e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:53.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9cddce4640 1 --2- 172.21.15.117:0/3924387113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cd80c7ee0 0x7f9cd813ee20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9cc800c330 tx=0x7f9cd815cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:53.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9cceffd640 1 -- 172.21.15.117:0/3924387113 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8042020 con 0x7f9cd80c7ee0 2024-09-19T08:37:53.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9cceffd640 1 -- 172.21.15.117:0/3924387113 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc8000ed0 con 0x7f9cd80c7ee0 2024-09-19T08:37:53.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9cceffd640 1 -- 172.21.15.117:0/3924387113 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc80074e0 con 0x7f9cd80c7ee0 2024-09-19T08:37:53.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9ce0749640 1 -- 172.21.15.117:0/3924387113 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd80cbbd0 con 0x7f9cd80c7ee0 2024-09-19T08:37:53.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.848+0000 7f9ce0749640 1 -- 172.21.15.117:0/3924387113 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd80c76e0 con 0x7f9cd80c7ee0 2024-09-19T08:37:53.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.849+0000 7f9ce0749640 1 -- 172.21.15.117:0/3924387113 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cd80cfe30 con 0x7f9cd80c7ee0 2024-09-19T08:37:53.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.850+0000 7f9cceffd640 1 -- 172.21.15.117:0/3924387113 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9cc8045020 con 0x7f9cd80c7ee0 2024-09-19T08:37:53.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.850+0000 7f9cceffd640 1 --2- 172.21.15.117:0/3924387113 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9cbc06c2b0 0x7f9cbc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:53.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.851+0000 7f9cceffd640 1 -- 172.21.15.117:0/3924387113 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9cc80abce0 con 0x7f9cd80c7ee0 2024-09-19T08:37:53.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.851+0000 7f9cde4e5640 1 --2- 172.21.15.117:0/3924387113 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9cbc06c2b0 0x7f9cbc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:53.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.851+0000 7f9cde4e5640 1 --2- 172.21.15.117:0/3924387113 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9cbc06c2b0 0x7f9cbc06e770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4009b50 tx=0x7f9cd4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:53.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:53.855+0000 7f9cceffd640 1 -- 172.21.15.117:0/3924387113 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9cc804c030 con 0x7f9cd80c7ee0 2024-09-19T08:37:54.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.032+0000 7f9ce0749640 1 -- 172.21.15.117:0/3924387113 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9cd80690c0 con 0x7f9cd80c7ee0 2024-09-19T08:37:54.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.032+0000 7f9cceffd640 1 -- 172.21.15.117:0/3924387113 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f9cc807a1a0 con 0x7f9cd80c7ee0 2024-09-19T08:37:54.032 INFO:teuthology.orchestra.run.smithi117.stderr:listed 0 entries 2024-09-19T08:37:54.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.034+0000 7f9ce0749640 1 -- 172.21.15.117:0/3924387113 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9cbc06c2b0 msgr2=0x7f9cbc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:54.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.034+0000 7f9ce0749640 1 --2- 172.21.15.117:0/3924387113 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9cbc06c2b0 0x7f9cbc06e770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4009b50 tx=0x7f9cd4008040 comp rx=0 tx=0).stop 2024-09-19T08:37:54.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.034+0000 7f9ce0749640 1 -- 172.21.15.117:0/3924387113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cd80c7ee0 msgr2=0x7f9cd813ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:54.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.034+0000 7f9ce0749640 1 --2- 172.21.15.117:0/3924387113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cd80c7ee0 0x7f9cd813ee20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9cc800c330 tx=0x7f9cd815cb20 comp rx=0 tx=0).stop 2024-09-19T08:37:54.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.034+0000 7f9ce0749640 1 -- 172.21.15.117:0/3924387113 shutdown_connections 2024-09-19T08:37:54.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.034+0000 7f9ce0749640 1 --2- 172.21.15.117:0/3924387113 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9cbc06c2b0 0x7f9cbc06e770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.034+0000 7f9ce0749640 1 --2- 172.21.15.117:0/3924387113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cd80c9330 0x7f9cd80c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.034+0000 7f9ce0749640 1 --2- 172.21.15.117:0/3924387113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cd80c7ee0 0x7f9cd813ee20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.034+0000 7f9ce0749640 1 --2- 172.21.15.117:0/3924387113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc4003f60 0x7f9cd813e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.034+0000 7f9ce0749640 1 -- 172.21.15.117:0/3924387113 >> 172.21.15.117:0/3924387113 conn(0x7f9cd80b3ed0 msgr2=0x7f9cd8141a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:54.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.034+0000 7f9ce0749640 1 -- 172.21.15.117:0/3924387113 shutdown_connections 2024-09-19T08:37:54.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.035+0000 7f9ce0749640 1 -- 172.21.15.117:0/3924387113 wait complete. 2024-09-19T08:37:54.045 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2024-09-19T08:37:54.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:54.046 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-09-19T08:37:54.076 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:37:54.077 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-19T08:37:54.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:37:54.077 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-19T08:37:54.136 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T08:37:54.136 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:37:54.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.234+0000 7fe91aa65640 1 Processor -- start 2024-09-19T08:37:54.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.234+0000 7fe91aa65640 1 -- start start 2024-09-19T08:37:54.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.235+0000 7fe91aa65640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe9140cc930 0x7fe9140ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:54.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.235+0000 7fe91aa65640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9140b4540 con 0x7fe9140c5b00 2024-09-19T08:37:54.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.235+0000 7fe91aa65640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9140c5ee0 con 0x7fe91415a7b0 2024-09-19T08:37:54.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.235+0000 7fe91aa65640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fe9140d0bc0 con 0x7fe9140cc930 2024-09-19T08:37:54.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.235+0000 7fe918801640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe9140c5b00 0x7fe9140cde40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:40050/0 (socket says 172.21.15.117:40050) 2024-09-19T08:37:54.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.235+0000 7fe918801640 1 -- 172.21.15.117:0/1694325325 learned_addr learned my addr 172.21.15.117:0/1694325325 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:54.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe919002640 1 --2- 172.21.15.117:0/1694325325 >> v2:172.21.15.146:3300/0 conn(0x7fe9140cc930 0x7fe9140ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:54.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe9137fe640 1 -- 172.21.15.117:0/1694325325 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2358087495 0 0) 0x7fe9140b4540 con 0x7fe9140c5b00 2024-09-19T08:37:54.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe9137fe640 1 -- 172.21.15.117:0/1694325325 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8fc003520 con 0x7fe9140c5b00 2024-09-19T08:37:54.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe9137fe640 1 -- 172.21.15.117:0/1694325325 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1033303548 0 0) 0x7fe8fc003520 con 0x7fe9140c5b00 2024-09-19T08:37:54.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe9137fe640 1 -- 172.21.15.117:0/1694325325 >> v2:172.21.15.146:3300/0 conn(0x7fe9140cc930 msgr2=0x7fe9140ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:54.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe9137fe640 1 --2- 172.21.15.117:0/1694325325 >> v2:172.21.15.146:3300/0 conn(0x7fe9140cc930 0x7fe9140ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe9137fe640 1 -- 172.21.15.117:0/1694325325 >> v1:172.21.15.146:6789/0 conn(0x7fe91415a7b0 legacy=0x7fe9140d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:54.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe9137fe640 1 -- 172.21.15.117:0/1694325325 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91415abf0 con 0x7fe9140c5b00 2024-09-19T08:37:54.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe9137fe640 1 -- 172.21.15.117:0/1694325325 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7fe904001670 con 0x7fe9140c5b00 2024-09-19T08:37:54.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe9137fe640 1 -- 172.21.15.117:0/1694325325 >> v1:172.21.15.117:6789/0 conn(0x7fe9140c5b00 legacy=0x7fe9140cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:54.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe9137fe640 1 --2- 172.21.15.117:0/1694325325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8fc0039b0 0x7fe8fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:54.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe9137fe640 1 --2- 172.21.15.117:0/1694325325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8fc004800 0x7fe8fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:54.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe9137fe640 1 --2- 172.21.15.117:0/1694325325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8fc0051c0 0x7fe8fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:54.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe9137fe640 1 -- 172.21.15.117:0/1694325325 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe9140d0bc0 con 0x7fe8fc0039b0 2024-09-19T08:37:54.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe9137fe640 1 -- 172.21.15.117:0/1694325325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc00c060 con 0x7fe8fc0051c0 2024-09-19T08:37:54.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe9137fe640 1 -- 172.21.15.117:0/1694325325 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fe8fc00c260 con 0x7fe8fc004800 2024-09-19T08:37:54.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe918801640 1 --2- 172.21.15.117:0/1694325325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8fc0039b0 0x7fe8fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:54.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe919002640 1 --2- 172.21.15.117:0/1694325325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8fc0051c0 0x7fe8fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:54.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe913fff640 1 --2- 172.21.15.117:0/1694325325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8fc004800 0x7fe8fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:54.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe918801640 1 -- 172.21.15.117:0/1694325325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8fc004800 msgr2=0x7fe8fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:54.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe918801640 1 --2- 172.21.15.117:0/1694325325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8fc004800 0x7fe8fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe918801640 1 -- 172.21.15.117:0/1694325325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8fc0051c0 msgr2=0x7fe8fc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:54.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe918801640 1 --2- 172.21.15.117:0/1694325325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8fc0051c0 0x7fe8fc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe918801640 1 -- 172.21.15.117:0/1694325325 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8fc003520 con 0x7fe8fc0039b0 2024-09-19T08:37:54.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe913fff640 1 --2- 172.21.15.117:0/1694325325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8fc004800 0x7fe8fc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:54.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe919002640 1 --2- 172.21.15.117:0/1694325325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8fc0051c0 0x7fe8fc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:54.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.236+0000 7fe919002640 1 -- 172.21.15.117:0/1694325325 reap_dead start 2024-09-19T08:37:54.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.237+0000 7fe918801640 1 --2- 172.21.15.117:0/1694325325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8fc0039b0 0x7fe8fc003dd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe90400c240 tx=0x7fe8fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63956e334097a222 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:54.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.237+0000 7fe9137fe640 1 -- 172.21.15.117:0/1694325325 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe904007d10 con 0x7fe8fc0039b0 2024-09-19T08:37:54.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.237+0000 7fe9137fe640 1 -- 172.21.15.117:0/1694325325 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9040058d0 con 0x7fe8fc0039b0 2024-09-19T08:37:54.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.237+0000 7fe9137fe640 1 -- 172.21.15.117:0/1694325325 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe904005d40 con 0x7fe8fc0039b0 2024-09-19T08:37:54.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.238+0000 7fe91aa65640 1 -- 172.21.15.117:0/1694325325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8fc0039b0 msgr2=0x7fe8fc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:54.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.238+0000 7fe91aa65640 1 --2- 172.21.15.117:0/1694325325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8fc0039b0 0x7fe8fc003dd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe90400c240 tx=0x7fe8fc005830 comp rx=0 tx=0).stop 2024-09-19T08:37:54.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.238+0000 7fe91aa65640 1 -- 172.21.15.117:0/1694325325 shutdown_connections 2024-09-19T08:37:54.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.238+0000 7fe91aa65640 1 --2- 172.21.15.117:0/1694325325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8fc0039b0 0x7fe8fc003dd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.238+0000 7fe91aa65640 1 -- 172.21.15.117:0/1694325325 >> 172.21.15.117:0/1694325325 conn(0x7fe91406bdf0 msgr2=0x7fe91406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:54.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.238+0000 7fe91aa65640 1 -- 172.21.15.117:0/1694325325 shutdown_connections 2024-09-19T08:37:54.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.238+0000 7fe91aa65640 1 -- 172.21.15.117:0/1694325325 wait complete. 2024-09-19T08:37:54.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.239+0000 7fe91aa65640 1 Processor -- start 2024-09-19T08:37:54.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.239+0000 7fe91aa65640 1 -- start start 2024-09-19T08:37:54.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.240+0000 7fe91aa65640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8fc0039b0 0x7fe91415f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:54.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.240+0000 7fe91aa65640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9141543b0 0x7fe914154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:54.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.240+0000 7fe91aa65640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe914156390 0x7fe914156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:54.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.240+0000 7fe91aa65640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe9140cfc90 con 0x7fe9141543b0 2024-09-19T08:37:54.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.240+0000 7fe91aa65640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe9140b4870 con 0x7fe8fc0039b0 2024-09-19T08:37:54.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.240+0000 7fe91aa65640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fe9140cff70 con 0x7fe914156390 2024-09-19T08:37:54.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.240+0000 7fe913fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9141543b0 0x7fe914154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:54.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.240+0000 7fe913fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9141543b0 0x7fe914154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52890/0 (socket says 172.21.15.117:52890) 2024-09-19T08:37:54.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.240+0000 7fe913fff640 1 -- 172.21.15.117:0/1788882710 learned_addr learned my addr 172.21.15.117:0/1788882710 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:54.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.240+0000 7fe918801640 1 --2- 172.21.15.117:0/1788882710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8fc0039b0 0x7fe91415f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:54.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.240+0000 7fe919002640 1 --2- 172.21.15.117:0/1788882710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe914156390 0x7fe914156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:54.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.240+0000 7fe913fff640 1 -- 172.21.15.117:0/1788882710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe914156390 msgr2=0x7fe914156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:54.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.240+0000 7fe913fff640 1 --2- 172.21.15.117:0/1788882710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe914156390 0x7fe914156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.240+0000 7fe913fff640 1 -- 172.21.15.117:0/1788882710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8fc0039b0 msgr2=0x7fe91415f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:54.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.240+0000 7fe913fff640 1 --2- 172.21.15.117:0/1788882710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8fc0039b0 0x7fe91415f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.240+0000 7fe913fff640 1 -- 172.21.15.117:0/1788882710 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe914154d50 con 0x7fe9141543b0 2024-09-19T08:37:54.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.241+0000 7fe913fff640 1 --2- 172.21.15.117:0/1788882710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9141543b0 0x7fe914154810 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe90800d770 tx=0x7fe90800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:54.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.241+0000 7fe9117fa640 1 -- 172.21.15.117:0/1788882710 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe908005270 con 0x7fe9141543b0 2024-09-19T08:37:54.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.241+0000 7fe9117fa640 1 -- 172.21.15.117:0/1788882710 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe908017070 con 0x7fe9141543b0 2024-09-19T08:37:54.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.241+0000 7fe91aa65640 1 -- 172.21.15.117:0/1788882710 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe914157050 con 0x7fe9141543b0 2024-09-19T08:37:54.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.241+0000 7fe9117fa640 1 -- 172.21.15.117:0/1788882710 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90800b6b0 con 0x7fe9141543b0 2024-09-19T08:37:54.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.241+0000 7fe91aa65640 1 -- 172.21.15.117:0/1788882710 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9141f7b60 con 0x7fe9141543b0 2024-09-19T08:37:54.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.242+0000 7fe91aa65640 1 -- 172.21.15.117:0/1788882710 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9141f7670 con 0x7fe9141543b0 2024-09-19T08:37:54.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.242+0000 7fe9117fa640 1 -- 172.21.15.117:0/1788882710 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe90800b850 con 0x7fe9141543b0 2024-09-19T08:37:54.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.243+0000 7fe9117fa640 1 --2- 172.21.15.117:0/1788882710 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe90006c2b0 0x7fe90006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:54.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.243+0000 7fe9117fa640 1 -- 172.21.15.117:0/1788882710 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe90808b3f0 con 0x7fe9141543b0 2024-09-19T08:37:54.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.243+0000 7fe918801640 1 --2- 172.21.15.117:0/1788882710 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe90006c2b0 0x7fe90006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:54.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.243+0000 7fe918801640 1 --2- 172.21.15.117:0/1788882710 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe90006c2b0 0x7fe90006e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe904033000 tx=0x7fe90402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:54.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.247+0000 7fe9117fa640 1 -- 172.21.15.117:0/1788882710 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe908059260 con 0x7fe9141543b0 2024-09-19T08:37:54.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.446+0000 7fe91aa65640 1 -- 172.21.15.117:0/1788882710 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe914158f80 con 0x7fe9141543b0 2024-09-19T08:37:54.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.448+0000 7fe9117fa640 1 -- 172.21.15.117:0/1788882710 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7fe90805d560 con 0x7fe9141543b0 2024-09-19T08:37:54.448 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:54.448 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":9,"btime":"2024-09-19T08:37:32:382208+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2592540396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2592540396},{"type":"v1","addr":"172.21.15.117:6833","nonce":2592540396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3561335184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3561335184},{"type":"v1","addr":"172.21.15.117:6835","nonce":3561335184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/2623207604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2623207604},{"type":"v1","addr":"172.21.15.146:6837","nonce":2623207604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:37:12.640173+0000","modified":"2024-09-19T08:37:31.712060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6836/2942334805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2942334805},{"type":"v1","addr":"172.21.15.146:6836","nonce":2942334805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4303,"qdb_cluster":[4303]},"id":1}]} 2024-09-19T08:37:54.448 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 9 2024-09-19T08:37:54.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.450+0000 7fe91aa65640 1 -- 172.21.15.117:0/1788882710 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe90006c2b0 msgr2=0x7fe90006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:54.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.450+0000 7fe91aa65640 1 --2- 172.21.15.117:0/1788882710 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe90006c2b0 0x7fe90006e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe904033000 tx=0x7fe90402e000 comp rx=0 tx=0).stop 2024-09-19T08:37:54.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.450+0000 7fe91aa65640 1 -- 172.21.15.117:0/1788882710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9141543b0 msgr2=0x7fe914154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:54.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.450+0000 7fe91aa65640 1 --2- 172.21.15.117:0/1788882710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9141543b0 0x7fe914154810 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe90800d770 tx=0x7fe90800dc30 comp rx=0 tx=0).stop 2024-09-19T08:37:54.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.450+0000 7fe91aa65640 1 -- 172.21.15.117:0/1788882710 shutdown_connections 2024-09-19T08:37:54.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.450+0000 7fe91aa65640 1 --2- 172.21.15.117:0/1788882710 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe90006c2b0 0x7fe90006e770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.450+0000 7fe91aa65640 1 --2- 172.21.15.117:0/1788882710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe914156390 0x7fe914156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.450+0000 7fe91aa65640 1 --2- 172.21.15.117:0/1788882710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9141543b0 0x7fe914154810 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.450+0000 7fe91aa65640 1 --2- 172.21.15.117:0/1788882710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8fc0039b0 0x7fe91415f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.450+0000 7fe91aa65640 1 -- 172.21.15.117:0/1788882710 >> 172.21.15.117:0/1788882710 conn(0x7fe91406bdf0 msgr2=0x7fe914157a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:54.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.450+0000 7fe91aa65640 1 -- 172.21.15.117:0/1788882710 shutdown_connections 2024-09-19T08:37:54.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.451+0000 7fe91aa65640 1 -- 172.21.15.117:0/1788882710 wait complete. 2024-09-19T08:37:54.463 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:37:54.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.561+0000 7f27bc6d9640 1 Processor -- start 2024-09-19T08:37:54.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.561+0000 7f27bc6d9640 1 -- start start 2024-09-19T08:37:54.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.562+0000 7f27bc6d9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27b4141680 0x7f27b40cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.562+0000 7f27bc6d9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f27b4142170 0x7f27b413f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.562+0000 7f27bc6d9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27b415d710 con 0x7f27b40d0370 2024-09-19T08:37:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.562+0000 7f27bc6d9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f27b40d07b0 con 0x7f27b4142170 2024-09-19T08:37:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.562+0000 7f27bc6d9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f27b415c6f0 con 0x7f27b4141680 2024-09-19T08:37:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.562+0000 7f27bac76640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f27b4142170 0x7f27b413f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.562+0000 7f27b9c74640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f27b40d0370 0x7f27b4141a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:52730/0 (socket says 172.21.15.117:52730) 2024-09-19T08:37:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.562+0000 7f27bac76640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f27b4142170 0x7f27b413f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57316/0 (socket says 172.21.15.117:57316) 2024-09-19T08:37:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.562+0000 7f27b9c74640 1 -- 172.21.15.117:0/3318704294 learned_addr learned my addr 172.21.15.117:0/3318704294 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.562+0000 7f27bac76640 1 -- 172.21.15.117:0/3318704294 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27b4141680 msgr2=0x7f27b40cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.562+0000 7f27ba475640 1 --2- 172.21.15.117:0/3318704294 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27b4141680 0x7f27b40cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.562+0000 7f27bac76640 1 --2- 172.21.15.117:0/3318704294 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27b4141680 0x7f27b40cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.562+0000 7f27b9473640 1 -- 172.21.15.117:0/3318704294 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 213041823 0 0) 0x7f27b415d710 con 0x7f27b40d0370 2024-09-19T08:37:54.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.562+0000 7f27bac76640 1 -- 172.21.15.117:0/3318704294 >> v1:172.21.15.117:6789/0 conn(0x7f27b40d0370 legacy=0x7f27b4141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:54.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.562+0000 7f27bac76640 1 -- 172.21.15.117:0/3318704294 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b4142600 con 0x7f27b4142170 2024-09-19T08:37:54.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.562+0000 7f27ba475640 1 --2- 172.21.15.117:0/3318704294 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27b4141680 0x7f27b40cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:54.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.563+0000 7f27bac76640 1 --2- 172.21.15.117:0/3318704294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b4142170 0x7f27b413f8b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f27ac009d90 tx=0x7f27ac02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37354c22bb5ea70c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:54.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.563+0000 7f27b9473640 1 -- 172.21.15.117:0/3318704294 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac007740 con 0x7f27b4142170 2024-09-19T08:37:54.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.563+0000 7f27b9473640 1 -- 172.21.15.117:0/3318704294 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27ac0078e0 con 0x7f27b4142170 2024-09-19T08:37:54.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.563+0000 7f27b9473640 1 -- 172.21.15.117:0/3318704294 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac007cb0 con 0x7f27b4142170 2024-09-19T08:37:54.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.564+0000 7f27bc6d9640 1 -- 172.21.15.117:0/3318704294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b4142170 msgr2=0x7f27b413f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:54.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.564+0000 7f27bc6d9640 1 --2- 172.21.15.117:0/3318704294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b4142170 0x7f27b413f8b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f27ac009d90 tx=0x7f27ac02a660 comp rx=0 tx=0).stop 2024-09-19T08:37:54.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.564+0000 7f27bc6d9640 1 -- 172.21.15.117:0/3318704294 shutdown_connections 2024-09-19T08:37:54.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.564+0000 7f27bc6d9640 1 --2- 172.21.15.117:0/3318704294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b4142170 0x7f27b413f8b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.564+0000 7f27bc6d9640 1 --2- 172.21.15.117:0/3318704294 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27b4141680 0x7f27b40cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.564+0000 7f27bc6d9640 1 -- 172.21.15.117:0/3318704294 >> 172.21.15.117:0/3318704294 conn(0x7f27b40b3ed0 msgr2=0x7f27b40b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:54.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.564+0000 7f27bc6d9640 1 -- 172.21.15.117:0/3318704294 shutdown_connections 2024-09-19T08:37:54.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.564+0000 7f27bc6d9640 1 -- 172.21.15.117:0/3318704294 wait complete. 2024-09-19T08:37:54.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.565+0000 7f27bc6d9640 1 Processor -- start 2024-09-19T08:37:54.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.565+0000 7f27bc6d9640 1 -- start start 2024-09-19T08:37:54.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.566+0000 7f27bc6d9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b40d0370 0x7f27b413e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:54.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.566+0000 7f27bc6d9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27b4141680 0x7f27b40b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:54.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.566+0000 7f27bc6d9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27b4142170 0x7f27b415b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:54.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.566+0000 7f27bc6d9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f27b415cf10 con 0x7f27b40d0370 2024-09-19T08:37:54.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.566+0000 7f27bc6d9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f27b415cc30 con 0x7f27b4141680 2024-09-19T08:37:54.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.566+0000 7f27bc6d9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f27b415d1f0 con 0x7f27b4142170 2024-09-19T08:37:54.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.566+0000 7f27ba475640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b40d0370 0x7f27b413e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:54.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.566+0000 7f27ba475640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b40d0370 0x7f27b413e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57324/0 (socket says 172.21.15.117:57324) 2024-09-19T08:37:54.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.566+0000 7f27ba475640 1 -- 172.21.15.117:0/56375172 learned_addr learned my addr 172.21.15.117:0/56375172 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:54.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.566+0000 7f27bac76640 1 --2- 172.21.15.117:0/56375172 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27b4142170 0x7f27b415b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.566+0000 7f27b9c74640 1 --2- 172.21.15.117:0/56375172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27b4141680 0x7f27b40b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.566+0000 7f27ba475640 1 -- 172.21.15.117:0/56375172 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27b4142170 msgr2=0x7f27b415b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.566+0000 7f27ba475640 1 --2- 172.21.15.117:0/56375172 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27b4142170 0x7f27b415b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.566+0000 7f27ba475640 1 -- 172.21.15.117:0/56375172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27b4141680 msgr2=0x7f27b40b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.566+0000 7f27ba475640 1 --2- 172.21.15.117:0/56375172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27b4141680 0x7f27b40b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.566+0000 7f27ba475640 1 -- 172.21.15.117:0/56375172 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b40b6e70 con 0x7f27b40d0370 2024-09-19T08:37:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.566+0000 7f27b9c74640 1 --2- 172.21.15.117:0/56375172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27b4141680 0x7f27b40b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.566+0000 7f27ba475640 1 --2- 172.21.15.117:0/56375172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b40d0370 0x7f27b413e100 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f27b000c7f0 tx=0x7f27b000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.566+0000 7f27aaffd640 1 -- 172.21.15.117:0/56375172 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b0015070 con 0x7f27b40d0370 2024-09-19T08:37:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.566+0000 7f27aaffd640 1 -- 172.21.15.117:0/56375172 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b0007a30 con 0x7f27b40d0370 2024-09-19T08:37:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.566+0000 7f27bc6d9640 1 -- 172.21.15.117:0/56375172 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b40b7150 con 0x7f27b40d0370 2024-09-19T08:37:54.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.567+0000 7f27aaffd640 1 -- 172.21.15.117:0/56375172 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b0007e00 con 0x7f27b40d0370 2024-09-19T08:37:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.567+0000 7f27bc6d9640 1 -- 172.21.15.117:0/56375172 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b41f4110 con 0x7f27b40d0370 2024-09-19T08:37:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.568+0000 7f27bc6d9640 1 -- 172.21.15.117:0/56375172 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27b40d1020 con 0x7f27b40d0370 2024-09-19T08:37:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.568+0000 7f27aaffd640 1 -- 172.21.15.117:0/56375172 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f27b0018070 con 0x7f27b40d0370 2024-09-19T08:37:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.568+0000 7f27aaffd640 1 --2- 172.21.15.117:0/56375172 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f279806c2b0 0x7f279806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.568+0000 7f27aaffd640 1 -- 172.21.15.117:0/56375172 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f27b008b6e0 con 0x7f27b40d0370 2024-09-19T08:37:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.569+0000 7f27b9c74640 1 --2- 172.21.15.117:0/56375172 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f279806c2b0 0x7f279806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:54.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.569+0000 7f27b9c74640 1 --2- 172.21.15.117:0/56375172 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f279806c2b0 0x7f279806e770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f27b406ee50 tx=0x7f27a4007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:54.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.573+0000 7f27aaffd640 1 -- 172.21.15.117:0/56375172 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f27b40d1020 con 0x7f27b40d0370 2024-09-19T08:37:54.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.775+0000 7f27bc6d9640 1 -- 172.21.15.117:0/56375172 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27b40690c0 con 0x7f27b40d0370 2024-09-19T08:37:54.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.776+0000 7f27aaffd640 1 -- 172.21.15.117:0/56375172 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7f27b0059490 con 0x7f27b40d0370 2024-09-19T08:37:54.776 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:54.777 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":9,"btime":"2024-09-19T08:37:32:382208+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2592540396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2592540396},{"type":"v1","addr":"172.21.15.117:6833","nonce":2592540396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3561335184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3561335184},{"type":"v1","addr":"172.21.15.117:6835","nonce":3561335184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/2623207604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2623207604},{"type":"v1","addr":"172.21.15.146:6837","nonce":2623207604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:37:12.640173+0000","modified":"2024-09-19T08:37:31.712060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6836/2942334805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2942334805},{"type":"v1","addr":"172.21.15.146:6836","nonce":2942334805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4303,"qdb_cluster":[4303]},"id":1}]} 2024-09-19T08:37:54.777 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 9 2024-09-19T08:37:54.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.778+0000 7f27bc6d9640 1 -- 172.21.15.117:0/56375172 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f279806c2b0 msgr2=0x7f279806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:54.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.778+0000 7f27bc6d9640 1 --2- 172.21.15.117:0/56375172 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f279806c2b0 0x7f279806e770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f27b406ee50 tx=0x7f27a4007c10 comp rx=0 tx=0).stop 2024-09-19T08:37:54.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.778+0000 7f27bc6d9640 1 -- 172.21.15.117:0/56375172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b40d0370 msgr2=0x7f27b413e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:54.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.778+0000 7f27bc6d9640 1 --2- 172.21.15.117:0/56375172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b40d0370 0x7f27b413e100 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f27b000c7f0 tx=0x7f27b000cbf0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.778+0000 7f27bc6d9640 1 -- 172.21.15.117:0/56375172 shutdown_connections 2024-09-19T08:37:54.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.778+0000 7f27bc6d9640 1 --2- 172.21.15.117:0/56375172 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f279806c2b0 0x7f279806e770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.778+0000 7f27bc6d9640 1 --2- 172.21.15.117:0/56375172 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27b4142170 0x7f27b415b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.778+0000 7f27bc6d9640 1 --2- 172.21.15.117:0/56375172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27b4141680 0x7f27b40b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.778+0000 7f27bc6d9640 1 --2- 172.21.15.117:0/56375172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b40d0370 0x7f27b413e100 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.778+0000 7f27bc6d9640 1 -- 172.21.15.117:0/56375172 >> 172.21.15.117:0/56375172 conn(0x7f27b40b3ed0 msgr2=0x7f27b40ce220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:54.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.778+0000 7f27bc6d9640 1 -- 172.21.15.117:0/56375172 shutdown_connections 2024-09-19T08:37:54.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.778+0000 7f27bc6d9640 1 -- 172.21.15.117:0/56375172 wait complete. 2024-09-19T08:37:54.789 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:37:54.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.887+0000 7ff16c65e640 1 Processor -- start 2024-09-19T08:37:54.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.887+0000 7ff16c65e640 1 -- start start 2024-09-19T08:37:54.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.888+0000 7ff16c65e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff16415b120 0x7ff16406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:54.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.888+0000 7ff16c65e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1640d0bc0 0x7ff16406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:54.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.888+0000 7ff16c65e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff16415b500 con 0x7ff16406dec0 2024-09-19T08:37:54.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.888+0000 7ff16c65e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff16406e940 con 0x7ff16415b120 2024-09-19T08:37:54.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.888+0000 7ff16c65e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7ff16406ec20 con 0x7ff1640d0bc0 2024-09-19T08:37:54.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.888+0000 7ff16a3fa640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff16415b120 0x7ff16406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:54.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.888+0000 7ff169bf9640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7ff16406dec0 0x7ff1640d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:52736/0 (socket says 172.21.15.117:52736) 2024-09-19T08:37:54.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.888+0000 7ff169bf9640 1 -- 172.21.15.117:0/1024495852 learned_addr learned my addr 172.21.15.117:0/1024495852 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:54.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.888+0000 7ff16a3fa640 1 -- 172.21.15.117:0/1024495852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1640d0bc0 msgr2=0x7ff16406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:54.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.888+0000 7ff16a3fa640 1 --2- 172.21.15.117:0/1024495852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1640d0bc0 0x7ff16406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.888+0000 7ff16a3fa640 1 -- 172.21.15.117:0/1024495852 >> v1:172.21.15.117:6789/0 conn(0x7ff16406dec0 legacy=0x7ff1640d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:54.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.888+0000 7ff16a3fa640 1 -- 172.21.15.117:0/1024495852 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff16406ef00 con 0x7ff16415b120 2024-09-19T08:37:54.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.888+0000 7ff1693f8640 1 -- 172.21.15.117:0/1024495852 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3787381664 0 0) 0x7ff16415b500 con 0x7ff16406dec0 2024-09-19T08:37:54.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.889+0000 7ff16a3fa640 1 --2- 172.21.15.117:0/1024495852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff16415b120 0x7ff16406f9e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff1600097a0 tx=0x7ff16002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e9a70bda067c2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:54.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.889+0000 7ff1693f8640 1 -- 172.21.15.117:0/1024495852 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff160037070 con 0x7ff16415b120 2024-09-19T08:37:54.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.889+0000 7ff1693f8640 1 -- 172.21.15.117:0/1024495852 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff160032440 con 0x7ff16415b120 2024-09-19T08:37:54.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.889+0000 7ff1693f8640 1 -- 172.21.15.117:0/1024495852 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff160032810 con 0x7ff16415b120 2024-09-19T08:37:54.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.889+0000 7ff16c65e640 1 -- 172.21.15.117:0/1024495852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff16415b120 msgr2=0x7ff16406f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:54.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.889+0000 7ff16c65e640 1 --2- 172.21.15.117:0/1024495852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff16415b120 0x7ff16406f9e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff1600097a0 tx=0x7ff16002a1a0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.890+0000 7ff16c65e640 1 -- 172.21.15.117:0/1024495852 shutdown_connections 2024-09-19T08:37:54.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.890+0000 7ff16c65e640 1 --2- 172.21.15.117:0/1024495852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1640d0bc0 0x7ff16406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.890+0000 7ff16c65e640 1 --2- 172.21.15.117:0/1024495852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff16415b120 0x7ff16406f9e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.890+0000 7ff16c65e640 1 -- 172.21.15.117:0/1024495852 >> 172.21.15.117:0/1024495852 conn(0x7ff16406bdf0 msgr2=0x7ff16406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:54.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.890+0000 7ff16c65e640 1 -- 172.21.15.117:0/1024495852 shutdown_connections 2024-09-19T08:37:54.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.890+0000 7ff16c65e640 1 -- 172.21.15.117:0/1024495852 wait complete. 2024-09-19T08:37:54.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.891+0000 7ff16c65e640 1 Processor -- start 2024-09-19T08:37:54.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.891+0000 7ff16c65e640 1 -- start start 2024-09-19T08:37:54.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.891+0000 7ff16c65e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff16406dec0 0x7ff16415e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.891+0000 7ff16c65e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1640d0bc0 0x7ff1640b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.891+0000 7ff16c65e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff16415b120 0x7ff1640ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.891+0000 7ff16c65e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff1640ce060 con 0x7ff16415b120 2024-09-19T08:37:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.891+0000 7ff16c65e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff16406f4c0 con 0x7ff16406dec0 2024-09-19T08:37:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.891+0000 7ff16c65e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7ff1640c5160 con 0x7ff1640d0bc0 2024-09-19T08:37:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.892+0000 7ff16abfb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff16415b120 0x7ff1640ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.892+0000 7ff16abfb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff16415b120 0x7ff1640ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57340/0 (socket says 172.21.15.117:57340) 2024-09-19T08:37:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.892+0000 7ff16abfb640 1 -- 172.21.15.117:0/2321206325 learned_addr learned my addr 172.21.15.117:0/2321206325 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.892+0000 7ff16a3fa640 1 --2- 172.21.15.117:0/2321206325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff16406dec0 0x7ff16415e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.892+0000 7ff16abfb640 1 -- 172.21.15.117:0/2321206325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1640d0bc0 msgr2=0x7ff1640b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.892+0000 7ff169bf9640 1 --2- 172.21.15.117:0/2321206325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1640d0bc0 0x7ff1640b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.892+0000 7ff16abfb640 1 --2- 172.21.15.117:0/2321206325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1640d0bc0 0x7ff1640b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.892+0000 7ff16abfb640 1 -- 172.21.15.117:0/2321206325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff16406dec0 msgr2=0x7ff16415e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:54.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.892+0000 7ff16abfb640 1 --2- 172.21.15.117:0/2321206325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff16406dec0 0x7ff16415e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:54.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.892+0000 7ff16abfb640 1 -- 172.21.15.117:0/2321206325 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1640b26d0 con 0x7ff16415b120 2024-09-19T08:37:54.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.892+0000 7ff16a3fa640 1 --2- 172.21.15.117:0/2321206325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff16406dec0 0x7ff16415e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:54.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.892+0000 7ff169bf9640 1 --2- 172.21.15.117:0/2321206325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1640d0bc0 0x7ff1640b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:54.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.892+0000 7ff16abfb640 1 --2- 172.21.15.117:0/2321206325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff16415b120 0x7ff1640ccdd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00ba10 tx=0x7ff15c00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:54.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.892+0000 7ff15affd640 1 -- 172.21.15.117:0/2321206325 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15c019070 con 0x7ff16415b120 2024-09-19T08:37:54.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.892+0000 7ff15affd640 1 -- 172.21.15.117:0/2321206325 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff15c00cac0 con 0x7ff16415b120 2024-09-19T08:37:54.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.892+0000 7ff16c65e640 1 -- 172.21.15.117:0/2321206325 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1640b29b0 con 0x7ff16415b120 2024-09-19T08:37:54.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.892+0000 7ff15affd640 1 -- 172.21.15.117:0/2321206325 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15c014440 con 0x7ff16415b120 2024-09-19T08:37:54.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.892+0000 7ff16c65e640 1 -- 172.21.15.117:0/2321206325 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff164071ee0 con 0x7ff16415b120 2024-09-19T08:37:54.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.893+0000 7ff16c65e640 1 -- 172.21.15.117:0/2321206325 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff16406e330 con 0x7ff16415b120 2024-09-19T08:37:54.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.894+0000 7ff15affd640 1 -- 172.21.15.117:0/2321206325 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff15c01c070 con 0x7ff16415b120 2024-09-19T08:37:54.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.894+0000 7ff15affd640 1 --2- 172.21.15.117:0/2321206325 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff14806c2e0 0x7ff14806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:54.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.894+0000 7ff15affd640 1 -- 172.21.15.117:0/2321206325 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7ff15c08b3c0 con 0x7ff16415b120 2024-09-19T08:37:54.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.894+0000 7ff16a3fa640 1 --2- 172.21.15.117:0/2321206325 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff14806c2e0 0x7ff14806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:54.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.895+0000 7ff16a3fa640 1 --2- 172.21.15.117:0/2321206325 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff14806c2e0 0x7ff14806e7a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff160034000 tx=0x7ff16002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:54.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:54.898+0000 7ff15affd640 1 -- 172.21.15.117:0/2321206325 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff15c059850 con 0x7ff16415b120 2024-09-19T08:37:55.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.065+0000 7ff16c65e640 1 -- 172.21.15.117:0/2321206325 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff16406ce20 con 0x7ff16415b120 2024-09-19T08:37:55.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.067+0000 7ff15affd640 1 -- 172.21.15.117:0/2321206325 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18745 (secure 0 0 0) 0x7ff15c059150 con 0x7ff16415b120 2024-09-19T08:37:55.067 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:55.067 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":27,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:37:54.439870+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:37:10.463000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:37:11.619440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:37:15.342435+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":0,"to":7}]},{"pgid":"4.e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:37:55.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.069+0000 7ff16c65e640 1 -- 172.21.15.117:0/2321206325 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff14806c2e0 msgr2=0x7ff14806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:55.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.069+0000 7ff16c65e640 1 --2- 172.21.15.117:0/2321206325 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff14806c2e0 0x7ff14806e7a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff160034000 tx=0x7ff16002e000 comp rx=0 tx=0).stop 2024-09-19T08:37:55.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.069+0000 7ff16c65e640 1 -- 172.21.15.117:0/2321206325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff16415b120 msgr2=0x7ff1640ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:55.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.069+0000 7ff16c65e640 1 --2- 172.21.15.117:0/2321206325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff16415b120 0x7ff1640ccdd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00ba10 tx=0x7ff15c00bed0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.069+0000 7ff16c65e640 1 -- 172.21.15.117:0/2321206325 shutdown_connections 2024-09-19T08:37:55.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.069+0000 7ff16c65e640 1 --2- 172.21.15.117:0/2321206325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff16415b120 0x7ff1640ccdd0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.069+0000 7ff16c65e640 1 --2- 172.21.15.117:0/2321206325 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff14806c2e0 0x7ff14806e7a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.069+0000 7ff16c65e640 1 --2- 172.21.15.117:0/2321206325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1640d0bc0 0x7ff1640b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.069+0000 7ff16c65e640 1 --2- 172.21.15.117:0/2321206325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff16406dec0 0x7ff16415e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.069+0000 7ff16c65e640 1 -- 172.21.15.117:0/2321206325 >> 172.21.15.117:0/2321206325 conn(0x7ff16406bdf0 msgr2=0x7ff1640ceb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:55.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.069+0000 7ff16c65e640 1 -- 172.21.15.117:0/2321206325 shutdown_connections 2024-09-19T08:37:55.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.069+0000 7ff16c65e640 1 -- 172.21.15.117:0/2321206325 wait complete. 2024-09-19T08:37:55.080 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T08:37:55.080 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:37:55.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.178+0000 7f1c545c4640 1 Processor -- start 2024-09-19T08:37:55.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.178+0000 7f1c545c4640 1 -- start start 2024-09-19T08:37:55.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.179+0000 7f1c545c4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1c4c147e70 0x7f1c4c0cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:55.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.179+0000 7f1c545c4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c4c0cfb00 con 0x7f1c4c06cd20 2024-09-19T08:37:55.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.179+0000 7f1c545c4640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c4c15f450 con 0x7f1c4c15ef80 2024-09-19T08:37:55.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.179+0000 7f1c545c4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f1c4c148250 con 0x7f1c4c147e70 2024-09-19T08:37:55.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.179+0000 7f1c52360640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1c4c147e70 0x7f1c4c0cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:55.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.179+0000 7f1c51b5f640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f1c4c06cd20 0x7f1c4c15e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:52742/0 (socket says 172.21.15.117:52742) 2024-09-19T08:37:55.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.179+0000 7f1c51b5f640 1 -- 172.21.15.117:0/2687160514 learned_addr learned my addr 172.21.15.117:0/2687160514 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:55.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.179+0000 7f1c52360640 1 -- 172.21.15.117:0/2687160514 >> v1:172.21.15.146:6789/0 conn(0x7f1c4c15ef80 legacy=0x7f1c4c0cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:55.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.179+0000 7f1c52360640 1 -- 172.21.15.117:0/2687160514 >> v1:172.21.15.117:6789/0 conn(0x7f1c4c06cd20 legacy=0x7f1c4c15e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:55.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.179+0000 7f1c52360640 1 -- 172.21.15.117:0/2687160514 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4c15f730 con 0x7f1c4c147e70 2024-09-19T08:37:55.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.179+0000 7f1c5135e640 1 -- 172.21.15.117:0/2687160514 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 219855597 0 0) 0x7f1c4c0cfb00 con 0x7f1c4c06cd20 2024-09-19T08:37:55.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.180+0000 7f1c52360640 1 --2- 172.21.15.117:0/2687160514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c4c147e70 0x7f1c4c0cf5c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1c480097a0 tx=0x7f1c4802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceae02e349caa4c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:55.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.180+0000 7f1c5135e640 1 -- 172.21.15.117:0/2687160514 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48037070 con 0x7f1c4c147e70 2024-09-19T08:37:55.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.180+0000 7f1c5135e640 1 -- 172.21.15.117:0/2687160514 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c4802ae50 con 0x7f1c4c147e70 2024-09-19T08:37:55.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.180+0000 7f1c5135e640 1 -- 172.21.15.117:0/2687160514 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48032660 con 0x7f1c4c147e70 2024-09-19T08:37:55.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.180+0000 7f1c545c4640 1 -- 172.21.15.117:0/2687160514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c4c147e70 msgr2=0x7f1c4c0cf5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:55.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.180+0000 7f1c545c4640 1 --2- 172.21.15.117:0/2687160514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c4c147e70 0x7f1c4c0cf5c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1c480097a0 tx=0x7f1c4802a140 comp rx=0 tx=0).stop 2024-09-19T08:37:55.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.181+0000 7f1c545c4640 1 -- 172.21.15.117:0/2687160514 shutdown_connections 2024-09-19T08:37:55.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.181+0000 7f1c545c4640 1 --2- 172.21.15.117:0/2687160514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c4c147e70 0x7f1c4c0cf5c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.181+0000 7f1c545c4640 1 -- 172.21.15.117:0/2687160514 >> 172.21.15.117:0/2687160514 conn(0x7f1c4c0b3ed0 msgr2=0x7f1c4c0b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:55.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.181+0000 7f1c545c4640 1 -- 172.21.15.117:0/2687160514 shutdown_connections 2024-09-19T08:37:55.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.181+0000 7f1c545c4640 1 -- 172.21.15.117:0/2687160514 wait complete. 2024-09-19T08:37:55.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.182+0000 7f1c545c4640 1 Processor -- start 2024-09-19T08:37:55.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.182+0000 7f1c545c4640 1 -- start start 2024-09-19T08:37:55.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.182+0000 7f1c545c4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c4c06cd20 0x7f1c4c0b6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:55.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.182+0000 7f1c545c4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c4c147e70 0x7f1c4c1f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:55.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.182+0000 7f1c545c4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c4c15ef80 0x7f1c4c0b7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:55.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.182+0000 7f1c545c4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c0cedc0 con 0x7f1c4c06cd20 2024-09-19T08:37:55.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.182+0000 7f1c545c4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c0cf130 con 0x7f1c4c15ef80 2024-09-19T08:37:55.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.182+0000 7f1c545c4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f1c4c0722f0 con 0x7f1c4c147e70 2024-09-19T08:37:55.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.183+0000 7f1c52360640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c4c06cd20 0x7f1c4c0b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:55.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.183+0000 7f1c52360640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c4c06cd20 0x7f1c4c0b6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57372/0 (socket says 172.21.15.117:57372) 2024-09-19T08:37:55.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.183+0000 7f1c52360640 1 -- 172.21.15.117:0/1463518353 learned_addr learned my addr 172.21.15.117:0/1463518353 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:55.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.183+0000 7f1c51b5f640 1 --2- 172.21.15.117:0/1463518353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c4c147e70 0x7f1c4c1f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:55.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.183+0000 7f1c52360640 1 -- 172.21.15.117:0/1463518353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c4c147e70 msgr2=0x7f1c4c1f4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:55.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.183+0000 7f1c52360640 1 --2- 172.21.15.117:0/1463518353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c4c147e70 0x7f1c4c1f4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.183+0000 7f1c52360640 1 -- 172.21.15.117:0/1463518353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c4c15ef80 msgr2=0x7f1c4c0b7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:55.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.183+0000 7f1c52360640 1 --2- 172.21.15.117:0/1463518353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c4c15ef80 0x7f1c4c0b7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.183+0000 7f1c52360640 1 -- 172.21.15.117:0/1463518353 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4c0b5680 con 0x7f1c4c06cd20 2024-09-19T08:37:55.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.183+0000 7f1c52360640 1 --2- 172.21.15.117:0/1463518353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c4c06cd20 0x7f1c4c0b6990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1c480097a0 tx=0x7f1c480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:55.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.183+0000 7f1c42ffd640 1 -- 172.21.15.117:0/1463518353 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48042070 con 0x7f1c4c06cd20 2024-09-19T08:37:55.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.183+0000 7f1c42ffd640 1 -- 172.21.15.117:0/1463518353 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c4803e670 con 0x7f1c4c06cd20 2024-09-19T08:37:55.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.183+0000 7f1c545c4640 1 -- 172.21.15.117:0/1463518353 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c4c0b5960 con 0x7f1c4c06cd20 2024-09-19T08:37:55.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.183+0000 7f1c42ffd640 1 -- 172.21.15.117:0/1463518353 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48037040 con 0x7f1c4c06cd20 2024-09-19T08:37:55.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.183+0000 7f1c545c4640 1 -- 172.21.15.117:0/1463518353 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c4c0b5f20 con 0x7f1c4c06cd20 2024-09-19T08:37:55.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.184+0000 7f1c545c4640 1 -- 172.21.15.117:0/1463518353 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c4c06d190 con 0x7f1c4c06cd20 2024-09-19T08:37:55.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.185+0000 7f1c42ffd640 1 -- 172.21.15.117:0/1463518353 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1c48045070 con 0x7f1c4c06cd20 2024-09-19T08:37:55.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.185+0000 7f1c42ffd640 1 --2- 172.21.15.117:0/1463518353 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1c3006c2b0 0x7f1c3006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:55.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.185+0000 7f1c42ffd640 1 -- 172.21.15.117:0/1463518353 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f1c480abf40 con 0x7f1c4c06cd20 2024-09-19T08:37:55.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.185+0000 7f1c51b5f640 1 --2- 172.21.15.117:0/1463518353 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1c3006c2b0 0x7f1c3006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:55.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.186+0000 7f1c51b5f640 1 --2- 172.21.15.117:0/1463518353 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1c3006c2b0 0x7f1c3006e770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c007fd0 tx=0x7f1c3c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:55.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.189+0000 7f1c42ffd640 1 -- 172.21.15.117:0/1463518353 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1c4807a4f0 con 0x7f1c4c06cd20 2024-09-19T08:37:55.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.389+0000 7f1c545c4640 1 -- 172.21.15.117:0/1463518353 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c4c0690c0 con 0x7f1c4c06cd20 2024-09-19T08:37:55.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.389+0000 7f1c42ffd640 1 -- 172.21.15.117:0/1463518353 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7f1c48079df0 con 0x7f1c4c06cd20 2024-09-19T08:37:55.389 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:55.389 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":9,"btime":"2024-09-19T08:37:32:382208+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2592540396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2592540396},{"type":"v1","addr":"172.21.15.117:6833","nonce":2592540396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3561335184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3561335184},{"type":"v1","addr":"172.21.15.117:6835","nonce":3561335184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/2623207604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2623207604},{"type":"v1","addr":"172.21.15.146:6837","nonce":2623207604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:37:12.640173+0000","modified":"2024-09-19T08:37:31.712060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6836/2942334805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2942334805},{"type":"v1","addr":"172.21.15.146:6836","nonce":2942334805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4303,"qdb_cluster":[4303]},"id":1}]} 2024-09-19T08:37:55.390 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 9 2024-09-19T08:37:55.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.391+0000 7f1c545c4640 1 -- 172.21.15.117:0/1463518353 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1c3006c2b0 msgr2=0x7f1c3006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:55.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.391+0000 7f1c545c4640 1 --2- 172.21.15.117:0/1463518353 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1c3006c2b0 0x7f1c3006e770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c007fd0 tx=0x7f1c3c009040 comp rx=0 tx=0).stop 2024-09-19T08:37:55.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.391+0000 7f1c545c4640 1 -- 172.21.15.117:0/1463518353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c4c06cd20 msgr2=0x7f1c4c0b6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:55.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.391+0000 7f1c545c4640 1 --2- 172.21.15.117:0/1463518353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c4c06cd20 0x7f1c4c0b6990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1c480097a0 tx=0x7f1c480046c0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.391+0000 7f1c545c4640 1 -- 172.21.15.117:0/1463518353 shutdown_connections 2024-09-19T08:37:55.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.391+0000 7f1c545c4640 1 --2- 172.21.15.117:0/1463518353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c4c15ef80 0x7f1c4c0b7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.391+0000 7f1c545c4640 1 --2- 172.21.15.117:0/1463518353 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1c3006c2b0 0x7f1c3006e770 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.391+0000 7f1c545c4640 1 --2- 172.21.15.117:0/1463518353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c4c147e70 0x7f1c4c1f4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.391+0000 7f1c545c4640 1 --2- 172.21.15.117:0/1463518353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c4c06cd20 0x7f1c4c0b6990 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.391+0000 7f1c545c4640 1 -- 172.21.15.117:0/1463518353 >> 172.21.15.117:0/1463518353 conn(0x7f1c4c0b3ed0 msgr2=0x7f1c4c0b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:55.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.391+0000 7f1c545c4640 1 -- 172.21.15.117:0/1463518353 shutdown_connections 2024-09-19T08:37:55.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.391+0000 7f1c545c4640 1 -- 172.21.15.117:0/1463518353 wait complete. 2024-09-19T08:37:55.402 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:37:55.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.503+0000 7f587d4d7640 1 Processor -- start 2024-09-19T08:37:55.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.503+0000 7f587d4d7640 1 -- start start 2024-09-19T08:37:55.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.504+0000 7f587d4d7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f58780d0070 0x7f587815f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:55.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.504+0000 7f587d4d7640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f58780d4130 0x7f58780d4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:55.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.504+0000 7f587d4d7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58780d1b10 con 0x7f587815f0d0 2024-09-19T08:37:55.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.504+0000 7f587d4d7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f58780cf2b0 con 0x7f58780d0070 2024-09-19T08:37:55.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.504+0000 7f587d4d7640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f58780cf590 con 0x7f58780d4130 2024-09-19T08:37:55.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.504+0000 7f5876ffd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f587815f0d0 0x7f58780d1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:52756/0 (socket says 172.21.15.117:52756) 2024-09-19T08:37:55.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.504+0000 7f5876ffd640 1 -- 172.21.15.117:0/604331702 learned_addr learned my addr 172.21.15.117:0/604331702 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:55.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.504+0000 7f58767fc640 1 --2- 172.21.15.117:0/604331702 >> v2:172.21.15.117:3300/0 conn(0x7f58780d0070 0x7f587815f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:55.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.504+0000 7f58777fe640 1 --2- 172.21.15.117:0/604331702 >> v2:172.21.15.146:3300/0 conn(0x7f58780d4130 0x7f58780d4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:55.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.504+0000 7f58767fc640 1 -- 172.21.15.117:0/604331702 >> v2:172.21.15.146:3300/0 conn(0x7f58780d4130 msgr2=0x7f58780d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:55.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.504+0000 7f58767fc640 1 --2- 172.21.15.117:0/604331702 >> v2:172.21.15.146:3300/0 conn(0x7f58780d4130 0x7f58780d4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.504+0000 7f58767fc640 1 -- 172.21.15.117:0/604331702 >> v1:172.21.15.117:6789/0 conn(0x7f587815f0d0 legacy=0x7f58780d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:55.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.504+0000 7f58767fc640 1 -- 172.21.15.117:0/604331702 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58780cf870 con 0x7f58780d0070 2024-09-19T08:37:55.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.504+0000 7f5875ffb640 1 -- 172.21.15.117:0/604331702 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 259922299 0 0) 0x7f58780d1b10 con 0x7f587815f0d0 2024-09-19T08:37:55.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.505+0000 7f58767fc640 1 --2- 172.21.15.117:0/604331702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58780d0070 0x7f587815f4b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f58780d04e0 tx=0x7f586002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7642d13c6064328a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:55.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.505+0000 7f5875ffb640 1 -- 172.21.15.117:0/604331702 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5860037070 con 0x7f58780d0070 2024-09-19T08:37:55.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.505+0000 7f5875ffb640 1 -- 172.21.15.117:0/604331702 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5860032440 con 0x7f58780d0070 2024-09-19T08:37:55.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.505+0000 7f5875ffb640 1 -- 172.21.15.117:0/604331702 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586002ae60 con 0x7f58780d0070 2024-09-19T08:37:55.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.506+0000 7f587d4d7640 1 -- 172.21.15.117:0/604331702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58780d0070 msgr2=0x7f587815f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:55.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.506+0000 7f587d4d7640 1 --2- 172.21.15.117:0/604331702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58780d0070 0x7f587815f4b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f58780d04e0 tx=0x7f586002a110 comp rx=0 tx=0).stop 2024-09-19T08:37:55.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.506+0000 7f587d4d7640 1 -- 172.21.15.117:0/604331702 shutdown_connections 2024-09-19T08:37:55.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.506+0000 7f587d4d7640 1 --2- 172.21.15.117:0/604331702 >> v2:172.21.15.146:3300/0 conn(0x7f58780d4130 0x7f58780d4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.506+0000 7f587d4d7640 1 --2- 172.21.15.117:0/604331702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58780d0070 0x7f587815f4b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.506+0000 7f587d4d7640 1 -- 172.21.15.117:0/604331702 >> 172.21.15.117:0/604331702 conn(0x7f587809d760 msgr2=0x7f587808bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:55.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.506+0000 7f587d4d7640 1 -- 172.21.15.117:0/604331702 shutdown_connections 2024-09-19T08:37:55.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.506+0000 7f587d4d7640 1 -- 172.21.15.117:0/604331702 wait complete. 2024-09-19T08:37:55.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.507+0000 7f587d4d7640 1 Processor -- start 2024-09-19T08:37:55.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.507+0000 7f587d4d7640 1 -- start start 2024-09-19T08:37:55.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.508+0000 7f587d4d7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58780d0070 0x7f58781518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:55.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.508+0000 7f587d4d7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58780d4130 0x7f5878159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:55.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.508+0000 7f587d4d7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f587815f0d0 0x7f5878159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:55.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.508+0000 7f587d4d7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f58780cef60 con 0x7f58780d4130 2024-09-19T08:37:55.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.508+0000 7f587d4d7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f58780d4aa0 con 0x7f58780d0070 2024-09-19T08:37:55.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.508+0000 7f587d4d7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f58780b2f70 con 0x7f587815f0d0 2024-09-19T08:37:55.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.508+0000 7f58767fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58780d4130 0x7f5878159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:55.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.508+0000 7f58767fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58780d4130 0x7f5878159690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57386/0 (socket says 172.21.15.117:57386) 2024-09-19T08:37:55.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.508+0000 7f58767fc640 1 -- 172.21.15.117:0/4013111951 learned_addr learned my addr 172.21.15.117:0/4013111951 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:55.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.508+0000 7f5876ffd640 1 --2- 172.21.15.117:0/4013111951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58780d0070 0x7f58781518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:55.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.508+0000 7f58777fe640 1 --2- 172.21.15.117:0/4013111951 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f587815f0d0 0x7f5878159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:55.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.508+0000 7f58767fc640 1 -- 172.21.15.117:0/4013111951 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f587815f0d0 msgr2=0x7f5878159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:55.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.508+0000 7f58767fc640 1 --2- 172.21.15.117:0/4013111951 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f587815f0d0 0x7f5878159bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.508+0000 7f58767fc640 1 -- 172.21.15.117:0/4013111951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58780d0070 msgr2=0x7f58781518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:55.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.508+0000 7f58767fc640 1 --2- 172.21.15.117:0/4013111951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58780d0070 0x7f58781518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.508+0000 7f58767fc640 1 -- 172.21.15.117:0/4013111951 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58780b8aa0 con 0x7f58780d4130 2024-09-19T08:37:55.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.508+0000 7f58777fe640 1 --2- 172.21.15.117:0/4013111951 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f587815f0d0 0x7f5878159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:55.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.508+0000 7f58767fc640 1 --2- 172.21.15.117:0/4013111951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58780d4130 0x7f5878159690 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5860000c00 tx=0x7f58600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:55.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.509+0000 7f586f7fe640 1 -- 172.21.15.117:0/4013111951 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5860037040 con 0x7f58780d4130 2024-09-19T08:37:55.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.509+0000 7f586f7fe640 1 -- 172.21.15.117:0/4013111951 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5860042070 con 0x7f58780d4130 2024-09-19T08:37:55.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.509+0000 7f586f7fe640 1 -- 172.21.15.117:0/4013111951 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5860030bd0 con 0x7f58780d4130 2024-09-19T08:37:55.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.509+0000 7f587d4d7640 1 -- 172.21.15.117:0/4013111951 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58780b8d80 con 0x7f58780d4130 2024-09-19T08:37:55.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.509+0000 7f587d4d7640 1 -- 172.21.15.117:0/4013111951 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58780b9340 con 0x7f58780d4130 2024-09-19T08:37:55.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.510+0000 7f587d4d7640 1 -- 172.21.15.117:0/4013111951 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58780d4560 con 0x7f58780d4130 2024-09-19T08:37:55.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.510+0000 7f586f7fe640 1 -- 172.21.15.117:0/4013111951 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5860047460 con 0x7f58780d4130 2024-09-19T08:37:55.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.510+0000 7f586f7fe640 1 --2- 172.21.15.117:0/4013111951 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f585806c2b0 0x7f585806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:55.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.511+0000 7f586f7fe640 1 -- 172.21.15.117:0/4013111951 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f58600ac360 con 0x7f58780d4130 2024-09-19T08:37:55.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.511+0000 7f5876ffd640 1 --2- 172.21.15.117:0/4013111951 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f585806c2b0 0x7f585806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:55.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.511+0000 7f5876ffd640 1 --2- 172.21.15.117:0/4013111951 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f585806c2b0 0x7f585806e770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f58680012e0 tx=0x7f5868009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:55.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.515+0000 7f586f7fe640 1 -- 172.21.15.117:0/4013111951 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5860032e20 con 0x7f58780d4130 2024-09-19T08:37:55.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.712+0000 7f587d4d7640 1 -- 172.21.15.117:0/4013111951 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f587806d710 con 0x7f58780d4130 2024-09-19T08:37:55.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.713+0000 7f586f7fe640 1 -- 172.21.15.117:0/4013111951 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7f586007a7f0 con 0x7f58780d4130 2024-09-19T08:37:55.713 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:55.713 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":9,"btime":"2024-09-19T08:37:32:382208+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/2592540396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2592540396},{"type":"v1","addr":"172.21.15.117:6833","nonce":2592540396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3561335184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3561335184},{"type":"v1","addr":"172.21.15.117:6835","nonce":3561335184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/2623207604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2623207604},{"type":"v1","addr":"172.21.15.146:6837","nonce":2623207604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:37:12.640173+0000","modified":"2024-09-19T08:37:31.712060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6836/2942334805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2942334805},{"type":"v1","addr":"172.21.15.146:6836","nonce":2942334805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4303,"qdb_cluster":[4303]},"id":1}]} 2024-09-19T08:37:55.713 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 9 2024-09-19T08:37:55.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.715+0000 7f587d4d7640 1 -- 172.21.15.117:0/4013111951 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f585806c2b0 msgr2=0x7f585806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:55.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.715+0000 7f587d4d7640 1 --2- 172.21.15.117:0/4013111951 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f585806c2b0 0x7f585806e770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f58680012e0 tx=0x7f5868009040 comp rx=0 tx=0).stop 2024-09-19T08:37:55.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.715+0000 7f587d4d7640 1 -- 172.21.15.117:0/4013111951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58780d4130 msgr2=0x7f5878159690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:55.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.715+0000 7f587d4d7640 1 --2- 172.21.15.117:0/4013111951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58780d4130 0x7f5878159690 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5860000c00 tx=0x7f58600046c0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.715+0000 7f587d4d7640 1 -- 172.21.15.117:0/4013111951 shutdown_connections 2024-09-19T08:37:55.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.715+0000 7f587d4d7640 1 --2- 172.21.15.117:0/4013111951 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f585806c2b0 0x7f585806e770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.715+0000 7f587d4d7640 1 --2- 172.21.15.117:0/4013111951 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f587815f0d0 0x7f5878159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.715+0000 7f587d4d7640 1 --2- 172.21.15.117:0/4013111951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58780d4130 0x7f5878159690 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.715+0000 7f587d4d7640 1 --2- 172.21.15.117:0/4013111951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58780d0070 0x7f58781518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.715+0000 7f587d4d7640 1 -- 172.21.15.117:0/4013111951 >> 172.21.15.117:0/4013111951 conn(0x7f587809d760 msgr2=0x7f58780d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:55.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.715+0000 7f587d4d7640 1 -- 172.21.15.117:0/4013111951 shutdown_connections 2024-09-19T08:37:55.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.715+0000 7f587d4d7640 1 -- 172.21.15.117:0/4013111951 wait complete. 2024-09-19T08:37:55.726 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:37:55.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.823+0000 7f90d0c74640 1 Processor -- start 2024-09-19T08:37:55.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.823+0000 7f90d0c74640 1 -- start start 2024-09-19T08:37:55.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.824+0000 7f90d0c74640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f90cc15b120 0x7f90cc06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:55.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.824+0000 7f90d0c74640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f90cc06dec0 0x7f90cc06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:55.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.824+0000 7f90d0c74640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90cc15b500 con 0x7f90cc0d04b0 2024-09-19T08:37:55.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.824+0000 7f90d0c74640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f90cc06e940 con 0x7f90cc06dec0 2024-09-19T08:37:55.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.824+0000 7f90d0c74640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f90cc06ec20 con 0x7f90cc15b120 2024-09-19T08:37:55.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.824+0000 7f90c9d9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f90cc06dec0 0x7f90cc06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:55.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.824+0000 7f90cad9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f90cc0d04b0 0x7f90cc0c5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:52758/0 (socket says 172.21.15.117:52758) 2024-09-19T08:37:55.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.824+0000 7f90cad9d640 1 -- 172.21.15.117:0/3377249801 learned_addr learned my addr 172.21.15.117:0/3377249801 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:55.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.825+0000 7f90c9d9b640 1 -- 172.21.15.117:0/3377249801 >> v2:172.21.15.146:3300/0 conn(0x7f90cc15b120 msgr2=0x7f90cc06f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:55.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.825+0000 7f90ca59c640 1 --2- 172.21.15.117:0/3377249801 >> v2:172.21.15.146:3300/0 conn(0x7f90cc15b120 0x7f90cc06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:55.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.825+0000 7f90c9d9b640 1 --2- 172.21.15.117:0/3377249801 >> v2:172.21.15.146:3300/0 conn(0x7f90cc15b120 0x7f90cc06f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.825+0000 7f90c9d9b640 1 -- 172.21.15.117:0/3377249801 >> v1:172.21.15.117:6789/0 conn(0x7f90cc0d04b0 legacy=0x7f90cc0c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:55.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.825+0000 7f90c9d9b640 1 -- 172.21.15.117:0/3377249801 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90cc06ef00 con 0x7f90cc06dec0 2024-09-19T08:37:55.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.825+0000 7f90c959a640 1 -- 172.21.15.117:0/3377249801 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 226783895 0 0) 0x7f90cc15b500 con 0x7f90cc0d04b0 2024-09-19T08:37:55.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.825+0000 7f90c9d9b640 1 --2- 172.21.15.117:0/3377249801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc06dec0 0x7f90cc06e330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f90cc06cb50 tx=0x7f90c002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd329e5837b3e1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:55.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.826+0000 7f90c959a640 1 -- 172.21.15.117:0/3377249801 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c0037070 con 0x7f90cc06dec0 2024-09-19T08:37:55.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.826+0000 7f90c959a640 1 -- 172.21.15.117:0/3377249801 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c0032440 con 0x7f90cc06dec0 2024-09-19T08:37:55.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.826+0000 7f90c959a640 1 -- 172.21.15.117:0/3377249801 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c0032810 con 0x7f90cc06dec0 2024-09-19T08:37:55.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.826+0000 7f90d0c74640 1 -- 172.21.15.117:0/3377249801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc06dec0 msgr2=0x7f90cc06e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:55.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.826+0000 7f90d0c74640 1 --2- 172.21.15.117:0/3377249801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc06dec0 0x7f90cc06e330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f90cc06cb50 tx=0x7f90c002a1a0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.826+0000 7f90d0c74640 1 -- 172.21.15.117:0/3377249801 shutdown_connections 2024-09-19T08:37:55.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.826+0000 7f90d0c74640 1 --2- 172.21.15.117:0/3377249801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc06dec0 0x7f90cc06e330 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.826+0000 7f90d0c74640 1 --2- 172.21.15.117:0/3377249801 >> v2:172.21.15.146:3300/0 conn(0x7f90cc15b120 0x7f90cc06f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.826+0000 7f90d0c74640 1 -- 172.21.15.117:0/3377249801 >> 172.21.15.117:0/3377249801 conn(0x7f90cc06bdf0 msgr2=0x7f90cc06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:55.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.826+0000 7f90d0c74640 1 -- 172.21.15.117:0/3377249801 shutdown_connections 2024-09-19T08:37:55.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.826+0000 7f90d0c74640 1 -- 172.21.15.117:0/3377249801 wait complete. 2024-09-19T08:37:55.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.828+0000 7f90d0c74640 1 Processor -- start 2024-09-19T08:37:55.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.828+0000 7f90d0c74640 1 -- start start 2024-09-19T08:37:55.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.828+0000 7f90d0c74640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc06dec0 0x7f90cc1505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:55.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.828+0000 7f90d0c74640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90cc0d04b0 0x7f90cc157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:55.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.828+0000 7f90d0c74640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90cc15b120 0x7f90cc15b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:55.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.828+0000 7f90d0c74640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc0ce060 con 0x7f90cc06dec0 2024-09-19T08:37:55.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.828+0000 7f90d0c74640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc06f4c0 con 0x7f90cc0d04b0 2024-09-19T08:37:55.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.828+0000 7f90d0c74640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f90cc0d0900 con 0x7f90cc15b120 2024-09-19T08:37:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.828+0000 7f90ca59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc06dec0 0x7f90cc1505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.828+0000 7f90ca59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc06dec0 0x7f90cc1505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57410/0 (socket says 172.21.15.117:57410) 2024-09-19T08:37:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.828+0000 7f90ca59c640 1 -- 172.21.15.117:0/3760031025 learned_addr learned my addr 172.21.15.117:0/3760031025 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.829+0000 7f90c9d9b640 1 --2- 172.21.15.117:0/3760031025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90cc0d04b0 0x7f90cc157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.829+0000 7f90cad9d640 1 --2- 172.21.15.117:0/3760031025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90cc15b120 0x7f90cc15b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.829+0000 7f90ca59c640 1 -- 172.21.15.117:0/3760031025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90cc15b120 msgr2=0x7f90cc15b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.829+0000 7f90ca59c640 1 --2- 172.21.15.117:0/3760031025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90cc15b120 0x7f90cc15b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.829+0000 7f90ca59c640 1 -- 172.21.15.117:0/3760031025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90cc0d04b0 msgr2=0x7f90cc157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.829+0000 7f90ca59c640 1 --2- 172.21.15.117:0/3760031025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90cc0d04b0 0x7f90cc157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.829+0000 7f90ca59c640 1 -- 172.21.15.117:0/3760031025 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90cc156c50 con 0x7f90cc06dec0 2024-09-19T08:37:55.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.829+0000 7f90c9d9b640 1 --2- 172.21.15.117:0/3760031025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90cc0d04b0 0x7f90cc157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.829+0000 7f90cad9d640 1 --2- 172.21.15.117:0/3760031025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90cc15b120 0x7f90cc15b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:37:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.829+0000 7f90ca59c640 1 --2- 172.21.15.117:0/3760031025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc06dec0 0x7f90cc1505e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00eaa0 tx=0x7f90bc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.829+0000 7f90baffd640 1 -- 172.21.15.117:0/3760031025 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90bc004220 con 0x7f90cc06dec0 2024-09-19T08:37:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.829+0000 7f90baffd640 1 -- 172.21.15.117:0/3760031025 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90bc0043c0 con 0x7f90cc06dec0 2024-09-19T08:37:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.829+0000 7f90d0c74640 1 -- 172.21.15.117:0/3760031025 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90cc156f30 con 0x7f90cc06dec0 2024-09-19T08:37:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.829+0000 7f90baffd640 1 -- 172.21.15.117:0/3760031025 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90bc007ba0 con 0x7f90cc06dec0 2024-09-19T08:37:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.829+0000 7f90d0c74640 1 -- 172.21.15.117:0/3760031025 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90cc1574f0 con 0x7f90cc06dec0 2024-09-19T08:37:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.830+0000 7f90d0c74640 1 -- 172.21.15.117:0/3760031025 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90cc070190 con 0x7f90cc06dec0 2024-09-19T08:37:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.831+0000 7f90baffd640 1 -- 172.21.15.117:0/3760031025 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f90bc00b030 con 0x7f90cc06dec0 2024-09-19T08:37:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.831+0000 7f90baffd640 1 --2- 172.21.15.117:0/3760031025 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f90ac06c2e0 0x7f90ac06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:55.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.831+0000 7f90baffd640 1 -- 172.21.15.117:0/3760031025 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f90bc08da20 con 0x7f90cc06dec0 2024-09-19T08:37:55.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.831+0000 7f90c9d9b640 1 --2- 172.21.15.117:0/3760031025 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f90ac06c2e0 0x7f90ac06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:55.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.832+0000 7f90c9d9b640 1 --2- 172.21.15.117:0/3760031025 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f90ac06c2e0 0x7f90ac06e7a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f90c0034000 tx=0x7f90c002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:55.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:55.835+0000 7f90baffd640 1 -- 172.21.15.117:0/3760031025 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f90cc070190 con 0x7f90cc06dec0 2024-09-19T08:37:56.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.003+0000 7f90d0c74640 1 -- 172.21.15.117:0/3760031025 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90cc0d0cd0 con 0x7f90cc06dec0 2024-09-19T08:37:56.004 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.004+0000 7f90baffd640 1 -- 172.21.15.117:0/3760031025 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18745 (secure 0 0 0) 0x7f90bc05beb0 con 0x7f90cc06dec0 2024-09-19T08:37:56.004 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:37:56.004 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":28,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:37:55.445678+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:37:10.463000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:37:11.619440+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T08:37:15.342435+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":0,"to":7}]},{"pgid":"4.e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:37:56.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.006+0000 7f90d0c74640 1 -- 172.21.15.117:0/3760031025 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f90ac06c2e0 msgr2=0x7f90ac06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:56.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.006+0000 7f90d0c74640 1 --2- 172.21.15.117:0/3760031025 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f90ac06c2e0 0x7f90ac06e7a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f90c0034000 tx=0x7f90c002e000 comp rx=0 tx=0).stop 2024-09-19T08:37:56.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.006+0000 7f90d0c74640 1 -- 172.21.15.117:0/3760031025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc06dec0 msgr2=0x7f90cc1505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:56.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.006+0000 7f90d0c74640 1 --2- 172.21.15.117:0/3760031025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc06dec0 0x7f90cc1505e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00eaa0 tx=0x7f90bc00ef60 comp rx=0 tx=0).stop 2024-09-19T08:37:56.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.006+0000 7f90d0c74640 1 -- 172.21.15.117:0/3760031025 shutdown_connections 2024-09-19T08:37:56.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.006+0000 7f90d0c74640 1 --2- 172.21.15.117:0/3760031025 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f90ac06c2e0 0x7f90ac06e7a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:56.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.006+0000 7f90d0c74640 1 --2- 172.21.15.117:0/3760031025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90cc15b120 0x7f90cc15b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:56.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.006+0000 7f90d0c74640 1 --2- 172.21.15.117:0/3760031025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90cc0d04b0 0x7f90cc157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:56.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.006+0000 7f90d0c74640 1 --2- 172.21.15.117:0/3760031025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90cc06dec0 0x7f90cc1505e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:56.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.006+0000 7f90d0c74640 1 -- 172.21.15.117:0/3760031025 >> 172.21.15.117:0/3760031025 conn(0x7f90cc06bdf0 msgr2=0x7f90cc0cb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:56.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.006+0000 7f90d0c74640 1 -- 172.21.15.117:0/3760031025 shutdown_connections 2024-09-19T08:37:56.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.006+0000 7f90d0c74640 1 -- 172.21.15.117:0/3760031025 wait complete. 2024-09-19T08:37:56.017 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T08:37:56.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.117+0000 7fab49ced640 1 Processor -- start 2024-09-19T08:37:56.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.117+0000 7fab49ced640 1 -- start start 2024-09-19T08:37:56.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.117+0000 7fab49ced640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab4415b120 0x7fab4406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:56.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab49ced640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fab4406dec0 0x7fab4406e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:56.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab49ced640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab4415b500 con 0x7fab440d04b0 2024-09-19T08:37:56.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab49ced640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fab4406e940 con 0x7fab4406dec0 2024-09-19T08:37:56.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab49ced640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fab4406ec20 con 0x7fab4415b120 2024-09-19T08:37:56.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab43fff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fab440d04b0 0x7fab440c5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:52774/0 (socket says 172.21.15.117:52774) 2024-09-19T08:37:56.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab43fff640 1 -- 172.21.15.117:0/3122287318 learned_addr learned my addr 172.21.15.117:0/3122287318 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:56.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab42ffd640 1 --2- 172.21.15.117:0/3122287318 >> v2:172.21.15.146:3300/0 conn(0x7fab4406dec0 0x7fab4406e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:56.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab437fe640 1 --2- 172.21.15.117:0/3122287318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab4415b120 0x7fab4406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:56.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab427fc640 1 -- 172.21.15.117:0/3122287318 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1339046849 0 0) 0x7fab4415b500 con 0x7fab440d04b0 2024-09-19T08:37:56.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab427fc640 1 -- 172.21.15.117:0/3122287318 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab2c003520 con 0x7fab440d04b0 2024-09-19T08:37:56.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab427fc640 1 -- 172.21.15.117:0/3122287318 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1490604371 0 0) 0x7fab2c003520 con 0x7fab440d04b0 2024-09-19T08:37:56.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab427fc640 1 -- 172.21.15.117:0/3122287318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab4415b120 msgr2=0x7fab4406f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:56.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab427fc640 1 --2- 172.21.15.117:0/3122287318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab4415b120 0x7fab4406f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:56.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab427fc640 1 -- 172.21.15.117:0/3122287318 >> v2:172.21.15.146:3300/0 conn(0x7fab4406dec0 msgr2=0x7fab4406e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:56.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab427fc640 1 --2- 172.21.15.117:0/3122287318 >> v2:172.21.15.146:3300/0 conn(0x7fab4406dec0 0x7fab4406e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:56.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab427fc640 1 -- 172.21.15.117:0/3122287318 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4406ef00 con 0x7fab440d04b0 2024-09-19T08:37:56.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab427fc640 1 -- 172.21.15.117:0/3122287318 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7fab3c0019f0 con 0x7fab440d04b0 2024-09-19T08:37:56.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab427fc640 1 -- 172.21.15.117:0/3122287318 >> v1:172.21.15.117:6789/0 conn(0x7fab440d04b0 legacy=0x7fab440c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:56.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab427fc640 1 --2- 172.21.15.117:0/3122287318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab2c0039b0 0x7fab2c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:56.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab427fc640 1 --2- 172.21.15.117:0/3122287318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab4415b120 0x7fab2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:56.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab427fc640 1 --2- 172.21.15.117:0/3122287318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab2c004d40 0x7fab2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:56.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab427fc640 1 -- 172.21.15.117:0/3122287318 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fab4406e940 con 0x7fab2c0039b0 2024-09-19T08:37:56.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab427fc640 1 -- 172.21.15.117:0/3122287318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fab4406ec20 con 0x7fab2c004d40 2024-09-19T08:37:56.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab427fc640 1 -- 172.21.15.117:0/3122287318 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fab2c00b9c0 con 0x7fab4415b120 2024-09-19T08:37:56.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.118+0000 7fab437fe640 1 --2- 172.21.15.117:0/3122287318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab2c0039b0 0x7fab2c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:56.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.119+0000 7fab42ffd640 1 --2- 172.21.15.117:0/3122287318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab4415b120 0x7fab2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:56.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.119+0000 7fab43fff640 1 --2- 172.21.15.117:0/3122287318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab2c004d40 0x7fab2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:56.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.119+0000 7fab437fe640 1 -- 172.21.15.117:0/3122287318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab4415b120 msgr2=0x7fab2c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:56.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.119+0000 7fab437fe640 1 --2- 172.21.15.117:0/3122287318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab4415b120 0x7fab2c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:56.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.119+0000 7fab437fe640 1 -- 172.21.15.117:0/3122287318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab2c004d40 msgr2=0x7fab2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:56.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.119+0000 7fab437fe640 1 --2- 172.21.15.117:0/3122287318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab2c004d40 0x7fab2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:56.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.119+0000 7fab437fe640 1 -- 172.21.15.117:0/3122287318 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab2c003520 con 0x7fab2c0039b0 2024-09-19T08:37:56.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.119+0000 7fab437fe640 1 --2- 172.21.15.117:0/3122287318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab2c0039b0 0x7fab2c003dd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fab34009ac0 tx=0x7fab2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb18419d7ecef5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:56.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.119+0000 7fab427fc640 1 -- 172.21.15.117:0/3122287318 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab34036070 con 0x7fab2c0039b0 2024-09-19T08:37:56.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.119+0000 7fab427fc640 1 -- 172.21.15.117:0/3122287318 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab34031400 con 0x7fab2c0039b0 2024-09-19T08:37:56.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.119+0000 7fab427fc640 1 -- 172.21.15.117:0/3122287318 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab34009690 con 0x7fab2c0039b0 2024-09-19T08:37:56.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.120+0000 7fab49ced640 1 -- 172.21.15.117:0/3122287318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab2c0039b0 msgr2=0x7fab2c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:56.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.120+0000 7fab49ced640 1 --2- 172.21.15.117:0/3122287318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab2c0039b0 0x7fab2c003dd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fab34009ac0 tx=0x7fab2c005830 comp rx=0 tx=0).stop 2024-09-19T08:37:56.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.120+0000 7fab43fff640 1 -- 172.21.15.117:0/3122287318 reap_dead start 2024-09-19T08:37:56.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.120+0000 7fab49ced640 1 -- 172.21.15.117:0/3122287318 shutdown_connections 2024-09-19T08:37:56.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.120+0000 7fab49ced640 1 -- 172.21.15.117:0/3122287318 >> 172.21.15.117:0/3122287318 conn(0x7fab4406bdf0 msgr2=0x7fab4406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:56.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.120+0000 7fab49ced640 1 -- 172.21.15.117:0/3122287318 shutdown_connections 2024-09-19T08:37:56.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.120+0000 7fab49ced640 1 -- 172.21.15.117:0/3122287318 wait complete. 2024-09-19T08:37:56.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.121+0000 7fab49ced640 1 Processor -- start 2024-09-19T08:37:56.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.121+0000 7fab49ced640 1 -- start start 2024-09-19T08:37:56.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.122+0000 7fab49ced640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab2c0039b0 0x7fab44159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:56.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.122+0000 7fab49ced640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab440b1640 0x7fab441f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:56.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.122+0000 7fab49ced640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab440b1aa0 0x7fab441f73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:56.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.122+0000 7fab49ced640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fab440ce060 con 0x7fab440b1640 2024-09-19T08:37:56.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.122+0000 7fab49ced640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fab4406f4c0 con 0x7fab440b1aa0 2024-09-19T08:37:56.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.122+0000 7fab49ced640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fab4406f9e0 con 0x7fab2c0039b0 2024-09-19T08:37:56.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.122+0000 7fab42ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab440b1640 0x7fab441f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:56.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.122+0000 7fab42ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab440b1640 0x7fab441f6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57436/0 (socket says 172.21.15.117:57436) 2024-09-19T08:37:56.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.122+0000 7fab42ffd640 1 -- 172.21.15.117:0/1365885946 learned_addr learned my addr 172.21.15.117:0/1365885946 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:56.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.122+0000 7fab437fe640 1 --2- 172.21.15.117:0/1365885946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab2c0039b0 0x7fab44159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:56.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.122+0000 7fab43fff640 1 --2- 172.21.15.117:0/1365885946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab440b1aa0 0x7fab441f73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:56.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.122+0000 7fab42ffd640 1 -- 172.21.15.117:0/1365885946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab2c0039b0 msgr2=0x7fab44159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:56.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.122+0000 7fab42ffd640 1 --2- 172.21.15.117:0/1365885946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab2c0039b0 0x7fab44159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:56.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.122+0000 7fab42ffd640 1 -- 172.21.15.117:0/1365885946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab440b1aa0 msgr2=0x7fab441f73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:56.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.123+0000 7fab42ffd640 1 --2- 172.21.15.117:0/1365885946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab440b1aa0 0x7fab441f73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:56.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.123+0000 7fab42ffd640 1 -- 172.21.15.117:0/1365885946 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab44072b50 con 0x7fab440b1640 2024-09-19T08:37:56.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.123+0000 7fab42ffd640 1 --2- 172.21.15.117:0/1365885946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab440b1640 0x7fab441f6e90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fab38011620 tx=0x7fab38011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:56.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.123+0000 7fab2bfff640 1 -- 172.21.15.117:0/1365885946 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab38015870 con 0x7fab440b1640 2024-09-19T08:37:56.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.123+0000 7fab2bfff640 1 -- 172.21.15.117:0/1365885946 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab38015a10 con 0x7fab440b1640 2024-09-19T08:37:56.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.123+0000 7fab49ced640 1 -- 172.21.15.117:0/1365885946 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab44072e30 con 0x7fab440b1640 2024-09-19T08:37:56.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.123+0000 7fab2bfff640 1 -- 172.21.15.117:0/1365885946 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab38015de0 con 0x7fab440b1640 2024-09-19T08:37:56.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.123+0000 7fab49ced640 1 -- 172.21.15.117:0/1365885946 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab440733f0 con 0x7fab440b1640 2024-09-19T08:37:56.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.124+0000 7fab49ced640 1 -- 172.21.15.117:0/1365885946 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab4406e300 con 0x7fab440b1640 2024-09-19T08:37:56.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.124+0000 7fab2bfff640 1 -- 172.21.15.117:0/1365885946 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fab3801d400 con 0x7fab440b1640 2024-09-19T08:37:56.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.125+0000 7fab2bfff640 1 --2- 172.21.15.117:0/1365885946 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fab3006c2e0 0x7fab3006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:56.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.125+0000 7fab2bfff640 1 -- 172.21.15.117:0/1365885946 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fab3808be80 con 0x7fab440b1640 2024-09-19T08:37:56.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.125+0000 7fab437fe640 1 --2- 172.21.15.117:0/1365885946 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fab3006c2e0 0x7fab3006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:56.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.125+0000 7fab437fe640 1 --2- 172.21.15.117:0/1365885946 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fab3006c2e0 0x7fab3006e7a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fab34033000 tx=0x7fab34008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:56.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.129+0000 7fab2bfff640 1 -- 172.21.15.117:0/1365885946 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fab38019030 con 0x7fab440b1640 2024-09-19T08:37:56.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.330+0000 7fab49ced640 1 -- 172.21.15.117:0/1365885946 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fab44157d10 con 0x7fab440b1640 2024-09-19T08:37:56.331 INFO:tasks.ceph.mon.a.smithi117.stderr:2024-09-19T08:37:56.331+0000 7f8064cfe640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:37:56.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.333+0000 7fab2bfff640 1 -- 172.21.15.117:0/1365885946 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7fab3805a280 con 0x7fab440b1640 2024-09-19T08:37:56.333 INFO:teuthology.orchestra.run.smithi117.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T08:37:56.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.335+0000 7fab49ced640 1 -- 172.21.15.117:0/1365885946 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fab3006c2e0 msgr2=0x7fab3006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:56.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.335+0000 7fab49ced640 1 --2- 172.21.15.117:0/1365885946 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fab3006c2e0 0x7fab3006e7a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fab34033000 tx=0x7fab34008030 comp rx=0 tx=0).stop 2024-09-19T08:37:56.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.335+0000 7fab49ced640 1 -- 172.21.15.117:0/1365885946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab440b1640 msgr2=0x7fab441f6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:56.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.335+0000 7fab49ced640 1 --2- 172.21.15.117:0/1365885946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab440b1640 0x7fab441f6e90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fab38011620 tx=0x7fab38011a20 comp rx=0 tx=0).stop 2024-09-19T08:37:56.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.335+0000 7fab49ced640 1 -- 172.21.15.117:0/1365885946 shutdown_connections 2024-09-19T08:37:56.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.335+0000 7fab49ced640 1 --2- 172.21.15.117:0/1365885946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab440b1aa0 0x7fab441f73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:56.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.335+0000 7fab49ced640 1 --2- 172.21.15.117:0/1365885946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab440b1640 0x7fab441f6e90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:56.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.335+0000 7fab49ced640 1 --2- 172.21.15.117:0/1365885946 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fab3006c2e0 0x7fab3006e7a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:56.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.335+0000 7fab49ced640 1 --2- 172.21.15.117:0/1365885946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab2c0039b0 0x7fab44159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:56.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.335+0000 7fab49ced640 1 -- 172.21.15.117:0/1365885946 >> 172.21.15.117:0/1365885946 conn(0x7fab4406bdf0 msgr2=0x7fab440c67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:56.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.335+0000 7fab49ced640 1 -- 172.21.15.117:0/1365885946 shutdown_connections 2024-09-19T08:37:56.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.335+0000 7fab49ced640 1 -- 172.21.15.117:0/1365885946 wait complete. 2024-09-19T08:37:56.339 INFO:tasks.ceph.mds.b.smithi146.stderr: -3182> 2024-09-19T08:37:18.283+0000 7fdaa0001640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T08:37:56.347 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T08:37:56.369 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2024-09-19T08:37:56.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.447+0000 7fb1cb398640 1 Processor -- start 2024-09-19T08:37:56.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.447+0000 7fb1cb398640 1 -- start start 2024-09-19T08:37:56.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.448+0000 7fb1cb398640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb1c40ae270 0x7fb1c406c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:56.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.448+0000 7fb1cb398640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb1c40cf680 0x7fb1c40cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:56.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.448+0000 7fb1cb398640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1c40cfda0 con 0x7fb1c415c270 2024-09-19T08:37:56.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.448+0000 7fb1cb398640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb1c40ccf80 con 0x7fb1c40cf680 2024-09-19T08:37:56.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.448+0000 7fb1cb398640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fb1c40cd260 con 0x7fb1c40ae270 2024-09-19T08:37:56.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.448+0000 7fb1c9935640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb1c40cf680 0x7fb1c40cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:56.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.448+0000 7fb1c9935640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb1c40cf680 0x7fb1c40cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57444/0 (socket says 172.21.15.117:57444) 2024-09-19T08:37:56.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.448+0000 7fb1c9935640 1 -- 172.21.15.117:0/65682101 learned_addr learned my addr 172.21.15.117:0/65682101 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:56.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.448+0000 7fb1c9134640 1 --1- 172.21.15.117:0/65682101 >> v1:172.21.15.117:6789/0 conn(0x7fb1c415c270 0x7fb1c40cef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:52790/0 (socket says 172.21.15.117:52790) 2024-09-19T08:37:56.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.448+0000 7fb1c8933640 1 --2- 172.21.15.117:0/65682101 >> v2:172.21.15.146:3300/0 conn(0x7fb1c40ae270 0x7fb1c406c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:56.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.448+0000 7fb1c9935640 1 -- 172.21.15.117:0/65682101 >> v2:172.21.15.146:3300/0 conn(0x7fb1c40ae270 msgr2=0x7fb1c406c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:56.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.448+0000 7fb1c9935640 1 --2- 172.21.15.117:0/65682101 >> v2:172.21.15.146:3300/0 conn(0x7fb1c40ae270 0x7fb1c406c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:56.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.448+0000 7fb1c9935640 1 -- 172.21.15.117:0/65682101 >> v1:172.21.15.117:6789/0 conn(0x7fb1c415c270 legacy=0x7fb1c40cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:56.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.448+0000 7fb1c9935640 1 -- 172.21.15.117:0/65682101 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c40cd540 con 0x7fb1c40cf680 2024-09-19T08:37:56.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.448+0000 7fb1bbfff640 1 -- 172.21.15.117:0/65682101 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 671473481 0 0) 0x7fb1c0001110 con 0x7fb1c415c270 2024-09-19T08:37:56.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.449+0000 7fb1c9935640 1 --2- 172.21.15.117:0/65682101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1c40cf680 0x7fb1c40cdd40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40cc070 tx=0x7fb1bc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1eff2d818a47454 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:56.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.449+0000 7fb1bbfff640 1 -- 172.21.15.117:0/65682101 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc036070 con 0x7fb1c40cf680 2024-09-19T08:37:56.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.449+0000 7fb1bbfff640 1 -- 172.21.15.117:0/65682101 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1bc031600 con 0x7fb1c40cf680 2024-09-19T08:37:56.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.449+0000 7fb1bbfff640 1 -- 172.21.15.117:0/65682101 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc0319d0 con 0x7fb1c40cf680 2024-09-19T08:37:56.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.450+0000 7fb1cb398640 1 -- 172.21.15.117:0/65682101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1c40cf680 msgr2=0x7fb1c40cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:56.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.450+0000 7fb1cb398640 1 --2- 172.21.15.117:0/65682101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1c40cf680 0x7fb1c40cdd40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40cc070 tx=0x7fb1bc02a6a0 comp rx=0 tx=0).stop 2024-09-19T08:37:56.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.450+0000 7fb1cb398640 1 -- 172.21.15.117:0/65682101 shutdown_connections 2024-09-19T08:37:56.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.450+0000 7fb1cb398640 1 --2- 172.21.15.117:0/65682101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1c40cf680 0x7fb1c40cdd40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:56.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.450+0000 7fb1cb398640 1 --2- 172.21.15.117:0/65682101 >> v2:172.21.15.146:3300/0 conn(0x7fb1c40ae270 0x7fb1c406c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:56.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.450+0000 7fb1cb398640 1 -- 172.21.15.117:0/65682101 >> 172.21.15.117:0/65682101 conn(0x7fb1c409a9f0 msgr2=0x7fb1c40b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:56.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.450+0000 7fb1cb398640 1 -- 172.21.15.117:0/65682101 shutdown_connections 2024-09-19T08:37:56.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.450+0000 7fb1cb398640 1 -- 172.21.15.117:0/65682101 wait complete. 2024-09-19T08:37:56.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.451+0000 7fb1cb398640 1 Processor -- start 2024-09-19T08:37:56.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.451+0000 7fb1cb398640 1 -- start start 2024-09-19T08:37:56.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.452+0000 7fb1cb398640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1c40ae270 0x7fb1c41572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:56.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.452+0000 7fb1cb398640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1c40cf680 0x7fb1c4154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:56.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.452+0000 7fb1cb398640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1c415c270 0x7fb1c415b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:56.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.452+0000 7fb1cb398640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c415c7d0 con 0x7fb1c415c270 2024-09-19T08:37:56.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.452+0000 7fb1cb398640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c415c650 con 0x7fb1c40cf680 2024-09-19T08:37:56.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.452+0000 7fb1cb398640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c40ccba0 con 0x7fb1c40ae270 2024-09-19T08:37:56.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.452+0000 7fb1c9935640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1c415c270 0x7fb1c415b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:56.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.452+0000 7fb1c9935640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1c415c270 0x7fb1c415b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57450/0 (socket says 172.21.15.117:57450) 2024-09-19T08:37:56.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.452+0000 7fb1c9935640 1 -- 172.21.15.117:0/3339164816 learned_addr learned my addr 172.21.15.117:0/3339164816 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:56.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.452+0000 7fb1c8933640 1 --2- 172.21.15.117:0/3339164816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1c40cf680 0x7fb1c4154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:56.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.452+0000 7fb1c9134640 1 --2- 172.21.15.117:0/3339164816 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1c40ae270 0x7fb1c41572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:56.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.452+0000 7fb1c9935640 1 -- 172.21.15.117:0/3339164816 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1c40ae270 msgr2=0x7fb1c41572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:56.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.452+0000 7fb1c9935640 1 --2- 172.21.15.117:0/3339164816 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1c40ae270 0x7fb1c41572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:56.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.452+0000 7fb1c9935640 1 -- 172.21.15.117:0/3339164816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1c40cf680 msgr2=0x7fb1c4154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:56.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.452+0000 7fb1c9935640 1 --2- 172.21.15.117:0/3339164816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1c40cf680 0x7fb1c4154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:56.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.452+0000 7fb1c9935640 1 -- 172.21.15.117:0/3339164816 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c41548a0 con 0x7fb1c415c270 2024-09-19T08:37:56.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.452+0000 7fb1c9935640 1 --2- 172.21.15.117:0/3339164816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1c415c270 0x7fb1c415b3b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009f40 tx=0x7fb1bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:56.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.452+0000 7fb1b9ffb640 1 -- 172.21.15.117:0/3339164816 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc036050 con 0x7fb1c415c270 2024-09-19T08:37:56.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.452+0000 7fb1b9ffb640 1 -- 172.21.15.117:0/3339164816 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1bc042070 con 0x7fb1c415c270 2024-09-19T08:37:56.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.452+0000 7fb1b9ffb640 1 -- 172.21.15.117:0/3339164816 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc009510 con 0x7fb1c415c270 2024-09-19T08:37:56.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.452+0000 7fb1cb398640 1 -- 172.21.15.117:0/3339164816 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c4154ec0 con 0x7fb1c415c270 2024-09-19T08:37:56.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.453+0000 7fb1cb398640 1 -- 172.21.15.117:0/3339164816 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c406f010 con 0x7fb1c415c270 2024-09-19T08:37:56.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.454+0000 7fb1cb398640 1 -- 172.21.15.117:0/3339164816 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c40b36a0 con 0x7fb1c415c270 2024-09-19T08:37:56.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.454+0000 7fb1b9ffb640 1 -- 172.21.15.117:0/3339164816 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb1bc007bf0 con 0x7fb1c415c270 2024-09-19T08:37:56.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.455+0000 7fb1b9ffb640 1 --2- 172.21.15.117:0/3339164816 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb1a806c2b0 0x7fb1a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:56.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.455+0000 7fb1c9134640 1 --2- 172.21.15.117:0/3339164816 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb1a806c2b0 0x7fb1a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:56.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.456+0000 7fb1c9134640 1 --2- 172.21.15.117:0/3339164816 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb1a806c2b0 0x7fb1a806e770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0000f60 tx=0x7fb1c0007b50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:56.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.456+0000 7fb1b9ffb640 1 -- 172.21.15.117:0/3339164816 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6676+0+0 (secure 0 0 0) 0x7fb1bc0782e0 con 0x7fb1c415c270 2024-09-19T08:37:56.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.460+0000 7fb1b9ffb640 1 -- 172.21.15.117:0/3339164816 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb1bc07a240 con 0x7fb1c415c270 2024-09-19T08:37:56.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:56.664+0000 7fb1cb398640 1 -- 172.21.15.117:0/3339164816 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb1c40b3010 con 0x7fb1c415c270 2024-09-19T08:37:57.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.335+0000 7fb1b9ffb640 1 -- 172.21.15.117:0/3339164816 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fb1bc07e540 con 0x7fb1c415c270 2024-09-19T08:37:57.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.337+0000 7fb1cb398640 1 -- 172.21.15.117:0/3339164816 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb1a806c2b0 msgr2=0x7fb1a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:57.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.337+0000 7fb1cb398640 1 --2- 172.21.15.117:0/3339164816 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb1a806c2b0 0x7fb1a806e770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0000f60 tx=0x7fb1c0007b50 comp rx=0 tx=0).stop 2024-09-19T08:37:57.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.337+0000 7fb1cb398640 1 -- 172.21.15.117:0/3339164816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1c415c270 msgr2=0x7fb1c415b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:57.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.337+0000 7fb1cb398640 1 --2- 172.21.15.117:0/3339164816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1c415c270 0x7fb1c415b3b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009f40 tx=0x7fb1bc004a40 comp rx=0 tx=0).stop 2024-09-19T08:37:57.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.337+0000 7fb1cb398640 1 -- 172.21.15.117:0/3339164816 shutdown_connections 2024-09-19T08:37:57.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.337+0000 7fb1cb398640 1 --2- 172.21.15.117:0/3339164816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1c415c270 0x7fb1c415b3b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:57.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.337+0000 7fb1cb398640 1 --2- 172.21.15.117:0/3339164816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1c40cf680 0x7fb1c4154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:57.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.337+0000 7fb1cb398640 1 --2- 172.21.15.117:0/3339164816 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb1a806c2b0 0x7fb1a806e770 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:57.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.337+0000 7fb1cb398640 1 --2- 172.21.15.117:0/3339164816 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1c40ae270 0x7fb1c41572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:57.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.337+0000 7fb1cb398640 1 -- 172.21.15.117:0/3339164816 >> 172.21.15.117:0/3339164816 conn(0x7fb1c409a9f0 msgr2=0x7fb1c40cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:57.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.337+0000 7fb1cb398640 1 -- 172.21.15.117:0/3339164816 shutdown_connections 2024-09-19T08:37:57.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.337+0000 7fb1cb398640 1 -- 172.21.15.117:0/3339164816 wait complete. 2024-09-19T08:37:57.349 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T08:37:57.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.453+0000 7fd6bac82640 1 Processor -- start 2024-09-19T08:37:57.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.453+0000 7fd6bac82640 1 -- start start 2024-09-19T08:37:57.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.454+0000 7fd6bac82640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd6b40b0a80 0x7fd6b40cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:57.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.454+0000 7fd6bac82640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6b406c990 con 0x7fd6b4161d90 2024-09-19T08:37:57.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.454+0000 7fd6bac82640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6b40cec10 con 0x7fd6b41619b0 2024-09-19T08:37:57.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.454+0000 7fd6bac82640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fd6b40ce930 con 0x7fd6b40b0a80 2024-09-19T08:37:57.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.454+0000 7fd6b921f640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fd6b4161d90 0x7fd6b40cc210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:52804/0 (socket says 172.21.15.117:52804) 2024-09-19T08:37:57.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.454+0000 7fd6b921f640 1 -- 172.21.15.117:0/1022703363 learned_addr learned my addr 172.21.15.117:0/1022703363 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:57.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6abfff640 1 --2- 172.21.15.117:0/1022703363 >> v2:172.21.15.146:3300/0 conn(0x7fd6b40b0a80 0x7fd6b40cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:57.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6ab7fe640 1 -- 172.21.15.117:0/1022703363 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4200963622 0 0) 0x7fd6b406c990 con 0x7fd6b4161d90 2024-09-19T08:37:57.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6ab7fe640 1 -- 172.21.15.117:0/1022703363 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd69c003520 con 0x7fd6b4161d90 2024-09-19T08:37:57.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6ab7fe640 1 -- 172.21.15.117:0/1022703363 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 856315960 0 0) 0x7fd69c003520 con 0x7fd6b4161d90 2024-09-19T08:37:57.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6ab7fe640 1 -- 172.21.15.117:0/1022703363 >> v2:172.21.15.146:3300/0 conn(0x7fd6b40b0a80 msgr2=0x7fd6b40cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:57.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6ab7fe640 1 --2- 172.21.15.117:0/1022703363 >> v2:172.21.15.146:3300/0 conn(0x7fd6b40b0a80 0x7fd6b40cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:57.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6ab7fe640 1 -- 172.21.15.117:0/1022703363 >> v1:172.21.15.146:6789/0 conn(0x7fd6b41619b0 legacy=0x7fd6b40d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:57.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6ab7fe640 1 -- 172.21.15.117:0/1022703363 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b40b0540 con 0x7fd6b4161d90 2024-09-19T08:37:57.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6ab7fe640 1 -- 172.21.15.117:0/1022703363 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7fd6ac0019f0 con 0x7fd6b4161d90 2024-09-19T08:37:57.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6ab7fe640 1 -- 172.21.15.117:0/1022703363 >> v1:172.21.15.117:6789/0 conn(0x7fd6b4161d90 legacy=0x7fd6b40cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:57.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6ab7fe640 1 --2- 172.21.15.117:0/1022703363 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd69c003a00 0x7fd69c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:57.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6ab7fe640 1 --2- 172.21.15.117:0/1022703363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd69c004800 0x7fd69c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:57.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6ab7fe640 1 --2- 172.21.15.117:0/1022703363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd69c0051c0 0x7fd69c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:57.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6ab7fe640 1 -- 172.21.15.117:0/1022703363 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b40ce930 con 0x7fd69c004800 2024-09-19T08:37:57.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6ab7fe640 1 -- 172.21.15.117:0/1022703363 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c00c0c0 con 0x7fd69c0051c0 2024-09-19T08:37:57.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6ab7fe640 1 -- 172.21.15.117:0/1022703363 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fd69c00c2c0 con 0x7fd69c003a00 2024-09-19T08:37:57.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6abfff640 1 --2- 172.21.15.117:0/1022703363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd69c004800 0x7fd69c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:57.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6b8a1e640 1 --2- 172.21.15.117:0/1022703363 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd69c003a00 0x7fd69c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:57.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6b921f640 1 --2- 172.21.15.117:0/1022703363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd69c0051c0 0x7fd69c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:57.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6abfff640 1 -- 172.21.15.117:0/1022703363 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd69c003a00 msgr2=0x7fd69c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:57.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6abfff640 1 --2- 172.21.15.117:0/1022703363 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd69c003a00 0x7fd69c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:57.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6abfff640 1 -- 172.21.15.117:0/1022703363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd69c0051c0 msgr2=0x7fd69c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:57.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6abfff640 1 --2- 172.21.15.117:0/1022703363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd69c0051c0 0x7fd69c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:57.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6abfff640 1 -- 172.21.15.117:0/1022703363 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69c003520 con 0x7fd69c004800 2024-09-19T08:37:57.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6b921f640 1 --2- 172.21.15.117:0/1022703363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd69c0051c0 0x7fd69c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:57.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.455+0000 7fd6b921f640 1 -- 172.21.15.117:0/1022703363 reap_dead start 2024-09-19T08:37:57.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.456+0000 7fd6abfff640 1 --2- 172.21.15.117:0/1022703363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd69c004800 0x7fd69c004c80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009a90 tx=0x7fd69c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a738de6c76231 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:57.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.456+0000 7fd6ab7fe640 1 -- 172.21.15.117:0/1022703363 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4036070 con 0x7fd69c004800 2024-09-19T08:37:57.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.456+0000 7fd6ab7fe640 1 -- 172.21.15.117:0/1022703363 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6a4031400 con 0x7fd69c004800 2024-09-19T08:37:57.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.456+0000 7fd6ab7fe640 1 -- 172.21.15.117:0/1022703363 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4009690 con 0x7fd69c004800 2024-09-19T08:37:57.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.457+0000 7fd6bac82640 1 -- 172.21.15.117:0/1022703363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd69c004800 msgr2=0x7fd69c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:57.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.457+0000 7fd6bac82640 1 --2- 172.21.15.117:0/1022703363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd69c004800 0x7fd69c004c80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009a90 tx=0x7fd69c005830 comp rx=0 tx=0).stop 2024-09-19T08:37:57.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.457+0000 7fd6bac82640 1 -- 172.21.15.117:0/1022703363 shutdown_connections 2024-09-19T08:37:57.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.457+0000 7fd6bac82640 1 --2- 172.21.15.117:0/1022703363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd69c004800 0x7fd69c004c80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:57.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.457+0000 7fd6bac82640 1 -- 172.21.15.117:0/1022703363 >> 172.21.15.117:0/1022703363 conn(0x7fd6b409a9f0 msgr2=0x7fd6b40b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:57.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.457+0000 7fd6bac82640 1 -- 172.21.15.117:0/1022703363 shutdown_connections 2024-09-19T08:37:57.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.457+0000 7fd6bac82640 1 -- 172.21.15.117:0/1022703363 wait complete. 2024-09-19T08:37:57.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.458+0000 7fd6bac82640 1 Processor -- start 2024-09-19T08:37:57.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.458+0000 7fd6bac82640 1 -- start start 2024-09-19T08:37:57.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.459+0000 7fd6bac82640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd69c004800 0x7fd6b40c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:57.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.459+0000 7fd6bac82640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6b41f3440 0x7fd6b41f38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:57.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.459+0000 7fd6bac82640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6b40ca780 0x7fd6b40cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:57.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.459+0000 7fd6bac82640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b40cd330 con 0x7fd6b41f3440 2024-09-19T08:37:57.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.459+0000 7fd6bac82640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b406c620 con 0x7fd6b40ca780 2024-09-19T08:37:57.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.459+0000 7fd6bac82640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fd6b40cd4b0 con 0x7fd69c004800 2024-09-19T08:37:57.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.459+0000 7fd6abfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6b41f3440 0x7fd6b41f38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:57.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.459+0000 7fd6abfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6b41f3440 0x7fd6b41f38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57472/0 (socket says 172.21.15.117:57472) 2024-09-19T08:37:57.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.459+0000 7fd6abfff640 1 -- 172.21.15.117:0/1713478245 learned_addr learned my addr 172.21.15.117:0/1713478245 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:57.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.459+0000 7fd6b8a1e640 1 --2- 172.21.15.117:0/1713478245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd69c004800 0x7fd6b40c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:57.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.459+0000 7fd6b921f640 1 --2- 172.21.15.117:0/1713478245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6b40ca780 0x7fd6b40cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:57.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.459+0000 7fd6abfff640 1 -- 172.21.15.117:0/1713478245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd69c004800 msgr2=0x7fd6b40c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:57.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.459+0000 7fd6abfff640 1 --2- 172.21.15.117:0/1713478245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd69c004800 0x7fd6b40c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:57.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.459+0000 7fd6abfff640 1 -- 172.21.15.117:0/1713478245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6b40ca780 msgr2=0x7fd6b40cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:57.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.459+0000 7fd6abfff640 1 --2- 172.21.15.117:0/1713478245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6b40ca780 0x7fd6b40cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:57.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.459+0000 7fd6abfff640 1 -- 172.21.15.117:0/1713478245 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b41f3e00 con 0x7fd6b41f3440 2024-09-19T08:37:57.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.459+0000 7fd6abfff640 1 --2- 172.21.15.117:0/1713478245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6b41f3440 0x7fd6b41f38c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009bb0 tx=0x7fd6a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:57.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.460+0000 7fd6a97fa640 1 -- 172.21.15.117:0/1713478245 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a403f020 con 0x7fd6b41f3440 2024-09-19T08:37:57.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.460+0000 7fd6a97fa640 1 -- 172.21.15.117:0/1713478245 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6a4037040 con 0x7fd6b41f3440 2024-09-19T08:37:57.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.460+0000 7fd6bac82640 1 -- 172.21.15.117:0/1713478245 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b40c8fb0 con 0x7fd6b41f3440 2024-09-19T08:37:57.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.460+0000 7fd6a97fa640 1 -- 172.21.15.117:0/1713478245 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4036070 con 0x7fd6b41f3440 2024-09-19T08:37:57.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.460+0000 7fd6bac82640 1 -- 172.21.15.117:0/1713478245 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b40c9570 con 0x7fd6b41f3440 2024-09-19T08:37:57.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.461+0000 7fd6bac82640 1 -- 172.21.15.117:0/1713478245 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6b4068da0 con 0x7fd6b41f3440 2024-09-19T08:37:57.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.461+0000 7fd6a97fa640 1 -- 172.21.15.117:0/1713478245 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd6a4042020 con 0x7fd6b41f3440 2024-09-19T08:37:57.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.462+0000 7fd6a97fa640 1 --2- 172.21.15.117:0/1713478245 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd6a006c2b0 0x7fd6a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:57.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.462+0000 7fd6a97fa640 1 -- 172.21.15.117:0/1713478245 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6676+0+0 (secure 0 0 0) 0x7fd6a40ab790 con 0x7fd6b41f3440 2024-09-19T08:37:57.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.462+0000 7fd6b8a1e640 1 --2- 172.21.15.117:0/1713478245 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd6a006c2b0 0x7fd6a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:57.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.462+0000 7fd6b8a1e640 1 --2- 172.21.15.117:0/1713478245 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd6a006c2b0 0x7fd6a006e770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd6b00017e0 tx=0x7fd6b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:57.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.466+0000 7fd6a97fa640 1 -- 172.21.15.117:0/1713478245 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd6b4068da0 con 0x7fd6b41f3440 2024-09-19T08:37:57.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:57.631+0000 7fd6bac82640 1 -- 172.21.15.117:0/1713478245 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd6b40cc600 con 0x7fd6b41f3440 2024-09-19T08:37:58.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.472+0000 7fd6a97fa640 1 -- 172.21.15.117:0/1713478245 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) ==== 181+0+0 (secure 0 0 0) 0x7fd6a4049030 con 0x7fd6b41f3440 2024-09-19T08:37:58.473 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'cephfs_metadata' removed 2024-09-19T08:37:58.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.476+0000 7fd6bac82640 1 -- 172.21.15.117:0/1713478245 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd6a006c2b0 msgr2=0x7fd6a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:58.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.476+0000 7fd6bac82640 1 --2- 172.21.15.117:0/1713478245 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd6a006c2b0 0x7fd6a006e770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd6b00017e0 tx=0x7fd6b0009040 comp rx=0 tx=0).stop 2024-09-19T08:37:58.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.476+0000 7fd6bac82640 1 -- 172.21.15.117:0/1713478245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6b41f3440 msgr2=0x7fd6b41f38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:58.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.476+0000 7fd6bac82640 1 --2- 172.21.15.117:0/1713478245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6b41f3440 0x7fd6b41f38c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009bb0 tx=0x7fd6a4004730 comp rx=0 tx=0).stop 2024-09-19T08:37:58.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.476+0000 7fd6bac82640 1 -- 172.21.15.117:0/1713478245 shutdown_connections 2024-09-19T08:37:58.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.476+0000 7fd6bac82640 1 --2- 172.21.15.117:0/1713478245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6b40ca780 0x7fd6b40cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:58.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.476+0000 7fd6bac82640 1 --2- 172.21.15.117:0/1713478245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6b41f3440 0x7fd6b41f38c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:58.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.476+0000 7fd6bac82640 1 --2- 172.21.15.117:0/1713478245 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd6a006c2b0 0x7fd6a006e770 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:58.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.476+0000 7fd6bac82640 1 --2- 172.21.15.117:0/1713478245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd69c004800 0x7fd6b40c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:58.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.476+0000 7fd6bac82640 1 -- 172.21.15.117:0/1713478245 >> 172.21.15.117:0/1713478245 conn(0x7fd6b409a9f0 msgr2=0x7fd6b4070880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:58.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.476+0000 7fd6bac82640 1 -- 172.21.15.117:0/1713478245 shutdown_connections 2024-09-19T08:37:58.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.476+0000 7fd6bac82640 1 -- 172.21.15.117:0/1713478245 wait complete. 2024-09-19T08:37:58.490 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T08:37:58.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.599+0000 7f59a22dd640 1 Processor -- start 2024-09-19T08:37:58.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.599+0000 7f59a22dd640 1 -- start start 2024-09-19T08:37:58.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.599+0000 7f59a22dd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f599c0b1550 0x7f599c0aec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:58.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.599+0000 7f59a22dd640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f599c0b27c0 0x7f599c0af140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:58.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.599+0000 7f59a22dd640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f599c0b19e0 con 0x7f599c15b1d0 2024-09-19T08:37:58.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.599+0000 7f59a22dd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f599c0b2560 con 0x7f599c0b1550 2024-09-19T08:37:58.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.599+0000 7f59a22dd640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f599c0b1cc0 con 0x7f599c0b27c0 2024-09-19T08:37:58.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.600+0000 7f5993fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f599c0b1550 0x7f599c0aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:58.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.600+0000 7f5993fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f599c0b1550 0x7f599c0aec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57488/0 (socket says 172.21.15.117:57488) 2024-09-19T08:37:58.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.600+0000 7f5993fff640 1 -- 172.21.15.117:0/1027937542 learned_addr learned my addr 172.21.15.117:0/1027937542 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:58.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.600+0000 7f5993fff640 1 -- 172.21.15.117:0/1027937542 >> v2:172.21.15.146:3300/0 conn(0x7f599c0b27c0 msgr2=0x7f599c0af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:58.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.600+0000 7f5993fff640 1 --2- 172.21.15.117:0/1027937542 >> v2:172.21.15.146:3300/0 conn(0x7f599c0b27c0 0x7f599c0af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:58.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.600+0000 7f5993fff640 1 -- 172.21.15.117:0/1027937542 >> v1:172.21.15.146:6789/0 conn(0x7f599c15b1d0 legacy=0x7f599c0b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:58.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.600+0000 7f5993fff640 1 -- 172.21.15.117:0/1027937542 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599c0b1fa0 con 0x7f599c0b1550 2024-09-19T08:37:58.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.601+0000 7f5993fff640 1 --2- 172.21.15.117:0/1027937542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f599c0b1550 0x7f599c0aec00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f599c072de0 tx=0x7f598402c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9978ad691da185f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:58.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.601+0000 7f599b7fe640 1 -- 172.21.15.117:0/1027937542 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59840325a0 con 0x7f599c0b1550 2024-09-19T08:37:58.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.601+0000 7f599b7fe640 1 -- 172.21.15.117:0/1027937542 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5984038070 con 0x7f599c0b1550 2024-09-19T08:37:58.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.601+0000 7f599b7fe640 1 -- 172.21.15.117:0/1027937542 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5984032960 con 0x7f599c0b1550 2024-09-19T08:37:58.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.601+0000 7f59a22dd640 1 -- 172.21.15.117:0/1027937542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f599c0b1550 msgr2=0x7f599c0aec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:58.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.601+0000 7f59a22dd640 1 --2- 172.21.15.117:0/1027937542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f599c0b1550 0x7f599c0aec00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f599c072de0 tx=0x7f598402c8e0 comp rx=0 tx=0).stop 2024-09-19T08:37:58.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.601+0000 7f59a22dd640 1 -- 172.21.15.117:0/1027937542 shutdown_connections 2024-09-19T08:37:58.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.601+0000 7f59a22dd640 1 --2- 172.21.15.117:0/1027937542 >> v2:172.21.15.146:3300/0 conn(0x7f599c0b27c0 0x7f599c0af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:58.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.601+0000 7f59a22dd640 1 --2- 172.21.15.117:0/1027937542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f599c0b1550 0x7f599c0aec00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:58.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.601+0000 7f59a22dd640 1 -- 172.21.15.117:0/1027937542 >> 172.21.15.117:0/1027937542 conn(0x7f599c09a9f0 msgr2=0x7f599c0b6530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:58.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.601+0000 7f59a22dd640 1 -- 172.21.15.117:0/1027937542 shutdown_connections 2024-09-19T08:37:58.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.601+0000 7f59a22dd640 1 -- 172.21.15.117:0/1027937542 wait complete. 2024-09-19T08:37:58.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.603+0000 7f59a22dd640 1 Processor -- start 2024-09-19T08:37:58.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.603+0000 7f59a22dd640 1 -- start start 2024-09-19T08:37:58.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.603+0000 7f59a22dd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f599c0b27c0 0x7f599c1e41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:58.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.603+0000 7f59a22dd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f599c15b1d0 0x7f599c154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:58.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.603+0000 7f59a22dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f599c154ac0 0x7f599c1f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:58.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.603+0000 7f59a22dd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f599c0b5130 con 0x7f599c154ac0 2024-09-19T08:37:58.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.603+0000 7f59a22dd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f599c15b5b0 con 0x7f599c0b27c0 2024-09-19T08:37:58.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.603+0000 7f59a22dd640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f599c0b52b0 con 0x7f599c15b1d0 2024-09-19T08:37:58.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.603+0000 7f59a087a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f599c154ac0 0x7f599c1f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:58.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.603+0000 7f59a087a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f599c154ac0 0x7f599c1f43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57490/0 (socket says 172.21.15.117:57490) 2024-09-19T08:37:58.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.603+0000 7f59a087a640 1 -- 172.21.15.117:0/334842732 learned_addr learned my addr 172.21.15.117:0/334842732 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:58.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.604+0000 7f5993fff640 1 --2- 172.21.15.117:0/334842732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f599c15b1d0 0x7f599c154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:58.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.604+0000 7f599bfff640 1 --2- 172.21.15.117:0/334842732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f599c0b27c0 0x7f599c1e41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:58.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.604+0000 7f59a087a640 1 -- 172.21.15.117:0/334842732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f599c15b1d0 msgr2=0x7f599c154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:58.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.604+0000 7f59a087a640 1 --2- 172.21.15.117:0/334842732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f599c15b1d0 0x7f599c154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:58.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.604+0000 7f59a087a640 1 -- 172.21.15.117:0/334842732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f599c0b27c0 msgr2=0x7f599c1e41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:58.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.604+0000 7f59a087a640 1 --2- 172.21.15.117:0/334842732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f599c0b27c0 0x7f599c1e41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:58.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.604+0000 7f59a087a640 1 -- 172.21.15.117:0/334842732 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599c1e5170 con 0x7f599c154ac0 2024-09-19T08:37:58.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.604+0000 7f599bfff640 1 --2- 172.21.15.117:0/334842732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f599c0b27c0 0x7f599c1e41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:58.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.604+0000 7f5993fff640 1 --2- 172.21.15.117:0/334842732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f599c15b1d0 0x7f599c154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:37:58.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.604+0000 7f59a087a640 1 --2- 172.21.15.117:0/334842732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f599c154ac0 0x7f599c1f43d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f599400b9e0 tx=0x7f599400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:58.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.604+0000 7f59997fa640 1 -- 172.21.15.117:0/334842732 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5994019070 con 0x7f599c154ac0 2024-09-19T08:37:58.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.604+0000 7f59997fa640 1 -- 172.21.15.117:0/334842732 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f599400cb20 con 0x7f599c154ac0 2024-09-19T08:37:58.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.604+0000 7f59a22dd640 1 -- 172.21.15.117:0/334842732 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f599c154f70 con 0x7f599c154ac0 2024-09-19T08:37:58.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.604+0000 7f59997fa640 1 -- 172.21.15.117:0/334842732 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5994014440 con 0x7f599c154ac0 2024-09-19T08:37:58.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.604+0000 7f59a22dd640 1 -- 172.21.15.117:0/334842732 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f599c1e4bb0 con 0x7f599c154ac0 2024-09-19T08:37:58.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.605+0000 7f59a22dd640 1 -- 172.21.15.117:0/334842732 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f599c0b4010 con 0x7f599c154ac0 2024-09-19T08:37:58.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.606+0000 7f59997fa640 1 -- 172.21.15.117:0/334842732 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f599401c070 con 0x7f599c154ac0 2024-09-19T08:37:58.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.606+0000 7f59997fa640 1 --2- 172.21.15.117:0/334842732 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f597c06c2b0 0x7f597c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:58.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.606+0000 7f59997fa640 1 -- 172.21.15.117:0/334842732 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6238+0+0 (secure 0 0 0) 0x7f599408b370 con 0x7f599c154ac0 2024-09-19T08:37:58.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.606+0000 7f599bfff640 1 --2- 172.21.15.117:0/334842732 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f597c06c2b0 0x7f597c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:58.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.607+0000 7f599bfff640 1 --2- 172.21.15.117:0/334842732 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f597c06c2b0 0x7f597c06e770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f598c006fd0 tx=0x7f598c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:58.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.610+0000 7f59997fa640 1 -- 172.21.15.117:0/334842732 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f59940598d0 con 0x7f599c154ac0 2024-09-19T08:37:58.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:58.778+0000 7f59a22dd640 1 -- 172.21.15.117:0/334842732 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f599c158860 con 0x7f599c154ac0 2024-09-19T08:37:59.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.480+0000 7f59997fa640 1 -- 172.21.15.117:0/334842732 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) ==== 169+0+0 (secure 0 0 0) 0x7f59940591d0 con 0x7f599c154ac0 2024-09-19T08:37:59.481 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'cephfs_data' removed 2024-09-19T08:37:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.484+0000 7f59a22dd640 1 -- 172.21.15.117:0/334842732 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f597c06c2b0 msgr2=0x7f597c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.484+0000 7f59a22dd640 1 --2- 172.21.15.117:0/334842732 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f597c06c2b0 0x7f597c06e770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f598c006fd0 tx=0x7f598c008040 comp rx=0 tx=0).stop 2024-09-19T08:37:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.484+0000 7f59a22dd640 1 -- 172.21.15.117:0/334842732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f599c154ac0 msgr2=0x7f599c1f43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.484+0000 7f59a22dd640 1 --2- 172.21.15.117:0/334842732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f599c154ac0 0x7f599c1f43d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f599400b9e0 tx=0x7f599400bea0 comp rx=0 tx=0).stop 2024-09-19T08:37:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.484+0000 7f59a22dd640 1 -- 172.21.15.117:0/334842732 shutdown_connections 2024-09-19T08:37:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.484+0000 7f59a22dd640 1 --2- 172.21.15.117:0/334842732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f599c154ac0 0x7f599c1f43d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.484+0000 7f59a22dd640 1 --2- 172.21.15.117:0/334842732 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f597c06c2b0 0x7f597c06e770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.484+0000 7f59a22dd640 1 --2- 172.21.15.117:0/334842732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f599c15b1d0 0x7f599c154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.484+0000 7f59a22dd640 1 --2- 172.21.15.117:0/334842732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f599c0b27c0 0x7f599c1e41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.484+0000 7f59a22dd640 1 -- 172.21.15.117:0/334842732 >> 172.21.15.117:0/334842732 conn(0x7f599c09a9f0 msgr2=0x7f599c06ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:59.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.485+0000 7f59a22dd640 1 -- 172.21.15.117:0/334842732 shutdown_connections 2024-09-19T08:37:59.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.485+0000 7f59a22dd640 1 -- 172.21.15.117:0/334842732 wait complete. 2024-09-19T08:37:59.500 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-19T08:37:59.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.607+0000 7f6c06242640 1 Processor -- start 2024-09-19T08:37:59.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.607+0000 7f6c06242640 1 -- start start 2024-09-19T08:37:59.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.608+0000 7f6c06242640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6c0015e2a0 0x7f6c0006d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:59.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.608+0000 7f6c06242640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c000d1880 con 0x7f6c0006d960 2024-09-19T08:37:59.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.608+0000 7f6c06242640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c000d1b60 con 0x7f6c0015e680 2024-09-19T08:37:59.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.608+0000 7f6c06242640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f6c000cf2d0 con 0x7f6c0015e2a0 2024-09-19T08:37:59.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.608+0000 7f6bff7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6c0015e2a0 0x7f6c0006d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:59.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.608+0000 7f6bfffff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f6c0006d960 0x7f6c000d4370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:52812/0 (socket says 172.21.15.117:52812) 2024-09-19T08:37:59.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.608+0000 7f6bfffff640 1 -- 172.21.15.117:0/497188811 learned_addr learned my addr 172.21.15.117:0/497188811 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:37:59.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.608+0000 7f6bff7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6c0015e2a0 0x7f6c0006d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57500/0 (socket says 172.21.15.117:57500) 2024-09-19T08:37:59.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.609+0000 7f6bff7fe640 1 -- 172.21.15.117:0/497188811 >> v1:172.21.15.146:6789/0 conn(0x7f6c0015e680 legacy=0x7f6c000cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:37:59.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.609+0000 7f6bff7fe640 1 -- 172.21.15.117:0/497188811 >> v1:172.21.15.117:6789/0 conn(0x7f6c0006d960 legacy=0x7f6c000d4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:59.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.609+0000 7f6bff7fe640 1 -- 172.21.15.117:0/497188811 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c000cf5b0 con 0x7f6c0015e2a0 2024-09-19T08:37:59.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.609+0000 7f6bfe7fc640 1 -- 172.21.15.117:0/497188811 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1951360294 0 0) 0x7f6c000d1880 con 0x7f6c0006d960 2024-09-19T08:37:59.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.609+0000 7f6bff7fe640 1 --2- 172.21.15.117:0/497188811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c0015e2a0 0x7f6c0006d420 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6bf00097a0 tx=0x7f6bf002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55aa544e6c61e8a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:59.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.609+0000 7f6bfe7fc640 1 -- 172.21.15.117:0/497188811 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0037070 con 0x7f6c0015e2a0 2024-09-19T08:37:59.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.609+0000 7f6bfe7fc640 1 -- 172.21.15.117:0/497188811 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf0032440 con 0x7f6c0015e2a0 2024-09-19T08:37:59.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.609+0000 7f6bfe7fc640 1 -- 172.21.15.117:0/497188811 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0032810 con 0x7f6c0015e2a0 2024-09-19T08:37:59.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.610+0000 7f6c06242640 1 -- 172.21.15.117:0/497188811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c0015e2a0 msgr2=0x7f6c0006d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:59.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.610+0000 7f6c06242640 1 --2- 172.21.15.117:0/497188811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c0015e2a0 0x7f6c0006d420 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6bf00097a0 tx=0x7f6bf002a1e0 comp rx=0 tx=0).stop 2024-09-19T08:37:59.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.610+0000 7f6c06242640 1 -- 172.21.15.117:0/497188811 shutdown_connections 2024-09-19T08:37:59.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.610+0000 7f6c06242640 1 --2- 172.21.15.117:0/497188811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c0015e2a0 0x7f6c0006d420 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:59.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.610+0000 7f6c06242640 1 -- 172.21.15.117:0/497188811 >> 172.21.15.117:0/497188811 conn(0x7f6c0009d760 msgr2=0x7f6c0008bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:37:59.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.610+0000 7f6c06242640 1 -- 172.21.15.117:0/497188811 shutdown_connections 2024-09-19T08:37:59.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.610+0000 7f6c06242640 1 -- 172.21.15.117:0/497188811 wait complete. 2024-09-19T08:37:59.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.611+0000 7f6c06242640 1 Processor -- start 2024-09-19T08:37:59.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.611+0000 7f6c06242640 1 -- start start 2024-09-19T08:37:59.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.612+0000 7f6c06242640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c0006d960 0x7f6c00159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:59.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.612+0000 7f6c06242640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c0015e2a0 0x7f6c001611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:59.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.612+0000 7f6c06242640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c0015e680 0x7f6c001616f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:59.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.612+0000 7f6c06242640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6c000d0360 con 0x7f6c0015e2a0 2024-09-19T08:37:59.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.612+0000 7f6c06242640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6c000d01e0 con 0x7f6c0015e680 2024-09-19T08:37:59.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.612+0000 7f6c06242640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f6c000d4a80 con 0x7f6c0006d960 2024-09-19T08:37:59.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.612+0000 7f6bfeffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c0015e2a0 0x7f6c001611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:59.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.612+0000 7f6bfeffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c0015e2a0 0x7f6c001611b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57510/0 (socket says 172.21.15.117:57510) 2024-09-19T08:37:59.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.612+0000 7f6bfeffd640 1 -- 172.21.15.117:0/989140667 learned_addr learned my addr 172.21.15.117:0/989140667 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:37:59.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.612+0000 7f6bfffff640 1 --2- 172.21.15.117:0/989140667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c0015e680 0x7f6c001616f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:59.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.612+0000 7f6bff7fe640 1 --2- 172.21.15.117:0/989140667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c0006d960 0x7f6c00159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:59.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.613+0000 7f6bfeffd640 1 -- 172.21.15.117:0/989140667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c0006d960 msgr2=0x7f6c00159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:59.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.613+0000 7f6bfeffd640 1 --2- 172.21.15.117:0/989140667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c0006d960 0x7f6c00159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:59.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.613+0000 7f6bfeffd640 1 -- 172.21.15.117:0/989140667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c0015e680 msgr2=0x7f6c001616f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:37:59.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.613+0000 7f6bfeffd640 1 --2- 172.21.15.117:0/989140667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c0015e680 0x7f6c001616f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:37:59.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.613+0000 7f6bfeffd640 1 -- 172.21.15.117:0/989140667 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c001599c0 con 0x7f6c0015e2a0 2024-09-19T08:37:59.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.613+0000 7f6bfeffd640 1 --2- 172.21.15.117:0/989140667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c0015e2a0 0x7f6c001611b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400b3c0 tx=0x7f6bf400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:59.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.613+0000 7f6be7fff640 1 -- 172.21.15.117:0/989140667 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4011830 con 0x7f6c0015e2a0 2024-09-19T08:37:59.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.613+0000 7f6be7fff640 1 -- 172.21.15.117:0/989140667 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf4016070 con 0x7f6c0015e2a0 2024-09-19T08:37:59.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.613+0000 7f6be7fff640 1 -- 172.21.15.117:0/989140667 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4011c30 con 0x7f6c0015e2a0 2024-09-19T08:37:59.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.613+0000 7f6c06242640 1 -- 172.21.15.117:0/989140667 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c000b7460 con 0x7f6c0015e2a0 2024-09-19T08:37:59.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.613+0000 7f6c06242640 1 -- 172.21.15.117:0/989140667 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c000b7a20 con 0x7f6c0015e2a0 2024-09-19T08:37:59.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.614+0000 7f6c06242640 1 -- 172.21.15.117:0/989140667 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c0006d420 con 0x7f6c0015e2a0 2024-09-19T08:37:59.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.614+0000 7f6be7fff640 1 -- 172.21.15.117:0/989140667 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6bf401b460 con 0x7f6c0015e2a0 2024-09-19T08:37:59.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.615+0000 7f6be7fff640 1 --2- 172.21.15.117:0/989140667 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6bec06c2b0 0x7f6bec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:37:59.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.615+0000 7f6be7fff640 1 -- 172.21.15.117:0/989140667 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5795+0+0 (secure 0 0 0) 0x7f6bf408b0a0 con 0x7f6c0015e2a0 2024-09-19T08:37:59.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.615+0000 7f6bff7fe640 1 --2- 172.21.15.117:0/989140667 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6bec06c2b0 0x7f6bec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:37:59.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.616+0000 7f6bff7fe640 1 --2- 172.21.15.117:0/989140667 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6bec06c2b0 0x7f6bec06e770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0034000 tx=0x7f6bf002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:37:59.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.619+0000 7f6be7fff640 1 -- 172.21.15.117:0/989140667 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6bf4059840 con 0x7f6c0015e2a0 2024-09-19T08:37:59.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:37:59.787+0000 7f6c06242640 1 -- 172.21.15.117:0/989140667 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6c0006cf90 con 0x7f6c0015e2a0 2024-09-19T08:38:00.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.485+0000 7f6be7fff640 1 -- 172.21.15.117:0/989140667 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) ==== 178+0+0 (secure 0 0 0) 0x7f6bf4059140 con 0x7f6c0015e2a0 2024-09-19T08:38:00.485 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'cephfs_data_ec' removed 2024-09-19T08:38:00.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.488+0000 7f6c06242640 1 -- 172.21.15.117:0/989140667 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6bec06c2b0 msgr2=0x7f6bec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:00.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.488+0000 7f6c06242640 1 --2- 172.21.15.117:0/989140667 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6bec06c2b0 0x7f6bec06e770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0034000 tx=0x7f6bf002e000 comp rx=0 tx=0).stop 2024-09-19T08:38:00.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.488+0000 7f6c06242640 1 -- 172.21.15.117:0/989140667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c0015e2a0 msgr2=0x7f6c001611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:00.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.489+0000 7f6c06242640 1 --2- 172.21.15.117:0/989140667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c0015e2a0 0x7f6c001611b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400b3c0 tx=0x7f6bf400b880 comp rx=0 tx=0).stop 2024-09-19T08:38:00.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.489+0000 7f6c06242640 1 -- 172.21.15.117:0/989140667 shutdown_connections 2024-09-19T08:38:00.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.489+0000 7f6c06242640 1 --2- 172.21.15.117:0/989140667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c0015e680 0x7f6c001616f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:00.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.489+0000 7f6c06242640 1 --2- 172.21.15.117:0/989140667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c0015e2a0 0x7f6c001611b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:00.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.489+0000 7f6c06242640 1 --2- 172.21.15.117:0/989140667 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6bec06c2b0 0x7f6bec06e770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:00.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.489+0000 7f6c06242640 1 --2- 172.21.15.117:0/989140667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c0006d960 0x7f6c00159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:00.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.489+0000 7f6c06242640 1 -- 172.21.15.117:0/989140667 >> 172.21.15.117:0/989140667 conn(0x7f6c0009d760 msgr2=0x7f6c00160910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:00.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.489+0000 7f6c06242640 1 -- 172.21.15.117:0/989140667 shutdown_connections 2024-09-19T08:38:00.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.489+0000 7f6c06242640 1 -- 172.21.15.117:0/989140667 wait complete. 2024-09-19T08:38:00.501 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T08:38:00.501 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T08:38:00.502 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T08:38:00.502 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:38:00.502 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T08:38:00.502 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T08:38:00.502 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T08:38:00.502 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:38:00.502 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T08:38:00.503 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T08:38:00.503 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T08:38:00.503 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:38:00.503 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T08:38:00.503 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T08:38:00.503 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T08:38:00.504 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:38:00.512 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T08:38:00.512 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T08:38:00.513 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T08:38:00.513 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T08:38:00.514 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T08:38:00.514 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T08:38:00.515 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T08:38:00.515 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T08:38:00.554 INFO:tasks.ceph.mds.a:Started 2024-09-19T08:38:00.555 DEBUG:teuthology.parallel:result is None 2024-09-19T08:38:00.555 INFO:tasks.ceph.mds.c:Started 2024-09-19T08:38:00.555 DEBUG:teuthology.parallel:result is None 2024-09-19T08:38:00.557 INFO:tasks.ceph.mds.b:Started 2024-09-19T08:38:00.558 DEBUG:teuthology.parallel:result is None 2024-09-19T08:38:00.558 INFO:tasks.ceph.mds.d:Started 2024-09-19T08:38:00.558 DEBUG:teuthology.parallel:result is None 2024-09-19T08:38:00.559 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T08:38:00.631 INFO:tasks.ceph.mds.a.smithi117.stdout:starting mds.a at 2024-09-19T08:38:00.631 INFO:tasks.ceph.mds.c.smithi117.stdout:starting mds.c at 2024-09-19T08:38:00.639 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2024-09-19T08:38:00.639 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2024-09-19T08:38:00.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.665+0000 7f3cb9ab7640 1 Processor -- start 2024-09-19T08:38:00.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.665+0000 7f3cb9ab7640 1 -- start start 2024-09-19T08:38:00.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.666+0000 7f3cb9ab7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406c320 0x7f3cb40b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:00.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.666+0000 7f3cb9ab7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3cb40b0460 0x7f3cb40b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:00.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.666+0000 7f3cb9ab7640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cb406ca00 con 0x7f3cb4145a20 2024-09-19T08:38:00.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.666+0000 7f3cb9ab7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f3cb40b1570 con 0x7f3cb40b0460 2024-09-19T08:38:00.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.666+0000 7f3cb9ab7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb40b0960 con 0x7f3cb406c320 2024-09-19T08:38:00.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.666+0000 7f3cb3fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3cb40b0460 0x7f3cb40b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:00.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.666+0000 7f3cb3fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3cb40b0460 0x7f3cb40b1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57546/0 (socket says 172.21.15.117:57546) 2024-09-19T08:38:00.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.666+0000 7f3cb3fff640 1 -- 172.21.15.117:0/4283841455 learned_addr learned my addr 172.21.15.117:0/4283841455 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:00.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.666+0000 7f3cb2ffd640 1 --2- 172.21.15.117:0/4283841455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406c320 0x7f3cb40b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:00.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.666+0000 7f3cb3fff640 1 -- 172.21.15.117:0/4283841455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406c320 msgr2=0x7f3cb40b6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:00.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.666+0000 7f3cb3fff640 1 --2- 172.21.15.117:0/4283841455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406c320 0x7f3cb40b6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:00.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.666+0000 7f3cb3fff640 1 -- 172.21.15.117:0/4283841455 >> v1:172.21.15.146:6789/0 conn(0x7f3cb4145a20 legacy=0x7f3cb406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:00.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.666+0000 7f3cb3fff640 1 -- 172.21.15.117:0/4283841455 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb40b0c40 con 0x7f3cb40b0460 2024-09-19T08:38:00.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.667+0000 7f3cb3fff640 1 --2- 172.21.15.117:0/4283841455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb40b0460 0x7f3cb40b1a00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40b16f0 tx=0x7f3cac02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3fd4fe2471d16da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:00.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.667+0000 7f3cb27fc640 1 -- 172.21.15.117:0/4283841455 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac036070 con 0x7f3cb40b0460 2024-09-19T08:38:00.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.667+0000 7f3cb27fc640 1 -- 172.21.15.117:0/4283841455 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cac031600 con 0x7f3cb40b0460 2024-09-19T08:38:00.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.667+0000 7f3cb27fc640 1 -- 172.21.15.117:0/4283841455 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac0319d0 con 0x7f3cb40b0460 2024-09-19T08:38:00.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.668+0000 7f3cb9ab7640 1 -- 172.21.15.117:0/4283841455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb40b0460 msgr2=0x7f3cb40b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:00.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.668+0000 7f3cb9ab7640 1 --2- 172.21.15.117:0/4283841455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb40b0460 0x7f3cb40b1a00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40b16f0 tx=0x7f3cac02a710 comp rx=0 tx=0).stop 2024-09-19T08:38:00.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.668+0000 7f3cb9ab7640 1 -- 172.21.15.117:0/4283841455 shutdown_connections 2024-09-19T08:38:00.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.668+0000 7f3cb9ab7640 1 --2- 172.21.15.117:0/4283841455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb40b0460 0x7f3cb40b1a00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:00.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.668+0000 7f3cb9ab7640 1 --2- 172.21.15.117:0/4283841455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406c320 0x7f3cb40b6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:00.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.668+0000 7f3cb9ab7640 1 -- 172.21.15.117:0/4283841455 >> 172.21.15.117:0/4283841455 conn(0x7f3cb409a9f0 msgr2=0x7f3cb40b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:00.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.668+0000 7f3cb9ab7640 1 -- 172.21.15.117:0/4283841455 shutdown_connections 2024-09-19T08:38:00.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.668+0000 7f3cb9ab7640 1 -- 172.21.15.117:0/4283841455 wait complete. 2024-09-19T08:38:00.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.669+0000 7f3cb9ab7640 1 Processor -- start 2024-09-19T08:38:00.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.669+0000 7f3cb9ab7640 1 -- start start 2024-09-19T08:38:00.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.670+0000 7f3cb9ab7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb406c320 0x7f3cb40cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:00.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.670+0000 7f3cb9ab7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb40b0460 0x7f3cb40cd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:00.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.670+0000 7f3cb9ab7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb4145a20 0x7f3cb41559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:00.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.670+0000 7f3cb9ab7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb4145e00 con 0x7f3cb4145a20 2024-09-19T08:38:00.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.670+0000 7f3cb9ab7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb40b1200 con 0x7f3cb406c320 2024-09-19T08:38:00.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.670+0000 7f3cb9ab7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb4145f80 con 0x7f3cb40b0460 2024-09-19T08:38:00.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.670+0000 7f3cb3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb4145a20 0x7f3cb41559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:00.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.670+0000 7f3cb3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb4145a20 0x7f3cb41559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57548/0 (socket says 172.21.15.117:57548) 2024-09-19T08:38:00.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.670+0000 7f3cb3fff640 1 -- 172.21.15.117:0/1750829775 learned_addr learned my addr 172.21.15.117:0/1750829775 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:00.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.670+0000 7f3cb2ffd640 1 --2- 172.21.15.117:0/1750829775 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb40b0460 0x7f3cb40cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:00.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.670+0000 7f3cb37fe640 1 --2- 172.21.15.117:0/1750829775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb406c320 0x7f3cb40cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:00.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.670+0000 7f3cb3fff640 1 -- 172.21.15.117:0/1750829775 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb40b0460 msgr2=0x7f3cb40cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:00.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.670+0000 7f3cb3fff640 1 --2- 172.21.15.117:0/1750829775 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb40b0460 0x7f3cb40cd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:00.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.670+0000 7f3cb3fff640 1 -- 172.21.15.117:0/1750829775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb406c320 msgr2=0x7f3cb40cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:00.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.670+0000 7f3cb3fff640 1 --2- 172.21.15.117:0/1750829775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb406c320 0x7f3cb40cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:00.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.670+0000 7f3cb3fff640 1 -- 172.21.15.117:0/1750829775 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb40cdeb0 con 0x7f3cb4145a20 2024-09-19T08:38:00.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.671+0000 7f3cb3fff640 1 --2- 172.21.15.117:0/1750829775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb4145a20 0x7f3cb41559a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009f40 tx=0x7f3cac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:00.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.671+0000 7f3c9bfff640 1 -- 172.21.15.117:0/1750829775 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac036050 con 0x7f3cb4145a20 2024-09-19T08:38:00.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.671+0000 7f3c9bfff640 1 -- 172.21.15.117:0/1750829775 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cac042070 con 0x7f3cb4145a20 2024-09-19T08:38:00.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.671+0000 7f3c9bfff640 1 -- 172.21.15.117:0/1750829775 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac009510 con 0x7f3cb4145a20 2024-09-19T08:38:00.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.671+0000 7f3cb9ab7640 1 -- 172.21.15.117:0/1750829775 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb41562a0 con 0x7f3cb4145a20 2024-09-19T08:38:00.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.671+0000 7f3cb9ab7640 1 -- 172.21.15.117:0/1750829775 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb4156860 con 0x7f3cb4145a20 2024-09-19T08:38:00.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.672+0000 7f3cb9ab7640 1 -- 172.21.15.117:0/1750829775 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb40af250 con 0x7f3cb4145a20 2024-09-19T08:38:00.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.672+0000 7f3c9bfff640 1 -- 172.21.15.117:0/1750829775 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3cac007bf0 con 0x7f3cb4145a20 2024-09-19T08:38:00.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.673+0000 7f3c9bfff640 1 --2- 172.21.15.117:0/1750829775 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3ca006c2b0 0x7f3ca006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:00.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.673+0000 7f3c9bfff640 1 -- 172.21.15.117:0/1750829775 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5335+0+0 (secure 0 0 0) 0x7f3cac0abeb0 con 0x7f3cb4145a20 2024-09-19T08:38:00.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.673+0000 7f3cb37fe640 1 --2- 172.21.15.117:0/1750829775 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3ca006c2b0 0x7f3ca006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:00.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.673+0000 7f3cb37fe640 1 --2- 172.21.15.117:0/1750829775 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3ca006c2b0 0x7f3ca006e770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3ca40016e0 tx=0x7f3ca4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:00.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.677+0000 7f3c9bfff640 1 -- 172.21.15.117:0/1750829775 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3cb40af250 con 0x7f3cb4145a20 2024-09-19T08:38:00.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:00.853+0000 7f3cb9ab7640 1 -- 172.21.15.117:0/1750829775 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f3cb40b6cb0 con 0x7f3cb4145a20 2024-09-19T08:38:01.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.497+0000 7f3c9bfff640 1 -- 172.21.15.117:0/1750829775 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) ==== 97+0+0 (secure 0 0 0) 0x7f3cac07a1d0 con 0x7f3cb4145a20 2024-09-19T08:38:01.501 INFO:teuthology.orchestra.run.smithi117.stderr: removed all blocklist entries 2024-09-19T08:38:01.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.500+0000 7f3cb9ab7640 1 -- 172.21.15.117:0/1750829775 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3ca006c2b0 msgr2=0x7f3ca006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:01.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.500+0000 7f3cb9ab7640 1 --2- 172.21.15.117:0/1750829775 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3ca006c2b0 0x7f3ca006e770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3ca40016e0 tx=0x7f3ca4009040 comp rx=0 tx=0).stop 2024-09-19T08:38:01.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.500+0000 7f3cb9ab7640 1 -- 172.21.15.117:0/1750829775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb4145a20 msgr2=0x7f3cb41559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:01.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.500+0000 7f3cb9ab7640 1 --2- 172.21.15.117:0/1750829775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb4145a20 0x7f3cb41559a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009f40 tx=0x7f3cac004a40 comp rx=0 tx=0).stop 2024-09-19T08:38:01.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.500+0000 7f3cb9ab7640 1 -- 172.21.15.117:0/1750829775 shutdown_connections 2024-09-19T08:38:01.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.500+0000 7f3cb9ab7640 1 --2- 172.21.15.117:0/1750829775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb4145a20 0x7f3cb41559a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:01.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.500+0000 7f3cb9ab7640 1 --2- 172.21.15.117:0/1750829775 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3ca006c2b0 0x7f3ca006e770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:01.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.500+0000 7f3cb9ab7640 1 --2- 172.21.15.117:0/1750829775 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb40b0460 0x7f3cb40cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:01.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.500+0000 7f3cb9ab7640 1 --2- 172.21.15.117:0/1750829775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb406c320 0x7f3cb40cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:01.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.500+0000 7f3cb9ab7640 1 -- 172.21.15.117:0/1750829775 >> 172.21.15.117:0/1750829775 conn(0x7f3cb409a9f0 msgr2=0x7f3cb4142ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:01.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.500+0000 7f3cb9ab7640 1 -- 172.21.15.117:0/1750829775 shutdown_connections 2024-09-19T08:38:01.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.500+0000 7f3cb9ab7640 1 -- 172.21.15.117:0/1750829775 wait complete. 2024-09-19T08:38:01.513 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T08:38:01.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.614+0000 7fb493166640 1 Processor -- start 2024-09-19T08:38:01.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.614+0000 7fb493166640 1 -- start start 2024-09-19T08:38:01.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.615+0000 7fb493166640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb48c141680 0x7fb48c0cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:01.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.615+0000 7fb493166640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb48c142170 0x7fb48c13f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:01.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.615+0000 7fb493166640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb48c15d710 con 0x7fb48c0d0370 2024-09-19T08:38:01.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.615+0000 7fb493166640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb48c0d07e0 con 0x7fb48c141680 2024-09-19T08:38:01.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.615+0000 7fb493166640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fb48c15c6f0 con 0x7fb48c142170 2024-09-19T08:38:01.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.615+0000 7fb490f02640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb48c141680 0x7fb48c0cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:01.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.615+0000 7fb490f02640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb48c141680 0x7fb48c0cfe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57562/0 (socket says 172.21.15.117:57562) 2024-09-19T08:38:01.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.615+0000 7fb490f02640 1 -- 172.21.15.117:0/3220207149 learned_addr learned my addr 172.21.15.117:0/3220207149 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:01.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.615+0000 7fb490f02640 1 -- 172.21.15.117:0/3220207149 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb48c142170 msgr2=0x7fb48c13f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:01.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.615+0000 7fb490f02640 1 --2- 172.21.15.117:0/3220207149 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb48c142170 0x7fb48c13f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:01.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.615+0000 7fb490f02640 1 -- 172.21.15.117:0/3220207149 >> v1:172.21.15.146:6789/0 conn(0x7fb48c0d0370 legacy=0x7fb48c141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:01.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.615+0000 7fb490f02640 1 -- 172.21.15.117:0/3220207149 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb48c15c950 con 0x7fb48c141680 2024-09-19T08:38:01.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.616+0000 7fb490f02640 1 --2- 172.21.15.117:0/3220207149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb48c141680 0x7fb48c0cfe30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb48c070fc0 tx=0x7fb48002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a83a028651b79d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:01.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.616+0000 7fb48b7fe640 1 -- 172.21.15.117:0/3220207149 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb480037070 con 0x7fb48c141680 2024-09-19T08:38:01.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.616+0000 7fb48b7fe640 1 -- 172.21.15.117:0/3220207149 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb480032440 con 0x7fb48c141680 2024-09-19T08:38:01.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.616+0000 7fb48b7fe640 1 -- 172.21.15.117:0/3220207149 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb480032810 con 0x7fb48c141680 2024-09-19T08:38:01.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.616+0000 7fb493166640 1 -- 172.21.15.117:0/3220207149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb48c141680 msgr2=0x7fb48c0cfe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:01.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.616+0000 7fb493166640 1 --2- 172.21.15.117:0/3220207149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb48c141680 0x7fb48c0cfe30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb48c070fc0 tx=0x7fb48002a230 comp rx=0 tx=0).stop 2024-09-19T08:38:01.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.616+0000 7fb493166640 1 -- 172.21.15.117:0/3220207149 shutdown_connections 2024-09-19T08:38:01.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.616+0000 7fb493166640 1 --2- 172.21.15.117:0/3220207149 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb48c142170 0x7fb48c13f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:01.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.616+0000 7fb493166640 1 --2- 172.21.15.117:0/3220207149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb48c141680 0x7fb48c0cfe30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:01.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.616+0000 7fb493166640 1 -- 172.21.15.117:0/3220207149 >> 172.21.15.117:0/3220207149 conn(0x7fb48c0b3ed0 msgr2=0x7fb48c0b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:01.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.616+0000 7fb493166640 1 -- 172.21.15.117:0/3220207149 shutdown_connections 2024-09-19T08:38:01.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.616+0000 7fb493166640 1 -- 172.21.15.117:0/3220207149 wait complete. 2024-09-19T08:38:01.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.618+0000 7fb493166640 1 Processor -- start 2024-09-19T08:38:01.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.618+0000 7fb493166640 1 -- start start 2024-09-19T08:38:01.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.618+0000 7fb493166640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb48c0d0370 0x7fb48c13ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:01.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.618+0000 7fb493166640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb48c141680 0x7fb48c0b6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:01.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.618+0000 7fb493166640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb48c142170 0x7fb48c0c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:01.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.618+0000 7fb493166640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb48c15d1f0 con 0x7fb48c0d0370 2024-09-19T08:38:01.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.618+0000 7fb493166640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb48c15cf10 con 0x7fb48c142170 2024-09-19T08:38:01.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.618+0000 7fb493166640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fb48c1425c0 con 0x7fb48c141680 2024-09-19T08:38:01.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.619+0000 7fb490f02640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb48c0d0370 0x7fb48c13ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:01.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.619+0000 7fb490f02640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb48c0d0370 0x7fb48c13ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57566/0 (socket says 172.21.15.117:57566) 2024-09-19T08:38:01.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.619+0000 7fb490f02640 1 -- 172.21.15.117:0/2296402787 learned_addr learned my addr 172.21.15.117:0/2296402787 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:01.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.619+0000 7fb48bfff640 1 --2- 172.21.15.117:0/2296402787 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb48c141680 0x7fb48c0b6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:01.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.619+0000 7fb490f02640 1 -- 172.21.15.117:0/2296402787 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb48c141680 msgr2=0x7fb48c0b6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:01.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.619+0000 7fb490f02640 1 --2- 172.21.15.117:0/2296402787 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb48c141680 0x7fb48c0b6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:01.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.619+0000 7fb490f02640 1 -- 172.21.15.117:0/2296402787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb48c142170 msgr2=0x7fb48c0c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:01.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.619+0000 7fb491703640 1 --2- 172.21.15.117:0/2296402787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb48c142170 0x7fb48c0c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:01.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.619+0000 7fb490f02640 1 --2- 172.21.15.117:0/2296402787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb48c142170 0x7fb48c0c83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:01.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.619+0000 7fb490f02640 1 -- 172.21.15.117:0/2296402787 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb48c0b76a0 con 0x7fb48c0d0370 2024-09-19T08:38:01.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.619+0000 7fb490f02640 1 --2- 172.21.15.117:0/2296402787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb48c0d0370 0x7fb48c13ece0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb480000c00 tx=0x7fb4800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:01.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.619+0000 7fb4897fa640 1 -- 172.21.15.117:0/2296402787 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb480037040 con 0x7fb48c0d0370 2024-09-19T08:38:01.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.619+0000 7fb4897fa640 1 -- 172.21.15.117:0/2296402787 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb480004230 con 0x7fb48c0d0370 2024-09-19T08:38:01.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.619+0000 7fb493166640 1 -- 172.21.15.117:0/2296402787 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb48c0b7980 con 0x7fb48c0d0370 2024-09-19T08:38:01.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.619+0000 7fb4897fa640 1 -- 172.21.15.117:0/2296402787 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48003c670 con 0x7fb48c0d0370 2024-09-19T08:38:01.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.619+0000 7fb493166640 1 -- 172.21.15.117:0/2296402787 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb48c0b7f40 con 0x7fb48c0d0370 2024-09-19T08:38:01.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.620+0000 7fb493166640 1 -- 172.21.15.117:0/2296402787 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb48c0cfe30 con 0x7fb48c0d0370 2024-09-19T08:38:01.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.621+0000 7fb4897fa640 1 -- 172.21.15.117:0/2296402787 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb48003a070 con 0x7fb48c0d0370 2024-09-19T08:38:01.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.621+0000 7fb4897fa640 1 --2- 172.21.15.117:0/2296402787 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb47006c2b0 0x7fb47006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:01.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.621+0000 7fb4897fa640 1 -- 172.21.15.117:0/2296402787 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fb4800abae0 con 0x7fb48c0d0370 2024-09-19T08:38:01.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.621+0000 7fb48bfff640 1 --2- 172.21.15.117:0/2296402787 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb47006c2b0 0x7fb47006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:01.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.622+0000 7fb48bfff640 1 --2- 172.21.15.117:0/2296402787 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb47006c2b0 0x7fb47006e770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb48c0b56f0 tx=0x7fb478009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:01.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.626+0000 7fb4897fa640 1 -- 172.21.15.117:0/2296402787 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb480041020 con 0x7fb48c0d0370 2024-09-19T08:38:01.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.856+0000 7fb493166640 1 -- 172.21.15.117:0/2296402787 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb48c0690c0 con 0x7fb48c0d0370 2024-09-19T08:38:01.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.856+0000 7fb4897fa640 1 -- 172.21.15.117:0/2296402787 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7fb48007a4a0 con 0x7fb48c0d0370 2024-09-19T08:38:01.857 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:01.857 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T08:38:01.857 INFO:teuthology.orchestra.run.smithi117.stdout: "auth_dump": [ 2024-09-19T08:38:01.857 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.857 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "mds.a", 2024-09-19T08:38:01.857 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB44utmHw2nDRAAoIVTtJpfdniBkgt/n50nHg==", 2024-09-19T08:38:01.857 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.858 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow", 2024-09-19T08:38:01.858 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow *", 2024-09-19T08:38:01.858 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow *", 2024-09-19T08:38:01.858 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:01.858 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.858 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.858 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.858 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "mds.b", 2024-09-19T08:38:01.858 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB44utmifiDGRAA34GAUAJ4KhXW2WGLdHa9xQ==", 2024-09-19T08:38:01.858 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.858 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow", 2024-09-19T08:38:01.858 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow *", 2024-09-19T08:38:01.859 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow *", 2024-09-19T08:38:01.859 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:01.859 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.859 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.859 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.859 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "mds.c", 2024-09-19T08:38:01.859 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB44utme+LSFBAA/tadCvj4CzlxiMj1w/T6/A==", 2024-09-19T08:38:01.859 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.859 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow", 2024-09-19T08:38:01.859 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow *", 2024-09-19T08:38:01.860 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow *", 2024-09-19T08:38:01.860 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:01.860 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.860 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.860 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.860 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "mds.d", 2024-09-19T08:38:01.861 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB44utmS0KGIBAAsTEM5IiQpHXzO5J+j1wn3w==", 2024-09-19T08:38:01.861 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.861 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow", 2024-09-19T08:38:01.861 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow *", 2024-09-19T08:38:01.861 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow *", 2024-09-19T08:38:01.862 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:01.862 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.862 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.862 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.862 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.0", 2024-09-19T08:38:01.862 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB84utmxBpsEhAABdz/Goew538p9BNfIgRrsQ==", 2024-09-19T08:38:01.862 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.862 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2024-09-19T08:38:01.863 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2024-09-19T08:38:01.863 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:01.863 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.863 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.863 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.863 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.1", 2024-09-19T08:38:01.863 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB/4utmHUdUIxAAG09ixI0+EoBdrDIJcwIGnQ==", 2024-09-19T08:38:01.864 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.864 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2024-09-19T08:38:01.864 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2024-09-19T08:38:01.864 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:01.864 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.864 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.864 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.864 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.2", 2024-09-19T08:38:01.864 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQCC4utmGxKkNBAAZ7PRYmJzVPiO4MJKhDi4Dg==", 2024-09-19T08:38:01.864 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.864 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2024-09-19T08:38:01.864 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2024-09-19T08:38:01.865 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:01.865 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.865 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.3", 2024-09-19T08:38:01.865 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQCF4utmITrTNRAAx1Vb1imQtiwe7bmAubkpAw==", 2024-09-19T08:38:01.865 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.865 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2024-09-19T08:38:01.865 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2024-09-19T08:38:01.865 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:01.865 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.865 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.865 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.866 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.4", 2024-09-19T08:38:01.866 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQCM4utmhQxCFBAATgkv9JUObRF+tpU1GYcPDw==", 2024-09-19T08:38:01.866 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.866 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2024-09-19T08:38:01.866 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2024-09-19T08:38:01.866 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:01.866 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.866 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.866 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.866 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.5", 2024-09-19T08:38:01.866 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQCP4utmwQLhMxAAgaQDJyUNuUAorZcg3ujn1g==", 2024-09-19T08:38:01.866 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.867 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2024-09-19T08:38:01.867 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2024-09-19T08:38:01.867 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:01.867 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.867 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.867 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.867 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.6", 2024-09-19T08:38:01.867 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQCT4utm8hylFxAAZIkKmzbAkG47lxMgxAQXYg==", 2024-09-19T08:38:01.867 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.867 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2024-09-19T08:38:01.867 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2024-09-19T08:38:01.867 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:01.868 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.868 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.7", 2024-09-19T08:38:01.868 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQCW4utm5q1yHBAA129yQst2D7WxXHl8n8H67A==", 2024-09-19T08:38:01.868 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.868 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2024-09-19T08:38:01.868 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2024-09-19T08:38:01.868 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:01.868 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.868 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.868 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.868 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.0", 2024-09-19T08:38:01.869 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB44utm6+SOJBAAd1SCpjEGh0tRc3cpmnVJDA==", 2024-09-19T08:38:01.869 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.869 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow", 2024-09-19T08:38:01.869 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow r", 2024-09-19T08:38:01.869 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow rw", 2024-09-19T08:38:01.869 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow rwx" 2024-09-19T08:38:01.869 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.869 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.869 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.869 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.1", 2024-09-19T08:38:01.869 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB44utmwZhILRAA7XsdtUcwcRNMsBtD7b0oEg==", 2024-09-19T08:38:01.869 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.869 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow", 2024-09-19T08:38:01.869 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow r", 2024-09-19T08:38:01.870 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow rw", 2024-09-19T08:38:01.870 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow rwx" 2024-09-19T08:38:01.870 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.870 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.870 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.870 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.2", 2024-09-19T08:38:01.870 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB44utm+kIcKhAAChWsl4sULIR5oEpWzebQBw==", 2024-09-19T08:38:01.870 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.870 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow", 2024-09-19T08:38:01.870 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow r", 2024-09-19T08:38:01.870 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow rw", 2024-09-19T08:38:01.870 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow rwx" 2024-09-19T08:38:01.870 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.871 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.3", 2024-09-19T08:38:01.871 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB44utmovjYMhAAM8bTiJHlA0Cs8jOoDV5N2w==", 2024-09-19T08:38:01.871 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.871 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow", 2024-09-19T08:38:01.871 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow r", 2024-09-19T08:38:01.871 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow rw", 2024-09-19T08:38:01.871 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow rwx" 2024-09-19T08:38:01.871 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.871 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.871 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.872 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.admin", 2024-09-19T08:38:01.872 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB34utmAVe1LRAA02O+aGvuW08bs5cP5Ybx5g==", 2024-09-19T08:38:01.872 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.872 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow *", 2024-09-19T08:38:01.872 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow *", 2024-09-19T08:38:01.872 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow *", 2024-09-19T08:38:01.873 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:01.873 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.873 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.873 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.873 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.bootstrap-mds", 2024-09-19T08:38:01.873 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQCh4utmvrQDJRAA3pCZglrZYc1P7Wbrh20t9Q==", 2024-09-19T08:38:01.874 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.874 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile bootstrap-mds" 2024-09-19T08:38:01.874 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.874 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.874 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.874 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.bootstrap-mgr", 2024-09-19T08:38:01.875 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQCh4utm8b0DJRAAt3xLYqY3ps9lO5HjeQn2sw==", 2024-09-19T08:38:01.875 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.875 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-19T08:38:01.875 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.875 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.875 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.875 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.bootstrap-osd", 2024-09-19T08:38:01.876 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQCh4utm3sQDJRAAcHaJrEborTMpOJsVXdIHpQ==", 2024-09-19T08:38:01.876 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.876 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile bootstrap-osd" 2024-09-19T08:38:01.876 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.876 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.876 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.876 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.bootstrap-rbd", 2024-09-19T08:38:01.876 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQCh4utmVcsDJRAA7i4TM394oEag+Y3sZr/zNQ==", 2024-09-19T08:38:01.877 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.877 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-19T08:38:01.877 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.877 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.877 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.877 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-19T08:38:01.878 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQCh4utm8dEDJRAAjxAiIltiBq8V7S7UGRmCwQ==", 2024-09-19T08:38:01.878 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.878 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-19T08:38:01.878 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.878 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.878 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.879 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.bootstrap-rgw", 2024-09-19T08:38:01.879 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQCh4utmUNkDJRAAB7vVDhovnZajem1JLsb9qw==", 2024-09-19T08:38:01.879 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.879 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-19T08:38:01.879 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.879 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.879 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "mgr.x", 2024-09-19T08:38:01.880 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB44utmIExxChAAnLzpZuo2zLAlA3djNp6qhQ==", 2024-09-19T08:38:01.880 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.880 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow *", 2024-09-19T08:38:01.880 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile mgr", 2024-09-19T08:38:01.880 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:01.880 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:01.880 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:01.880 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "mgr.y", 2024-09-19T08:38:01.880 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB44utmU4TYBhAARfqD+WyAad5N6j/Dbg4azQ==", 2024-09-19T08:38:01.880 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:01.880 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow *", 2024-09-19T08:38:01.880 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile mgr", 2024-09-19T08:38:01.881 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:01.881 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.881 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:01.881 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2024-09-19T08:38:01.881 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T08:38:01.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.858+0000 7fb493166640 1 -- 172.21.15.117:0/2296402787 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb47006c2b0 msgr2=0x7fb47006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:01.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.858+0000 7fb493166640 1 --2- 172.21.15.117:0/2296402787 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb47006c2b0 0x7fb47006e770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb48c0b56f0 tx=0x7fb478009040 comp rx=0 tx=0).stop 2024-09-19T08:38:01.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.858+0000 7fb493166640 1 -- 172.21.15.117:0/2296402787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb48c0d0370 msgr2=0x7fb48c13ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:01.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.858+0000 7fb493166640 1 --2- 172.21.15.117:0/2296402787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb48c0d0370 0x7fb48c13ece0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb480000c00 tx=0x7fb4800046c0 comp rx=0 tx=0).stop 2024-09-19T08:38:01.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.859+0000 7fb493166640 1 -- 172.21.15.117:0/2296402787 shutdown_connections 2024-09-19T08:38:01.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.859+0000 7fb493166640 1 --2- 172.21.15.117:0/2296402787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb48c142170 0x7fb48c0c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:01.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.859+0000 7fb493166640 1 --2- 172.21.15.117:0/2296402787 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb47006c2b0 0x7fb47006e770 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:01.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.859+0000 7fb493166640 1 --2- 172.21.15.117:0/2296402787 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb48c141680 0x7fb48c0b6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:01.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.859+0000 7fb493166640 1 --2- 172.21.15.117:0/2296402787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb48c0d0370 0x7fb48c13ece0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:01.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.859+0000 7fb493166640 1 -- 172.21.15.117:0/2296402787 >> 172.21.15.117:0/2296402787 conn(0x7fb48c0b3ed0 msgr2=0x7fb48c0b3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:01.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.859+0000 7fb493166640 1 -- 172.21.15.117:0/2296402787 shutdown_connections 2024-09-19T08:38:01.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.859+0000 7fb493166640 1 -- 172.21.15.117:0/2296402787 wait complete. 2024-09-19T08:38:01.884 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-19T08:38:01.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.983+0000 7f8645113640 1 Processor -- start 2024-09-19T08:38:01.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.983+0000 7f8645113640 1 -- start start 2024-09-19T08:38:01.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.983+0000 7f8645113640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86400cf680 0x7f864006c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:01.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.983+0000 7f8645113640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86400cfda0 con 0x7f86400ae270 2024-09-19T08:38:01.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.983+0000 7f8645113640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86400ccf80 con 0x7f864015c270 2024-09-19T08:38:01.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.983+0000 7f8645113640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f86400cd260 con 0x7f86400cf680 2024-09-19T08:38:01.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.984+0000 7f863f59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86400cf680 0x7f864006c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:01.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.984+0000 7f863e59c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f86400ae270 0x7f86400cdd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:52820/0 (socket says 172.21.15.117:52820) 2024-09-19T08:38:01.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.984+0000 7f863e59c640 1 -- 172.21.15.117:0/304468449 learned_addr learned my addr 172.21.15.117:0/304468449 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:01.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.984+0000 7f863f59e640 1 -- 172.21.15.117:0/304468449 >> v1:172.21.15.146:6789/0 conn(0x7f864015c270 legacy=0x7f86400cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:01.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.984+0000 7f863f59e640 1 -- 172.21.15.117:0/304468449 >> v1:172.21.15.117:6789/0 conn(0x7f86400ae270 legacy=0x7f86400cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:01.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.984+0000 7f863f59e640 1 -- 172.21.15.117:0/304468449 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86400cd540 con 0x7f86400cf680 2024-09-19T08:38:01.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.985+0000 7f863f59e640 1 --2- 172.21.15.117:0/304468449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86400cf680 0x7f864006c620 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f86300097a0 tx=0x7f863002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d498e0adb303a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:01.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.985+0000 7f863dd9b640 1 -- 172.21.15.117:0/304468449 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8630037070 con 0x7f86400cf680 2024-09-19T08:38:01.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.985+0000 7f863dd9b640 1 -- 172.21.15.117:0/304468449 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f863002ae50 con 0x7f86400cf680 2024-09-19T08:38:01.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.985+0000 7f863dd9b640 1 -- 172.21.15.117:0/304468449 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8630032660 con 0x7f86400cf680 2024-09-19T08:38:01.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.985+0000 7f8645113640 1 -- 172.21.15.117:0/304468449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86400cf680 msgr2=0x7f864006c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:01.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.985+0000 7f8645113640 1 --2- 172.21.15.117:0/304468449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86400cf680 0x7f864006c620 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f86300097a0 tx=0x7f863002a140 comp rx=0 tx=0).stop 2024-09-19T08:38:01.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.985+0000 7f8645113640 1 -- 172.21.15.117:0/304468449 shutdown_connections 2024-09-19T08:38:01.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.985+0000 7f8645113640 1 --2- 172.21.15.117:0/304468449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86400cf680 0x7f864006c620 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:01.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.985+0000 7f8645113640 1 -- 172.21.15.117:0/304468449 >> 172.21.15.117:0/304468449 conn(0x7f864009a9f0 msgr2=0x7f86400b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:01.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.985+0000 7f8645113640 1 -- 172.21.15.117:0/304468449 shutdown_connections 2024-09-19T08:38:01.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.985+0000 7f8645113640 1 -- 172.21.15.117:0/304468449 wait complete. 2024-09-19T08:38:01.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.987+0000 7f8645113640 1 Processor -- start 2024-09-19T08:38:01.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.987+0000 7f8645113640 1 -- start start 2024-09-19T08:38:01.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.987+0000 7f8645113640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86400ae270 0x7f864006f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:01.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.987+0000 7f8645113640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86400cf680 0x7f86400cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:01.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.987+0000 7f8645113640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f864015c270 0x7f8640158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:01.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.987+0000 7f8645113640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f864015c7d0 con 0x7f86400cf680 2024-09-19T08:38:01.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.987+0000 7f8645113640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f864015c650 con 0x7f864015c270 2024-09-19T08:38:01.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.987+0000 7f8645113640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f86400ccba0 con 0x7f86400ae270 2024-09-19T08:38:01.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.988+0000 7f863e59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86400cf680 0x7f86400cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:01.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.988+0000 7f863e59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86400cf680 0x7f86400cabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57588/0 (socket says 172.21.15.117:57588) 2024-09-19T08:38:01.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.988+0000 7f863e59c640 1 -- 172.21.15.117:0/1464579253 learned_addr learned my addr 172.21.15.117:0/1464579253 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:01.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.988+0000 7f863ed9d640 1 --2- 172.21.15.117:0/1464579253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86400ae270 0x7f864006f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:01.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.988+0000 7f863f59e640 1 --2- 172.21.15.117:0/1464579253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f864015c270 0x7f8640158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:01.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.988+0000 7f863e59c640 1 -- 172.21.15.117:0/1464579253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86400ae270 msgr2=0x7f864006f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:01.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.988+0000 7f863e59c640 1 --2- 172.21.15.117:0/1464579253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86400ae270 0x7f864006f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:01.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.988+0000 7f863e59c640 1 -- 172.21.15.117:0/1464579253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f864015c270 msgr2=0x7f8640158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:01.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.988+0000 7f863e59c640 1 --2- 172.21.15.117:0/1464579253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f864015c270 0x7f8640158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:01.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.988+0000 7f863e59c640 1 -- 172.21.15.117:0/1464579253 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f864006f1b0 con 0x7f86400cf680 2024-09-19T08:38:01.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.988+0000 7f863e59c640 1 --2- 172.21.15.117:0/1464579253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86400cf680 0x7f86400cabc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f862800c400 tx=0x7f862800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:01.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.988+0000 7f86377fe640 1 -- 172.21.15.117:0/1464579253 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8628017070 con 0x7f86400cf680 2024-09-19T08:38:01.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.988+0000 7f86377fe640 1 -- 172.21.15.117:0/1464579253 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8628005ce0 con 0x7f86400cf680 2024-09-19T08:38:01.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.988+0000 7f8645113640 1 -- 172.21.15.117:0/1464579253 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f864006feb0 con 0x7f86400cf680 2024-09-19T08:38:01.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.988+0000 7f86377fe640 1 -- 172.21.15.117:0/1464579253 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86280072f0 con 0x7f86400cf680 2024-09-19T08:38:01.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.988+0000 7f8645113640 1 -- 172.21.15.117:0/1464579253 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86400cb6f0 con 0x7f86400cf680 2024-09-19T08:38:01.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.989+0000 7f8645113640 1 -- 172.21.15.117:0/1464579253 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86400b36a0 con 0x7f86400cf680 2024-09-19T08:38:01.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.990+0000 7f86377fe640 1 -- 172.21.15.117:0/1464579253 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f862801a070 con 0x7f86400cf680 2024-09-19T08:38:01.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.990+0000 7f86377fe640 1 --2- 172.21.15.117:0/1464579253 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f862006c2b0 0x7f862006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:01.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.990+0000 7f86377fe640 1 -- 172.21.15.117:0/1464579253 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f862808a6a0 con 0x7f86400cf680 2024-09-19T08:38:01.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.990+0000 7f863ed9d640 1 --2- 172.21.15.117:0/1464579253 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f862006c2b0 0x7f862006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:01.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.991+0000 7f863ed9d640 1 --2- 172.21.15.117:0/1464579253 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f862006c2b0 0x7f862006e770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f86401f7470 tx=0x7f86380094d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:01.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:01.994+0000 7f86377fe640 1 -- 172.21.15.117:0/1464579253 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f86400cfda0 con 0x7f86400cf680 2024-09-19T08:38:02.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.223+0000 7f8645113640 1 -- 172.21.15.117:0/1464579253 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f86400cb930 con 0x7f86400cf680 2024-09-19T08:38:02.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.226+0000 7f86377fe640 1 -- 172.21.15.117:0/1464579253 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f862808a070 con 0x7f86400cf680 2024-09-19T08:38:02.227 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.227+0000 7f8645113640 1 -- 172.21.15.117:0/1464579253 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f862006c2b0 msgr2=0x7f862006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:02.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.227+0000 7f8645113640 1 --2- 172.21.15.117:0/1464579253 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f862006c2b0 0x7f862006e770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f86401f7470 tx=0x7f86380094d0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.227+0000 7f8645113640 1 -- 172.21.15.117:0/1464579253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86400cf680 msgr2=0x7f86400cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:02.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.227+0000 7f8645113640 1 --2- 172.21.15.117:0/1464579253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86400cf680 0x7f86400cabc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f862800c400 tx=0x7f862800c8c0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.227+0000 7f8645113640 1 -- 172.21.15.117:0/1464579253 shutdown_connections 2024-09-19T08:38:02.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.227+0000 7f8645113640 1 --2- 172.21.15.117:0/1464579253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f864015c270 0x7f8640158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.227+0000 7f8645113640 1 --2- 172.21.15.117:0/1464579253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86400cf680 0x7f86400cabc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.227+0000 7f8645113640 1 --2- 172.21.15.117:0/1464579253 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f862006c2b0 0x7f862006e770 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.227+0000 7f8645113640 1 --2- 172.21.15.117:0/1464579253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86400ae270 0x7f864006f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.227+0000 7f8645113640 1 -- 172.21.15.117:0/1464579253 >> 172.21.15.117:0/1464579253 conn(0x7f864009a9f0 msgr2=0x7f86400af0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:02.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.227+0000 7f8645113640 1 -- 172.21.15.117:0/1464579253 shutdown_connections 2024-09-19T08:38:02.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.227+0000 7f8645113640 1 -- 172.21.15.117:0/1464579253 wait complete. 2024-09-19T08:38:02.238 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-19T08:38:02.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.340+0000 7f168aa1e640 1 Processor -- start 2024-09-19T08:38:02.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.340+0000 7f168aa1e640 1 -- start start 2024-09-19T08:38:02.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.341+0000 7f168aa1e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16840b0a80 0x7f16840cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:02.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.341+0000 7f168aa1e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f168406c990 con 0x7f16841619b0 2024-09-19T08:38:02.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.341+0000 7f168aa1e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16840cec10 con 0x7f1684161d90 2024-09-19T08:38:02.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.341+0000 7f168aa1e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f16840ce930 con 0x7f16840b0a80 2024-09-19T08:38:02.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.341+0000 7f1683fff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f16841619b0 0x7f16840d0440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:52834/0 (socket says 172.21.15.117:52834) 2024-09-19T08:38:02.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.341+0000 7f1683fff640 1 -- 172.21.15.117:0/1962594638 learned_addr learned my addr 172.21.15.117:0/1962594638 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:02.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.341+0000 7f16837fe640 1 --2- 172.21.15.117:0/1962594638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16840b0a80 0x7f16840cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:02.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.341+0000 7f1682ffd640 1 -- 172.21.15.117:0/1962594638 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3093626999 0 0) 0x7f168406c990 con 0x7f16841619b0 2024-09-19T08:38:02.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.341+0000 7f1682ffd640 1 -- 172.21.15.117:0/1962594638 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f166c003520 con 0x7f16841619b0 2024-09-19T08:38:02.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.341+0000 7f1682ffd640 1 -- 172.21.15.117:0/1962594638 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1957469882 0 0) 0x7f16840cec10 con 0x7f1684161d90 2024-09-19T08:38:02.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.341+0000 7f1682ffd640 1 -- 172.21.15.117:0/1962594638 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f168406c990 con 0x7f1684161d90 2024-09-19T08:38:02.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.341+0000 7f1682ffd640 1 -- 172.21.15.117:0/1962594638 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2905794129 0 0) 0x7f166c003520 con 0x7f16841619b0 2024-09-19T08:38:02.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.341+0000 7f16837fe640 1 -- 172.21.15.117:0/1962594638 >> v1:172.21.15.146:6789/0 conn(0x7f1684161d90 legacy=0x7f16840cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:02.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.341+0000 7f16837fe640 1 -- 172.21.15.117:0/1962594638 >> v1:172.21.15.117:6789/0 conn(0x7f16841619b0 legacy=0x7f16840d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:02.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.341+0000 7f16837fe640 1 -- 172.21.15.117:0/1962594638 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16840b0540 con 0x7f16840b0a80 2024-09-19T08:38:02.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.342+0000 7f16837fe640 1 --2- 172.21.15.117:0/1962594638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16840b0a80 0x7f16840cbcd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f16780097d0 tx=0x7f167802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c95fd5efc030c4c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:02.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.342+0000 7f1682ffd640 1 -- 172.21.15.117:0/1962594638 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1678037070 con 0x7f16840b0a80 2024-09-19T08:38:02.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.342+0000 7f1682ffd640 1 -- 172.21.15.117:0/1962594638 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f167802ac30 con 0x7f16840b0a80 2024-09-19T08:38:02.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.342+0000 7f1682ffd640 1 -- 172.21.15.117:0/1962594638 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16740015f0 con 0x7f16840b0a80 2024-09-19T08:38:02.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.343+0000 7f168aa1e640 1 -- 172.21.15.117:0/1962594638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16840b0a80 msgr2=0x7f16840cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:02.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.343+0000 7f168aa1e640 1 --2- 172.21.15.117:0/1962594638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16840b0a80 0x7f16840cbcd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f16780097d0 tx=0x7f167802a1a0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.343+0000 7f168aa1e640 1 -- 172.21.15.117:0/1962594638 shutdown_connections 2024-09-19T08:38:02.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.343+0000 7f168aa1e640 1 --2- 172.21.15.117:0/1962594638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16840b0a80 0x7f16840cbcd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.343+0000 7f168aa1e640 1 -- 172.21.15.117:0/1962594638 >> 172.21.15.117:0/1962594638 conn(0x7f168409a9f0 msgr2=0x7f16840b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:02.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.343+0000 7f168aa1e640 1 -- 172.21.15.117:0/1962594638 shutdown_connections 2024-09-19T08:38:02.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.343+0000 7f168aa1e640 1 -- 172.21.15.117:0/1962594638 wait complete. 2024-09-19T08:38:02.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.344+0000 7f168aa1e640 1 Processor -- start 2024-09-19T08:38:02.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.344+0000 7f168aa1e640 1 -- start start 2024-09-19T08:38:02.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.345+0000 7f168aa1e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16840b0a80 0x7f168415b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:02.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.345+0000 7f168aa1e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16841619b0 0x7f168415bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:02.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.345+0000 7f168aa1e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1684161d90 0x7f1684159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:02.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.345+0000 7f168aa1e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f16840cd330 con 0x7f1684161d90 2024-09-19T08:38:02.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.345+0000 7f168aa1e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f168406c620 con 0x7f16840b0a80 2024-09-19T08:38:02.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.345+0000 7f168aa1e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f16840cd4b0 con 0x7f16841619b0 2024-09-19T08:38:02.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.345+0000 7f1688fbb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1684161d90 0x7f1684159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:02.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.345+0000 7f1688fbb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1684161d90 0x7f1684159c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57602/0 (socket says 172.21.15.117:57602) 2024-09-19T08:38:02.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.345+0000 7f1688fbb640 1 -- 172.21.15.117:0/2589350080 learned_addr learned my addr 172.21.15.117:0/2589350080 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:02.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.345+0000 7f16837fe640 1 --2- 172.21.15.117:0/2589350080 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16841619b0 0x7f168415bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:02.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.345+0000 7f1683fff640 1 --2- 172.21.15.117:0/2589350080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16840b0a80 0x7f168415b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:02.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.345+0000 7f1688fbb640 1 -- 172.21.15.117:0/2589350080 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16841619b0 msgr2=0x7f168415bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:02.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.345+0000 7f1688fbb640 1 --2- 172.21.15.117:0/2589350080 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16841619b0 0x7f168415bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.345+0000 7f1688fbb640 1 -- 172.21.15.117:0/2589350080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16840b0a80 msgr2=0x7f168415b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:02.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.345+0000 7f1688fbb640 1 --2- 172.21.15.117:0/2589350080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16840b0a80 0x7f168415b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.345+0000 7f1688fbb640 1 -- 172.21.15.117:0/2589350080 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16841f7480 con 0x7f1684161d90 2024-09-19T08:38:02.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.345+0000 7f1688fbb640 1 --2- 172.21.15.117:0/2589350080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1684161d90 0x7f1684159c70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f167c00c830 tx=0x7f167c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:02.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.346+0000 7f1680ff9640 1 -- 172.21.15.117:0/2589350080 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c003b70 con 0x7f1684161d90 2024-09-19T08:38:02.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.346+0000 7f1680ff9640 1 -- 172.21.15.117:0/2589350080 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f167c003d10 con 0x7f1684161d90 2024-09-19T08:38:02.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.346+0000 7f168aa1e640 1 -- 172.21.15.117:0/2589350080 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16841f7760 con 0x7f1684161d90 2024-09-19T08:38:02.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.346+0000 7f1680ff9640 1 -- 172.21.15.117:0/2589350080 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c00aa90 con 0x7f1684161d90 2024-09-19T08:38:02.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.346+0000 7f168aa1e640 1 -- 172.21.15.117:0/2589350080 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16841f7d20 con 0x7f1684161d90 2024-09-19T08:38:02.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.347+0000 7f168aa1e640 1 -- 172.21.15.117:0/2589350080 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16840d15c0 con 0x7f1684161d90 2024-09-19T08:38:02.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.347+0000 7f1680ff9640 1 -- 172.21.15.117:0/2589350080 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f167c00ac30 con 0x7f1684161d90 2024-09-19T08:38:02.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.348+0000 7f1680ff9640 1 --2- 172.21.15.117:0/2589350080 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f167006c2b0 0x7f167006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:02.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.348+0000 7f1680ff9640 1 -- 172.21.15.117:0/2589350080 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f167c08b270 con 0x7f1684161d90 2024-09-19T08:38:02.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.348+0000 7f1683fff640 1 --2- 172.21.15.117:0/2589350080 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f167006c2b0 0x7f167006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:02.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.348+0000 7f1683fff640 1 --2- 172.21.15.117:0/2589350080 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f167006c2b0 0x7f167006e770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1674000f60 tx=0x7f1674009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:02.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.352+0000 7f1680ff9640 1 -- 172.21.15.117:0/2589350080 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f167c059c60 con 0x7f1684161d90 2024-09-19T08:38:02.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.585+0000 7f168aa1e640 1 -- 172.21.15.117:0/2589350080 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f168415c6e0 con 0x7f1684161d90 2024-09-19T08:38:02.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.587+0000 7f1680ff9640 1 -- 172.21.15.117:0/2589350080 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f167c059560 con 0x7f1684161d90 2024-09-19T08:38:02.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.590+0000 7f168aa1e640 1 -- 172.21.15.117:0/2589350080 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f167006c2b0 msgr2=0x7f167006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:02.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.590+0000 7f168aa1e640 1 --2- 172.21.15.117:0/2589350080 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f167006c2b0 0x7f167006e770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1674000f60 tx=0x7f1674009040 comp rx=0 tx=0).stop 2024-09-19T08:38:02.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.590+0000 7f168aa1e640 1 -- 172.21.15.117:0/2589350080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1684161d90 msgr2=0x7f1684159c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:02.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.590+0000 7f168aa1e640 1 --2- 172.21.15.117:0/2589350080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1684161d90 0x7f1684159c70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f167c00c830 tx=0x7f167c00ccf0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.590+0000 7f168aa1e640 1 -- 172.21.15.117:0/2589350080 shutdown_connections 2024-09-19T08:38:02.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.590+0000 7f168aa1e640 1 --2- 172.21.15.117:0/2589350080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1684161d90 0x7f1684159c70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.590+0000 7f168aa1e640 1 --2- 172.21.15.117:0/2589350080 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f167006c2b0 0x7f167006e770 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.590+0000 7f168aa1e640 1 --2- 172.21.15.117:0/2589350080 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16841619b0 0x7f168415bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.590+0000 7f168aa1e640 1 --2- 172.21.15.117:0/2589350080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16840b0a80 0x7f168415b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.590+0000 7f168aa1e640 1 -- 172.21.15.117:0/2589350080 >> 172.21.15.117:0/2589350080 conn(0x7f168409a9f0 msgr2=0x7f16840ccb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:02.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.590+0000 7f168aa1e640 1 -- 172.21.15.117:0/2589350080 shutdown_connections 2024-09-19T08:38:02.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.590+0000 7f168aa1e640 1 -- 172.21.15.117:0/2589350080 wait complete. 2024-09-19T08:38:02.601 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-19T08:38:02.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.701+0000 7fda344dd640 1 Processor -- start 2024-09-19T08:38:02.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.701+0000 7fda344dd640 1 -- start start 2024-09-19T08:38:02.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.702+0000 7fda344dd640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fda2c0d0bc0 0x7fda2c0cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:02.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.702+0000 7fda344dd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fda2c15c2c0 0x7fda2c0cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:02.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.702+0000 7fda344dd640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda2c0cfc80 con 0x7fda2c15bee0 2024-09-19T08:38:02.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.702+0000 7fda344dd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fda2c0ceaf0 con 0x7fda2c15c2c0 2024-09-19T08:38:02.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.702+0000 7fda344dd640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fda2c0cdee0 con 0x7fda2c0d0bc0 2024-09-19T08:38:02.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.702+0000 7fda32a7a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fda2c15c2c0 0x7fda2c0cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:02.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.702+0000 7fda32a7a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fda2c15c2c0 0x7fda2c0cf740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57612/0 (socket says 172.21.15.117:57612) 2024-09-19T08:38:02.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.702+0000 7fda32a7a640 1 -- 172.21.15.117:0/1911674406 learned_addr learned my addr 172.21.15.117:0/1911674406 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:02.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.702+0000 7fda31a78640 1 --2- 172.21.15.117:0/1911674406 >> v2:172.21.15.146:3300/0 conn(0x7fda2c0d0bc0 0x7fda2c0cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:02.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.702+0000 7fda32a7a640 1 -- 172.21.15.117:0/1911674406 >> v2:172.21.15.146:3300/0 conn(0x7fda2c0d0bc0 msgr2=0x7fda2c0cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:02.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.702+0000 7fda32a7a640 1 --2- 172.21.15.117:0/1911674406 >> v2:172.21.15.146:3300/0 conn(0x7fda2c0d0bc0 0x7fda2c0cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.702+0000 7fda32a7a640 1 -- 172.21.15.117:0/1911674406 >> v1:172.21.15.146:6789/0 conn(0x7fda2c15bee0 legacy=0x7fda2c0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:02.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.702+0000 7fda32a7a640 1 -- 172.21.15.117:0/1911674406 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda2c0ce1c0 con 0x7fda2c15c2c0 2024-09-19T08:38:02.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.703+0000 7fda32a7a640 1 --2- 172.21.15.117:0/1911674406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda2c15c2c0 0x7fda2c0cf740 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0cadd0 tx=0x7fda2402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eabd1ba49fd2edf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:02.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.703+0000 7fda31277640 1 -- 172.21.15.117:0/1911674406 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda24036070 con 0x7fda2c15c2c0 2024-09-19T08:38:02.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.703+0000 7fda31277640 1 -- 172.21.15.117:0/1911674406 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda24031600 con 0x7fda2c15c2c0 2024-09-19T08:38:02.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.703+0000 7fda31277640 1 -- 172.21.15.117:0/1911674406 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda240319d0 con 0x7fda2c15c2c0 2024-09-19T08:38:02.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.704+0000 7fda344dd640 1 -- 172.21.15.117:0/1911674406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda2c15c2c0 msgr2=0x7fda2c0cf740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:02.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.704+0000 7fda344dd640 1 --2- 172.21.15.117:0/1911674406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda2c15c2c0 0x7fda2c0cf740 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0cadd0 tx=0x7fda2402a730 comp rx=0 tx=0).stop 2024-09-19T08:38:02.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.704+0000 7fda344dd640 1 -- 172.21.15.117:0/1911674406 shutdown_connections 2024-09-19T08:38:02.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.704+0000 7fda344dd640 1 --2- 172.21.15.117:0/1911674406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda2c15c2c0 0x7fda2c0cf740 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.704+0000 7fda344dd640 1 --2- 172.21.15.117:0/1911674406 >> v2:172.21.15.146:3300/0 conn(0x7fda2c0d0bc0 0x7fda2c0cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.704+0000 7fda344dd640 1 -- 172.21.15.117:0/1911674406 >> 172.21.15.117:0/1911674406 conn(0x7fda2c06bdf0 msgr2=0x7fda2c06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:02.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.704+0000 7fda344dd640 1 -- 172.21.15.117:0/1911674406 shutdown_connections 2024-09-19T08:38:02.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.704+0000 7fda344dd640 1 -- 172.21.15.117:0/1911674406 wait complete. 2024-09-19T08:38:02.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.705+0000 7fda344dd640 1 Processor -- start 2024-09-19T08:38:02.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.705+0000 7fda344dd640 1 -- start start 2024-09-19T08:38:02.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda344dd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2c0d0bc0 0x7fda2c15a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:02.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda344dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda2c15bee0 0x7fda2c0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:02.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda344dd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda2c15c2c0 0x7fda2c155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:02.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda344dd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fda2c06dec0 con 0x7fda2c15bee0 2024-09-19T08:38:02.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda344dd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fda2c0ce780 con 0x7fda2c0d0bc0 2024-09-19T08:38:02.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda344dd640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fda2c06e040 con 0x7fda2c15c2c0 2024-09-19T08:38:02.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda31a78640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda2c15bee0 0x7fda2c0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:02.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda31a78640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda2c15bee0 0x7fda2c0cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57624/0 (socket says 172.21.15.117:57624) 2024-09-19T08:38:02.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda31a78640 1 -- 172.21.15.117:0/2075367116 learned_addr learned my addr 172.21.15.117:0/2075367116 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:02.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda32279640 1 --2- 172.21.15.117:0/2075367116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2c0d0bc0 0x7fda2c15a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:02.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda32a7a640 1 --2- 172.21.15.117:0/2075367116 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda2c15c2c0 0x7fda2c155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:02.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda31a78640 1 -- 172.21.15.117:0/2075367116 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda2c15c2c0 msgr2=0x7fda2c155330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:02.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda31a78640 1 --2- 172.21.15.117:0/2075367116 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda2c15c2c0 0x7fda2c155330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda31a78640 1 -- 172.21.15.117:0/2075367116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2c0d0bc0 msgr2=0x7fda2c15a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:02.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda31a78640 1 --2- 172.21.15.117:0/2075367116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2c0d0bc0 0x7fda2c15a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda31a78640 1 -- 172.21.15.117:0/2075367116 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda2c1f1d90 con 0x7fda2c15bee0 2024-09-19T08:38:02.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda32279640 1 --2- 172.21.15.117:0/2075367116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2c0d0bc0 0x7fda2c15a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:02.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda31a78640 1 --2- 172.21.15.117:0/2075367116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda2c15bee0 0x7fda2c0cd370 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fda2000d5f0 tx=0x7fda2000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:02.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda1effd640 1 -- 172.21.15.117:0/2075367116 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda200125f0 con 0x7fda2c15bee0 2024-09-19T08:38:02.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda1effd640 1 -- 172.21.15.117:0/2075367116 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda20019070 con 0x7fda2c15bee0 2024-09-19T08:38:02.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda1effd640 1 -- 172.21.15.117:0/2075367116 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda200129d0 con 0x7fda2c15bee0 2024-09-19T08:38:02.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda344dd640 1 -- 172.21.15.117:0/2075367116 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda2c1f2030 con 0x7fda2c15bee0 2024-09-19T08:38:02.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.706+0000 7fda344dd640 1 -- 172.21.15.117:0/2075367116 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda2c1f25f0 con 0x7fda2c15bee0 2024-09-19T08:38:02.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.707+0000 7fda344dd640 1 -- 172.21.15.117:0/2075367116 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda2c0d04b0 con 0x7fda2c15bee0 2024-09-19T08:38:02.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.708+0000 7fda1effd640 1 -- 172.21.15.117:0/2075367116 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fda20012b70 con 0x7fda2c15bee0 2024-09-19T08:38:02.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.708+0000 7fda1effd640 1 --2- 172.21.15.117:0/2075367116 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fda1006c2b0 0x7fda1006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:02.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.708+0000 7fda1effd640 1 -- 172.21.15.117:0/2075367116 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fda2008b680 con 0x7fda2c15bee0 2024-09-19T08:38:02.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.708+0000 7fda32279640 1 --2- 172.21.15.117:0/2075367116 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fda1006c2b0 0x7fda1006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:02.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.709+0000 7fda32279640 1 --2- 172.21.15.117:0/2075367116 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fda1006c2b0 0x7fda1006e770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fda2c15fc50 tx=0x7fda28009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:02.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.712+0000 7fda1effd640 1 -- 172.21.15.117:0/2075367116 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fda20059fb0 con 0x7fda2c15bee0 2024-09-19T08:38:02.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.942+0000 7fda344dd640 1 -- 172.21.15.117:0/2075367116 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fda2c06ce20 con 0x7fda2c15bee0 2024-09-19T08:38:02.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.944+0000 7fda1effd640 1 -- 172.21.15.117:0/2075367116 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7fda200598b0 con 0x7fda2c15bee0 2024-09-19T08:38:02.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.946+0000 7fda344dd640 1 -- 172.21.15.117:0/2075367116 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fda1006c2b0 msgr2=0x7fda1006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:02.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.946+0000 7fda344dd640 1 --2- 172.21.15.117:0/2075367116 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fda1006c2b0 0x7fda1006e770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fda2c15fc50 tx=0x7fda28009040 comp rx=0 tx=0).stop 2024-09-19T08:38:02.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.946+0000 7fda344dd640 1 -- 172.21.15.117:0/2075367116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda2c15bee0 msgr2=0x7fda2c0cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:02.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.946+0000 7fda344dd640 1 --2- 172.21.15.117:0/2075367116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda2c15bee0 0x7fda2c0cd370 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fda2000d5f0 tx=0x7fda2000dab0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.946+0000 7fda344dd640 1 -- 172.21.15.117:0/2075367116 shutdown_connections 2024-09-19T08:38:02.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.946+0000 7fda344dd640 1 --2- 172.21.15.117:0/2075367116 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fda1006c2b0 0x7fda1006e770 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.946+0000 7fda344dd640 1 --2- 172.21.15.117:0/2075367116 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda2c15c2c0 0x7fda2c155330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.946+0000 7fda344dd640 1 --2- 172.21.15.117:0/2075367116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda2c15bee0 0x7fda2c0cd370 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.946+0000 7fda344dd640 1 --2- 172.21.15.117:0/2075367116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2c0d0bc0 0x7fda2c15a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:02.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.946+0000 7fda344dd640 1 -- 172.21.15.117:0/2075367116 >> 172.21.15.117:0/2075367116 conn(0x7fda2c06bdf0 msgr2=0x7fda2c0cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:02.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.946+0000 7fda344dd640 1 -- 172.21.15.117:0/2075367116 shutdown_connections 2024-09-19T08:38:02.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:02.946+0000 7fda344dd640 1 -- 172.21.15.117:0/2075367116 wait complete. 2024-09-19T08:38:02.956 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-19T08:38:03.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.055+0000 7f7258af8640 1 Processor -- start 2024-09-19T08:38:03.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.055+0000 7f7258af8640 1 -- start start 2024-09-19T08:38:03.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.056+0000 7f7258af8640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f725415e4f0 0x7f72540b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.056+0000 7f7258af8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7254070930 0x7f72540b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.056+0000 7f7258af8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72540b5590 con 0x7f72540add30 2024-09-19T08:38:03.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.056+0000 7f7258af8640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f7254070ea0 con 0x7f725415e4f0 2024-09-19T08:38:03.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.056+0000 7f7258af8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f725406e8c0 con 0x7f7254070930 2024-09-19T08:38:03.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.056+0000 7f725259c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f72540add30 0x7f72540ae110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:52848/0 (socket says 172.21.15.117:52848) 2024-09-19T08:38:03.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.056+0000 7f725259c640 1 -- 172.21.15.117:0/3187901550 learned_addr learned my addr 172.21.15.117:0/3187901550 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:03.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.056+0000 7f725159a640 1 -- 172.21.15.117:0/3187901550 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2840147890 0 0) 0x7f72540b5590 con 0x7f72540add30 2024-09-19T08:38:03.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.056+0000 7f7252d9d640 1 --2- 172.21.15.117:0/3187901550 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7254070930 0x7f72540b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.056+0000 7f725159a640 1 -- 172.21.15.117:0/3187901550 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f723c003520 con 0x7f72540add30 2024-09-19T08:38:03.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.056+0000 7f7251d9b640 1 --2- 172.21.15.117:0/3187901550 >> v2:172.21.15.146:3300/0 conn(0x7f725415e4f0 0x7f72540b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f725159a640 1 -- 172.21.15.117:0/3187901550 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3335877804 0 0) 0x7f723c003520 con 0x7f72540add30 2024-09-19T08:38:03.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f725159a640 1 -- 172.21.15.117:0/3187901550 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7254070930 msgr2=0x7f72540b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:03.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f725159a640 1 --2- 172.21.15.117:0/3187901550 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7254070930 0x7f72540b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f725159a640 1 -- 172.21.15.117:0/3187901550 >> v2:172.21.15.146:3300/0 conn(0x7f725415e4f0 msgr2=0x7f72540b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:03.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f725159a640 1 --2- 172.21.15.117:0/3187901550 >> v2:172.21.15.146:3300/0 conn(0x7f725415e4f0 0x7f72540b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f725159a640 1 -- 172.21.15.117:0/3187901550 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f725406eba0 con 0x7f72540add30 2024-09-19T08:38:03.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f725159a640 1 -- 172.21.15.117:0/3187901550 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f7244001670 con 0x7f72540add30 2024-09-19T08:38:03.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f7251d9b640 1 --2- 172.21.15.117:0/3187901550 >> v2:172.21.15.146:3300/0 conn(0x7f725415e4f0 0x7f72540b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:03.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f725159a640 1 -- 172.21.15.117:0/3187901550 >> v1:172.21.15.117:6789/0 conn(0x7f72540add30 legacy=0x7f72540ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:03.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f725159a640 1 --2- 172.21.15.117:0/3187901550 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7254070930 0x7f723c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f725159a640 1 --2- 172.21.15.117:0/3187901550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f723c003f80 0x7f723c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f725159a640 1 --2- 172.21.15.117:0/3187901550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f723c004d40 0x7f723c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f725159a640 1 -- 172.21.15.117:0/3187901550 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7254070ea0 con 0x7f723c004d40 2024-09-19T08:38:03.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f725159a640 1 -- 172.21.15.117:0/3187901550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f725406e8c0 con 0x7f723c003f80 2024-09-19T08:38:03.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f725159a640 1 -- 172.21.15.117:0/3187901550 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f723c00ba70 con 0x7f7254070930 2024-09-19T08:38:03.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f7252d9d640 1 --2- 172.21.15.117:0/3187901550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f723c004d40 0x7f723c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f725259c640 1 --2- 172.21.15.117:0/3187901550 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7254070930 0x7f723c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f7251d9b640 1 --2- 172.21.15.117:0/3187901550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f723c003f80 0x7f723c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f7252d9d640 1 -- 172.21.15.117:0/3187901550 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7254070930 msgr2=0x7f723c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:03.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f7252d9d640 1 --2- 172.21.15.117:0/3187901550 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7254070930 0x7f723c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f7252d9d640 1 -- 172.21.15.117:0/3187901550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f723c003f80 msgr2=0x7f723c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:03.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f7252d9d640 1 --2- 172.21.15.117:0/3187901550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f723c003f80 0x7f723c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.057+0000 7f7252d9d640 1 -- 172.21.15.117:0/3187901550 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723c003520 con 0x7f723c004d40 2024-09-19T08:38:03.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.058+0000 7f7252d9d640 1 --2- 172.21.15.117:0/3187901550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f723c004d40 0x7f723c0051c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f724c009fc0 tx=0x7f723c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229c16fce0e28149 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:03.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.058+0000 7f725159a640 1 -- 172.21.15.117:0/3187901550 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724c009c10 con 0x7f723c004d40 2024-09-19T08:38:03.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.058+0000 7f725159a640 1 -- 172.21.15.117:0/3187901550 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f724c036070 con 0x7f723c004d40 2024-09-19T08:38:03.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.058+0000 7f725159a640 1 -- 172.21.15.117:0/3187901550 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724c031880 con 0x7f723c004d40 2024-09-19T08:38:03.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.058+0000 7f7258af8640 1 -- 172.21.15.117:0/3187901550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f723c004d40 msgr2=0x7f723c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:03.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.058+0000 7f7258af8640 1 --2- 172.21.15.117:0/3187901550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f723c004d40 0x7f723c0051c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f724c009fc0 tx=0x7f723c005830 comp rx=0 tx=0).stop 2024-09-19T08:38:03.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.058+0000 7f7252d9d640 1 -- 172.21.15.117:0/3187901550 reap_dead start 2024-09-19T08:38:03.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.059+0000 7f7258af8640 1 -- 172.21.15.117:0/3187901550 shutdown_connections 2024-09-19T08:38:03.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.059+0000 7f7258af8640 1 -- 172.21.15.117:0/3187901550 >> 172.21.15.117:0/3187901550 conn(0x7f725406bc10 msgr2=0x7f725406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:03.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.059+0000 7f7258af8640 1 -- 172.21.15.117:0/3187901550 shutdown_connections 2024-09-19T08:38:03.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.059+0000 7f7258af8640 1 -- 172.21.15.117:0/3187901550 wait complete. 2024-09-19T08:38:03.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.060+0000 7f7258af8640 1 Processor -- start 2024-09-19T08:38:03.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.060+0000 7f7258af8640 1 -- start start 2024-09-19T08:38:03.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.061+0000 7f7258af8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f723c004d40 0x7f7254152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.061+0000 7f7258af8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72540ceea0 0x7f72541542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.061+0000 7f7258af8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72540cf320 0x7f7254154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.061+0000 7f7258af8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f72540b0270 con 0x7f72540cf320 2024-09-19T08:38:03.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.061+0000 7f7258af8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f72540b00f0 con 0x7f723c004d40 2024-09-19T08:38:03.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.061+0000 7f7258af8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f72540b03f0 con 0x7f72540ceea0 2024-09-19T08:38:03.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.061+0000 7f7252d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72540cf320 0x7f7254154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.061+0000 7f7252d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72540cf320 0x7f7254154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57642/0 (socket says 172.21.15.117:57642) 2024-09-19T08:38:03.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.061+0000 7f7252d9d640 1 -- 172.21.15.117:0/1445974515 learned_addr learned my addr 172.21.15.117:0/1445974515 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:03.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.061+0000 7f725259c640 1 --2- 172.21.15.117:0/1445974515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f723c004d40 0x7f7254152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.061+0000 7f7251d9b640 1 --2- 172.21.15.117:0/1445974515 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72540ceea0 0x7f72541542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.061+0000 7f7252d9d640 1 -- 172.21.15.117:0/1445974515 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72540ceea0 msgr2=0x7f72541542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:03.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.061+0000 7f7252d9d640 1 --2- 172.21.15.117:0/1445974515 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72540ceea0 0x7f72541542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.061+0000 7f7252d9d640 1 -- 172.21.15.117:0/1445974515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f723c004d40 msgr2=0x7f7254152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:03.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.061+0000 7f7252d9d640 1 --2- 172.21.15.117:0/1445974515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f723c004d40 0x7f7254152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.061+0000 7f7252d9d640 1 -- 172.21.15.117:0/1445974515 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f725415cc40 con 0x7f72540cf320 2024-09-19T08:38:03.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.061+0000 7f7252d9d640 1 --2- 172.21.15.117:0/1445974515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72540cf320 0x7f7254154800 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f724c00e230 tx=0x7f724c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:03.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.061+0000 7f7242ffd640 1 -- 172.21.15.117:0/1445974515 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724c009c10 con 0x7f72540cf320 2024-09-19T08:38:03.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.062+0000 7f7242ffd640 1 -- 172.21.15.117:0/1445974515 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f724c031db0 con 0x7f72540cf320 2024-09-19T08:38:03.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.062+0000 7f7258af8640 1 -- 172.21.15.117:0/1445974515 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f725415cf20 con 0x7f72540cf320 2024-09-19T08:38:03.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.062+0000 7f7242ffd640 1 -- 172.21.15.117:0/1445974515 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724c003bd0 con 0x7f72540cf320 2024-09-19T08:38:03.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.062+0000 7f7258af8640 1 -- 172.21.15.117:0/1445974515 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72540cf8f0 con 0x7f72540cf320 2024-09-19T08:38:03.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.063+0000 7f7258af8640 1 -- 172.21.15.117:0/1445974515 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7254161870 con 0x7f72540cf320 2024-09-19T08:38:03.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.063+0000 7f7242ffd640 1 -- 172.21.15.117:0/1445974515 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f724c005d10 con 0x7f72540cf320 2024-09-19T08:38:03.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.063+0000 7f7242ffd640 1 --2- 172.21.15.117:0/1445974515 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f723406c2b0 0x7f723406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.064+0000 7f7242ffd640 1 -- 172.21.15.117:0/1445974515 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f724c0ac7c0 con 0x7f72540cf320 2024-09-19T08:38:03.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.064+0000 7f725259c640 1 --2- 172.21.15.117:0/1445974515 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f723406c2b0 0x7f723406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.064+0000 7f725259c640 1 --2- 172.21.15.117:0/1445974515 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f723406c2b0 0x7f723406e770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7244000c00 tx=0x7f7244001e00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:03.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.068+0000 7f7242ffd640 1 -- 172.21.15.117:0/1445974515 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f724c04a060 con 0x7f72540cf320 2024-09-19T08:38:03.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.297+0000 7f7258af8640 1 -- 172.21.15.117:0/1445974515 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f7254153da0 con 0x7f72540cf320 2024-09-19T08:38:03.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.299+0000 7f7242ffd640 1 -- 172.21.15.117:0/1445974515 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f724c07ab30 con 0x7f72540cf320 2024-09-19T08:38:03.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.301+0000 7f7258af8640 1 -- 172.21.15.117:0/1445974515 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f723406c2b0 msgr2=0x7f723406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:03.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.301+0000 7f7258af8640 1 --2- 172.21.15.117:0/1445974515 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f723406c2b0 0x7f723406e770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7244000c00 tx=0x7f7244001e00 comp rx=0 tx=0).stop 2024-09-19T08:38:03.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.301+0000 7f7258af8640 1 -- 172.21.15.117:0/1445974515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72540cf320 msgr2=0x7f7254154800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:03.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.301+0000 7f7258af8640 1 --2- 172.21.15.117:0/1445974515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72540cf320 0x7f7254154800 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f724c00e230 tx=0x7f724c009750 comp rx=0 tx=0).stop 2024-09-19T08:38:03.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.301+0000 7f7258af8640 1 -- 172.21.15.117:0/1445974515 shutdown_connections 2024-09-19T08:38:03.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.302+0000 7f7258af8640 1 --2- 172.21.15.117:0/1445974515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72540cf320 0x7f7254154800 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.302+0000 7f7258af8640 1 --2- 172.21.15.117:0/1445974515 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f723406c2b0 0x7f723406e770 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.302+0000 7f7258af8640 1 --2- 172.21.15.117:0/1445974515 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72540ceea0 0x7f72541542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.302+0000 7f7258af8640 1 --2- 172.21.15.117:0/1445974515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f723c004d40 0x7f7254152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.302+0000 7f7258af8640 1 -- 172.21.15.117:0/1445974515 >> 172.21.15.117:0/1445974515 conn(0x7f725406bc10 msgr2=0x7f72540af610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:03.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.302+0000 7f7258af8640 1 -- 172.21.15.117:0/1445974515 shutdown_connections 2024-09-19T08:38:03.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.302+0000 7f7258af8640 1 -- 172.21.15.117:0/1445974515 wait complete. 2024-09-19T08:38:03.312 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-19T08:38:03.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.412+0000 7f0bfabe4640 1 Processor -- start 2024-09-19T08:38:03.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.412+0000 7f0bfabe4640 1 -- start start 2024-09-19T08:38:03.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.413+0000 7f0bfabe4640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0bf415b120 0x7f0bf406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.413+0000 7f0bfabe4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0bf406dec0 0x7f0bf406e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.413+0000 7f0bfabe4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0bf40d04b0 0x7f0bf40d0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.413+0000 7f0bfabe4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f0bf40d0e40 con 0x7f0bf40d04b0 2024-09-19T08:38:03.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.413+0000 7f0bfabe4640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f0bf415b500 con 0x7f0bf415b120 2024-09-19T08:38:03.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.413+0000 7f0bfabe4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f0bf406e940 con 0x7f0bf406dec0 2024-09-19T08:38:03.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.413+0000 7f0bf9181640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0bf40d04b0 0x7f0bf40d0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.413+0000 7f0bf9181640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0bf40d04b0 0x7f0bf40d0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57646/0 (socket says 172.21.15.117:57646) 2024-09-19T08:38:03.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.413+0000 7f0bf9181640 1 -- 172.21.15.117:0/177485343 learned_addr learned my addr 172.21.15.117:0/177485343 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:03.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.414+0000 7f0bf3fff640 1 --2- 172.21.15.117:0/177485343 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0bf406dec0 0x7f0bf406e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.414+0000 7f0bf8980640 1 --2- 172.21.15.117:0/177485343 >> v2:172.21.15.146:3300/0 conn(0x7f0bf415b120 0x7f0bf406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.414+0000 7f0bf9181640 1 -- 172.21.15.117:0/177485343 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0bf406dec0 msgr2=0x7f0bf406e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:03.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.414+0000 7f0bf9181640 1 --2- 172.21.15.117:0/177485343 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0bf406dec0 0x7f0bf406e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.414+0000 7f0bf9181640 1 -- 172.21.15.117:0/177485343 >> v2:172.21.15.146:3300/0 conn(0x7f0bf415b120 msgr2=0x7f0bf406f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:03.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.414+0000 7f0bf9181640 1 --2- 172.21.15.117:0/177485343 >> v2:172.21.15.146:3300/0 conn(0x7f0bf415b120 0x7f0bf406f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.414+0000 7f0bf9181640 1 -- 172.21.15.117:0/177485343 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf406ec20 con 0x7f0bf40d04b0 2024-09-19T08:38:03.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.414+0000 7f0bf9181640 1 --2- 172.21.15.117:0/177485343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bf40d04b0 0x7f0bf40d0900 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0bf406cb50 tx=0x7f0bdc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2b59f513947644 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:03.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.414+0000 7f0bf37fe640 1 -- 172.21.15.117:0/177485343 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc037070 con 0x7f0bf40d04b0 2024-09-19T08:38:03.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.415+0000 7f0bf37fe640 1 -- 172.21.15.117:0/177485343 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bdc032440 con 0x7f0bf40d04b0 2024-09-19T08:38:03.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.415+0000 7f0bf37fe640 1 -- 172.21.15.117:0/177485343 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc032810 con 0x7f0bf40d04b0 2024-09-19T08:38:03.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.415+0000 7f0bfabe4640 1 -- 172.21.15.117:0/177485343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bf40d04b0 msgr2=0x7f0bf40d0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:03.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.415+0000 7f0bfabe4640 1 --2- 172.21.15.117:0/177485343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bf40d04b0 0x7f0bf40d0900 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0bf406cb50 tx=0x7f0bdc02a1e0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.415+0000 7f0bfabe4640 1 -- 172.21.15.117:0/177485343 shutdown_connections 2024-09-19T08:38:03.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.415+0000 7f0bfabe4640 1 --2- 172.21.15.117:0/177485343 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0bf406dec0 0x7f0bf406e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.415+0000 7f0bfabe4640 1 --2- 172.21.15.117:0/177485343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bf40d04b0 0x7f0bf40d0900 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.415+0000 7f0bfabe4640 1 --2- 172.21.15.117:0/177485343 >> v2:172.21.15.146:3300/0 conn(0x7f0bf415b120 0x7f0bf406f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.415+0000 7f0bfabe4640 1 -- 172.21.15.117:0/177485343 >> 172.21.15.117:0/177485343 conn(0x7f0bf406bdf0 msgr2=0x7f0bf406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:03.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.415+0000 7f0bfabe4640 1 -- 172.21.15.117:0/177485343 shutdown_connections 2024-09-19T08:38:03.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.415+0000 7f0bfabe4640 1 -- 172.21.15.117:0/177485343 wait complete. 2024-09-19T08:38:03.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.416+0000 7f0bfabe4640 1 Processor -- start 2024-09-19T08:38:03.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.416+0000 7f0bfabe4640 1 -- start start 2024-09-19T08:38:03.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.417+0000 7f0bfabe4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bf406dec0 0x7f0bf4158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.417+0000 7f0bfabe4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0bf40d04b0 0x7f0bf41571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.417+0000 7f0bfabe4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bf415b120 0x7f0bf41677d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.417+0000 7f0bfabe4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf406f4c0 con 0x7f0bf415b120 2024-09-19T08:38:03.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.417+0000 7f0bfabe4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf406f1e0 con 0x7f0bf406dec0 2024-09-19T08:38:03.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.417+0000 7f0bfabe4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f0bf40ce060 con 0x7f0bf40d04b0 2024-09-19T08:38:03.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.417+0000 7f0bf9181640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bf415b120 0x7f0bf41677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.417+0000 7f0bf9181640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bf415b120 0x7f0bf41677d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57662/0 (socket says 172.21.15.117:57662) 2024-09-19T08:38:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.417+0000 7f0bf9181640 1 -- 172.21.15.117:0/2729881959 learned_addr learned my addr 172.21.15.117:0/2729881959 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.418+0000 7f0bf3fff640 1 --2- 172.21.15.117:0/2729881959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0bf40d04b0 0x7f0bf41571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.418+0000 7f0bf9181640 1 -- 172.21.15.117:0/2729881959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0bf40d04b0 msgr2=0x7f0bf41571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.418+0000 7f0bf8980640 1 --2- 172.21.15.117:0/2729881959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bf406dec0 0x7f0bf4158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.418+0000 7f0bf9181640 1 --2- 172.21.15.117:0/2729881959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0bf40d04b0 0x7f0bf41571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.418+0000 7f0bf9181640 1 -- 172.21.15.117:0/2729881959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bf406dec0 msgr2=0x7f0bf4158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.418+0000 7f0bf9181640 1 --2- 172.21.15.117:0/2729881959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bf406dec0 0x7f0bf4158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.418+0000 7f0bf9181640 1 -- 172.21.15.117:0/2729881959 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf4157860 con 0x7f0bf415b120 2024-09-19T08:38:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.418+0000 7f0bf8980640 1 --2- 172.21.15.117:0/2729881959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bf406dec0 0x7f0bf4158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.418+0000 7f0bf9181640 1 --2- 172.21.15.117:0/2729881959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bf415b120 0x7f0bf41677d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0090b0 tx=0x7f0bdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.418+0000 7f0bf17fa640 1 -- 172.21.15.117:0/2729881959 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc037040 con 0x7f0bf415b120 2024-09-19T08:38:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.418+0000 7f0bf17fa640 1 -- 172.21.15.117:0/2729881959 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bdc042070 con 0x7f0bf415b120 2024-09-19T08:38:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.418+0000 7f0bfabe4640 1 -- 172.21.15.117:0/2729881959 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf4150b50 con 0x7f0bf415b120 2024-09-19T08:38:03.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.418+0000 7f0bf17fa640 1 -- 172.21.15.117:0/2729881959 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc030920 con 0x7f0bf415b120 2024-09-19T08:38:03.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.418+0000 7f0bfabe4640 1 -- 172.21.15.117:0/2729881959 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bf4151110 con 0x7f0bf415b120 2024-09-19T08:38:03.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.419+0000 7f0bfabe4640 1 -- 172.21.15.117:0/2729881959 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bf40d08e0 con 0x7f0bf415b120 2024-09-19T08:38:03.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.419+0000 7f0bf17fa640 1 -- 172.21.15.117:0/2729881959 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0bdc030ac0 con 0x7f0bf415b120 2024-09-19T08:38:03.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.420+0000 7f0bf17fa640 1 --2- 172.21.15.117:0/2729881959 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f0bd406c2b0 0x7f0bd406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.420+0000 7f0bf17fa640 1 -- 172.21.15.117:0/2729881959 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f0bdc0abb40 con 0x7f0bf415b120 2024-09-19T08:38:03.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.420+0000 7f0bf8980640 1 --2- 172.21.15.117:0/2729881959 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f0bd406c2b0 0x7f0bd406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.420+0000 7f0bf8980640 1 --2- 172.21.15.117:0/2729881959 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f0bd406c2b0 0x7f0bd406e770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00b800 tx=0x7f0bec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:03.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.424+0000 7f0bf17fa640 1 -- 172.21.15.117:0/2729881959 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0bdc079eb0 con 0x7f0bf415b120 2024-09-19T08:38:03.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.656+0000 7f0bfabe4640 1 -- 172.21.15.117:0/2729881959 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f0bf406ce20 con 0x7f0bf415b120 2024-09-19T08:38:03.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.658+0000 7f0bf17fa640 1 -- 172.21.15.117:0/2729881959 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f0bdc07e1b0 con 0x7f0bf415b120 2024-09-19T08:38:03.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.660+0000 7f0bfabe4640 1 -- 172.21.15.117:0/2729881959 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f0bd406c2b0 msgr2=0x7f0bd406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:03.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.660+0000 7f0bfabe4640 1 --2- 172.21.15.117:0/2729881959 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f0bd406c2b0 0x7f0bd406e770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00b800 tx=0x7f0bec008040 comp rx=0 tx=0).stop 2024-09-19T08:38:03.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.660+0000 7f0bfabe4640 1 -- 172.21.15.117:0/2729881959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bf415b120 msgr2=0x7f0bf41677d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:03.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.660+0000 7f0bfabe4640 1 --2- 172.21.15.117:0/2729881959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bf415b120 0x7f0bf41677d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0090b0 tx=0x7f0bdc0046c0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.660+0000 7f0bfabe4640 1 -- 172.21.15.117:0/2729881959 shutdown_connections 2024-09-19T08:38:03.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.660+0000 7f0bfabe4640 1 --2- 172.21.15.117:0/2729881959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0bf415b120 0x7f0bf41677d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.660+0000 7f0bfabe4640 1 --2- 172.21.15.117:0/2729881959 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f0bd406c2b0 0x7f0bd406e770 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.660+0000 7f0bfabe4640 1 --2- 172.21.15.117:0/2729881959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0bf40d04b0 0x7f0bf41571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.660+0000 7f0bfabe4640 1 --2- 172.21.15.117:0/2729881959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bf406dec0 0x7f0bf4158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.660+0000 7f0bfabe4640 1 -- 172.21.15.117:0/2729881959 >> 172.21.15.117:0/2729881959 conn(0x7f0bf406bdf0 msgr2=0x7f0bf40b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:03.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.660+0000 7f0bfabe4640 1 -- 172.21.15.117:0/2729881959 shutdown_connections 2024-09-19T08:38:03.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.660+0000 7f0bfabe4640 1 -- 172.21.15.117:0/2729881959 wait complete. 2024-09-19T08:38:03.670 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-19T08:38:03.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.770+0000 7fa9fadb9640 1 Processor -- start 2024-09-19T08:38:03.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.770+0000 7fa9fadb9640 1 -- start start 2024-09-19T08:38:03.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.771+0000 7fa9fadb9640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa9f4161d90 0x7fa9f40cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.771+0000 7fa9fadb9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f406c990 con 0x7fa9f40b0a80 2024-09-19T08:38:03.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.771+0000 7fa9fadb9640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f40cec10 con 0x7fa9f41619b0 2024-09-19T08:38:03.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.771+0000 7fa9fadb9640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f40ce930 con 0x7fa9f4161d90 2024-09-19T08:38:03.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.771+0000 7fa9f3fff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fa9f40b0a80 0x7fa9f40cbcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:52850/0 (socket says 172.21.15.117:52850) 2024-09-19T08:38:03.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.771+0000 7fa9f3fff640 1 -- 172.21.15.117:0/3802068293 learned_addr learned my addr 172.21.15.117:0/3802068293 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:03.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.771+0000 7fa9f37fe640 1 -- 172.21.15.117:0/3802068293 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4161495813 0 0) 0x7fa9f406c990 con 0x7fa9f40b0a80 2024-09-19T08:38:03.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.771+0000 7fa9f37fe640 1 -- 172.21.15.117:0/3802068293 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9dc003520 con 0x7fa9f40b0a80 2024-09-19T08:38:03.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.771+0000 7fa9f9356640 1 --2- 172.21.15.117:0/3802068293 >> v2:172.21.15.146:3300/0 conn(0x7fa9f4161d90 0x7fa9f40cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f37fe640 1 -- 172.21.15.117:0/3802068293 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3673532450 0 0) 0x7fa9dc003520 con 0x7fa9f40b0a80 2024-09-19T08:38:03.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f37fe640 1 -- 172.21.15.117:0/3802068293 >> v2:172.21.15.146:3300/0 conn(0x7fa9f4161d90 msgr2=0x7fa9f40cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:03.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f37fe640 1 --2- 172.21.15.117:0/3802068293 >> v2:172.21.15.146:3300/0 conn(0x7fa9f4161d90 0x7fa9f40cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f37fe640 1 -- 172.21.15.117:0/3802068293 >> v1:172.21.15.146:6789/0 conn(0x7fa9f41619b0 legacy=0x7fa9f40d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:03.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f37fe640 1 -- 172.21.15.117:0/3802068293 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f40b0540 con 0x7fa9f40b0a80 2024-09-19T08:38:03.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f37fe640 1 -- 172.21.15.117:0/3802068293 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7fa9e8001670 con 0x7fa9f40b0a80 2024-09-19T08:38:03.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f9356640 1 --2- 172.21.15.117:0/3802068293 >> v2:172.21.15.146:3300/0 conn(0x7fa9f4161d90 0x7fa9f40cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:03.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f37fe640 1 -- 172.21.15.117:0/3802068293 >> v1:172.21.15.117:6789/0 conn(0x7fa9f40b0a80 legacy=0x7fa9f40cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:03.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f37fe640 1 --2- 172.21.15.117:0/3802068293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9dc0039b0 0x7fa9dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f37fe640 1 --2- 172.21.15.117:0/3802068293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9dc004800 0x7fa9dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f37fe640 1 --2- 172.21.15.117:0/3802068293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9dc0051c0 0x7fa9dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f37fe640 1 -- 172.21.15.117:0/3802068293 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f40ce930 con 0x7fa9dc0039b0 2024-09-19T08:38:03.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f37fe640 1 -- 172.21.15.117:0/3802068293 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc00c110 con 0x7fa9dc0051c0 2024-09-19T08:38:03.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f37fe640 1 -- 172.21.15.117:0/3802068293 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fa9dc00c310 con 0x7fa9dc004800 2024-09-19T08:38:03.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f8b55640 1 --2- 172.21.15.117:0/3802068293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9dc0039b0 0x7fa9dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f3fff640 1 --2- 172.21.15.117:0/3802068293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9dc004800 0x7fa9dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f9356640 1 --2- 172.21.15.117:0/3802068293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9dc0051c0 0x7fa9dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f8b55640 1 -- 172.21.15.117:0/3802068293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9dc004800 msgr2=0x7fa9dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:03.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f8b55640 1 --2- 172.21.15.117:0/3802068293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9dc004800 0x7fa9dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f8b55640 1 -- 172.21.15.117:0/3802068293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9dc0051c0 msgr2=0x7fa9dc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:03.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f8b55640 1 --2- 172.21.15.117:0/3802068293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9dc0051c0 0x7fa9dc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f8b55640 1 -- 172.21.15.117:0/3802068293 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9dc003520 con 0x7fa9dc0039b0 2024-09-19T08:38:03.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f9356640 1 --2- 172.21.15.117:0/3802068293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9dc0051c0 0x7fa9dc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:03.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f3fff640 1 --2- 172.21.15.117:0/3802068293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9dc004800 0x7fa9dc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:03.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.772+0000 7fa9f9356640 1 -- 172.21.15.117:0/3802068293 reap_dead start 2024-09-19T08:38:03.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.773+0000 7fa9f8b55640 1 --2- 172.21.15.117:0/3802068293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9dc0039b0 0x7fa9dc003dd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4001750 tx=0x7fa9dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53bca2bb3bce5931 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:03.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.773+0000 7fa9f37fe640 1 -- 172.21.15.117:0/3802068293 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4001370 con 0x7fa9dc0039b0 2024-09-19T08:38:03.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.773+0000 7fa9f37fe640 1 -- 172.21.15.117:0/3802068293 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e40052d0 con 0x7fa9dc0039b0 2024-09-19T08:38:03.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.773+0000 7fa9f37fe640 1 -- 172.21.15.117:0/3802068293 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e402abc0 con 0x7fa9dc0039b0 2024-09-19T08:38:03.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.773+0000 7fa9fadb9640 1 -- 172.21.15.117:0/3802068293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9dc0039b0 msgr2=0x7fa9dc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:03.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.773+0000 7fa9fadb9640 1 --2- 172.21.15.117:0/3802068293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9dc0039b0 0x7fa9dc003dd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4001750 tx=0x7fa9dc005830 comp rx=0 tx=0).stop 2024-09-19T08:38:03.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.773+0000 7fa9fadb9640 1 -- 172.21.15.117:0/3802068293 shutdown_connections 2024-09-19T08:38:03.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.773+0000 7fa9fadb9640 1 --2- 172.21.15.117:0/3802068293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9dc0039b0 0x7fa9dc003dd0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.773+0000 7fa9fadb9640 1 -- 172.21.15.117:0/3802068293 >> 172.21.15.117:0/3802068293 conn(0x7fa9f409a9f0 msgr2=0x7fa9f40b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:03.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.774+0000 7fa9fadb9640 1 -- 172.21.15.117:0/3802068293 shutdown_connections 2024-09-19T08:38:03.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.774+0000 7fa9fadb9640 1 -- 172.21.15.117:0/3802068293 wait complete. 2024-09-19T08:38:03.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.775+0000 7fa9fadb9640 1 Processor -- start 2024-09-19T08:38:03.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.775+0000 7fa9fadb9640 1 -- start start 2024-09-19T08:38:03.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9fadb9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9dc0039b0 0x7fa9f40c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9fadb9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9f40b34e0 0x7fa9f415fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9fadb9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9f4160040 0x7fa9f41f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9fadb9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f40cd330 con 0x7fa9dc0039b0 2024-09-19T08:38:03.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9fadb9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f406c620 con 0x7fa9f40b34e0 2024-09-19T08:38:03.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9fadb9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f40cd4b0 con 0x7fa9f4160040 2024-09-19T08:38:03.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9f8b55640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9dc0039b0 0x7fa9f40c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9f8b55640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9dc0039b0 0x7fa9f40c4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57678/0 (socket says 172.21.15.117:57678) 2024-09-19T08:38:03.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9f8b55640 1 -- 172.21.15.117:0/1062880758 learned_addr learned my addr 172.21.15.117:0/1062880758 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:03.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9f9356640 1 --2- 172.21.15.117:0/1062880758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9f4160040 0x7fa9f41f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9f3fff640 1 --2- 172.21.15.117:0/1062880758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9f40b34e0 0x7fa9f415fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9f8b55640 1 -- 172.21.15.117:0/1062880758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9f4160040 msgr2=0x7fa9f41f3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:03.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9f8b55640 1 --2- 172.21.15.117:0/1062880758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9f4160040 0x7fa9f41f3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9f8b55640 1 -- 172.21.15.117:0/1062880758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9f40b34e0 msgr2=0x7fa9f415fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:03.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9f8b55640 1 --2- 172.21.15.117:0/1062880758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9f40b34e0 0x7fa9f415fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:03.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9f8b55640 1 -- 172.21.15.117:0/1062880758 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f41f45d0 con 0x7fa9dc0039b0 2024-09-19T08:38:03.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9f9356640 1 --2- 172.21.15.117:0/1062880758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9f4160040 0x7fa9f41f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:03.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9f3fff640 1 --2- 172.21.15.117:0/1062880758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9f40b34e0 0x7fa9f415fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:03.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9f8b55640 1 --2- 172.21.15.117:0/1062880758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9dc0039b0 0x7fa9f40c4e40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4005040 tx=0x7fa9e4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:03.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9f17fa640 1 -- 172.21.15.117:0/1062880758 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e403f030 con 0x7fa9dc0039b0 2024-09-19T08:38:03.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9f17fa640 1 -- 172.21.15.117:0/1062880758 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e4005480 con 0x7fa9dc0039b0 2024-09-19T08:38:03.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9fadb9640 1 -- 172.21.15.117:0/1062880758 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f41f48b0 con 0x7fa9dc0039b0 2024-09-19T08:38:03.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9f17fa640 1 -- 172.21.15.117:0/1062880758 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4037040 con 0x7fa9dc0039b0 2024-09-19T08:38:03.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.776+0000 7fa9fadb9640 1 -- 172.21.15.117:0/1062880758 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f40b70f0 con 0x7fa9dc0039b0 2024-09-19T08:38:03.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.777+0000 7fa9fadb9640 1 -- 172.21.15.117:0/1062880758 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9f40d0440 con 0x7fa9dc0039b0 2024-09-19T08:38:03.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.778+0000 7fa9f17fa640 1 -- 172.21.15.117:0/1062880758 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa9e4042070 con 0x7fa9dc0039b0 2024-09-19T08:38:03.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.778+0000 7fa9f17fa640 1 --2- 172.21.15.117:0/1062880758 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa9e006c2e0 0x7fa9e006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:03.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.778+0000 7fa9f17fa640 1 -- 172.21.15.117:0/1062880758 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fa9e40aa700 con 0x7fa9dc0039b0 2024-09-19T08:38:03.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.779+0000 7fa9f3fff640 1 --2- 172.21.15.117:0/1062880758 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa9e006c2e0 0x7fa9e006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:03.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.779+0000 7fa9f3fff640 1 --2- 172.21.15.117:0/1062880758 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa9e006c2e0 0x7fa9e006e7a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80017e0 tx=0x7fa9e8001df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:03.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:03.783+0000 7fa9f17fa640 1 -- 172.21.15.117:0/1062880758 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa9e40433b0 con 0x7fa9dc0039b0 2024-09-19T08:38:04.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.013+0000 7fa9fadb9640 1 -- 172.21.15.117:0/1062880758 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fa9f4160420 con 0x7fa9dc0039b0 2024-09-19T08:38:04.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.015+0000 7fa9f17fa640 1 -- 172.21.15.117:0/1062880758 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7fa9e4078fa0 con 0x7fa9dc0039b0 2024-09-19T08:38:04.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.017+0000 7fa9fadb9640 1 -- 172.21.15.117:0/1062880758 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa9e006c2e0 msgr2=0x7fa9e006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:04.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.017+0000 7fa9fadb9640 1 --2- 172.21.15.117:0/1062880758 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa9e006c2e0 0x7fa9e006e7a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80017e0 tx=0x7fa9e8001df0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.017+0000 7fa9fadb9640 1 -- 172.21.15.117:0/1062880758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9dc0039b0 msgr2=0x7fa9f40c4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:04.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.017+0000 7fa9fadb9640 1 --2- 172.21.15.117:0/1062880758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9dc0039b0 0x7fa9f40c4e40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4005040 tx=0x7fa9e4001120 comp rx=0 tx=0).stop 2024-09-19T08:38:04.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.017+0000 7fa9fadb9640 1 -- 172.21.15.117:0/1062880758 shutdown_connections 2024-09-19T08:38:04.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.017+0000 7fa9fadb9640 1 --2- 172.21.15.117:0/1062880758 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa9e006c2e0 0x7fa9e006e7a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.017+0000 7fa9fadb9640 1 --2- 172.21.15.117:0/1062880758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9f4160040 0x7fa9f41f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.017+0000 7fa9fadb9640 1 --2- 172.21.15.117:0/1062880758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9f40b34e0 0x7fa9f415fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.017+0000 7fa9fadb9640 1 --2- 172.21.15.117:0/1062880758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9dc0039b0 0x7fa9f40c4e40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.017+0000 7fa9fadb9640 1 -- 172.21.15.117:0/1062880758 >> 172.21.15.117:0/1062880758 conn(0x7fa9f409a9f0 msgr2=0x7fa9f40d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:04.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.017+0000 7fa9fadb9640 1 -- 172.21.15.117:0/1062880758 shutdown_connections 2024-09-19T08:38:04.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.017+0000 7fa9fadb9640 1 -- 172.21.15.117:0/1062880758 wait complete. 2024-09-19T08:38:04.027 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T08:38:04.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.125+0000 7fcfab1a2640 1 Processor -- start 2024-09-19T08:38:04.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.125+0000 7fcfab1a2640 1 -- start start 2024-09-19T08:38:04.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.126+0000 7fcfab1a2640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfa4162a00 0x7fcfa40d0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:04.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.126+0000 7fcfab1a2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcfa40b4f80 0x7fcfa40d0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:04.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.126+0000 7fcfab1a2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfa40d2110 con 0x7fcfa40b7020 2024-09-19T08:38:04.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.126+0000 7fcfab1a2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fcfa40d23f0 con 0x7fcfa40b4f80 2024-09-19T08:38:04.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.126+0000 7fcfab1a2640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fcfa40d26d0 con 0x7fcfa4162a00 2024-09-19T08:38:04.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.127+0000 7fcfa999f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcfa40b4f80 0x7fcfa40d0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:04.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.127+0000 7fcfaa9a1640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fcfa40b7020 0x7fcfa40b74d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:52864/0 (socket says 172.21.15.117:52864) 2024-09-19T08:38:04.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.127+0000 7fcfaa9a1640 1 -- 172.21.15.117:0/905029422 learned_addr learned my addr 172.21.15.117:0/905029422 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:04.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.127+0000 7fcfaa1a0640 1 --2- 172.21.15.117:0/905029422 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfa4162a00 0x7fcfa40d0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:04.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.127+0000 7fcfa999f640 1 -- 172.21.15.117:0/905029422 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfa4162a00 msgr2=0x7fcfa40d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:04.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.127+0000 7fcfa999f640 1 --2- 172.21.15.117:0/905029422 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfa4162a00 0x7fcfa40d0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.127+0000 7fcfa999f640 1 -- 172.21.15.117:0/905029422 >> v1:172.21.15.117:6789/0 conn(0x7fcfa40b7020 legacy=0x7fcfa40b74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:04.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.127+0000 7fcfa999f640 1 -- 172.21.15.117:0/905029422 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa40d29b0 con 0x7fcfa40b4f80 2024-09-19T08:38:04.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.127+0000 7fcfa919e640 1 -- 172.21.15.117:0/905029422 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3720322303 0 0) 0x7fcfa40d2110 con 0x7fcfa40b7020 2024-09-19T08:38:04.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.128+0000 7fcfa999f640 1 --2- 172.21.15.117:0/905029422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfa40b4f80 0x7fcfa40d0e40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcf940097a0 tx=0x7fcf9402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a7d8118e18352f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:04.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.128+0000 7fcfa919e640 1 -- 172.21.15.117:0/905029422 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf94037070 con 0x7fcfa40b4f80 2024-09-19T08:38:04.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.128+0000 7fcfa919e640 1 -- 172.21.15.117:0/905029422 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf9402ae50 con 0x7fcfa40b4f80 2024-09-19T08:38:04.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.128+0000 7fcfa919e640 1 -- 172.21.15.117:0/905029422 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf94032660 con 0x7fcfa40b4f80 2024-09-19T08:38:04.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.128+0000 7fcfab1a2640 1 -- 172.21.15.117:0/905029422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfa40b4f80 msgr2=0x7fcfa40d0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:04.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.128+0000 7fcfab1a2640 1 --2- 172.21.15.117:0/905029422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfa40b4f80 0x7fcfa40d0e40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcf940097a0 tx=0x7fcf9402a100 comp rx=0 tx=0).stop 2024-09-19T08:38:04.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.128+0000 7fcfab1a2640 1 -- 172.21.15.117:0/905029422 shutdown_connections 2024-09-19T08:38:04.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.128+0000 7fcfab1a2640 1 --2- 172.21.15.117:0/905029422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfa40b4f80 0x7fcfa40d0e40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.128+0000 7fcfab1a2640 1 --2- 172.21.15.117:0/905029422 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfa4162a00 0x7fcfa40d0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.128+0000 7fcfab1a2640 1 -- 172.21.15.117:0/905029422 >> 172.21.15.117:0/905029422 conn(0x7fcfa409d520 msgr2=0x7fcfa40d41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:04.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.128+0000 7fcfab1a2640 1 -- 172.21.15.117:0/905029422 shutdown_connections 2024-09-19T08:38:04.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.128+0000 7fcfab1a2640 1 -- 172.21.15.117:0/905029422 wait complete. 2024-09-19T08:38:04.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.129+0000 7fcfab1a2640 1 Processor -- start 2024-09-19T08:38:04.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.130+0000 7fcfab1a2640 1 -- start start 2024-09-19T08:38:04.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.130+0000 7fcfab1a2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfa40b4f80 0x7fcfa41e7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:04.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.130+0000 7fcfab1a2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfa40b7020 0x7fcfa41593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:04.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.130+0000 7fcfab1a2640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfa4162a00 0x7fcfa40c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:04.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.130+0000 7fcfab1a2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa40d3330 con 0x7fcfa40b4f80 2024-09-19T08:38:04.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.130+0000 7fcfab1a2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa40d31b0 con 0x7fcfa40b7020 2024-09-19T08:38:04.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.130+0000 7fcfab1a2640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fcfa4162de0 con 0x7fcfa4162a00 2024-09-19T08:38:04.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.130+0000 7fcfaa1a0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfa40b4f80 0x7fcfa41e7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:04.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.130+0000 7fcfaa1a0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfa40b4f80 0x7fcfa41e7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57690/0 (socket says 172.21.15.117:57690) 2024-09-19T08:38:04.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.130+0000 7fcfaa1a0640 1 -- 172.21.15.117:0/2685834974 learned_addr learned my addr 172.21.15.117:0/2685834974 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:04.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.131+0000 7fcfa999f640 1 --2- 172.21.15.117:0/2685834974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfa40b7020 0x7fcfa41593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:04.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.131+0000 7fcfaa9a1640 1 --2- 172.21.15.117:0/2685834974 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfa4162a00 0x7fcfa40c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:04.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.131+0000 7fcfaa1a0640 1 -- 172.21.15.117:0/2685834974 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfa4162a00 msgr2=0x7fcfa40c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:04.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.131+0000 7fcfaa1a0640 1 --2- 172.21.15.117:0/2685834974 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfa4162a00 0x7fcfa40c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.131+0000 7fcfaa1a0640 1 -- 172.21.15.117:0/2685834974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfa40b7020 msgr2=0x7fcfa41593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:04.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.131+0000 7fcfaa1a0640 1 --2- 172.21.15.117:0/2685834974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfa40b7020 0x7fcfa41593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.131+0000 7fcfaa1a0640 1 -- 172.21.15.117:0/2685834974 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa41e83c0 con 0x7fcfa40b4f80 2024-09-19T08:38:04.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.131+0000 7fcfaa1a0640 1 --2- 172.21.15.117:0/2685834974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfa40b4f80 0x7fcfa41e7de0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000e8a0 tx=0x7fcfa000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:04.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.131+0000 7fcf9affd640 1 -- 172.21.15.117:0/2685834974 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0017070 con 0x7fcfa40b4f80 2024-09-19T08:38:04.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.131+0000 7fcf9affd640 1 -- 172.21.15.117:0/2685834974 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa000c940 con 0x7fcfa40b4f80 2024-09-19T08:38:04.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.131+0000 7fcfab1a2640 1 -- 172.21.15.117:0/2685834974 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfa41e86a0 con 0x7fcfa40b4f80 2024-09-19T08:38:04.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.131+0000 7fcf9affd640 1 -- 172.21.15.117:0/2685834974 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa000cd30 con 0x7fcfa40b4f80 2024-09-19T08:38:04.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.131+0000 7fcfab1a2640 1 -- 172.21.15.117:0/2685834974 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfa41e8c60 con 0x7fcfa40b4f80 2024-09-19T08:38:04.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.132+0000 7fcfab1a2640 1 -- 172.21.15.117:0/2685834974 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfa40d0900 con 0x7fcfa40b4f80 2024-09-19T08:38:04.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.133+0000 7fcf9affd640 1 -- 172.21.15.117:0/2685834974 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcfa001a070 con 0x7fcfa40b4f80 2024-09-19T08:38:04.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.133+0000 7fcf9affd640 1 --2- 172.21.15.117:0/2685834974 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf8806c2b0 0x7fcf8806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:04.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.133+0000 7fcf9affd640 1 -- 172.21.15.117:0/2685834974 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fcfa008b380 con 0x7fcfa40b4f80 2024-09-19T08:38:04.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.133+0000 7fcfa999f640 1 --2- 172.21.15.117:0/2685834974 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf8806c2b0 0x7fcf8806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:04.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.134+0000 7fcfa999f640 1 --2- 172.21.15.117:0/2685834974 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf8806c2b0 0x7fcf8806e770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcf94034000 tx=0x7fcf9402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:04.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.137+0000 7fcf9affd640 1 -- 172.21.15.117:0/2685834974 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcfa00596f0 con 0x7fcfa40b4f80 2024-09-19T08:38:04.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.304+0000 7fcfab1a2640 1 -- 172.21.15.117:0/2685834974 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fcfa40d1870 con 0x7fcfa40b4f80 2024-09-19T08:38:04.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.304+0000 7fcf9affd640 1 -- 172.21.15.117:0/2685834974 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) ==== 84+0+65 (secure 0 0 0) 0x7fcfa005d9f0 con 0x7fcfa40b4f80 2024-09-19T08:38:04.304 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:04.304 INFO:teuthology.orchestra.run.smithi117.stdout:[ 2024-09-19T08:38:04.305 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:04.305 INFO:teuthology.orchestra.run.smithi117.stdout: "poolnum": 1, 2024-09-19T08:38:04.305 INFO:teuthology.orchestra.run.smithi117.stdout: "poolname": ".mgr" 2024-09-19T08:38:04.305 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:04.305 INFO:teuthology.orchestra.run.smithi117.stdout:] 2024-09-19T08:38:04.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.306+0000 7fcfab1a2640 1 -- 172.21.15.117:0/2685834974 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf8806c2b0 msgr2=0x7fcf8806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:04.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.306+0000 7fcfab1a2640 1 --2- 172.21.15.117:0/2685834974 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf8806c2b0 0x7fcf8806e770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcf94034000 tx=0x7fcf9402e000 comp rx=0 tx=0).stop 2024-09-19T08:38:04.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.306+0000 7fcfab1a2640 1 -- 172.21.15.117:0/2685834974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfa40b4f80 msgr2=0x7fcfa41e7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:04.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.306+0000 7fcfab1a2640 1 --2- 172.21.15.117:0/2685834974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfa40b4f80 0x7fcfa41e7de0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000e8a0 tx=0x7fcfa000ed60 comp rx=0 tx=0).stop 2024-09-19T08:38:04.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.306+0000 7fcfab1a2640 1 -- 172.21.15.117:0/2685834974 shutdown_connections 2024-09-19T08:38:04.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.306+0000 7fcfab1a2640 1 --2- 172.21.15.117:0/2685834974 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf8806c2b0 0x7fcf8806e770 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.306+0000 7fcfab1a2640 1 --2- 172.21.15.117:0/2685834974 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfa4162a00 0x7fcfa40c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.306+0000 7fcfab1a2640 1 --2- 172.21.15.117:0/2685834974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfa40b7020 0x7fcfa41593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.306+0000 7fcfab1a2640 1 --2- 172.21.15.117:0/2685834974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfa40b4f80 0x7fcfa41e7de0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.306+0000 7fcfab1a2640 1 -- 172.21.15.117:0/2685834974 >> 172.21.15.117:0/2685834974 conn(0x7fcfa409d520 msgr2=0x7fcfa40d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:04.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.306+0000 7fcfab1a2640 1 -- 172.21.15.117:0/2685834974 shutdown_connections 2024-09-19T08:38:04.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.306+0000 7fcfab1a2640 1 -- 172.21.15.117:0/2685834974 wait complete. 2024-09-19T08:38:04.317 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T08:38:04.317 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T08:38:04.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.418+0000 7fe9140c9640 1 Processor -- start 2024-09-19T08:38:04.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.418+0000 7fe9140c9640 1 -- start start 2024-09-19T08:38:04.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.419+0000 7fe9140c9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe90c142170 0x7fe90c166d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:04.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.419+0000 7fe9140c9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe90c15d710 con 0x7fe90c141680 2024-09-19T08:38:04.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.419+0000 7fe9140c9640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe90c15c950 con 0x7fe90c0d0540 2024-09-19T08:38:04.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.419+0000 7fe9140c9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fe90c15c6f0 con 0x7fe90c142170 2024-09-19T08:38:04.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.419+0000 7fe911e65640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe90c141680 0x7fe90c0cfe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:37494/0 (socket says 172.21.15.117:37494) 2024-09-19T08:38:04.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.419+0000 7fe911e65640 1 -- 172.21.15.117:0/1166596326 learned_addr learned my addr 172.21.15.117:0/1166596326 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:04.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.419+0000 7fe912666640 1 --2- 172.21.15.117:0/1166596326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe90c142170 0x7fe90c166d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:04.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.419+0000 7fe910e63640 1 -- 172.21.15.117:0/1166596326 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3016754113 0 0) 0x7fe90c15d710 con 0x7fe90c141680 2024-09-19T08:38:04.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.419+0000 7fe910e63640 1 -- 172.21.15.117:0/1166596326 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8f4003520 con 0x7fe90c141680 2024-09-19T08:38:04.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.419+0000 7fe910e63640 1 -- 172.21.15.117:0/1166596326 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1064555561 0 0) 0x7fe8f4003520 con 0x7fe90c141680 2024-09-19T08:38:04.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.420+0000 7fe910e63640 1 -- 172.21.15.117:0/1166596326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe90c142170 msgr2=0x7fe90c166d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:04.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.420+0000 7fe910e63640 1 --2- 172.21.15.117:0/1166596326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe90c142170 0x7fe90c166d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.420+0000 7fe910e63640 1 -- 172.21.15.117:0/1166596326 >> v1:172.21.15.146:6789/0 conn(0x7fe90c0d0540 legacy=0x7fe90c141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:04.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.420+0000 7fe910e63640 1 -- 172.21.15.117:0/1166596326 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90c15cc30 con 0x7fe90c141680 2024-09-19T08:38:04.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.420+0000 7fe910e63640 1 -- 172.21.15.117:0/1166596326 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7fe8fc001a10 con 0x7fe90c141680 2024-09-19T08:38:04.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.420+0000 7fe910e63640 1 -- 172.21.15.117:0/1166596326 >> v1:172.21.15.117:6789/0 conn(0x7fe90c141680 legacy=0x7fe90c0cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:04.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.420+0000 7fe910e63640 1 --2- 172.21.15.117:0/1166596326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe90c142170 0x7fe8f40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:04.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.420+0000 7fe910e63640 1 --2- 172.21.15.117:0/1166596326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8f4003f60 0x7fe8f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:04.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.420+0000 7fe910e63640 1 --2- 172.21.15.117:0/1166596326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8f4004d40 0x7fe8f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:04.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.420+0000 7fe910e63640 1 -- 172.21.15.117:0/1166596326 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe90c15c6f0 con 0x7fe8f4003f60 2024-09-19T08:38:04.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.420+0000 7fe910e63640 1 -- 172.21.15.117:0/1166596326 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f400baa0 con 0x7fe8f4004d40 2024-09-19T08:38:04.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.420+0000 7fe910e63640 1 -- 172.21.15.117:0/1166596326 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f400bca0 con 0x7fe90c142170 2024-09-19T08:38:04.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.420+0000 7fe911664640 1 --2- 172.21.15.117:0/1166596326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8f4003f60 0x7fe8f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:04.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.420+0000 7fe911e65640 1 --2- 172.21.15.117:0/1166596326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe90c142170 0x7fe8f40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:04.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.420+0000 7fe912666640 1 --2- 172.21.15.117:0/1166596326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8f4004d40 0x7fe8f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:04.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.420+0000 7fe911664640 1 -- 172.21.15.117:0/1166596326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe90c142170 msgr2=0x7fe8f40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:04.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.420+0000 7fe911664640 1 --2- 172.21.15.117:0/1166596326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe90c142170 0x7fe8f40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.420+0000 7fe911664640 1 -- 172.21.15.117:0/1166596326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8f4004d40 msgr2=0x7fe8f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:04.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.420+0000 7fe911664640 1 --2- 172.21.15.117:0/1166596326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8f4004d40 0x7fe8f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.420+0000 7fe911664640 1 -- 172.21.15.117:0/1166596326 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f4003520 con 0x7fe8f4003f60 2024-09-19T08:38:04.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.421+0000 7fe911664640 1 --2- 172.21.15.117:0/1166596326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8f4003f60 0x7fe8f4004800 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe900001750 tx=0x7fe8f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d64a77460f6fa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:04.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.421+0000 7fe910e63640 1 -- 172.21.15.117:0/1166596326 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe900001370 con 0x7fe8f4003f60 2024-09-19T08:38:04.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.421+0000 7fe910e63640 1 -- 172.21.15.117:0/1166596326 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9000052d0 con 0x7fe8f4003f60 2024-09-19T08:38:04.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.421+0000 7fe910e63640 1 -- 172.21.15.117:0/1166596326 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90002abe0 con 0x7fe8f4003f60 2024-09-19T08:38:04.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.421+0000 7fe9140c9640 1 -- 172.21.15.117:0/1166596326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8f4003f60 msgr2=0x7fe8f4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:04.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.421+0000 7fe9140c9640 1 --2- 172.21.15.117:0/1166596326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8f4003f60 0x7fe8f4004800 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe900001750 tx=0x7fe8f4005830 comp rx=0 tx=0).stop 2024-09-19T08:38:04.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.421+0000 7fe912666640 1 -- 172.21.15.117:0/1166596326 reap_dead start 2024-09-19T08:38:04.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.421+0000 7fe9140c9640 1 -- 172.21.15.117:0/1166596326 shutdown_connections 2024-09-19T08:38:04.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.421+0000 7fe9140c9640 1 -- 172.21.15.117:0/1166596326 >> 172.21.15.117:0/1166596326 conn(0x7fe90c0b3ed0 msgr2=0x7fe90c0b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:04.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.422+0000 7fe9140c9640 1 -- 172.21.15.117:0/1166596326 shutdown_connections 2024-09-19T08:38:04.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.422+0000 7fe9140c9640 1 -- 172.21.15.117:0/1166596326 wait complete. 2024-09-19T08:38:04.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.423+0000 7fe9140c9640 1 Processor -- start 2024-09-19T08:38:04.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.423+0000 7fe9140c9640 1 -- start start 2024-09-19T08:38:04.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.423+0000 7fe9140c9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8f4003f60 0x7fe90c1f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:04.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.423+0000 7fe9140c9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe90c0b6eb0 0x7fe90c134c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:04.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.423+0000 7fe9140c9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe90c0b5bf0 0x7fe90c156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:04.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.423+0000 7fe9140c9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe90c1425c0 con 0x7fe90c0b6eb0 2024-09-19T08:38:04.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.423+0000 7fe9140c9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe90c15d1f0 con 0x7fe8f4003f60 2024-09-19T08:38:04.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.423+0000 7fe9140c9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fe90c1408c0 con 0x7fe90c0b5bf0 2024-09-19T08:38:04.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.424+0000 7fe911664640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe90c0b6eb0 0x7fe90c134c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:04.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.424+0000 7fe911664640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe90c0b6eb0 0x7fe90c134c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47058/0 (socket says 172.21.15.117:47058) 2024-09-19T08:38:04.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.424+0000 7fe911664640 1 -- 172.21.15.117:0/3114998023 learned_addr learned my addr 172.21.15.117:0/3114998023 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:04.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.424+0000 7fe912666640 1 --2- 172.21.15.117:0/3114998023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe90c0b5bf0 0x7fe90c156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:04.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.424+0000 7fe911e65640 1 --2- 172.21.15.117:0/3114998023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8f4003f60 0x7fe90c1f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:04.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.424+0000 7fe911664640 1 -- 172.21.15.117:0/3114998023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe90c0b5bf0 msgr2=0x7fe90c156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:04.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.424+0000 7fe911664640 1 --2- 172.21.15.117:0/3114998023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe90c0b5bf0 0x7fe90c156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.424+0000 7fe911664640 1 -- 172.21.15.117:0/3114998023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8f4003f60 msgr2=0x7fe90c1f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:04.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.424+0000 7fe911664640 1 --2- 172.21.15.117:0/3114998023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8f4003f60 0x7fe90c1f1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:04.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.424+0000 7fe911664640 1 -- 172.21.15.117:0/3114998023 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90c1e3480 con 0x7fe90c0b6eb0 2024-09-19T08:38:04.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.424+0000 7fe911664640 1 --2- 172.21.15.117:0/3114998023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe90c0b6eb0 0x7fe90c134c20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe900001870 tx=0x7fe900001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:04.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.424+0000 7fe90a7fc640 1 -- 172.21.15.117:0/3114998023 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe900040020 con 0x7fe90c0b6eb0 2024-09-19T08:38:04.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.424+0000 7fe90a7fc640 1 -- 172.21.15.117:0/3114998023 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe900007680 con 0x7fe90c0b6eb0 2024-09-19T08:38:04.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.424+0000 7fe9140c9640 1 -- 172.21.15.117:0/3114998023 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe90c0b7470 con 0x7fe90c0b6eb0 2024-09-19T08:38:04.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.424+0000 7fe90a7fc640 1 -- 172.21.15.117:0/3114998023 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe900007a30 con 0x7fe90c0b6eb0 2024-09-19T08:38:04.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.424+0000 7fe9140c9640 1 -- 172.21.15.117:0/3114998023 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe90c0b7750 con 0x7fe90c0b6eb0 2024-09-19T08:38:04.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.425+0000 7fe9140c9640 1 -- 172.21.15.117:0/3114998023 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe90c141a60 con 0x7fe90c0b6eb0 2024-09-19T08:38:04.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.426+0000 7fe90a7fc640 1 -- 172.21.15.117:0/3114998023 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe900043020 con 0x7fe90c0b6eb0 2024-09-19T08:38:04.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.426+0000 7fe90a7fc640 1 --2- 172.21.15.117:0/3114998023 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe8f806c2e0 0x7fe8f806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:04.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.426+0000 7fe90a7fc640 1 -- 172.21.15.117:0/3114998023 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fe9000aafa0 con 0x7fe90c0b6eb0 2024-09-19T08:38:04.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.426+0000 7fe911e65640 1 --2- 172.21.15.117:0/3114998023 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe8f806c2e0 0x7fe8f806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:04.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.427+0000 7fe911e65640 1 --2- 172.21.15.117:0/3114998023 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe8f806c2e0 0x7fe8f806e7a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc001580 tx=0x7fe8fc006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:04.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.431+0000 7fe90a7fc640 1 -- 172.21.15.117:0/3114998023 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe90004a030 con 0x7fe90c0b6eb0 2024-09-19T08:38:04.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:04.598+0000 7fe9140c9640 1 -- 172.21.15.117:0/3114998023 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe90c13f590 con 0x7fe90c0b6eb0 2024-09-19T08:38:05.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.504+0000 7fe90a7fc640 1 -- 172.21.15.117:0/3114998023 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) ==== 138+0+0 (secure 0 0 0) 0x7fe900079960 con 0x7fe90c0b6eb0 2024-09-19T08:38:05.504 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'cephfs_metadata' created 2024-09-19T08:38:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.507+0000 7fe9140c9640 1 -- 172.21.15.117:0/3114998023 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe8f806c2e0 msgr2=0x7fe8f806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.507+0000 7fe9140c9640 1 --2- 172.21.15.117:0/3114998023 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe8f806c2e0 0x7fe8f806e7a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc001580 tx=0x7fe8fc006040 comp rx=0 tx=0).stop 2024-09-19T08:38:05.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.507+0000 7fe9140c9640 1 -- 172.21.15.117:0/3114998023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe90c0b6eb0 msgr2=0x7fe90c134c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:05.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.507+0000 7fe9140c9640 1 --2- 172.21.15.117:0/3114998023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe90c0b6eb0 0x7fe90c134c20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe900001870 tx=0x7fe900001120 comp rx=0 tx=0).stop 2024-09-19T08:38:05.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.507+0000 7fe9140c9640 1 -- 172.21.15.117:0/3114998023 shutdown_connections 2024-09-19T08:38:05.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.507+0000 7fe9140c9640 1 --2- 172.21.15.117:0/3114998023 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe8f806c2e0 0x7fe8f806e7a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:05.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.507+0000 7fe9140c9640 1 --2- 172.21.15.117:0/3114998023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe90c0b5bf0 0x7fe90c156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:05.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.507+0000 7fe9140c9640 1 --2- 172.21.15.117:0/3114998023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe90c0b6eb0 0x7fe90c134c20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:05.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.507+0000 7fe9140c9640 1 --2- 172.21.15.117:0/3114998023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8f4003f60 0x7fe90c1f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:05.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.507+0000 7fe9140c9640 1 -- 172.21.15.117:0/3114998023 >> 172.21.15.117:0/3114998023 conn(0x7fe90c0b3ed0 msgr2=0x7fe90c0b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:05.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.508+0000 7fe9140c9640 1 -- 172.21.15.117:0/3114998023 shutdown_connections 2024-09-19T08:38:05.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.508+0000 7fe9140c9640 1 -- 172.21.15.117:0/3114998023 wait complete. 2024-09-19T08:38:05.524 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T08:38:05.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.631+0000 7fbce71d8640 1 Processor -- start 2024-09-19T08:38:05.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.631+0000 7fbce71d8640 1 -- start start 2024-09-19T08:38:05.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.631+0000 7fbce71d8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbce015ce70 0x7fbce00cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:05.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.631+0000 7fbce71d8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbce00b13a0 0x7fbce00ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:05.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.631+0000 7fbce71d8640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbce00d05e0 0x7fbce00d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:05.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.632+0000 7fbce71d8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbce00cd2d0 con 0x7fbce015ce70 2024-09-19T08:38:05.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.632+0000 7fbce71d8640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fbce015d250 con 0x7fbce00d05e0 2024-09-19T08:38:05.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.632+0000 7fbce71d8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fbce00d0f30 con 0x7fbce00b13a0 2024-09-19T08:38:05.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.632+0000 7fbce4f74640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbce015ce70 0x7fbce00cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:05.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.632+0000 7fbce4f74640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbce015ce70 0x7fbce00cfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47062/0 (socket says 172.21.15.117:47062) 2024-09-19T08:38:05.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.632+0000 7fbce4f74640 1 -- 172.21.15.117:0/1664272945 learned_addr learned my addr 172.21.15.117:0/1664272945 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:05.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.632+0000 7fbcdffff640 1 --2- 172.21.15.117:0/1664272945 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbce00b13a0 0x7fbce00ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:05.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.632+0000 7fbce5775640 1 --2- 172.21.15.117:0/1664272945 >> v2:172.21.15.146:3300/0 conn(0x7fbce00d05e0 0x7fbce00d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:05.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.632+0000 7fbce4f74640 1 -- 172.21.15.117:0/1664272945 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbce00b13a0 msgr2=0x7fbce00ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:05.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.632+0000 7fbce4f74640 1 --2- 172.21.15.117:0/1664272945 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbce00b13a0 0x7fbce00ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:05.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.632+0000 7fbce4f74640 1 -- 172.21.15.117:0/1664272945 >> v2:172.21.15.146:3300/0 conn(0x7fbce00d05e0 msgr2=0x7fbce00d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:05.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.632+0000 7fbce4f74640 1 --2- 172.21.15.117:0/1664272945 >> v2:172.21.15.146:3300/0 conn(0x7fbce00d05e0 0x7fbce00d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:05.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.632+0000 7fbce4f74640 1 -- 172.21.15.117:0/1664272945 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce00d03c0 con 0x7fbce015ce70 2024-09-19T08:38:05.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.632+0000 7fbce5775640 1 --2- 172.21.15.117:0/1664272945 >> v2:172.21.15.146:3300/0 conn(0x7fbce00d05e0 0x7fbce00d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:05.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.633+0000 7fbce4f74640 1 --2- 172.21.15.117:0/1664272945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbce015ce70 0x7fbce00cfde0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbce0073450 tx=0x7fbcd402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68272d0f2763666a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:05.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.633+0000 7fbcdf7fe640 1 -- 172.21.15.117:0/1664272945 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4037070 con 0x7fbce015ce70 2024-09-19T08:38:05.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.633+0000 7fbcdf7fe640 1 -- 172.21.15.117:0/1664272945 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd4032440 con 0x7fbce015ce70 2024-09-19T08:38:05.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.633+0000 7fbcdf7fe640 1 -- 172.21.15.117:0/1664272945 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4032810 con 0x7fbce015ce70 2024-09-19T08:38:05.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.633+0000 7fbce71d8640 1 -- 172.21.15.117:0/1664272945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbce015ce70 msgr2=0x7fbce00cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:05.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.633+0000 7fbce71d8640 1 --2- 172.21.15.117:0/1664272945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbce015ce70 0x7fbce00cfde0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbce0073450 tx=0x7fbcd402a140 comp rx=0 tx=0).stop 2024-09-19T08:38:05.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.633+0000 7fbce71d8640 1 -- 172.21.15.117:0/1664272945 shutdown_connections 2024-09-19T08:38:05.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.633+0000 7fbce71d8640 1 --2- 172.21.15.117:0/1664272945 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbce00b13a0 0x7fbce00ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:05.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.633+0000 7fbce71d8640 1 --2- 172.21.15.117:0/1664272945 >> v2:172.21.15.146:3300/0 conn(0x7fbce00d05e0 0x7fbce00d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:05.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.633+0000 7fbce71d8640 1 --2- 172.21.15.117:0/1664272945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbce015ce70 0x7fbce00cfde0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:05.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.633+0000 7fbce71d8640 1 -- 172.21.15.117:0/1664272945 >> 172.21.15.117:0/1664272945 conn(0x7fbce00d2210 msgr2=0x7fbce00d2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:05.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.633+0000 7fbce71d8640 1 -- 172.21.15.117:0/1664272945 shutdown_connections 2024-09-19T08:38:05.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.633+0000 7fbce71d8640 1 -- 172.21.15.117:0/1664272945 wait complete. 2024-09-19T08:38:05.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.635+0000 7fbce71d8640 1 Processor -- start 2024-09-19T08:38:05.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.635+0000 7fbce71d8640 1 -- start start 2024-09-19T08:38:05.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.635+0000 7fbce71d8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce00b13a0 0x7fbce00cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:05.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.635+0000 7fbce71d8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbce00d05e0 0x7fbce01572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:05.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.636+0000 7fbce71d8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbce015ce70 0x7fbce01f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:05.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.636+0000 7fbce71d8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbce015d790 con 0x7fbce015ce70 2024-09-19T08:38:05.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.636+0000 7fbce71d8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbce015da70 con 0x7fbce00b13a0 2024-09-19T08:38:05.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.636+0000 7fbce71d8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fbce009ab20 con 0x7fbce00d05e0 2024-09-19T08:38:05.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.636+0000 7fbce5775640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbce015ce70 0x7fbce01f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:05.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.636+0000 7fbce5775640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbce015ce70 0x7fbce01f5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47070/0 (socket says 172.21.15.117:47070) 2024-09-19T08:38:05.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.636+0000 7fbce5775640 1 -- 172.21.15.117:0/604497246 learned_addr learned my addr 172.21.15.117:0/604497246 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:05.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.636+0000 7fbcdffff640 1 --2- 172.21.15.117:0/604497246 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbce00d05e0 0x7fbce01572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:05.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.636+0000 7fbce4f74640 1 --2- 172.21.15.117:0/604497246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce00b13a0 0x7fbce00cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:05.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.636+0000 7fbce5775640 1 -- 172.21.15.117:0/604497246 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbce00d05e0 msgr2=0x7fbce01572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:05.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.636+0000 7fbce5775640 1 --2- 172.21.15.117:0/604497246 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbce00d05e0 0x7fbce01572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:05.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.636+0000 7fbce5775640 1 -- 172.21.15.117:0/604497246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce00b13a0 msgr2=0x7fbce00cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:05.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.636+0000 7fbce5775640 1 --2- 172.21.15.117:0/604497246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce00b13a0 0x7fbce00cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:05.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.636+0000 7fbce5775640 1 -- 172.21.15.117:0/604497246 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce00cbbd0 con 0x7fbce015ce70 2024-09-19T08:38:05.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.636+0000 7fbce5775640 1 --2- 172.21.15.117:0/604497246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbce015ce70 0x7fbce01f5c60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800cd50 tx=0x7fbcd800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:05.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.636+0000 7fbcdd7fa640 1 -- 172.21.15.117:0/604497246 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd800f680 con 0x7fbce015ce70 2024-09-19T08:38:05.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.636+0000 7fbcdd7fa640 1 -- 172.21.15.117:0/604497246 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd800f840 con 0x7fbce015ce70 2024-09-19T08:38:05.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.636+0000 7fbce71d8640 1 -- 172.21.15.117:0/604497246 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce00cbeb0 con 0x7fbce015ce70 2024-09-19T08:38:05.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.636+0000 7fbcdd7fa640 1 -- 172.21.15.117:0/604497246 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd800fc30 con 0x7fbce015ce70 2024-09-19T08:38:05.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.636+0000 7fbce71d8640 1 -- 172.21.15.117:0/604497246 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce01577f0 con 0x7fbce015ce70 2024-09-19T08:38:05.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.637+0000 7fbce71d8640 1 -- 172.21.15.117:0/604497246 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce00d09f0 con 0x7fbce015ce70 2024-09-19T08:38:05.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.638+0000 7fbcdd7fa640 1 -- 172.21.15.117:0/604497246 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbcd80213f0 con 0x7fbce015ce70 2024-09-19T08:38:05.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.638+0000 7fbcdd7fa640 1 --2- 172.21.15.117:0/604497246 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbcc406c2b0 0x7fbcc406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:05.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.638+0000 7fbcdd7fa640 1 -- 172.21.15.117:0/604497246 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5619+0+0 (secure 0 0 0) 0x7fbcd808bf50 con 0x7fbce015ce70 2024-09-19T08:38:05.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.639+0000 7fbce4f74640 1 --2- 172.21.15.117:0/604497246 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbcc406c2b0 0x7fbcc406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:05.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.639+0000 7fbce4f74640 1 --2- 172.21.15.117:0/604497246 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbcc406c2b0 0x7fbcc406e770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4034000 tx=0x7fbcd402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:05.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.643+0000 7fbcdd7fa640 1 -- 172.21.15.117:0/604497246 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbcd8014030 con 0x7fbce015ce70 2024-09-19T08:38:05.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:05.809+0000 7fbce71d8640 1 -- 172.21.15.117:0/604497246 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbce015a150 con 0x7fbce015ce70 2024-09-19T08:38:05.940 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T08:38:05.943 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T08:38:06.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.510+0000 7fbcdd7fa640 1 -- 172.21.15.117:0/604497246 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) ==== 170+0+0 (secure 0 0 0) 0x7fbcd805a150 con 0x7fbce015ce70 2024-09-19T08:38:06.510 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'cephfs_data' created 2024-09-19T08:38:06.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.512+0000 7fbce71d8640 1 -- 172.21.15.117:0/604497246 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbcc406c2b0 msgr2=0x7fbcc406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:06.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.512+0000 7fbce71d8640 1 --2- 172.21.15.117:0/604497246 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbcc406c2b0 0x7fbcc406e770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4034000 tx=0x7fbcd402e000 comp rx=0 tx=0).stop 2024-09-19T08:38:06.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.512+0000 7fbce71d8640 1 -- 172.21.15.117:0/604497246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbce015ce70 msgr2=0x7fbce01f5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:06.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.512+0000 7fbce71d8640 1 --2- 172.21.15.117:0/604497246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbce015ce70 0x7fbce01f5c60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800cd50 tx=0x7fbcd800a650 comp rx=0 tx=0).stop 2024-09-19T08:38:06.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.512+0000 7fbce71d8640 1 -- 172.21.15.117:0/604497246 shutdown_connections 2024-09-19T08:38:06.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.512+0000 7fbce71d8640 1 --2- 172.21.15.117:0/604497246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbce015ce70 0x7fbce01f5c60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:06.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.512+0000 7fbce71d8640 1 --2- 172.21.15.117:0/604497246 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbcc406c2b0 0x7fbcc406e770 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:06.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.512+0000 7fbce71d8640 1 --2- 172.21.15.117:0/604497246 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbce00d05e0 0x7fbce01572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:06.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.512+0000 7fbce71d8640 1 --2- 172.21.15.117:0/604497246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce00b13a0 0x7fbce00cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:06.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.512+0000 7fbce71d8640 1 -- 172.21.15.117:0/604497246 >> 172.21.15.117:0/604497246 conn(0x7fbce00d2210 msgr2=0x7fbce00afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:06.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.512+0000 7fbce71d8640 1 -- 172.21.15.117:0/604497246 shutdown_connections 2024-09-19T08:38:06.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.513+0000 7fbce71d8640 1 -- 172.21.15.117:0/604497246 wait complete. 2024-09-19T08:38:06.533 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T08:38:06.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.635+0000 7f7331f52640 1 Processor -- start 2024-09-19T08:38:06.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.635+0000 7f7331f52640 1 -- start start 2024-09-19T08:38:06.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.636+0000 7f7331f52640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f732c072250 0x7f732c0cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:06.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.636+0000 7f7331f52640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f732c072690 0x7f732c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:06.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.636+0000 7f7331f52640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f732c0d2b30 con 0x7f732c0d2750 2024-09-19T08:38:06.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.636+0000 7f7331f52640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f732c145bd0 con 0x7f732c072690 2024-09-19T08:38:06.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.636+0000 7f7331f52640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f732c1427e0 con 0x7f732c072250 2024-09-19T08:38:06.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.637+0000 7f7322ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f732c072250 0x7f732c0cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:06.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.637+0000 7f732bfff640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f732c072690 0x7f732c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:06.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.637+0000 7f732b7fe640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f732c0d2750 0x7f732c13f860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.117:45624/0 (socket says 172.21.15.117:45624) 2024-09-19T08:38:06.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.637+0000 7f7322ffd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f732c072250 0x7f732c0cfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.117:52074/0 (socket says 172.21.15.117:52074) 2024-09-19T08:38:06.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.637+0000 7f732b7fe640 1 -- 172.21.15.117:0/3320391239 learned_addr learned my addr 172.21.15.117:0/3320391239 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:06.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.637+0000 7f7322ffd640 1 -- 172.21.15.117:0/3320391239 >> v2:172.21.15.146:3300/0 conn(0x7f732c072690 msgr2=0x7f732c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:06.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.637+0000 7f7322ffd640 1 --2- 172.21.15.117:0/3320391239 >> v2:172.21.15.146:3300/0 conn(0x7f732c072690 0x7f732c0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:06.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.637+0000 7f7322ffd640 1 -- 172.21.15.117:0/3320391239 >> v1:172.21.15.146:6789/0 conn(0x7f732c0d2750 legacy=0x7f732c13f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:06.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.637+0000 7f7322ffd640 1 -- 172.21.15.117:0/3320391239 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732c141c60 con 0x7f732c072250 2024-09-19T08:38:06.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.637+0000 7f732bfff640 1 --2- 172.21.15.117:0/3320391239 >> v2:172.21.15.146:3300/0 conn(0x7f732c072690 0x7f732c0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:38:06.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.638+0000 7f7322ffd640 1 --2- 172.21.15.117:0/3320391239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f732c072250 0x7f732c0cfdc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f73140097a0 tx=0x7f731402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cccec88d0483273 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:06.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.638+0000 7f732affd640 1 -- 172.21.15.117:0/3320391239 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7314037070 con 0x7f732c072250 2024-09-19T08:38:06.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.638+0000 7f732affd640 1 -- 172.21.15.117:0/3320391239 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f731402ae50 con 0x7f732c072250 2024-09-19T08:38:06.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.638+0000 7f732affd640 1 -- 172.21.15.117:0/3320391239 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7314032660 con 0x7f732c072250 2024-09-19T08:38:06.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.638+0000 7f7331f52640 1 -- 172.21.15.117:0/3320391239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f732c072250 msgr2=0x7f732c0cfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:06.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.638+0000 7f7331f52640 1 --2- 172.21.15.117:0/3320391239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f732c072250 0x7f732c0cfdc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f73140097a0 tx=0x7f731402a100 comp rx=0 tx=0).stop 2024-09-19T08:38:06.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.638+0000 7f7331f52640 1 -- 172.21.15.117:0/3320391239 shutdown_connections 2024-09-19T08:38:06.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.638+0000 7f7331f52640 1 --2- 172.21.15.117:0/3320391239 >> v2:172.21.15.146:3300/0 conn(0x7f732c072690 0x7f732c0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:06.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.638+0000 7f7331f52640 1 --2- 172.21.15.117:0/3320391239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f732c072250 0x7f732c0cfdc0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:06.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.638+0000 7f7331f52640 1 -- 172.21.15.117:0/3320391239 >> 172.21.15.117:0/3320391239 conn(0x7f732c0b4040 msgr2=0x7f732c0b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:06.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.638+0000 7f7331f52640 1 -- 172.21.15.117:0/3320391239 shutdown_connections 2024-09-19T08:38:06.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.638+0000 7f7331f52640 1 -- 172.21.15.117:0/3320391239 wait complete. 2024-09-19T08:38:06.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.640+0000 7f7331f52640 1 Processor -- start 2024-09-19T08:38:06.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.640+0000 7f7331f52640 1 -- start start 2024-09-19T08:38:06.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.640+0000 7f7331f52640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f732c072250 0x7f732c15d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:06.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.640+0000 7f7331f52640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f732c072690 0x7f732c15b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:06.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.640+0000 7f7331f52640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732c0d2750 0x7f732c0b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:06.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.640+0000 7f7331f52640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f732c142500 con 0x7f732c072690 2024-09-19T08:38:06.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.640+0000 7f7331f52640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f732c142220 con 0x7f732c0d2750 2024-09-19T08:38:06.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.640+0000 7f7331f52640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f732c1418b0 con 0x7f732c072250 2024-09-19T08:38:06.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.641+0000 7f7322ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f732c072690 0x7f732c15b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:06.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.641+0000 7f7322ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f732c072690 0x7f732c15b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47074/0 (socket says 172.21.15.117:47074) 2024-09-19T08:38:06.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.641+0000 7f7322ffd640 1 -- 172.21.15.117:0/3632134895 learned_addr learned my addr 172.21.15.117:0/3632134895 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:06.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.641+0000 7f732b7fe640 1 --2- 172.21.15.117:0/3632134895 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f732c072250 0x7f732c15d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:06.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.641+0000 7f732bfff640 1 --2- 172.21.15.117:0/3632134895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732c0d2750 0x7f732c0b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:06.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.641+0000 7f7322ffd640 1 -- 172.21.15.117:0/3632134895 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f732c072250 msgr2=0x7f732c15d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:06.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.641+0000 7f7322ffd640 1 --2- 172.21.15.117:0/3632134895 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f732c072250 0x7f732c15d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:06.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.641+0000 7f7322ffd640 1 -- 172.21.15.117:0/3632134895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732c0d2750 msgr2=0x7f732c0b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:06.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.641+0000 7f7322ffd640 1 --2- 172.21.15.117:0/3632134895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732c0d2750 0x7f732c0b2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:06.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.641+0000 7f7322ffd640 1 -- 172.21.15.117:0/3632134895 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732c0b55e0 con 0x7f732c072690 2024-09-19T08:38:06.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.641+0000 7f7322ffd640 1 --2- 172.21.15.117:0/3632134895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f732c072690 0x7f732c15b7d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7314035040 tx=0x7f73140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:06.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.641+0000 7f7328ff9640 1 -- 172.21.15.117:0/3632134895 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7314041070 con 0x7f732c072690 2024-09-19T08:38:06.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.641+0000 7f7328ff9640 1 -- 172.21.15.117:0/3632134895 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f731403c460 con 0x7f732c072690 2024-09-19T08:38:06.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.641+0000 7f7331f52640 1 -- 172.21.15.117:0/3632134895 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f732c15d810 con 0x7f732c072690 2024-09-19T08:38:06.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.641+0000 7f7328ff9640 1 -- 172.21.15.117:0/3632134895 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7314037040 con 0x7f732c072690 2024-09-19T08:38:06.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.641+0000 7f7331f52640 1 -- 172.21.15.117:0/3632134895 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f732c15ddc0 con 0x7f732c072690 2024-09-19T08:38:06.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.642+0000 7f7331f52640 1 -- 172.21.15.117:0/3632134895 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f732c0b18b0 con 0x7f732c072690 2024-09-19T08:38:06.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.643+0000 7f7328ff9640 1 -- 172.21.15.117:0/3632134895 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f731403a070 con 0x7f732c072690 2024-09-19T08:38:06.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.643+0000 7f7328ff9640 1 --2- 172.21.15.117:0/3632134895 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f730c06c2b0 0x7f730c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:06.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.643+0000 7f7328ff9640 1 -- 172.21.15.117:0/3632134895 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6001+0+0 (secure 0 0 0) 0x7f73140ab500 con 0x7f732c072690 2024-09-19T08:38:06.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.643+0000 7f732b7fe640 1 --2- 172.21.15.117:0/3632134895 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f730c06c2b0 0x7f730c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:06.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.644+0000 7f732b7fe640 1 --2- 172.21.15.117:0/3632134895 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f730c06c2b0 0x7f730c06e770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f731c007fd0 tx=0x7f731c007e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:06.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.648+0000 7f7328ff9640 1 -- 172.21.15.117:0/3632134895 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f732c0b18b0 con 0x7f732c072690 2024-09-19T08:38:06.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:06.851+0000 7f7331f52640 1 -- 172.21.15.117:0/3632134895 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f732c0cd1f0 con 0x7f732c072690 2024-09-19T08:38:07.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.511+0000 7f7328ff9640 1 -- 172.21.15.117:0/3632134895 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7f73140794f0 con 0x7f732c072690 2024-09-19T08:38:07.512 INFO:teuthology.orchestra.run.smithi117.stderr:new fs with metadata pool 5 and data pool 6 2024-09-19T08:38:07.514 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.514+0000 7f7331f52640 1 -- 172.21.15.117:0/3632134895 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f730c06c2b0 msgr2=0x7f730c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:07.514 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.514+0000 7f7331f52640 1 --2- 172.21.15.117:0/3632134895 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f730c06c2b0 0x7f730c06e770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f731c007fd0 tx=0x7f731c007e80 comp rx=0 tx=0).stop 2024-09-19T08:38:07.514 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.514+0000 7f7331f52640 1 -- 172.21.15.117:0/3632134895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f732c072690 msgr2=0x7f732c15b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:07.514 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.514+0000 7f7331f52640 1 --2- 172.21.15.117:0/3632134895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f732c072690 0x7f732c15b7d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7314035040 tx=0x7f73140046c0 comp rx=0 tx=0).stop 2024-09-19T08:38:07.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.514+0000 7f7331f52640 1 -- 172.21.15.117:0/3632134895 shutdown_connections 2024-09-19T08:38:07.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.514+0000 7f7331f52640 1 --2- 172.21.15.117:0/3632134895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f732c0d2750 0x7f732c0b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:07.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.514+0000 7f7331f52640 1 --2- 172.21.15.117:0/3632134895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f732c072690 0x7f732c15b7d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:07.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.514+0000 7f7331f52640 1 --2- 172.21.15.117:0/3632134895 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f730c06c2b0 0x7f730c06e770 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:07.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.514+0000 7f7331f52640 1 --2- 172.21.15.117:0/3632134895 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f732c072250 0x7f732c15d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:07.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.514+0000 7f7331f52640 1 -- 172.21.15.117:0/3632134895 >> 172.21.15.117:0/3632134895 conn(0x7f732c0b4040 msgr2=0x7f732c0cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:07.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.515+0000 7f7331f52640 1 -- 172.21.15.117:0/3632134895 shutdown_connections 2024-09-19T08:38:07.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.516+0000 7f7331f52640 1 -- 172.21.15.117:0/3632134895 wait complete. 2024-09-19T08:38:07.545 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:38:07.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.644+0000 7f2cf5ae6640 1 Processor -- start 2024-09-19T08:38:07.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.644+0000 7f2cf5ae6640 1 -- start start 2024-09-19T08:38:07.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.645+0000 7f2cf5ae6640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2cf00d0bc0 0x7f2cf00c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:07.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.645+0000 7f2cf5ae6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cf015b500 con 0x7f2cf006f9e0 2024-09-19T08:38:07.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.645+0000 7f2cf5ae6640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cf006e940 con 0x7f2cf015b120 2024-09-19T08:38:07.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.645+0000 7f2cf5ae6640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f2cf006ec20 con 0x7f2cf00d0bc0 2024-09-19T08:38:07.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.645+0000 7f2ceeffd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f2cf006f9e0 0x7f2cf00d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:37506/0 (socket says 172.21.15.117:37506) 2024-09-19T08:38:07.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.645+0000 7f2ceeffd640 1 -- 172.21.15.117:0/728834562 learned_addr learned my addr 172.21.15.117:0/728834562 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:07.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.645+0000 7f2ceffff640 1 --2- 172.21.15.117:0/728834562 >> v2:172.21.15.146:3300/0 conn(0x7f2cf00d0bc0 0x7f2cf00c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:07.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.645+0000 7f2cee7fc640 1 -- 172.21.15.117:0/728834562 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 814652729 0 0) 0x7f2cf015b500 con 0x7f2cf006f9e0 2024-09-19T08:38:07.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.645+0000 7f2cee7fc640 1 -- 172.21.15.117:0/728834562 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cd8003520 con 0x7f2cf006f9e0 2024-09-19T08:38:07.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2cee7fc640 1 -- 172.21.15.117:0/728834562 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 587560762 0 0) 0x7f2cd8003520 con 0x7f2cf006f9e0 2024-09-19T08:38:07.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2cee7fc640 1 -- 172.21.15.117:0/728834562 >> v2:172.21.15.146:3300/0 conn(0x7f2cf00d0bc0 msgr2=0x7f2cf00c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:07.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2cee7fc640 1 --2- 172.21.15.117:0/728834562 >> v2:172.21.15.146:3300/0 conn(0x7f2cf00d0bc0 0x7f2cf00c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:07.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2cee7fc640 1 -- 172.21.15.117:0/728834562 >> v1:172.21.15.146:6789/0 conn(0x7f2cf015b120 legacy=0x7f2cf006dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:07.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2cee7fc640 1 -- 172.21.15.117:0/728834562 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf006ef00 con 0x7f2cf006f9e0 2024-09-19T08:38:07.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2cee7fc640 1 -- 172.21.15.117:0/728834562 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f2ce4001670 con 0x7f2cf006f9e0 2024-09-19T08:38:07.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2cee7fc640 1 -- 172.21.15.117:0/728834562 >> v1:172.21.15.117:6789/0 conn(0x7f2cf006f9e0 legacy=0x7f2cf00d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:07.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2cee7fc640 1 --2- 172.21.15.117:0/728834562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cd80039b0 0x7f2cd8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:07.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2cee7fc640 1 --2- 172.21.15.117:0/728834562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cd80043b0 0x7f2cd8004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:07.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2cee7fc640 1 --2- 172.21.15.117:0/728834562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cd8005080 0x7f2cd800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:07.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2cee7fc640 1 -- 172.21.15.117:0/728834562 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf006ec20 con 0x7f2cd80039b0 2024-09-19T08:38:07.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2cee7fc640 1 -- 172.21.15.117:0/728834562 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd800bfe0 con 0x7f2cd80043b0 2024-09-19T08:38:07.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2cee7fc640 1 -- 172.21.15.117:0/728834562 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f2cd800c1e0 con 0x7f2cd8005080 2024-09-19T08:38:07.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2cef7fe640 1 --2- 172.21.15.117:0/728834562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cd80039b0 0x7f2cd8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:07.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2ceeffd640 1 --2- 172.21.15.117:0/728834562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cd80043b0 0x7f2cd8004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:07.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2ceffff640 1 --2- 172.21.15.117:0/728834562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cd8005080 0x7f2cd800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:07.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2cef7fe640 1 -- 172.21.15.117:0/728834562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cd8005080 msgr2=0x7f2cd800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:07.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2cef7fe640 1 --2- 172.21.15.117:0/728834562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cd8005080 0x7f2cd800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:07.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2cef7fe640 1 -- 172.21.15.117:0/728834562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cd80043b0 msgr2=0x7f2cd8004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:07.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2cef7fe640 1 --2- 172.21.15.117:0/728834562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cd80043b0 0x7f2cd8004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:07.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2cef7fe640 1 -- 172.21.15.117:0/728834562 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd8003520 con 0x7f2cd80039b0 2024-09-19T08:38:07.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2ceffff640 1 --2- 172.21.15.117:0/728834562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cd8005080 0x7f2cd800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:07.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.646+0000 7f2ceffff640 1 -- 172.21.15.117:0/728834562 reap_dead start 2024-09-19T08:38:07.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.647+0000 7f2cef7fe640 1 --2- 172.21.15.117:0/728834562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cd80039b0 0x7f2cd8003d90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0001860 tx=0x7f2cd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e1a00d1c21b490 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:07.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.647+0000 7f2cee7fc640 1 -- 172.21.15.117:0/728834562 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0037070 con 0x7f2cd80039b0 2024-09-19T08:38:07.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.647+0000 7f2cee7fc640 1 -- 172.21.15.117:0/728834562 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce002abf0 con 0x7f2cd80039b0 2024-09-19T08:38:07.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.647+0000 7f2cee7fc640 1 -- 172.21.15.117:0/728834562 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0001430 con 0x7f2cd80039b0 2024-09-19T08:38:07.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.647+0000 7f2cf5ae6640 1 -- 172.21.15.117:0/728834562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cd80039b0 msgr2=0x7f2cd8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:07.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.647+0000 7f2cf5ae6640 1 --2- 172.21.15.117:0/728834562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cd80039b0 0x7f2cd8003d90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0001860 tx=0x7f2cd8005830 comp rx=0 tx=0).stop 2024-09-19T08:38:07.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.647+0000 7f2cf5ae6640 1 -- 172.21.15.117:0/728834562 shutdown_connections 2024-09-19T08:38:07.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.647+0000 7f2cf5ae6640 1 --2- 172.21.15.117:0/728834562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cd80039b0 0x7f2cd8003d90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:07.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.647+0000 7f2cf5ae6640 1 -- 172.21.15.117:0/728834562 >> 172.21.15.117:0/728834562 conn(0x7f2cf006bdf0 msgr2=0x7f2cf006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:07.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.648+0000 7f2cf5ae6640 1 -- 172.21.15.117:0/728834562 shutdown_connections 2024-09-19T08:38:07.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.648+0000 7f2cf5ae6640 1 -- 172.21.15.117:0/728834562 wait complete. 2024-09-19T08:38:07.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.649+0000 7f2cf5ae6640 1 Processor -- start 2024-09-19T08:38:07.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.649+0000 7f2cf5ae6640 1 -- start start 2024-09-19T08:38:07.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2cf5ae6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cd80039b0 0x7f2cf0149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:07.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2cf5ae6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cf00c9560 0x7f2cf015c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:07.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2cf5ae6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cf01f1db0 0x7f2cf00ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:07.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2cf5ae6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf00ce060 con 0x7f2cf00c9560 2024-09-19T08:38:07.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2cf5ae6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf006f4c0 con 0x7f2cd80039b0 2024-09-19T08:38:07.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2cf5ae6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f2cf00d04b0 con 0x7f2cf01f1db0 2024-09-19T08:38:07.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2ceeffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cf00c9560 0x7f2cf015c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:07.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2ceeffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cf00c9560 0x7f2cf015c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47096/0 (socket says 172.21.15.117:47096) 2024-09-19T08:38:07.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2ceeffd640 1 -- 172.21.15.117:0/2628555919 learned_addr learned my addr 172.21.15.117:0/2628555919 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:07.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2cef7fe640 1 --2- 172.21.15.117:0/2628555919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cd80039b0 0x7f2cf0149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:07.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2ceffff640 1 --2- 172.21.15.117:0/2628555919 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cf01f1db0 0x7f2cf00ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:07.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2ceeffd640 1 -- 172.21.15.117:0/2628555919 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cf01f1db0 msgr2=0x7f2cf00ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:07.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2ceeffd640 1 --2- 172.21.15.117:0/2628555919 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cf01f1db0 0x7f2cf00ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:07.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2ceeffd640 1 -- 172.21.15.117:0/2628555919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cd80039b0 msgr2=0x7f2cf0149630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:07.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2ceeffd640 1 --2- 172.21.15.117:0/2628555919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cd80039b0 0x7f2cf0149630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:07.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2ceeffd640 1 -- 172.21.15.117:0/2628555919 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf00c9af0 con 0x7f2cf00c9560 2024-09-19T08:38:07.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2ceeffd640 1 --2- 172.21.15.117:0/2628555919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cf00c9560 0x7f2cf015c0a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4007290 tx=0x7f2ce4007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:07.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2cd7fff640 1 -- 172.21.15.117:0/2628555919 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce400f960 con 0x7f2cf00c9560 2024-09-19T08:38:07.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2cd7fff640 1 -- 172.21.15.117:0/2628555919 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce4018070 con 0x7f2cf00c9560 2024-09-19T08:38:07.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2cf5ae6640 1 -- 172.21.15.117:0/2628555919 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cf00c9dd0 con 0x7f2cf00c9560 2024-09-19T08:38:07.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2cd7fff640 1 -- 172.21.15.117:0/2628555919 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce400fd00 con 0x7f2cf00c9560 2024-09-19T08:38:07.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.650+0000 7f2cf5ae6640 1 -- 172.21.15.117:0/2628555919 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cf00ca390 con 0x7f2cf00c9560 2024-09-19T08:38:07.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.651+0000 7f2cf5ae6640 1 -- 172.21.15.117:0/2628555919 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cf00d07e0 con 0x7f2cf00c9560 2024-09-19T08:38:07.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.652+0000 7f2cd7fff640 1 -- 172.21.15.117:0/2628555919 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2ce401d460 con 0x7f2cf00c9560 2024-09-19T08:38:07.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.652+0000 7f2cd7fff640 1 --2- 172.21.15.117:0/2628555919 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2cdc06c2b0 0x7f2cdc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:07.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.652+0000 7f2cd7fff640 1 -- 172.21.15.117:0/2628555919 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f2ce408b580 con 0x7f2cf00c9560 2024-09-19T08:38:07.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.653+0000 7f2cef7fe640 1 --2- 172.21.15.117:0/2628555919 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2cdc06c2b0 0x7f2cdc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:07.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.653+0000 7f2cef7fe640 1 --2- 172.21.15.117:0/2628555919 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2cdc06c2b0 0x7f2cdc06e770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0034000 tx=0x7f2ce0009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:07.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.657+0000 7f2cd7fff640 1 -- 172.21.15.117:0/2628555919 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2ce40595a0 con 0x7f2cf00c9560 2024-09-19T08:38:07.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.823+0000 7f2cf5ae6640 1 -- 172.21.15.117:0/2628555919 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2cf015ca90 con 0x7f2cf00c9560 2024-09-19T08:38:07.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.824+0000 7f2cd7fff640 1 -- 172.21.15.117:0/2628555919 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17063 (secure 0 0 0) 0x7f2ce405d8a0 con 0x7f2cf00c9560 2024-09-19T08:38:07.824 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:07.824 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":39,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:38:06.852400+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:38:04.617092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-19T08:38:05.827922+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:38:07.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.826+0000 7f2cf5ae6640 1 -- 172.21.15.117:0/2628555919 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2cdc06c2b0 msgr2=0x7f2cdc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:07.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.826+0000 7f2cf5ae6640 1 --2- 172.21.15.117:0/2628555919 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2cdc06c2b0 0x7f2cdc06e770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0034000 tx=0x7f2ce0009030 comp rx=0 tx=0).stop 2024-09-19T08:38:07.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.826+0000 7f2cf5ae6640 1 -- 172.21.15.117:0/2628555919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cf00c9560 msgr2=0x7f2cf015c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:07.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.826+0000 7f2cf5ae6640 1 --2- 172.21.15.117:0/2628555919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cf00c9560 0x7f2cf015c0a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4007290 tx=0x7f2ce4007750 comp rx=0 tx=0).stop 2024-09-19T08:38:07.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.826+0000 7f2cf5ae6640 1 -- 172.21.15.117:0/2628555919 shutdown_connections 2024-09-19T08:38:07.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.826+0000 7f2cf5ae6640 1 --2- 172.21.15.117:0/2628555919 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2cdc06c2b0 0x7f2cdc06e770 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:07.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.826+0000 7f2cf5ae6640 1 --2- 172.21.15.117:0/2628555919 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cf01f1db0 0x7f2cf00ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:07.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.826+0000 7f2cf5ae6640 1 --2- 172.21.15.117:0/2628555919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cf00c9560 0x7f2cf015c0a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:07.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.826+0000 7f2cf5ae6640 1 --2- 172.21.15.117:0/2628555919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cd80039b0 0x7f2cf0149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:07.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.826+0000 7f2cf5ae6640 1 -- 172.21.15.117:0/2628555919 >> 172.21.15.117:0/2628555919 conn(0x7f2cf006bdf0 msgr2=0x7f2cf00c6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:07.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.826+0000 7f2cf5ae6640 1 -- 172.21.15.117:0/2628555919 shutdown_connections 2024-09-19T08:38:07.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.826+0000 7f2cf5ae6640 1 -- 172.21.15.117:0/2628555919 wait complete. 2024-09-19T08:38:07.837 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:38:07.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.936+0000 7f7458874640 1 Processor -- start 2024-09-19T08:38:07.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.936+0000 7f7458874640 1 -- start start 2024-09-19T08:38:07.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.937+0000 7f7458874640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f745415b120 0x7f745406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:07.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.937+0000 7f7458874640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f745406dec0 0x7f745406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:07.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.937+0000 7f7458874640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f745415b500 con 0x7f74540d04b0 2024-09-19T08:38:07.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.937+0000 7f7458874640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f745406e940 con 0x7f745406dec0 2024-09-19T08:38:07.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.937+0000 7f7458874640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f745406ec20 con 0x7f745415b120 2024-09-19T08:38:07.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.937+0000 7f7451d9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f745406dec0 0x7f745406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:07.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.937+0000 7f7451d9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f745406dec0 0x7f745406e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47100/0 (socket says 172.21.15.117:47100) 2024-09-19T08:38:07.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.937+0000 7f7451d9b640 1 -- 172.21.15.117:0/477288975 learned_addr learned my addr 172.21.15.117:0/477288975 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:07.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.937+0000 7f745259c640 1 --2- 172.21.15.117:0/477288975 >> v2:172.21.15.146:3300/0 conn(0x7f745415b120 0x7f745406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:07.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.938+0000 7f7451d9b640 1 -- 172.21.15.117:0/477288975 >> v2:172.21.15.146:3300/0 conn(0x7f745415b120 msgr2=0x7f745406f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:07.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.938+0000 7f7451d9b640 1 --2- 172.21.15.117:0/477288975 >> v2:172.21.15.146:3300/0 conn(0x7f745415b120 0x7f745406f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:07.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.938+0000 7f7451d9b640 1 -- 172.21.15.117:0/477288975 >> v1:172.21.15.146:6789/0 conn(0x7f74540d04b0 legacy=0x7f74540c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:07.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.938+0000 7f7451d9b640 1 -- 172.21.15.117:0/477288975 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f745406ef00 con 0x7f745406dec0 2024-09-19T08:38:07.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.938+0000 7f7451d9b640 1 --2- 172.21.15.117:0/477288975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f745406dec0 0x7f745406e330 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f745406cb50 tx=0x7f744802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed631369d196a047 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:07.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.938+0000 7f745159a640 1 -- 172.21.15.117:0/477288975 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7448037070 con 0x7f745406dec0 2024-09-19T08:38:07.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.938+0000 7f745159a640 1 -- 172.21.15.117:0/477288975 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7448032440 con 0x7f745406dec0 2024-09-19T08:38:07.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.938+0000 7f745159a640 1 -- 172.21.15.117:0/477288975 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7448032810 con 0x7f745406dec0 2024-09-19T08:38:07.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.939+0000 7f7458874640 1 -- 172.21.15.117:0/477288975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f745406dec0 msgr2=0x7f745406e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:07.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.939+0000 7f7458874640 1 --2- 172.21.15.117:0/477288975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f745406dec0 0x7f745406e330 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f745406cb50 tx=0x7f744802a270 comp rx=0 tx=0).stop 2024-09-19T08:38:07.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.939+0000 7f7458874640 1 -- 172.21.15.117:0/477288975 shutdown_connections 2024-09-19T08:38:07.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.939+0000 7f7458874640 1 --2- 172.21.15.117:0/477288975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f745406dec0 0x7f745406e330 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:07.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.939+0000 7f7458874640 1 --2- 172.21.15.117:0/477288975 >> v2:172.21.15.146:3300/0 conn(0x7f745415b120 0x7f745406f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:07.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.939+0000 7f7458874640 1 -- 172.21.15.117:0/477288975 >> 172.21.15.117:0/477288975 conn(0x7f745406bdf0 msgr2=0x7f745406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:07.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.939+0000 7f7458874640 1 -- 172.21.15.117:0/477288975 shutdown_connections 2024-09-19T08:38:07.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.939+0000 7f7458874640 1 -- 172.21.15.117:0/477288975 wait complete. 2024-09-19T08:38:07.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.940+0000 7f7458874640 1 Processor -- start 2024-09-19T08:38:07.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.940+0000 7f7458874640 1 -- start start 2024-09-19T08:38:07.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.941+0000 7f7458874640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f745406dec0 0x7f74541ebd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:07.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.941+0000 7f7458874640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74540d04b0 0x7f7454157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:07.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.941+0000 7f7458874640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f745415b120 0x7f74540c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:07.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.941+0000 7f7458874640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f74540ce060 con 0x7f745415b120 2024-09-19T08:38:07.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.941+0000 7f7458874640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f745406f4c0 con 0x7f745406dec0 2024-09-19T08:38:07.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.941+0000 7f7458874640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f74540d0900 con 0x7f74540d04b0 2024-09-19T08:38:07.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.941+0000 7f7452d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f745415b120 0x7f74540c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:07.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.941+0000 7f7452d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f745415b120 0x7f74540c5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47106/0 (socket says 172.21.15.117:47106) 2024-09-19T08:38:07.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.941+0000 7f7452d9d640 1 -- 172.21.15.117:0/4202594478 learned_addr learned my addr 172.21.15.117:0/4202594478 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:07.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.941+0000 7f745259c640 1 --2- 172.21.15.117:0/4202594478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f745406dec0 0x7f74541ebd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:07.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.941+0000 7f7451d9b640 1 --2- 172.21.15.117:0/4202594478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74540d04b0 0x7f7454157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:07.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.942+0000 7f7452d9d640 1 -- 172.21.15.117:0/4202594478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74540d04b0 msgr2=0x7f7454157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:07.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.942+0000 7f7452d9d640 1 --2- 172.21.15.117:0/4202594478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74540d04b0 0x7f7454157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:07.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.942+0000 7f7452d9d640 1 -- 172.21.15.117:0/4202594478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f745406dec0 msgr2=0x7f74541ebd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:07.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.942+0000 7f7452d9d640 1 --2- 172.21.15.117:0/4202594478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f745406dec0 0x7f74541ebd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:07.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.942+0000 7f7452d9d640 1 -- 172.21.15.117:0/4202594478 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74541f5490 con 0x7f745415b120 2024-09-19T08:38:07.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.942+0000 7f7452d9d640 1 --2- 172.21.15.117:0/4202594478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f745415b120 0x7f74540c5820 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f744c00c740 tx=0x7f744c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:07.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.942+0000 7f7442ffd640 1 -- 172.21.15.117:0/4202594478 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c016020 con 0x7f745415b120 2024-09-19T08:38:07.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.942+0000 7f7442ffd640 1 -- 172.21.15.117:0/4202594478 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f744c00ce50 con 0x7f745415b120 2024-09-19T08:38:07.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.942+0000 7f7458874640 1 -- 172.21.15.117:0/4202594478 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74541f5770 con 0x7f745415b120 2024-09-19T08:38:07.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.942+0000 7f7442ffd640 1 -- 172.21.15.117:0/4202594478 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c003970 con 0x7f745415b120 2024-09-19T08:38:07.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.942+0000 7f7458874640 1 -- 172.21.15.117:0/4202594478 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7454157ea0 con 0x7f745415b120 2024-09-19T08:38:07.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.943+0000 7f7458874640 1 -- 172.21.15.117:0/4202594478 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74540d0cd0 con 0x7f745415b120 2024-09-19T08:38:07.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.943+0000 7f7442ffd640 1 -- 172.21.15.117:0/4202594478 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f744c003b10 con 0x7f745415b120 2024-09-19T08:38:07.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.944+0000 7f7442ffd640 1 --2- 172.21.15.117:0/4202594478 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f743406c2e0 0x7f743406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:07.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.944+0000 7f7442ffd640 1 -- 172.21.15.117:0/4202594478 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f744c08b090 con 0x7f745415b120 2024-09-19T08:38:07.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.944+0000 7f745259c640 1 --2- 172.21.15.117:0/4202594478 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f743406c2e0 0x7f743406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:07.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.945+0000 7f745259c640 1 --2- 172.21.15.117:0/4202594478 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f743406c2e0 0x7f743406e7a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7444009aa0 tx=0x7f7444009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:07.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:07.948+0000 7f7442ffd640 1 -- 172.21.15.117:0/4202594478 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f744c020020 con 0x7f745415b120 2024-09-19T08:38:08.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.112+0000 7f7458874640 1 -- 172.21.15.117:0/4202594478 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74540cadd0 con 0x7f745415b120 2024-09-19T08:38:08.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.113+0000 7f7442ffd640 1 -- 172.21.15.117:0/4202594478 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17063 (secure 0 0 0) 0x7f744c082e20 con 0x7f745415b120 2024-09-19T08:38:08.114 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:08.115 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":39,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:38:06.852400+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:38:04.617092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-19T08:38:05.827922+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:38:08.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.115+0000 7f7458874640 1 -- 172.21.15.117:0/4202594478 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f743406c2e0 msgr2=0x7f743406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:08.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.115+0000 7f7458874640 1 --2- 172.21.15.117:0/4202594478 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f743406c2e0 0x7f743406e7a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7444009aa0 tx=0x7f7444009190 comp rx=0 tx=0).stop 2024-09-19T08:38:08.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.115+0000 7f7458874640 1 -- 172.21.15.117:0/4202594478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f745415b120 msgr2=0x7f74540c5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:08.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.115+0000 7f7458874640 1 --2- 172.21.15.117:0/4202594478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f745415b120 0x7f74540c5820 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f744c00c740 tx=0x7f744c00cc00 comp rx=0 tx=0).stop 2024-09-19T08:38:08.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.115+0000 7f7458874640 1 -- 172.21.15.117:0/4202594478 shutdown_connections 2024-09-19T08:38:08.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.115+0000 7f7458874640 1 --2- 172.21.15.117:0/4202594478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f745415b120 0x7f74540c5820 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.115+0000 7f7458874640 1 --2- 172.21.15.117:0/4202594478 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f743406c2e0 0x7f743406e7a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.115+0000 7f7458874640 1 --2- 172.21.15.117:0/4202594478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74540d04b0 0x7f7454157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.115+0000 7f7458874640 1 --2- 172.21.15.117:0/4202594478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f745406dec0 0x7f74541ebd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.115+0000 7f7458874640 1 -- 172.21.15.117:0/4202594478 >> 172.21.15.117:0/4202594478 conn(0x7f745406bdf0 msgr2=0x7f74540ceb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:08.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.115+0000 7f7458874640 1 -- 172.21.15.117:0/4202594478 shutdown_connections 2024-09-19T08:38:08.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.115+0000 7f7458874640 1 -- 172.21.15.117:0/4202594478 wait complete. 2024-09-19T08:38:08.127 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T08:38:08.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.227+0000 7f4d362d7640 1 Processor -- start 2024-09-19T08:38:08.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.227+0000 7f4d362d7640 1 -- start start 2024-09-19T08:38:08.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.228+0000 7f4d362d7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4d3015c2c0 0x7f4d300cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:08.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.228+0000 7f4d362d7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d300cdee0 con 0x7f4d3015bee0 2024-09-19T08:38:08.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.228+0000 7f4d362d7640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d300ce1c0 con 0x7f4d300d0bc0 2024-09-19T08:38:08.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.228+0000 7f4d362d7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f4d300ceaf0 con 0x7f4d3015c2c0 2024-09-19T08:38:08.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.228+0000 7f4d34874640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4d3015c2c0 0x7f4d300cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:08.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.228+0000 7f4d2ffff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f4d3015bee0 0x7f4d300d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:37508/0 (socket says 172.21.15.117:37508) 2024-09-19T08:38:08.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.228+0000 7f4d2ffff640 1 -- 172.21.15.117:0/3441568767 learned_addr learned my addr 172.21.15.117:0/3441568767 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:08.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.229+0000 7f4d34874640 1 -- 172.21.15.117:0/3441568767 >> v1:172.21.15.146:6789/0 conn(0x7f4d300d0bc0 legacy=0x7f4d300cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:08.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.229+0000 7f4d34874640 1 -- 172.21.15.117:0/3441568767 >> v1:172.21.15.117:6789/0 conn(0x7f4d3015bee0 legacy=0x7f4d300d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:08.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.229+0000 7f4d2f7fe640 1 -- 172.21.15.117:0/3441568767 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2142708801 0 0) 0x7f4d300cdee0 con 0x7f4d3015bee0 2024-09-19T08:38:08.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.229+0000 7f4d34874640 1 -- 172.21.15.117:0/3441568767 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d300ce4a0 con 0x7f4d3015c2c0 2024-09-19T08:38:08.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.229+0000 7f4d34874640 1 --2- 172.21.15.117:0/3441568767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d3015c2c0 0x7f4d300cf910 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009d90 tx=0x7f4d2802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d0f95593ff7c47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:08.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.229+0000 7f4d2f7fe640 1 -- 172.21.15.117:0/3441568767 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28007740 con 0x7f4d3015c2c0 2024-09-19T08:38:08.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.229+0000 7f4d2f7fe640 1 -- 172.21.15.117:0/3441568767 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d280078e0 con 0x7f4d3015c2c0 2024-09-19T08:38:08.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.229+0000 7f4d2f7fe640 1 -- 172.21.15.117:0/3441568767 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28007cb0 con 0x7f4d3015c2c0 2024-09-19T08:38:08.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.230+0000 7f4d362d7640 1 -- 172.21.15.117:0/3441568767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d3015c2c0 msgr2=0x7f4d300cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:08.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.230+0000 7f4d362d7640 1 --2- 172.21.15.117:0/3441568767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d3015c2c0 0x7f4d300cf910 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009d90 tx=0x7f4d2802a6a0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.230+0000 7f4d362d7640 1 -- 172.21.15.117:0/3441568767 shutdown_connections 2024-09-19T08:38:08.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.230+0000 7f4d362d7640 1 --2- 172.21.15.117:0/3441568767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d3015c2c0 0x7f4d300cf910 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.230+0000 7f4d362d7640 1 -- 172.21.15.117:0/3441568767 >> 172.21.15.117:0/3441568767 conn(0x7f4d3006bdf0 msgr2=0x7f4d3006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:08.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.230+0000 7f4d362d7640 1 -- 172.21.15.117:0/3441568767 shutdown_connections 2024-09-19T08:38:08.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.230+0000 7f4d362d7640 1 -- 172.21.15.117:0/3441568767 wait complete. 2024-09-19T08:38:08.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.231+0000 7f4d362d7640 1 Processor -- start 2024-09-19T08:38:08.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.231+0000 7f4d362d7640 1 -- start start 2024-09-19T08:38:08.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.232+0000 7f4d362d7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d300d0bc0 0x7f4d3014ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:08.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.232+0000 7f4d362d7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d3015bee0 0x7f4d3015ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:08.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.232+0000 7f4d362d7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d3015c2c0 0x7f4d30153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:08.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.232+0000 7f4d362d7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3006f050 con 0x7f4d3015c2c0 2024-09-19T08:38:08.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.232+0000 7f4d362d7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3006eed0 con 0x7f4d3015bee0 2024-09-19T08:38:08.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.232+0000 7f4d362d7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f4d30166ea0 con 0x7f4d300d0bc0 2024-09-19T08:38:08.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.232+0000 7f4d34874640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d3015c2c0 0x7f4d30153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:08.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.232+0000 7f4d34874640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d3015c2c0 0x7f4d30153020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47122/0 (socket says 172.21.15.117:47122) 2024-09-19T08:38:08.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.232+0000 7f4d34874640 1 -- 172.21.15.117:0/3723177647 learned_addr learned my addr 172.21.15.117:0/3723177647 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:08.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.232+0000 7f4d2ffff640 1 --2- 172.21.15.117:0/3723177647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d300d0bc0 0x7f4d3014ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:08.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.232+0000 7f4d27fff640 1 --2- 172.21.15.117:0/3723177647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d3015bee0 0x7f4d3015ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:08.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.232+0000 7f4d34874640 1 -- 172.21.15.117:0/3723177647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d300d0bc0 msgr2=0x7f4d3014ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:08.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.232+0000 7f4d34874640 1 --2- 172.21.15.117:0/3723177647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d300d0bc0 0x7f4d3014ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.232+0000 7f4d34874640 1 -- 172.21.15.117:0/3723177647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d3015bee0 msgr2=0x7f4d3015ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:08.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.232+0000 7f4d34874640 1 --2- 172.21.15.117:0/3723177647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d3015bee0 0x7f4d3015ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.232+0000 7f4d34874640 1 -- 172.21.15.117:0/3723177647 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d30159bb0 con 0x7f4d3015c2c0 2024-09-19T08:38:08.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.232+0000 7f4d27fff640 1 --2- 172.21.15.117:0/3723177647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d3015bee0 0x7f4d3015ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:08.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.233+0000 7f4d34874640 1 --2- 172.21.15.117:0/3723177647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d3015c2c0 0x7f4d30153020 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4d2802ac90 tx=0x7f4d28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:08.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.233+0000 7f4d2d7fa640 1 -- 172.21.15.117:0/3723177647 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28040070 con 0x7f4d3015c2c0 2024-09-19T08:38:08.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.233+0000 7f4d2d7fa640 1 -- 172.21.15.117:0/3723177647 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d28031c90 con 0x7f4d3015c2c0 2024-09-19T08:38:08.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.233+0000 7f4d362d7640 1 -- 172.21.15.117:0/3723177647 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d30159e90 con 0x7f4d3015c2c0 2024-09-19T08:38:08.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.233+0000 7f4d2d7fa640 1 -- 172.21.15.117:0/3723177647 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28045680 con 0x7f4d3015c2c0 2024-09-19T08:38:08.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.233+0000 7f4d362d7640 1 -- 172.21.15.117:0/3723177647 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d3015a450 con 0x7f4d3015c2c0 2024-09-19T08:38:08.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.234+0000 7f4d362d7640 1 -- 172.21.15.117:0/3723177647 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d300d04b0 con 0x7f4d3015c2c0 2024-09-19T08:38:08.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.234+0000 7f4d2d7fa640 1 -- 172.21.15.117:0/3723177647 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4d28039040 con 0x7f4d3015c2c0 2024-09-19T08:38:08.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.235+0000 7f4d2d7fa640 1 --2- 172.21.15.117:0/3723177647 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4d1006c2b0 0x7f4d1006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:08.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.235+0000 7f4d2d7fa640 1 -- 172.21.15.117:0/3723177647 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f4d280acf80 con 0x7f4d3015c2c0 2024-09-19T08:38:08.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.235+0000 7f4d2ffff640 1 --2- 172.21.15.117:0/3723177647 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4d1006c2b0 0x7f4d1006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:08.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.235+0000 7f4d2ffff640 1 --2- 172.21.15.117:0/3723177647 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4d1006c2b0 0x7f4d1006e770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4d20000f60 tx=0x7f4d20007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:08.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.239+0000 7f4d2d7fa640 1 -- 172.21.15.117:0/3723177647 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4d2807b620 con 0x7f4d3015c2c0 2024-09-19T08:38:08.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.439+0000 7f4d362d7640 1 -- 172.21.15.117:0/3723177647 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4d30158600 con 0x7f4d3015c2c0 2024-09-19T08:38:08.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.519+0000 7f4d2d7fa640 1 -- 172.21.15.117:0/3723177647 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f4d2807af20 con 0x7f4d3015c2c0 2024-09-19T08:38:08.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.522+0000 7f4d362d7640 1 -- 172.21.15.117:0/3723177647 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4d1006c2b0 msgr2=0x7f4d1006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:08.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.522+0000 7f4d362d7640 1 --2- 172.21.15.117:0/3723177647 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4d1006c2b0 0x7f4d1006e770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4d20000f60 tx=0x7f4d20007d50 comp rx=0 tx=0).stop 2024-09-19T08:38:08.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.522+0000 7f4d362d7640 1 -- 172.21.15.117:0/3723177647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d3015c2c0 msgr2=0x7f4d30153020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:08.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.522+0000 7f4d362d7640 1 --2- 172.21.15.117:0/3723177647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d3015c2c0 0x7f4d30153020 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4d2802ac90 tx=0x7f4d28004a40 comp rx=0 tx=0).stop 2024-09-19T08:38:08.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.523+0000 7f4d362d7640 1 -- 172.21.15.117:0/3723177647 shutdown_connections 2024-09-19T08:38:08.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.523+0000 7f4d362d7640 1 --2- 172.21.15.117:0/3723177647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d3015c2c0 0x7f4d30153020 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.523+0000 7f4d362d7640 1 --2- 172.21.15.117:0/3723177647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d3015bee0 0x7f4d3015ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.523+0000 7f4d362d7640 1 --2- 172.21.15.117:0/3723177647 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4d1006c2b0 0x7f4d1006e770 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.523+0000 7f4d362d7640 1 --2- 172.21.15.117:0/3723177647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d300d0bc0 0x7f4d3014ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.523+0000 7f4d362d7640 1 -- 172.21.15.117:0/3723177647 >> 172.21.15.117:0/3723177647 conn(0x7f4d3006bdf0 msgr2=0x7f4d300b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:08.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.523+0000 7f4d362d7640 1 -- 172.21.15.117:0/3723177647 shutdown_connections 2024-09-19T08:38:08.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.523+0000 7f4d362d7640 1 -- 172.21.15.117:0/3723177647 wait complete. 2024-09-19T08:38:08.536 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T08:38:08.536 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T08:38:08.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.637+0000 7ff256274640 1 Processor -- start 2024-09-19T08:38:08.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.637+0000 7ff256274640 1 -- start start 2024-09-19T08:38:08.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff256274640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff250141680 0x7ff2500cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:08.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff256274640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff25015d710 con 0x7ff2500d0370 2024-09-19T08:38:08.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff256274640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff25015c950 con 0x7ff250142170 2024-09-19T08:38:08.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff256274640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7ff2500d07e0 con 0x7ff250141680 2024-09-19T08:38:08.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff24f7fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7ff2500d0370 0x7ff250141a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:37524/0 (socket says 172.21.15.117:37524) 2024-09-19T08:38:08.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff24f7fe640 1 -- 172.21.15.117:0/2951873263 learned_addr learned my addr 172.21.15.117:0/2951873263 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:08.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff24effd640 1 -- 172.21.15.117:0/2951873263 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3620347487 0 0) 0x7ff25015d710 con 0x7ff2500d0370 2024-09-19T08:38:08.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff24effd640 1 -- 172.21.15.117:0/2951873263 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff23c003520 con 0x7ff2500d0370 2024-09-19T08:38:08.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff24ffff640 1 --2- 172.21.15.117:0/2951873263 >> v2:172.21.15.146:3300/0 conn(0x7ff250141680 0x7ff2500cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:08.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff24effd640 1 -- 172.21.15.117:0/2951873263 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1434678299 0 0) 0x7ff23c003520 con 0x7ff2500d0370 2024-09-19T08:38:08.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff24effd640 1 -- 172.21.15.117:0/2951873263 >> v2:172.21.15.146:3300/0 conn(0x7ff250141680 msgr2=0x7ff2500cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:08.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff24effd640 1 --2- 172.21.15.117:0/2951873263 >> v2:172.21.15.146:3300/0 conn(0x7ff250141680 0x7ff2500cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff24effd640 1 -- 172.21.15.117:0/2951873263 >> v1:172.21.15.146:6789/0 conn(0x7ff250142170 legacy=0x7ff25013f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:08.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff24effd640 1 -- 172.21.15.117:0/2951873263 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25015cc30 con 0x7ff2500d0370 2024-09-19T08:38:08.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff24effd640 1 -- 172.21.15.117:0/2951873263 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7ff238001670 con 0x7ff2500d0370 2024-09-19T08:38:08.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff24effd640 1 -- 172.21.15.117:0/2951873263 >> v1:172.21.15.117:6789/0 conn(0x7ff2500d0370 legacy=0x7ff250141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:08.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff24effd640 1 --2- 172.21.15.117:0/2951873263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff23c0039b0 0x7ff23c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:08.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff24effd640 1 --2- 172.21.15.117:0/2951873263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff23c004800 0x7ff23c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:08.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff24effd640 1 --2- 172.21.15.117:0/2951873263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff23c0051c0 0x7ff23c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:08.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff24effd640 1 -- 172.21.15.117:0/2951873263 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff2500d07e0 con 0x7ff23c0039b0 2024-09-19T08:38:08.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff24effd640 1 -- 172.21.15.117:0/2951873263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c00c0f0 con 0x7ff23c004800 2024-09-19T08:38:08.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff24effd640 1 -- 172.21.15.117:0/2951873263 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7ff23c00c2f0 con 0x7ff23c0051c0 2024-09-19T08:38:08.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.638+0000 7ff24ffff640 1 --2- 172.21.15.117:0/2951873263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff23c0039b0 0x7ff23c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:08.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.639+0000 7ff24f7fe640 1 --2- 172.21.15.117:0/2951873263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff23c004800 0x7ff23c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:08.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.639+0000 7ff254811640 1 --2- 172.21.15.117:0/2951873263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff23c0051c0 0x7ff23c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:08.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.639+0000 7ff24ffff640 1 -- 172.21.15.117:0/2951873263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff23c0051c0 msgr2=0x7ff23c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:08.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.639+0000 7ff24ffff640 1 --2- 172.21.15.117:0/2951873263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff23c0051c0 0x7ff23c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.639+0000 7ff24ffff640 1 -- 172.21.15.117:0/2951873263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff23c004800 msgr2=0x7ff23c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:08.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.639+0000 7ff24ffff640 1 --2- 172.21.15.117:0/2951873263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff23c004800 0x7ff23c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.639+0000 7ff24ffff640 1 -- 172.21.15.117:0/2951873263 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff23c003520 con 0x7ff23c0039b0 2024-09-19T08:38:08.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.639+0000 7ff254811640 1 --2- 172.21.15.117:0/2951873263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff23c0051c0 0x7ff23c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:08.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.639+0000 7ff254811640 1 -- 172.21.15.117:0/2951873263 reap_dead start 2024-09-19T08:38:08.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.639+0000 7ff24ffff640 1 --2- 172.21.15.117:0/2951873263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff23c0039b0 0x7ff23c003db0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff24000ba00 tx=0x7ff23c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90822b2a61b9998f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:08.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.640+0000 7ff24effd640 1 -- 172.21.15.117:0/2951873263 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff240030070 con 0x7ff23c0039b0 2024-09-19T08:38:08.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.640+0000 7ff24effd640 1 -- 172.21.15.117:0/2951873263 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff24002ad80 con 0x7ff23c0039b0 2024-09-19T08:38:08.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.640+0000 7ff24effd640 1 -- 172.21.15.117:0/2951873263 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24000b600 con 0x7ff23c0039b0 2024-09-19T08:38:08.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.640+0000 7ff256274640 1 -- 172.21.15.117:0/2951873263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff23c0039b0 msgr2=0x7ff23c003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:08.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.640+0000 7ff256274640 1 --2- 172.21.15.117:0/2951873263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff23c0039b0 0x7ff23c003db0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff24000ba00 tx=0x7ff23c005830 comp rx=0 tx=0).stop 2024-09-19T08:38:08.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.640+0000 7ff256274640 1 -- 172.21.15.117:0/2951873263 shutdown_connections 2024-09-19T08:38:08.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.640+0000 7ff256274640 1 --2- 172.21.15.117:0/2951873263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff23c0039b0 0x7ff23c003db0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.640+0000 7ff256274640 1 -- 172.21.15.117:0/2951873263 >> 172.21.15.117:0/2951873263 conn(0x7ff2500b3ed0 msgr2=0x7ff2500b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:08.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.640+0000 7ff256274640 1 -- 172.21.15.117:0/2951873263 shutdown_connections 2024-09-19T08:38:08.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.640+0000 7ff256274640 1 -- 172.21.15.117:0/2951873263 wait complete. 2024-09-19T08:38:08.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.641+0000 7ff256274640 1 Processor -- start 2024-09-19T08:38:08.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.642+0000 7ff256274640 1 -- start start 2024-09-19T08:38:08.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.642+0000 7ff256274640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff23c0039b0 0x7ff2501f1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:08.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.642+0000 7ff256274640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2500ca1b0 0x7ff25013ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:08.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.642+0000 7ff256274640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2500c82c0 0x7ff2500c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:08.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.642+0000 7ff256274640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff25015d1f0 con 0x7ff2500c82c0 2024-09-19T08:38:08.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.642+0000 7ff256274640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff25015c6f0 con 0x7ff2500ca1b0 2024-09-19T08:38:08.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.642+0000 7ff256274640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7ff250142570 con 0x7ff23c0039b0 2024-09-19T08:38:08.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.642+0000 7ff254811640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2500c82c0 0x7ff2500c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:08.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.642+0000 7ff254811640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2500c82c0 0x7ff2500c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47134/0 (socket says 172.21.15.117:47134) 2024-09-19T08:38:08.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.642+0000 7ff254811640 1 -- 172.21.15.117:0/1415011383 learned_addr learned my addr 172.21.15.117:0/1415011383 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:08.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.642+0000 7ff24ffff640 1 --2- 172.21.15.117:0/1415011383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff23c0039b0 0x7ff2501f1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:08.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.642+0000 7ff24f7fe640 1 --2- 172.21.15.117:0/1415011383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2500ca1b0 0x7ff25013ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:08.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.643+0000 7ff254811640 1 -- 172.21.15.117:0/1415011383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff23c0039b0 msgr2=0x7ff2501f1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:08.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.643+0000 7ff254811640 1 --2- 172.21.15.117:0/1415011383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff23c0039b0 0x7ff2501f1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.643+0000 7ff254811640 1 -- 172.21.15.117:0/1415011383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2500ca1b0 msgr2=0x7ff25013ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:08.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.643+0000 7ff254811640 1 --2- 172.21.15.117:0/1415011383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2500ca1b0 0x7ff25013ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:08.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.643+0000 7ff254811640 1 -- 172.21.15.117:0/1415011383 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2500b7ef0 con 0x7ff2500c82c0 2024-09-19T08:38:08.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.643+0000 7ff254811640 1 --2- 172.21.15.117:0/1415011383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2500c82c0 0x7ff2500c8740 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff2500d0a30 tx=0x7ff24800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:08.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.643+0000 7ff24cff9640 1 -- 172.21.15.117:0/1415011383 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24801b070 con 0x7ff2500c82c0 2024-09-19T08:38:08.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.643+0000 7ff24cff9640 1 -- 172.21.15.117:0/1415011383 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff248006b50 con 0x7ff2500c82c0 2024-09-19T08:38:08.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.643+0000 7ff256274640 1 -- 172.21.15.117:0/1415011383 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2500ca630 con 0x7ff2500c82c0 2024-09-19T08:38:08.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.643+0000 7ff24cff9640 1 -- 172.21.15.117:0/1415011383 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24800c610 con 0x7ff2500c82c0 2024-09-19T08:38:08.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.643+0000 7ff256274640 1 -- 172.21.15.117:0/1415011383 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2501f26e0 con 0x7ff2500c82c0 2024-09-19T08:38:08.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.644+0000 7ff256274640 1 -- 172.21.15.117:0/1415011383 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2500cfe30 con 0x7ff2500c82c0 2024-09-19T08:38:08.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.645+0000 7ff24cff9640 1 -- 172.21.15.117:0/1415011383 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff24801e070 con 0x7ff2500c82c0 2024-09-19T08:38:08.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.645+0000 7ff24cff9640 1 --2- 172.21.15.117:0/1415011383 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff23006c2b0 0x7ff23006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:08.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.645+0000 7ff24cff9640 1 -- 172.21.15.117:0/1415011383 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7ff24808acb0 con 0x7ff2500c82c0 2024-09-19T08:38:08.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.645+0000 7ff24ffff640 1 --2- 172.21.15.117:0/1415011383 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff23006c2b0 0x7ff23006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:08.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.646+0000 7ff24ffff640 1 --2- 172.21.15.117:0/1415011383 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff23006c2b0 0x7ff23006e770 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0057e0 tx=0x7ff240030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:08.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.649+0000 7ff24cff9640 1 -- 172.21.15.117:0/1415011383 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff248058c40 con 0x7ff2500c82c0 2024-09-19T08:38:08.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:08.853+0000 7ff256274640 1 -- 172.21.15.117:0/1415011383 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff25013f590 con 0x7ff2500c82c0 2024-09-19T08:38:09.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.531+0000 7ff24cff9640 1 -- 172.21.15.117:0/1415011383 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7ff24805cf40 con 0x7ff2500c82c0 2024-09-19T08:38:09.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.533+0000 7ff256274640 1 -- 172.21.15.117:0/1415011383 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff23006c2b0 msgr2=0x7ff23006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:09.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.533+0000 7ff256274640 1 --2- 172.21.15.117:0/1415011383 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff23006c2b0 0x7ff23006e770 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0057e0 tx=0x7ff240030000 comp rx=0 tx=0).stop 2024-09-19T08:38:09.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.533+0000 7ff256274640 1 -- 172.21.15.117:0/1415011383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2500c82c0 msgr2=0x7ff2500c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:09.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.533+0000 7ff256274640 1 --2- 172.21.15.117:0/1415011383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2500c82c0 0x7ff2500c8740 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff2500d0a30 tx=0x7ff24800eb90 comp rx=0 tx=0).stop 2024-09-19T08:38:09.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.533+0000 7ff256274640 1 -- 172.21.15.117:0/1415011383 shutdown_connections 2024-09-19T08:38:09.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.533+0000 7ff256274640 1 --2- 172.21.15.117:0/1415011383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2500c82c0 0x7ff2500c8740 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.533+0000 7ff256274640 1 --2- 172.21.15.117:0/1415011383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2500ca1b0 0x7ff25013ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.533+0000 7ff256274640 1 --2- 172.21.15.117:0/1415011383 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff23006c2b0 0x7ff23006e770 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.533+0000 7ff256274640 1 --2- 172.21.15.117:0/1415011383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff23c0039b0 0x7ff2501f1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.533+0000 7ff256274640 1 -- 172.21.15.117:0/1415011383 >> 172.21.15.117:0/1415011383 conn(0x7ff2500b3ed0 msgr2=0x7ff2500d2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:09.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.533+0000 7ff256274640 1 -- 172.21.15.117:0/1415011383 shutdown_connections 2024-09-19T08:38:09.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.533+0000 7ff256274640 1 -- 172.21.15.117:0/1415011383 wait complete. 2024-09-19T08:38:09.546 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T08:38:09.547 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:38:09.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.647+0000 7fc23b75f640 1 Processor -- start 2024-09-19T08:38:09.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.647+0000 7fc23b75f640 1 -- start start 2024-09-19T08:38:09.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.648+0000 7fc23b75f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc23415e2a0 0x7fc23406d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:09.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.648+0000 7fc23b75f640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc23415e680 0x7fc2340cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:09.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.648+0000 7fc23b75f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc23406d960 0x7fc2340d0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:09.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.648+0000 7fc23b75f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc2340d1880 con 0x7fc23406d960 2024-09-19T08:38:09.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.648+0000 7fc23b75f640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fc2340d1b60 con 0x7fc23415e680 2024-09-19T08:38:09.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.648+0000 7fc23b75f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fc2340cf2d0 con 0x7fc23415e2a0 2024-09-19T08:38:09.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.648+0000 7fc239cfc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc23406d960 0x7fc2340d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:09.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.648+0000 7fc239cfc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc23406d960 0x7fc2340d0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47142/0 (socket says 172.21.15.117:47142) 2024-09-19T08:38:09.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.648+0000 7fc239cfc640 1 -- 172.21.15.117:0/587110004 learned_addr learned my addr 172.21.15.117:0/587110004 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:09.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.649+0000 7fc2394fb640 1 --2- 172.21.15.117:0/587110004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc23415e2a0 0x7fc23406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:09.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.649+0000 7fc238cfa640 1 --2- 172.21.15.117:0/587110004 >> v2:172.21.15.146:3300/0 conn(0x7fc23415e680 0x7fc2340cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:09.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.649+0000 7fc239cfc640 1 -- 172.21.15.117:0/587110004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc23415e2a0 msgr2=0x7fc23406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:09.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.649+0000 7fc239cfc640 1 --2- 172.21.15.117:0/587110004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc23415e2a0 0x7fc23406d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.649+0000 7fc239cfc640 1 -- 172.21.15.117:0/587110004 >> v2:172.21.15.146:3300/0 conn(0x7fc23415e680 msgr2=0x7fc2340cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:09.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.649+0000 7fc239cfc640 1 --2- 172.21.15.117:0/587110004 >> v2:172.21.15.146:3300/0 conn(0x7fc23415e680 0x7fc2340cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.649+0000 7fc239cfc640 1 -- 172.21.15.117:0/587110004 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2340cf5b0 con 0x7fc23406d960 2024-09-19T08:38:09.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.649+0000 7fc239cfc640 1 --2- 172.21.15.117:0/587110004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23406d960 0x7fc2340d0010 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc2340d1f60 tx=0x7fc22c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272dbabab9c614e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:09.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.650+0000 7fc22bfff640 1 -- 172.21.15.117:0/587110004 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c037070 con 0x7fc23406d960 2024-09-19T08:38:09.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.650+0000 7fc22bfff640 1 -- 172.21.15.117:0/587110004 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc22c032440 con 0x7fc23406d960 2024-09-19T08:38:09.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.650+0000 7fc22bfff640 1 -- 172.21.15.117:0/587110004 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c032810 con 0x7fc23406d960 2024-09-19T08:38:09.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.650+0000 7fc23b75f640 1 -- 172.21.15.117:0/587110004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23406d960 msgr2=0x7fc2340d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:09.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.650+0000 7fc23b75f640 1 --2- 172.21.15.117:0/587110004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23406d960 0x7fc2340d0010 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc2340d1f60 tx=0x7fc22c02a1e0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.650+0000 7fc23b75f640 1 -- 172.21.15.117:0/587110004 shutdown_connections 2024-09-19T08:38:09.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.650+0000 7fc23b75f640 1 --2- 172.21.15.117:0/587110004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23406d960 0x7fc2340d0010 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.650+0000 7fc23b75f640 1 --2- 172.21.15.117:0/587110004 >> v2:172.21.15.146:3300/0 conn(0x7fc23415e680 0x7fc2340cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.650+0000 7fc23b75f640 1 --2- 172.21.15.117:0/587110004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc23415e2a0 0x7fc23406d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.650+0000 7fc23b75f640 1 -- 172.21.15.117:0/587110004 >> 172.21.15.117:0/587110004 conn(0x7fc23409d760 msgr2=0x7fc23408bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:09.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.650+0000 7fc23b75f640 1 -- 172.21.15.117:0/587110004 shutdown_connections 2024-09-19T08:38:09.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.650+0000 7fc23b75f640 1 -- 172.21.15.117:0/587110004 wait complete. 2024-09-19T08:38:09.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.651+0000 7fc23b75f640 1 Processor -- start 2024-09-19T08:38:09.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.651+0000 7fc23b75f640 1 -- start start 2024-09-19T08:38:09.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.652+0000 7fc23b75f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23406d960 0x7fc2341f49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:09.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.652+0000 7fc23b75f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc23415e2a0 0x7fc23415c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:09.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.652+0000 7fc23b75f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc23415e680 0x7fc23415c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:09.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.652+0000 7fc23b75f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc2340d44f0 con 0x7fc23406d960 2024-09-19T08:38:09.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.652+0000 7fc23b75f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc2340d4370 con 0x7fc23415e2a0 2024-09-19T08:38:09.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.652+0000 7fc23b75f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fc2340d4670 con 0x7fc23415e680 2024-09-19T08:38:09.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.652+0000 7fc2394fb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23406d960 0x7fc2341f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:09.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.652+0000 7fc2394fb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23406d960 0x7fc2341f49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47148/0 (socket says 172.21.15.117:47148) 2024-09-19T08:38:09.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.652+0000 7fc2394fb640 1 -- 172.21.15.117:0/4253610903 learned_addr learned my addr 172.21.15.117:0/4253610903 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:09.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.652+0000 7fc239cfc640 1 --2- 172.21.15.117:0/4253610903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc23415e680 0x7fc23415c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:09.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.652+0000 7fc238cfa640 1 --2- 172.21.15.117:0/4253610903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc23415e2a0 0x7fc23415c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:09.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.653+0000 7fc2394fb640 1 -- 172.21.15.117:0/4253610903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc23415e680 msgr2=0x7fc23415c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:09.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.653+0000 7fc2394fb640 1 --2- 172.21.15.117:0/4253610903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc23415e680 0x7fc23415c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.653+0000 7fc2394fb640 1 -- 172.21.15.117:0/4253610903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc23415e2a0 msgr2=0x7fc23415c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:09.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.653+0000 7fc2394fb640 1 --2- 172.21.15.117:0/4253610903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc23415e2a0 0x7fc23415c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.653+0000 7fc2394fb640 1 -- 172.21.15.117:0/4253610903 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2341f4f00 con 0x7fc23406d960 2024-09-19T08:38:09.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.653+0000 7fc239cfc640 1 --2- 172.21.15.117:0/4253610903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc23415e680 0x7fc23415c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:09.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.653+0000 7fc2394fb640 1 --2- 172.21.15.117:0/4253610903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23406d960 0x7fc2341f49c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc230007ec0 tx=0x7fc23000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:09.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.653+0000 7fc229ffb640 1 -- 172.21.15.117:0/4253610903 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc230014620 con 0x7fc23406d960 2024-09-19T08:38:09.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.653+0000 7fc229ffb640 1 -- 172.21.15.117:0/4253610903 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc230019070 con 0x7fc23406d960 2024-09-19T08:38:09.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.653+0000 7fc23b75f640 1 -- 172.21.15.117:0/4253610903 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2341f7780 con 0x7fc23406d960 2024-09-19T08:38:09.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.653+0000 7fc229ffb640 1 -- 172.21.15.117:0/4253610903 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc230014a20 con 0x7fc23406d960 2024-09-19T08:38:09.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.653+0000 7fc23b75f640 1 -- 172.21.15.117:0/4253610903 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2341f7d40 con 0x7fc23406d960 2024-09-19T08:38:09.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.654+0000 7fc23b75f640 1 -- 172.21.15.117:0/4253610903 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2340d4a40 con 0x7fc23406d960 2024-09-19T08:38:09.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.655+0000 7fc229ffb640 1 -- 172.21.15.117:0/4253610903 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc230014bc0 con 0x7fc23406d960 2024-09-19T08:38:09.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.655+0000 7fc229ffb640 1 --2- 172.21.15.117:0/4253610903 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc21806c2b0 0x7fc21806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:09.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.655+0000 7fc229ffb640 1 -- 172.21.15.117:0/4253610903 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fc23008bf20 con 0x7fc23406d960 2024-09-19T08:38:09.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.655+0000 7fc238cfa640 1 --2- 172.21.15.117:0/4253610903 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc21806c2b0 0x7fc21806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:09.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.656+0000 7fc238cfa640 1 --2- 172.21.15.117:0/4253610903 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc21806c2b0 0x7fc21806e770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc224006fd0 tx=0x7fc224008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:09.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.659+0000 7fc229ffb640 1 -- 172.21.15.117:0/4253610903 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc23005a500 con 0x7fc23406d960 2024-09-19T08:38:09.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.859+0000 7fc23b75f640 1 -- 172.21.15.117:0/4253610903 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2341629c0 con 0x7fc23406d960 2024-09-19T08:38:09.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.859+0000 7fc229ffb640 1 -- 172.21.15.117:0/4253610903 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5235 (secure 0 0 0) 0x7fc230059e00 con 0x7fc23406d960 2024-09-19T08:38:09.860 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:09.860 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":16,"btime":"2024-09-19T08:38:09:528263+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4595,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2240250216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2240250216},{"type":"v1","addr":"172.21.15.146:6836","nonce":2240250216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2165679820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2165679820},{"type":"v1","addr":"172.21.15.117:6834","nonce":2165679820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2737032516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2737032516},{"type":"v1","addr":"172.21.15.117:6835","nonce":2737032516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:38:06.852720+0000","modified":"2024-09-19T08:38:08.856085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/3614861409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":3614861409},{"type":"v1","addr":"172.21.15.146:6837","nonce":3614861409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4926,"qdb_cluster":[4926]},"id":2}]} 2024-09-19T08:38:09.861 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 16 2024-09-19T08:38:09.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.861+0000 7fc23b75f640 1 -- 172.21.15.117:0/4253610903 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc21806c2b0 msgr2=0x7fc21806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:09.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.861+0000 7fc23b75f640 1 --2- 172.21.15.117:0/4253610903 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc21806c2b0 0x7fc21806e770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc224006fd0 tx=0x7fc224008040 comp rx=0 tx=0).stop 2024-09-19T08:38:09.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.861+0000 7fc23b75f640 1 -- 172.21.15.117:0/4253610903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23406d960 msgr2=0x7fc2341f49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:09.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.861+0000 7fc23b75f640 1 --2- 172.21.15.117:0/4253610903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23406d960 0x7fc2341f49c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc230007ec0 tx=0x7fc23000e4b0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.861+0000 7fc23b75f640 1 -- 172.21.15.117:0/4253610903 shutdown_connections 2024-09-19T08:38:09.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.861+0000 7fc23b75f640 1 --2- 172.21.15.117:0/4253610903 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc21806c2b0 0x7fc21806e770 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.861+0000 7fc23b75f640 1 --2- 172.21.15.117:0/4253610903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc23415e680 0x7fc23415c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.861+0000 7fc23b75f640 1 --2- 172.21.15.117:0/4253610903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc23415e2a0 0x7fc23415c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.861+0000 7fc23b75f640 1 --2- 172.21.15.117:0/4253610903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc23406d960 0x7fc2341f49c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.861+0000 7fc23b75f640 1 -- 172.21.15.117:0/4253610903 >> 172.21.15.117:0/4253610903 conn(0x7fc23409d760 msgr2=0x7fc23415f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:09.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.861+0000 7fc23b75f640 1 -- 172.21.15.117:0/4253610903 shutdown_connections 2024-09-19T08:38:09.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.861+0000 7fc23b75f640 1 -- 172.21.15.117:0/4253610903 wait complete. 2024-09-19T08:38:09.873 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:38:09.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.970+0000 7fbb78ee6640 1 Processor -- start 2024-09-19T08:38:09.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.970+0000 7fbb78ee6640 1 -- start start 2024-09-19T08:38:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.971+0000 7fbb78ee6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb7415c140 0x7fbb74160650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.971+0000 7fbb78ee6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb74160b90 con 0x7fbb740b6650 2024-09-19T08:38:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.971+0000 7fbb78ee6640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb7415c520 con 0x7fbb7406f9d0 2024-09-19T08:38:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.971+0000 7fbb78ee6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fbb7415c7f0 con 0x7fbb7415c140 2024-09-19T08:38:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.971+0000 7fbb72d9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fbb740b6650 0x7fbb7415d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:37530/0 (socket says 172.21.15.117:37530) 2024-09-19T08:38:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.971+0000 7fbb72d9d640 1 -- 172.21.15.117:0/385075397 learned_addr learned my addr 172.21.15.117:0/385075397 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.971+0000 7fbb7259c640 1 --2- 172.21.15.117:0/385075397 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb7415c140 0x7fbb74160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.971+0000 7fbb71d9b640 1 -- 172.21.15.117:0/385075397 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2051933965 0 0) 0x7fbb6c001490 con 0x7fbb740b6650 2024-09-19T08:38:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.971+0000 7fbb71d9b640 1 -- 172.21.15.117:0/385075397 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb60003520 con 0x7fbb740b6650 2024-09-19T08:38:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.971+0000 7fbb71d9b640 1 -- 172.21.15.117:0/385075397 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3139919162 0 0) 0x7fbb7415c520 con 0x7fbb7406f9d0 2024-09-19T08:38:09.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.971+0000 7fbb71d9b640 1 -- 172.21.15.117:0/385075397 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb6c001490 con 0x7fbb7406f9d0 2024-09-19T08:38:09.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.971+0000 7fbb71d9b640 1 -- 172.21.15.117:0/385075397 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2152940955 0 0) 0x7fbb60003520 con 0x7fbb740b6650 2024-09-19T08:38:09.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.971+0000 7fbb71d9b640 1 -- 172.21.15.117:0/385075397 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb7415c140 msgr2=0x7fbb74160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:09.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.971+0000 7fbb71d9b640 1 --2- 172.21.15.117:0/385075397 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb7415c140 0x7fbb74160650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.971+0000 7fbb71d9b640 1 -- 172.21.15.117:0/385075397 >> v1:172.21.15.146:6789/0 conn(0x7fbb7406f9d0 legacy=0x7fbb740b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:09.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.971+0000 7fbb71d9b640 1 -- 172.21.15.117:0/385075397 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb7415cad0 con 0x7fbb740b6650 2024-09-19T08:38:09.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.971+0000 7fbb71d9b640 1 -- 172.21.15.117:0/385075397 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7fbb6c001bc0 con 0x7fbb740b6650 2024-09-19T08:38:09.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.971+0000 7fbb7259c640 1 --2- 172.21.15.117:0/385075397 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb7415c140 0x7fbb74160650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:38:09.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.971+0000 7fbb71d9b640 1 -- 172.21.15.117:0/385075397 >> v1:172.21.15.117:6789/0 conn(0x7fbb740b6650 legacy=0x7fbb7415d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:09.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.971+0000 7fbb71d9b640 1 --2- 172.21.15.117:0/385075397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb60003b70 0x7fbb60003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:09.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.972+0000 7fbb71d9b640 1 --2- 172.21.15.117:0/385075397 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb7415c140 0x7fbb60004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:09.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.972+0000 7fbb71d9b640 1 --2- 172.21.15.117:0/385075397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb60004d40 0x7fbb600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:09.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.972+0000 7fbb71d9b640 1 -- 172.21.15.117:0/385075397 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7415c7f0 con 0x7fbb60003b70 2024-09-19T08:38:09.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.972+0000 7fbb71d9b640 1 -- 172.21.15.117:0/385075397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6000ba70 con 0x7fbb60004d40 2024-09-19T08:38:09.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.972+0000 7fbb71d9b640 1 -- 172.21.15.117:0/385075397 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fbb6000bbf0 con 0x7fbb7415c140 2024-09-19T08:38:09.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.972+0000 7fbb7259c640 1 --2- 172.21.15.117:0/385075397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb60003b70 0x7fbb60003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:09.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.972+0000 7fbb6bfff640 1 --2- 172.21.15.117:0/385075397 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb7415c140 0x7fbb60004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:09.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.972+0000 7fbb72d9d640 1 --2- 172.21.15.117:0/385075397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb60004d40 0x7fbb600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:09.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.972+0000 7fbb7259c640 1 -- 172.21.15.117:0/385075397 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb7415c140 msgr2=0x7fbb60004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:09.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.972+0000 7fbb7259c640 1 --2- 172.21.15.117:0/385075397 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb7415c140 0x7fbb60004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.972+0000 7fbb7259c640 1 -- 172.21.15.117:0/385075397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb60004d40 msgr2=0x7fbb600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:09.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.972+0000 7fbb7259c640 1 --2- 172.21.15.117:0/385075397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb60004d40 0x7fbb600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.972+0000 7fbb7259c640 1 -- 172.21.15.117:0/385075397 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb60003520 con 0x7fbb60003b70 2024-09-19T08:38:09.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.973+0000 7fbb7259c640 1 --2- 172.21.15.117:0/385075397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb60003b70 0x7fbb60003f70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbb64009cc0 tx=0x7fbb60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f377f1fcc1843602 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:09.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.973+0000 7fbb71d9b640 1 -- 172.21.15.117:0/385075397 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb64036070 con 0x7fbb60003b70 2024-09-19T08:38:09.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.973+0000 7fbb71d9b640 1 -- 172.21.15.117:0/385075397 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb64031400 con 0x7fbb60003b70 2024-09-19T08:38:09.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.973+0000 7fbb71d9b640 1 -- 172.21.15.117:0/385075397 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb64009860 con 0x7fbb60003b70 2024-09-19T08:38:09.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.973+0000 7fbb78ee6640 1 -- 172.21.15.117:0/385075397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb60003b70 msgr2=0x7fbb60003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:09.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.973+0000 7fbb78ee6640 1 --2- 172.21.15.117:0/385075397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb60003b70 0x7fbb60003f70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbb64009cc0 tx=0x7fbb60005830 comp rx=0 tx=0).stop 2024-09-19T08:38:09.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.973+0000 7fbb72d9d640 1 -- 172.21.15.117:0/385075397 reap_dead start 2024-09-19T08:38:09.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.973+0000 7fbb78ee6640 1 -- 172.21.15.117:0/385075397 shutdown_connections 2024-09-19T08:38:09.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.973+0000 7fbb78ee6640 1 -- 172.21.15.117:0/385075397 >> 172.21.15.117:0/385075397 conn(0x7fbb7406bc10 msgr2=0x7fbb7406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:09.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.973+0000 7fbb78ee6640 1 -- 172.21.15.117:0/385075397 shutdown_connections 2024-09-19T08:38:09.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.973+0000 7fbb78ee6640 1 -- 172.21.15.117:0/385075397 wait complete. 2024-09-19T08:38:09.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.975+0000 7fbb78ee6640 1 Processor -- start 2024-09-19T08:38:09.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.975+0000 7fbb78ee6640 1 -- start start 2024-09-19T08:38:09.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.975+0000 7fbb78ee6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb60003b70 0x7fbb7414a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:09.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.975+0000 7fbb78ee6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb7414abd0 0x7fbb7414c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:09.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.975+0000 7fbb78ee6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb7414c9c0 0x7fbb740b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:09.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.975+0000 7fbb78ee6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7415d370 con 0x7fbb60003b70 2024-09-19T08:38:09.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.975+0000 7fbb78ee6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7415d090 con 0x7fbb7414c9c0 2024-09-19T08:38:09.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.975+0000 7fbb78ee6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fbb74160650 con 0x7fbb7414abd0 2024-09-19T08:38:09.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.975+0000 7fbb7259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb60003b70 0x7fbb7414a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:09.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.976+0000 7fbb7259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb60003b70 0x7fbb7414a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47166/0 (socket says 172.21.15.117:47166) 2024-09-19T08:38:09.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.976+0000 7fbb7259c640 1 -- 172.21.15.117:0/1281395211 learned_addr learned my addr 172.21.15.117:0/1281395211 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:09.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.976+0000 7fbb6bfff640 1 --2- 172.21.15.117:0/1281395211 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb7414abd0 0x7fbb7414c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:09.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.976+0000 7fbb72d9d640 1 --2- 172.21.15.117:0/1281395211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb7414c9c0 0x7fbb740b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:09.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.976+0000 7fbb7259c640 1 -- 172.21.15.117:0/1281395211 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb7414abd0 msgr2=0x7fbb7414c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:09.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.976+0000 7fbb7259c640 1 --2- 172.21.15.117:0/1281395211 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb7414abd0 0x7fbb7414c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.976+0000 7fbb7259c640 1 -- 172.21.15.117:0/1281395211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb7414c9c0 msgr2=0x7fbb740b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:09.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.976+0000 7fbb7259c640 1 --2- 172.21.15.117:0/1281395211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb7414c9c0 0x7fbb740b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:09.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.976+0000 7fbb7259c640 1 -- 172.21.15.117:0/1281395211 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb74150250 con 0x7fbb60003b70 2024-09-19T08:38:09.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.976+0000 7fbb72d9d640 1 --2- 172.21.15.117:0/1281395211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb7414c9c0 0x7fbb740b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:09.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.976+0000 7fbb7259c640 1 --2- 172.21.15.117:0/1281395211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb60003b70 0x7fbb7414a340 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbb64009de0 tx=0x7fbb64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:09.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.976+0000 7fbb6affd640 1 -- 172.21.15.117:0/1281395211 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb64040030 con 0x7fbb60003b70 2024-09-19T08:38:09.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.976+0000 7fbb6affd640 1 -- 172.21.15.117:0/1281395211 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb640093e0 con 0x7fbb60003b70 2024-09-19T08:38:09.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.976+0000 7fbb78ee6640 1 -- 172.21.15.117:0/1281395211 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb74150530 con 0x7fbb60003b70 2024-09-19T08:38:09.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.976+0000 7fbb6affd640 1 -- 172.21.15.117:0/1281395211 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb64036040 con 0x7fbb60003b70 2024-09-19T08:38:09.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.976+0000 7fbb78ee6640 1 -- 172.21.15.117:0/1281395211 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb74150af0 con 0x7fbb60003b70 2024-09-19T08:38:09.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.977+0000 7fbb78ee6640 1 -- 172.21.15.117:0/1281395211 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb740b5f40 con 0x7fbb60003b70 2024-09-19T08:38:09.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.977+0000 7fbb6affd640 1 -- 172.21.15.117:0/1281395211 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbb64043070 con 0x7fbb60003b70 2024-09-19T08:38:09.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.978+0000 7fbb6affd640 1 --2- 172.21.15.117:0/1281395211 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbb5406c2b0 0x7fbb5406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:09.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.978+0000 7fbb6affd640 1 -- 172.21.15.117:0/1281395211 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fbb640ab0d0 con 0x7fbb60003b70 2024-09-19T08:38:09.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.978+0000 7fbb6bfff640 1 --2- 172.21.15.117:0/1281395211 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbb5406c2b0 0x7fbb5406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:09.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.978+0000 7fbb6bfff640 1 --2- 172.21.15.117:0/1281395211 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbb5406c2b0 0x7fbb5406e770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbb7414ea30 tx=0x7fbb5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:09.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:09.982+0000 7fbb6affd640 1 -- 172.21.15.117:0/1281395211 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbb64078fd0 con 0x7fbb60003b70 2024-09-19T08:38:10.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.148+0000 7fbb78ee6640 1 -- 172.21.15.117:0/1281395211 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb74067fc0 con 0x7fbb60003b70 2024-09-19T08:38:10.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.149+0000 7fbb6affd640 1 -- 172.21.15.117:0/1281395211 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17050 (secure 0 0 0) 0x7fbb6407d2d0 con 0x7fbb60003b70 2024-09-19T08:38:10.150 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:10.150 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":40,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:38:08.520988+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:38:04.617092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-19T08:38:05.827922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:38:10.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.151+0000 7fbb78ee6640 1 -- 172.21.15.117:0/1281395211 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbb5406c2b0 msgr2=0x7fbb5406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:10.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.151+0000 7fbb78ee6640 1 --2- 172.21.15.117:0/1281395211 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbb5406c2b0 0x7fbb5406e770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbb7414ea30 tx=0x7fbb5c009040 comp rx=0 tx=0).stop 2024-09-19T08:38:10.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.151+0000 7fbb78ee6640 1 -- 172.21.15.117:0/1281395211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb60003b70 msgr2=0x7fbb7414a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:10.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.151+0000 7fbb78ee6640 1 --2- 172.21.15.117:0/1281395211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb60003b70 0x7fbb7414a340 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbb64009de0 tx=0x7fbb64004730 comp rx=0 tx=0).stop 2024-09-19T08:38:10.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.151+0000 7fbb78ee6640 1 -- 172.21.15.117:0/1281395211 shutdown_connections 2024-09-19T08:38:10.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.151+0000 7fbb78ee6640 1 --2- 172.21.15.117:0/1281395211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb7414c9c0 0x7fbb740b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.151+0000 7fbb78ee6640 1 --2- 172.21.15.117:0/1281395211 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbb5406c2b0 0x7fbb5406e770 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.151+0000 7fbb78ee6640 1 --2- 172.21.15.117:0/1281395211 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb7414abd0 0x7fbb7414c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.151+0000 7fbb78ee6640 1 --2- 172.21.15.117:0/1281395211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb60003b70 0x7fbb7414a340 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.151+0000 7fbb78ee6640 1 -- 172.21.15.117:0/1281395211 >> 172.21.15.117:0/1281395211 conn(0x7fbb7406bc10 msgr2=0x7fbb7406cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:10.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.151+0000 7fbb78ee6640 1 -- 172.21.15.117:0/1281395211 shutdown_connections 2024-09-19T08:38:10.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.151+0000 7fbb78ee6640 1 -- 172.21.15.117:0/1281395211 wait complete. 2024-09-19T08:38:10.164 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T08:38:10.164 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:38:10.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.261+0000 7f34026f1640 1 Processor -- start 2024-09-19T08:38:10.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.261+0000 7f34026f1640 1 -- start start 2024-09-19T08:38:10.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.262+0000 7f34026f1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f33fc15fa10 0x7f33fc0b3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:10.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.262+0000 7f34026f1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33fc0b3bc0 con 0x7f33fc161770 2024-09-19T08:38:10.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.262+0000 7f34026f1640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33fc0b3ea0 con 0x7f33fc0727c0 2024-09-19T08:38:10.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.262+0000 7f34026f1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f33fc0b4180 con 0x7f33fc15fa10 2024-09-19T08:38:10.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.262+0000 7f3400c8e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f33fc15fa10 0x7f33fc0b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:10.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.262+0000 7f33fbfff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f33fc161770 0x7f33fc0720b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:37534/0 (socket says 172.21.15.117:37534) 2024-09-19T08:38:10.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.262+0000 7f33fbfff640 1 -- 172.21.15.117:0/3569239291 learned_addr learned my addr 172.21.15.117:0/3569239291 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:10.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.262+0000 7f3400c8e640 1 -- 172.21.15.117:0/3569239291 >> v1:172.21.15.146:6789/0 conn(0x7f33fc0727c0 legacy=0x7f33fc06e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:10.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.262+0000 7f3400c8e640 1 -- 172.21.15.117:0/3569239291 >> v1:172.21.15.117:6789/0 conn(0x7f33fc161770 legacy=0x7f33fc0720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:10.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.262+0000 7f33faffd640 1 -- 172.21.15.117:0/3569239291 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1785802348 0 0) 0x7f33fc0b3bc0 con 0x7f33fc161770 2024-09-19T08:38:10.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.262+0000 7f3400c8e640 1 -- 172.21.15.117:0/3569239291 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33fc0b4460 con 0x7f33fc15fa10 2024-09-19T08:38:10.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.263+0000 7f3400c8e640 1 --2- 172.21.15.117:0/3569239291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33fc15fa10 0x7f33fc0b3490 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009d90 tx=0x7f33f402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f137e163d2811c79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:10.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.263+0000 7f33faffd640 1 -- 172.21.15.117:0/3569239291 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f4007740 con 0x7f33fc15fa10 2024-09-19T08:38:10.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.263+0000 7f33faffd640 1 -- 172.21.15.117:0/3569239291 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f40078e0 con 0x7f33fc15fa10 2024-09-19T08:38:10.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.263+0000 7f33faffd640 1 -- 172.21.15.117:0/3569239291 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f4007cb0 con 0x7f33fc15fa10 2024-09-19T08:38:10.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.264+0000 7f34026f1640 1 -- 172.21.15.117:0/3569239291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33fc15fa10 msgr2=0x7f33fc0b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:10.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.264+0000 7f34026f1640 1 --2- 172.21.15.117:0/3569239291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33fc15fa10 0x7f33fc0b3490 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009d90 tx=0x7f33f402a6a0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.264+0000 7f34026f1640 1 -- 172.21.15.117:0/3569239291 shutdown_connections 2024-09-19T08:38:10.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.264+0000 7f34026f1640 1 --2- 172.21.15.117:0/3569239291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33fc15fa10 0x7f33fc0b3490 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.264+0000 7f34026f1640 1 -- 172.21.15.117:0/3569239291 >> 172.21.15.117:0/3569239291 conn(0x7f33fc067d70 msgr2=0x7f33fc06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:10.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.264+0000 7f34026f1640 1 -- 172.21.15.117:0/3569239291 shutdown_connections 2024-09-19T08:38:10.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.264+0000 7f34026f1640 1 -- 172.21.15.117:0/3569239291 wait complete. 2024-09-19T08:38:10.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.265+0000 7f34026f1640 1 Processor -- start 2024-09-19T08:38:10.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.265+0000 7f34026f1640 1 -- start start 2024-09-19T08:38:10.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.266+0000 7f34026f1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33fc0727c0 0x7f33fc0aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:10.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.266+0000 7f34026f1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33fc15fa10 0x7f33fc14afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:10.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.266+0000 7f34026f1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33fc161770 0x7f33fc155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:10.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.266+0000 7f34026f1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc15f360 con 0x7f33fc0727c0 2024-09-19T08:38:10.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.266+0000 7f34026f1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc161b50 con 0x7f33fc161770 2024-09-19T08:38:10.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.266+0000 7f34026f1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f33fc15f4e0 con 0x7f33fc15fa10 2024-09-19T08:38:10.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.266+0000 7f33fbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33fc0727c0 0x7f33fc0aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:10.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.266+0000 7f33fbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33fc0727c0 0x7f33fc0aec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47180/0 (socket says 172.21.15.117:47180) 2024-09-19T08:38:10.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.266+0000 7f33fbfff640 1 -- 172.21.15.117:0/4152363714 learned_addr learned my addr 172.21.15.117:0/4152363714 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:10.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.266+0000 7f33fb7fe640 1 --2- 172.21.15.117:0/4152363714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33fc15fa10 0x7f33fc14afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:10.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.266+0000 7f3400c8e640 1 --2- 172.21.15.117:0/4152363714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33fc161770 0x7f33fc155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:10.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.266+0000 7f33fbfff640 1 -- 172.21.15.117:0/4152363714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33fc15fa10 msgr2=0x7f33fc14afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:10.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.266+0000 7f33fbfff640 1 --2- 172.21.15.117:0/4152363714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33fc15fa10 0x7f33fc14afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.266+0000 7f33fbfff640 1 -- 172.21.15.117:0/4152363714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33fc161770 msgr2=0x7f33fc155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:10.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.266+0000 7f33fbfff640 1 --2- 172.21.15.117:0/4152363714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33fc161770 0x7f33fc155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.266+0000 7f33fbfff640 1 -- 172.21.15.117:0/4152363714 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33fc14ba50 con 0x7f33fc0727c0 2024-09-19T08:38:10.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.267+0000 7f33fbfff640 1 --2- 172.21.15.117:0/4152363714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33fc0727c0 0x7f33fc0aec50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00c430 tx=0x7f33ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:10.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.267+0000 7f33f8ff9640 1 -- 172.21.15.117:0/4152363714 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec0074e0 con 0x7f33fc0727c0 2024-09-19T08:38:10.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.267+0000 7f33f8ff9640 1 -- 172.21.15.117:0/4152363714 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ec0047e0 con 0x7f33fc0727c0 2024-09-19T08:38:10.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.267+0000 7f33f8ff9640 1 -- 172.21.15.117:0/4152363714 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec004bd0 con 0x7f33fc0727c0 2024-09-19T08:38:10.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.267+0000 7f34026f1640 1 -- 172.21.15.117:0/4152363714 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33fc14bfe0 con 0x7f33fc0727c0 2024-09-19T08:38:10.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.267+0000 7f34026f1640 1 -- 172.21.15.117:0/4152363714 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33fc157560 con 0x7f33fc0727c0 2024-09-19T08:38:10.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.268+0000 7f34026f1640 1 -- 172.21.15.117:0/4152363714 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33fc0b3490 con 0x7f33fc0727c0 2024-09-19T08:38:10.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.268+0000 7f33f8ff9640 1 -- 172.21.15.117:0/4152363714 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f33ec011070 con 0x7f33fc0727c0 2024-09-19T08:38:10.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.269+0000 7f33f8ff9640 1 --2- 172.21.15.117:0/4152363714 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f33e806c2b0 0x7f33e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:10.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.269+0000 7f33f8ff9640 1 -- 172.21.15.117:0/4152363714 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f33ec08b0a0 con 0x7f33fc0727c0 2024-09-19T08:38:10.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.269+0000 7f33fb7fe640 1 --2- 172.21.15.117:0/4152363714 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f33e806c2b0 0x7f33e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:10.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.269+0000 7f33fb7fe640 1 --2- 172.21.15.117:0/4152363714 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f33e806c2b0 0x7f33e806e770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0af5f0 tx=0x7f33f0007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:10.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.273+0000 7f33f8ff9640 1 -- 172.21.15.117:0/4152363714 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f33ec059030 con 0x7f33fc0727c0 2024-09-19T08:38:10.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.433+0000 7f34026f1640 1 -- 172.21.15.117:0/4152363714 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f33fc14be20 con 0x7f33e806c2b0 2024-09-19T08:38:10.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.440+0000 7f33f8ff9640 1 -- 172.21.15.117:0/4152363714 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245966 (secure 0 0 0) 0x7f33f0003940 con 0x7f33e806c2b0 2024-09-19T08:38:10.444 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:10.445 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-09-19T08:38:10.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.443+0000 7f34026f1640 1 -- 172.21.15.117:0/4152363714 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f33e806c2b0 msgr2=0x7f33e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:10.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.443+0000 7f34026f1640 1 --2- 172.21.15.117:0/4152363714 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f33e806c2b0 0x7f33e806e770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0af5f0 tx=0x7f33f0007e30 comp rx=0 tx=0).stop 2024-09-19T08:38:10.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.443+0000 7f34026f1640 1 -- 172.21.15.117:0/4152363714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33fc0727c0 msgr2=0x7f33fc0aec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:10.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.443+0000 7f34026f1640 1 --2- 172.21.15.117:0/4152363714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33fc0727c0 0x7f33fc0aec50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00c430 tx=0x7f33ec00c8f0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.443+0000 7f34026f1640 1 -- 172.21.15.117:0/4152363714 shutdown_connections 2024-09-19T08:38:10.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.443+0000 7f34026f1640 1 --2- 172.21.15.117:0/4152363714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33fc161770 0x7f33fc155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.443+0000 7f34026f1640 1 --2- 172.21.15.117:0/4152363714 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f33e806c2b0 0x7f33e806e770 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.443+0000 7f34026f1640 1 --2- 172.21.15.117:0/4152363714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33fc15fa10 0x7f33fc14afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.443+0000 7f34026f1640 1 --2- 172.21.15.117:0/4152363714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33fc0727c0 0x7f33fc0aec50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.443+0000 7f34026f1640 1 -- 172.21.15.117:0/4152363714 >> 172.21.15.117:0/4152363714 conn(0x7f33fc067d70 msgr2=0x7f33fc161cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:10.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.443+0000 7f34026f1640 1 -- 172.21.15.117:0/4152363714 shutdown_connections 2024-09-19T08:38:10.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.443+0000 7f34026f1640 1 -- 172.21.15.117:0/4152363714 wait complete. 2024-09-19T08:38:10.455 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-19T08:38:09.860076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220664,"kb_used_data":4436,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754056,"statfs":{"total":773094113280,"available":772868153344,"internally_reserved":0,"allocated":4542464,"data_stored":2579211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.354425"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515535+0000","last_change":"2024-09-19T08:38:06.515535+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515535+0000","last_undegraded":"2024-09-19T08:38:06.515535+0000","last_fullsized":"2024-09-19T08:38:06.515535+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522972+0000","last_change":"2024-09-19T08:38:06.522972+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522972+0000","last_undegraded":"2024-09-19T08:38:06.522972+0000","last_fullsized":"2024-09-19T08:38:06.522972+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515332+0000","last_change":"2024-09-19T08:38:06.515332+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515332+0000","last_undegraded":"2024-09-19T08:38:06.515332+0000","last_fullsized":"2024-09-19T08:38:06.515332+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515942+0000","last_change":"2024-09-19T08:38:06.515942+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515942+0000","last_undegraded":"2024-09-19T08:38:06.515942+0000","last_fullsized":"2024-09-19T08:38:06.515942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524194+0000","last_change":"2024-09-19T08:38:06.524194+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524194+0000","last_undegraded":"2024-09-19T08:38:06.524194+0000","last_fullsized":"2024-09-19T08:38:06.524194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.525385+0000","last_change":"2024-09-19T08:38:06.525385+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.525385+0000","last_undegraded":"2024-09-19T08:38:06.525385+0000","last_fullsized":"2024-09-19T08:38:06.525385+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.518025+0000","last_change":"2024-09-19T08:38:06.518025+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.518025+0000","last_undegraded":"2024-09-19T08:38:06.518025+0000","last_fullsized":"2024-09-19T08:38:06.518025+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524657+0000","last_change":"2024-09-19T08:38:06.524657+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524657+0000","last_undegraded":"2024-09-19T08:38:06.524657+0000","last_fullsized":"2024-09-19T08:38:06.524657+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.525829+0000","last_change":"2024-09-19T08:38:06.525829+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.525829+0000","last_undegraded":"2024-09-19T08:38:06.525829+0000","last_fullsized":"2024-09-19T08:38:06.525829+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524230+0000","last_change":"2024-09-19T08:38:06.524230+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524230+0000","last_undegraded":"2024-09-19T08:38:06.524230+0000","last_fullsized":"2024-09-19T08:38:06.524230+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520291+0000","last_change":"2024-09-19T08:38:06.520291+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520291+0000","last_undegraded":"2024-09-19T08:38:06.520291+0000","last_fullsized":"2024-09-19T08:38:06.520291+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521463+0000","last_change":"2024-09-19T08:38:06.521463+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521463+0000","last_undegraded":"2024-09-19T08:38:06.521463+0000","last_fullsized":"2024-09-19T08:38:06.521463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523791+0000","last_change":"2024-09-19T08:38:06.523791+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523791+0000","last_undegraded":"2024-09-19T08:38:06.523791+0000","last_fullsized":"2024-09-19T08:38:06.523791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522950+0000","last_change":"2024-09-19T08:38:06.522950+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522950+0000","last_undegraded":"2024-09-19T08:38:06.522950+0000","last_fullsized":"2024-09-19T08:38:06.522950+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521265+0000","last_change":"2024-09-19T08:38:06.521265+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521265+0000","last_undegraded":"2024-09-19T08:38:06.521265+0000","last_fullsized":"2024-09-19T08:38:06.521265+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519596+0000","last_change":"2024-09-19T08:38:06.519596+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519596+0000","last_undegraded":"2024-09-19T08:38:06.519596+0000","last_fullsized":"2024-09-19T08:38:06.519596+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.526134+0000","last_change":"2024-09-19T08:38:06.526134+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.526134+0000","last_undegraded":"2024-09-19T08:38:06.526134+0000","last_fullsized":"2024-09-19T08:38:06.526134+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524748+0000","last_change":"2024-09-19T08:38:06.524748+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524748+0000","last_undegraded":"2024-09-19T08:38:06.524748+0000","last_fullsized":"2024-09-19T08:38:06.524748+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523613+0000","last_change":"2024-09-19T08:38:06.523613+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523613+0000","last_undegraded":"2024-09-19T08:38:06.523613+0000","last_fullsized":"2024-09-19T08:38:06.523613+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520740+0000","last_change":"2024-09-19T08:38:06.520740+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520740+0000","last_undegraded":"2024-09-19T08:38:06.520740+0000","last_fullsized":"2024-09-19T08:38:06.520740+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.517564+0000","last_change":"2024-09-19T08:38:06.517564+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.517564+0000","last_undegraded":"2024-09-19T08:38:06.517564+0000","last_fullsized":"2024-09-19T08:38:06.517564+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519809+0000","last_change":"2024-09-19T08:38:06.519809+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519809+0000","last_undegraded":"2024-09-19T08:38:06.519809+0000","last_fullsized":"2024-09-19T08:38:06.519809+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.516283+0000","last_change":"2024-09-19T08:38:06.516283+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.516283+0000","last_undegraded":"2024-09-19T08:38:06.516283+0000","last_fullsized":"2024-09-19T08:38:06.516283+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524056+0000","last_change":"2024-09-19T08:38:06.524056+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524056+0000","last_undegraded":"2024-09-19T08:38:06.524056+0000","last_fullsized":"2024-09-19T08:38:06.524056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524230+0000","last_change":"2024-09-19T08:38:06.524230+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524230+0000","last_undegraded":"2024-09-19T08:38:06.524230+0000","last_fullsized":"2024-09-19T08:38:06.524230+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520284+0000","last_change":"2024-09-19T08:38:06.520284+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520284+0000","last_undegraded":"2024-09-19T08:38:06.520284+0000","last_fullsized":"2024-09-19T08:38:06.520284+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524644+0000","last_change":"2024-09-19T08:38:06.524644+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524644+0000","last_undegraded":"2024-09-19T08:38:06.524644+0000","last_fullsized":"2024-09-19T08:38:06.524644+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522221+0000","last_change":"2024-09-19T08:38:06.522221+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522221+0000","last_undegraded":"2024-09-19T08:38:06.522221+0000","last_fullsized":"2024-09-19T08:38:06.522221+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.517123+0000","last_change":"2024-09-19T08:38:06.517123+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.517123+0000","last_undegraded":"2024-09-19T08:38:06.517123+0000","last_fullsized":"2024-09-19T08:38:06.517123+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519849+0000","last_change":"2024-09-19T08:38:06.519849+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519849+0000","last_undegraded":"2024-09-19T08:38:06.519849+0000","last_fullsized":"2024-09-19T08:38:06.519849+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.528728+0000","last_change":"2024-09-19T08:38:06.525759+0000","last_active":"2024-09-19T08:38:06.528728+0000","last_peered":"2024-09-19T08:38:06.528728+0000","last_clean":"2024-09-19T08:38:06.528728+0000","last_became_active":"2024-09-19T08:38:06.525478+0000","last_became_peered":"2024-09-19T08:38:06.525478+0000","last_unstale":"2024-09-19T08:38:06.528728+0000","last_undegraded":"2024-09-19T08:38:06.528728+0000","last_fullsized":"2024-09-19T08:38:06.528728+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:22.876048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523934+0000","last_change":"2024-09-19T08:38:06.523934+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523934+0000","last_undegraded":"2024-09-19T08:38:06.523934+0000","last_fullsized":"2024-09-19T08:38:06.523934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.538022+0000","last_change":"2024-09-19T08:38:06.530592+0000","last_active":"2024-09-19T08:38:06.538022+0000","last_peered":"2024-09-19T08:38:06.538022+0000","last_clean":"2024-09-19T08:38:06.538022+0000","last_became_active":"2024-09-19T08:38:06.530244+0000","last_became_peered":"2024-09-19T08:38:06.530244+0000","last_unstale":"2024-09-19T08:38:06.538022+0000","last_undegraded":"2024-09-19T08:38:06.538022+0000","last_fullsized":"2024-09-19T08:38:06.538022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:49.718905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519761+0000","last_change":"2024-09-19T08:38:06.519761+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519761+0000","last_undegraded":"2024-09-19T08:38:06.519761+0000","last_fullsized":"2024-09-19T08:38:06.519761+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.538310+0000","last_change":"2024-09-19T08:38:06.533569+0000","last_active":"2024-09-19T08:38:06.538310+0000","last_peered":"2024-09-19T08:38:06.538310+0000","last_clean":"2024-09-19T08:38:06.538310+0000","last_became_active":"2024-09-19T08:38:06.533287+0000","last_became_peered":"2024-09-19T08:38:06.533287+0000","last_unstale":"2024-09-19T08:38:06.538310+0000","last_undegraded":"2024-09-19T08:38:06.538310+0000","last_fullsized":"2024-09-19T08:38:06.538310+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:36.052253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522054+0000","last_change":"2024-09-19T08:38:06.522054+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522054+0000","last_undegraded":"2024-09-19T08:38:06.522054+0000","last_fullsized":"2024-09-19T08:38:06.522054+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.525135+0000","last_change":"2024-09-19T08:38:06.523268+0000","last_active":"2024-09-19T08:38:06.525135+0000","last_peered":"2024-09-19T08:38:06.525135+0000","last_clean":"2024-09-19T08:38:06.525135+0000","last_became_active":"2024-09-19T08:38:06.523001+0000","last_became_peered":"2024-09-19T08:38:06.523001+0000","last_unstale":"2024-09-19T08:38:06.525135+0000","last_undegraded":"2024-09-19T08:38:06.525135+0000","last_fullsized":"2024-09-19T08:38:06.525135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:34.263681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.516654+0000","last_change":"2024-09-19T08:38:06.516654+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.516654+0000","last_undegraded":"2024-09-19T08:38:06.516654+0000","last_fullsized":"2024-09-19T08:38:06.516654+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.529403+0000","last_change":"2024-09-19T08:38:06.526836+0000","last_active":"2024-09-19T08:38:06.529403+0000","last_peered":"2024-09-19T08:38:06.529403+0000","last_clean":"2024-09-19T08:38:06.529403+0000","last_became_active":"2024-09-19T08:38:06.526218+0000","last_became_peered":"2024-09-19T08:38:06.526218+0000","last_unstale":"2024-09-19T08:38:06.529403+0000","last_undegraded":"2024-09-19T08:38:06.529403+0000","last_fullsized":"2024-09-19T08:38:06.529403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:56.987321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523086+0000","last_change":"2024-09-19T08:38:06.523086+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523086+0000","last_undegraded":"2024-09-19T08:38:06.523086+0000","last_fullsized":"2024-09-19T08:38:06.523086+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.536536+0000","last_change":"2024-09-19T08:38:06.536127+0000","last_active":"2024-09-19T08:38:06.536536+0000","last_peered":"2024-09-19T08:38:06.536536+0000","last_clean":"2024-09-19T08:38:06.536536+0000","last_became_active":"2024-09-19T08:38:06.535869+0000","last_became_peered":"2024-09-19T08:38:06.535869+0000","last_unstale":"2024-09-19T08:38:06.536536+0000","last_undegraded":"2024-09-19T08:38:06.536536+0000","last_fullsized":"2024-09-19T08:38:06.536536+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:45.599877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524245+0000","last_change":"2024-09-19T08:38:06.524245+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524245+0000","last_undegraded":"2024-09-19T08:38:06.524245+0000","last_fullsized":"2024-09-19T08:38:06.524245+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.527767+0000","last_change":"2024-09-19T08:38:06.524509+0000","last_active":"2024-09-19T08:38:06.527767+0000","last_peered":"2024-09-19T08:38:06.527767+0000","last_clean":"2024-09-19T08:38:06.527767+0000","last_became_active":"2024-09-19T08:38:06.524232+0000","last_became_peered":"2024-09-19T08:38:06.524232+0000","last_unstale":"2024-09-19T08:38:06.527767+0000","last_undegraded":"2024-09-19T08:38:06.527767+0000","last_fullsized":"2024-09-19T08:38:06.527767+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:07.229721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524208+0000","last_change":"2024-09-19T08:38:06.524208+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524208+0000","last_undegraded":"2024-09-19T08:38:06.524208+0000","last_fullsized":"2024-09-19T08:38:06.524208+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.534483+0000","last_change":"2024-09-19T08:38:06.533229+0000","last_active":"2024-09-19T08:38:06.534483+0000","last_peered":"2024-09-19T08:38:06.534483+0000","last_clean":"2024-09-19T08:38:06.534483+0000","last_became_active":"2024-09-19T08:38:06.532969+0000","last_became_peered":"2024-09-19T08:38:06.532969+0000","last_unstale":"2024-09-19T08:38:06.534483+0000","last_undegraded":"2024-09-19T08:38:06.534483+0000","last_fullsized":"2024-09-19T08:38:06.534483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:19.610768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515386+0000","last_change":"2024-09-19T08:38:06.515386+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515386+0000","last_undegraded":"2024-09-19T08:38:06.515386+0000","last_fullsized":"2024-09-19T08:38:06.515386+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.532787+0000","last_change":"2024-09-19T08:38:06.525562+0000","last_active":"2024-09-19T08:38:06.532787+0000","last_peered":"2024-09-19T08:38:06.532787+0000","last_clean":"2024-09-19T08:38:06.532787+0000","last_became_active":"2024-09-19T08:38:06.524991+0000","last_became_peered":"2024-09-19T08:38:06.524991+0000","last_unstale":"2024-09-19T08:38:06.532787+0000","last_undegraded":"2024-09-19T08:38:06.532787+0000","last_fullsized":"2024-09-19T08:38:06.532787+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:51.219417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519077+0000","last_change":"2024-09-19T08:38:06.519077+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519077+0000","last_undegraded":"2024-09-19T08:38:06.519077+0000","last_fullsized":"2024-09-19T08:38:06.519077+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.534055+0000","last_change":"2024-09-19T08:38:06.531379+0000","last_active":"2024-09-19T08:38:06.534055+0000","last_peered":"2024-09-19T08:38:06.534055+0000","last_clean":"2024-09-19T08:38:06.534055+0000","last_became_active":"2024-09-19T08:38:06.530810+0000","last_became_peered":"2024-09-19T08:38:06.530810+0000","last_unstale":"2024-09-19T08:38:06.534055+0000","last_undegraded":"2024-09-19T08:38:06.534055+0000","last_fullsized":"2024-09-19T08:38:06.534055+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:38.604762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.514826+0000","last_change":"2024-09-19T08:38:06.514826+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.514826+0000","last_undegraded":"2024-09-19T08:38:06.514826+0000","last_fullsized":"2024-09-19T08:38:06.514826+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.527986+0000","last_change":"2024-09-19T08:38:06.525652+0000","last_active":"2024-09-19T08:38:06.527986+0000","last_peered":"2024-09-19T08:38:06.527986+0000","last_clean":"2024-09-19T08:38:06.527986+0000","last_became_active":"2024-09-19T08:38:06.525395+0000","last_became_peered":"2024-09-19T08:38:06.525395+0000","last_unstale":"2024-09-19T08:38:06.527986+0000","last_undegraded":"2024-09-19T08:38:06.527986+0000","last_fullsized":"2024-09-19T08:38:06.527986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:20.592921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521608+0000","last_change":"2024-09-19T08:38:06.521608+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521608+0000","last_undegraded":"2024-09-19T08:38:06.521608+0000","last_fullsized":"2024-09-19T08:38:06.521608+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.527796+0000","last_change":"2024-09-19T08:38:06.524138+0000","last_active":"2024-09-19T08:38:06.527796+0000","last_peered":"2024-09-19T08:38:06.527796+0000","last_clean":"2024-09-19T08:38:06.527796+0000","last_became_active":"2024-09-19T08:38:06.523848+0000","last_became_peered":"2024-09-19T08:38:06.523848+0000","last_unstale":"2024-09-19T08:38:06.527796+0000","last_undegraded":"2024-09-19T08:38:06.527796+0000","last_fullsized":"2024-09-19T08:38:06.527796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:01.499409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.514819+0000","last_change":"2024-09-19T08:38:06.514819+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.514819+0000","last_undegraded":"2024-09-19T08:38:06.514819+0000","last_fullsized":"2024-09-19T08:38:06.514819+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.535660+0000","last_change":"2024-09-19T08:38:06.530737+0000","last_active":"2024-09-19T08:38:06.535660+0000","last_peered":"2024-09-19T08:38:06.535660+0000","last_clean":"2024-09-19T08:38:06.535660+0000","last_became_active":"2024-09-19T08:38:06.530436+0000","last_became_peered":"2024-09-19T08:38:06.530436+0000","last_unstale":"2024-09-19T08:38:06.535660+0000","last_undegraded":"2024-09-19T08:38:06.535660+0000","last_fullsized":"2024-09-19T08:38:06.535660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:35.022819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523686+0000","last_change":"2024-09-19T08:38:06.523686+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523686+0000","last_undegraded":"2024-09-19T08:38:06.523686+0000","last_fullsized":"2024-09-19T08:38:06.523686+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.538175+0000","last_change":"2024-09-19T08:38:06.533437+0000","last_active":"2024-09-19T08:38:06.538175+0000","last_peered":"2024-09-19T08:38:06.538175+0000","last_clean":"2024-09-19T08:38:06.538175+0000","last_became_active":"2024-09-19T08:38:06.533139+0000","last_became_peered":"2024-09-19T08:38:06.533139+0000","last_unstale":"2024-09-19T08:38:06.538175+0000","last_undegraded":"2024-09-19T08:38:06.538175+0000","last_fullsized":"2024-09-19T08:38:06.538175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:34.263681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521411+0000","last_change":"2024-09-19T08:38:06.521411+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521411+0000","last_undegraded":"2024-09-19T08:38:06.521411+0000","last_fullsized":"2024-09-19T08:38:06.521411+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.526852+0000","last_change":"2024-09-19T08:38:06.523001+0000","last_active":"2024-09-19T08:38:06.526852+0000","last_peered":"2024-09-19T08:38:06.526852+0000","last_clean":"2024-09-19T08:38:06.526852+0000","last_became_active":"2024-09-19T08:38:06.522686+0000","last_became_peered":"2024-09-19T08:38:06.522686+0000","last_unstale":"2024-09-19T08:38:06.526852+0000","last_undegraded":"2024-09-19T08:38:06.526852+0000","last_fullsized":"2024-09-19T08:38:06.526852+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:36.343142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.532540+0000","last_change":"2024-09-19T08:38:06.529230+0000","last_active":"2024-09-19T08:38:06.532540+0000","last_peered":"2024-09-19T08:38:06.532540+0000","last_clean":"2024-09-19T08:38:06.532540+0000","last_became_active":"2024-09-19T08:38:06.528958+0000","last_became_peered":"2024-09-19T08:38:06.528958+0000","last_unstale":"2024-09-19T08:38:06.532540+0000","last_undegraded":"2024-09-19T08:38:06.532540+0000","last_fullsized":"2024-09-19T08:38:06.532540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:01.499409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523135+0000","last_change":"2024-09-19T08:38:06.523135+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523135+0000","last_undegraded":"2024-09-19T08:38:06.523135+0000","last_fullsized":"2024-09-19T08:38:06.523135+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.535293+0000","last_change":"2024-09-19T08:38:06.534098+0000","last_active":"2024-09-19T08:38:06.535293+0000","last_peered":"2024-09-19T08:38:06.535293+0000","last_clean":"2024-09-19T08:38:06.535293+0000","last_became_active":"2024-09-19T08:38:06.533792+0000","last_became_peered":"2024-09-19T08:38:06.533792+0000","last_unstale":"2024-09-19T08:38:06.535293+0000","last_undegraded":"2024-09-19T08:38:06.535293+0000","last_fullsized":"2024-09-19T08:38:06.535293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:17.394057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520696+0000","last_change":"2024-09-19T08:38:06.520696+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520696+0000","last_undegraded":"2024-09-19T08:38:06.520696+0000","last_fullsized":"2024-09-19T08:38:06.520696+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.528660+0000","last_change":"2024-09-19T08:38:06.527561+0000","last_active":"2024-09-19T08:38:06.528660+0000","last_peered":"2024-09-19T08:38:06.528660+0000","last_clean":"2024-09-19T08:38:06.528660+0000","last_became_active":"2024-09-19T08:38:06.527305+0000","last_became_peered":"2024-09-19T08:38:06.527305+0000","last_unstale":"2024-09-19T08:38:06.528660+0000","last_undegraded":"2024-09-19T08:38:06.528660+0000","last_fullsized":"2024-09-19T08:38:06.528660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:38:37.770723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521186+0000","last_change":"2024-09-19T08:38:06.521186+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521186+0000","last_undegraded":"2024-09-19T08:38:06.521186+0000","last_fullsized":"2024-09-19T08:38:06.521186+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T08:38:05.518506+0000","last_change":"2024-09-19T08:38:05.518506+0000","last_active":"2024-09-19T08:38:05.500429+0000","last_peered":"2024-09-19T08:38:05.500429+0000","last_clean":"2024-09-19T08:38:05.500429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:05.518506+0000","last_undegraded":"2024-09-19T08:38:05.518506+0000","last_fullsized":"2024-09-19T08:38:05.518506+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521112+0000","last_change":"2024-09-19T08:38:06.521112+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521112+0000","last_undegraded":"2024-09-19T08:38:06.521112+0000","last_fullsized":"2024-09-19T08:38:06.521112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.535356+0000","last_change":"2024-09-19T08:38:06.529491+0000","last_active":"2024-09-19T08:38:06.535356+0000","last_peered":"2024-09-19T08:38:06.535356+0000","last_clean":"2024-09-19T08:38:06.535356+0000","last_became_active":"2024-09-19T08:38:06.529160+0000","last_became_peered":"2024-09-19T08:38:06.529160+0000","last_unstale":"2024-09-19T08:38:06.535356+0000","last_undegraded":"2024-09-19T08:38:06.535356+0000","last_fullsized":"2024-09-19T08:38:06.535356+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:49.654020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520861+0000","last_change":"2024-09-19T08:38:06.520861+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520861+0000","last_undegraded":"2024-09-19T08:38:06.520861+0000","last_fullsized":"2024-09-19T08:38:06.520861+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.532652+0000","last_change":"2024-09-19T08:38:06.526582+0000","last_active":"2024-09-19T08:38:06.532652+0000","last_peered":"2024-09-19T08:38:06.532652+0000","last_clean":"2024-09-19T08:38:06.532652+0000","last_became_active":"2024-09-19T08:38:06.526290+0000","last_became_peered":"2024-09-19T08:38:06.526290+0000","last_unstale":"2024-09-19T08:38:06.532652+0000","last_undegraded":"2024-09-19T08:38:06.532652+0000","last_fullsized":"2024-09-19T08:38:06.532652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:44.073925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515014+0000","last_change":"2024-09-19T08:38:06.515014+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515014+0000","last_undegraded":"2024-09-19T08:38:06.515014+0000","last_fullsized":"2024-09-19T08:38:06.515014+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.538133+0000","last_change":"2024-09-19T08:38:06.531426+0000","last_active":"2024-09-19T08:38:06.538133+0000","last_peered":"2024-09-19T08:38:06.538133+0000","last_clean":"2024-09-19T08:38:06.538133+0000","last_became_active":"2024-09-19T08:38:06.531074+0000","last_became_peered":"2024-09-19T08:38:06.531074+0000","last_unstale":"2024-09-19T08:38:06.538133+0000","last_undegraded":"2024-09-19T08:38:06.538133+0000","last_fullsized":"2024-09-19T08:38:06.538133+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:06.375637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520413+0000","last_change":"2024-09-19T08:38:06.520413+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520413+0000","last_undegraded":"2024-09-19T08:38:06.520413+0000","last_fullsized":"2024-09-19T08:38:06.520413+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.534561+0000","last_change":"2024-09-19T08:38:06.533258+0000","last_active":"2024-09-19T08:38:06.534561+0000","last_peered":"2024-09-19T08:38:06.534561+0000","last_clean":"2024-09-19T08:38:06.534561+0000","last_became_active":"2024-09-19T08:38:06.533008+0000","last_became_peered":"2024-09-19T08:38:06.533008+0000","last_unstale":"2024-09-19T08:38:06.534561+0000","last_undegraded":"2024-09-19T08:38:06.534561+0000","last_fullsized":"2024-09-19T08:38:06.534561+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:04.672846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515726+0000","last_change":"2024-09-19T08:38:06.515726+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515726+0000","last_undegraded":"2024-09-19T08:38:06.515726+0000","last_fullsized":"2024-09-19T08:38:06.515726+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.538182+0000","last_change":"2024-09-19T08:38:06.533577+0000","last_active":"2024-09-19T08:38:06.538182+0000","last_peered":"2024-09-19T08:38:06.538182+0000","last_clean":"2024-09-19T08:38:06.538182+0000","last_became_active":"2024-09-19T08:38:06.533276+0000","last_became_peered":"2024-09-19T08:38:06.533276+0000","last_unstale":"2024-09-19T08:38:06.538182+0000","last_undegraded":"2024-09-19T08:38:06.538182+0000","last_fullsized":"2024-09-19T08:38:06.538182+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:22.876048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.534078+0000","last_change":"2024-09-19T08:38:06.532515+0000","last_active":"2024-09-19T08:38:06.534078+0000","last_peered":"2024-09-19T08:38:06.534078+0000","last_clean":"2024-09-19T08:38:06.534078+0000","last_became_active":"2024-09-19T08:38:06.532253+0000","last_became_peered":"2024-09-19T08:38:06.532253+0000","last_unstale":"2024-09-19T08:38:06.534078+0000","last_undegraded":"2024-09-19T08:38:06.534078+0000","last_fullsized":"2024-09-19T08:38:06.534078+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:54.746465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519972+0000","last_change":"2024-09-19T08:38:06.519972+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519972+0000","last_undegraded":"2024-09-19T08:38:06.519972+0000","last_fullsized":"2024-09-19T08:38:06.519972+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T08:38:05.516525+0000","last_change":"2024-09-19T08:38:05.516525+0000","last_active":"2024-09-19T08:38:05.500429+0000","last_peered":"2024-09-19T08:38:05.500429+0000","last_clean":"2024-09-19T08:38:05.500429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:05.516525+0000","last_undegraded":"2024-09-19T08:38:05.516525+0000","last_fullsized":"2024-09-19T08:38:05.516525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521088+0000","last_change":"2024-09-19T08:38:06.521088+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521088+0000","last_undegraded":"2024-09-19T08:38:06.521088+0000","last_fullsized":"2024-09-19T08:38:06.521088+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T08:38:05.516323+0000","last_change":"2024-09-19T08:38:05.516323+0000","last_active":"2024-09-19T08:38:05.500429+0000","last_peered":"2024-09-19T08:38:05.500429+0000","last_clean":"2024-09-19T08:38:05.500429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:05.516323+0000","last_undegraded":"2024-09-19T08:38:05.516323+0000","last_fullsized":"2024-09-19T08:38:05.516323+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.535645+0000","last_change":"2024-09-19T08:38:06.530799+0000","last_active":"2024-09-19T08:38:06.535645+0000","last_peered":"2024-09-19T08:38:06.535645+0000","last_clean":"2024-09-19T08:38:06.535645+0000","last_became_active":"2024-09-19T08:38:06.530484+0000","last_became_peered":"2024-09-19T08:38:06.530484+0000","last_unstale":"2024-09-19T08:38:06.535645+0000","last_undegraded":"2024-09-19T08:38:06.535645+0000","last_fullsized":"2024-09-19T08:38:06.535645+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:26.454464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522886+0000","last_change":"2024-09-19T08:38:06.522886+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522886+0000","last_undegraded":"2024-09-19T08:38:06.522886+0000","last_fullsized":"2024-09-19T08:38:06.522886+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.531801+0000","last_change":"2024-09-19T08:38:06.528224+0000","last_active":"2024-09-19T08:38:06.531801+0000","last_peered":"2024-09-19T08:38:06.531801+0000","last_clean":"2024-09-19T08:38:06.531801+0000","last_became_active":"2024-09-19T08:38:06.527744+0000","last_became_peered":"2024-09-19T08:38:06.527744+0000","last_unstale":"2024-09-19T08:38:06.531801+0000","last_undegraded":"2024-09-19T08:38:06.531801+0000","last_fullsized":"2024-09-19T08:38:06.531801+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:13.093311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523853+0000","last_change":"2024-09-19T08:38:06.523853+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523853+0000","last_undegraded":"2024-09-19T08:38:06.523853+0000","last_fullsized":"2024-09-19T08:38:06.523853+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.534560+0000","last_change":"2024-09-19T08:38:06.533024+0000","last_active":"2024-09-19T08:38:06.534560+0000","last_peered":"2024-09-19T08:38:06.534560+0000","last_clean":"2024-09-19T08:38:06.534560+0000","last_became_active":"2024-09-19T08:38:06.532728+0000","last_became_peered":"2024-09-19T08:38:06.532728+0000","last_unstale":"2024-09-19T08:38:06.534560+0000","last_undegraded":"2024-09-19T08:38:06.534560+0000","last_fullsized":"2024-09-19T08:38:06.534560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:59.807121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519499+0000","last_change":"2024-09-19T08:38:06.519499+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519499+0000","last_undegraded":"2024-09-19T08:38:06.519499+0000","last_fullsized":"2024-09-19T08:38:06.519499+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.532632+0000","last_change":"2024-09-19T08:38:06.525546+0000","last_active":"2024-09-19T08:38:06.532632+0000","last_peered":"2024-09-19T08:38:06.532632+0000","last_clean":"2024-09-19T08:38:06.532632+0000","last_became_active":"2024-09-19T08:38:06.525227+0000","last_became_peered":"2024-09-19T08:38:06.525227+0000","last_unstale":"2024-09-19T08:38:06.532632+0000","last_undegraded":"2024-09-19T08:38:06.532632+0000","last_fullsized":"2024-09-19T08:38:06.532632+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:13.093311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522539+0000","last_change":"2024-09-19T08:38:06.522539+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522539+0000","last_undegraded":"2024-09-19T08:38:06.522539+0000","last_fullsized":"2024-09-19T08:38:06.522539+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.530671+0000","last_change":"2024-09-19T08:38:06.526379+0000","last_active":"2024-09-19T08:38:06.530671+0000","last_peered":"2024-09-19T08:38:06.530671+0000","last_clean":"2024-09-19T08:38:06.530671+0000","last_became_active":"2024-09-19T08:38:06.525731+0000","last_became_peered":"2024-09-19T08:38:06.525731+0000","last_unstale":"2024-09-19T08:38:06.530671+0000","last_undegraded":"2024-09-19T08:38:06.530671+0000","last_fullsized":"2024-09-19T08:38:06.530671+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:07.229721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":198,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.519210+0000","last_change":"2024-09-19T08:37:04.479071+0000","last_active":"2024-09-19T08:38:06.519210+0000","last_peered":"2024-09-19T08:38:06.519210+0000","last_clean":"2024-09-19T08:38:06.519210+0000","last_became_active":"2024-09-19T08:37:04.478199+0000","last_became_peered":"2024-09-19T08:37:04.478199+0000","last_unstale":"2024-09-19T08:38:06.519210+0000","last_undegraded":"2024-09-19T08:38:06.519210+0000","last_fullsized":"2024-09-19T08:38:06.519210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_clean_scrub_stamp":"2024-09-19T08:37:02.519738+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:32.963748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1011712,"data_stored":764344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1024000,"data_stored":771011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:38:10.459 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:38:10.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.595+0000 7fc5ffd66640 1 Processor -- start 2024-09-19T08:38:10.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.596+0000 7fc5ffd66640 1 -- start start 2024-09-19T08:38:10.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.596+0000 7fc5ffd66640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc5f815f0d0 0x7fc5f815f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:10.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.596+0000 7fc5ffd66640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5f80d4130 0x7fc5f80d45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:10.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.596+0000 7fc5ffd66640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5f80d4ae0 con 0x7fc5f80d0070 2024-09-19T08:38:10.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.596+0000 7fc5ffd66640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc5f80d1b10 con 0x7fc5f815f0d0 2024-09-19T08:38:10.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.596+0000 7fc5ffd66640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f80cf2b0 con 0x7fc5f80d4130 2024-09-19T08:38:10.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.597+0000 7fc5fdb02640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc5f815f0d0 0x7fc5f815f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:10.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.597+0000 7fc5fdb02640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc5f815f0d0 0x7fc5f815f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47192/0 (socket says 172.21.15.117:47192) 2024-09-19T08:38:10.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.597+0000 7fc5fdb02640 1 -- 172.21.15.117:0/235469563 learned_addr learned my addr 172.21.15.117:0/235469563 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:10.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.597+0000 7fc5fdb02640 1 -- 172.21.15.117:0/235469563 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5f80d4130 msgr2=0x7fc5f80d45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:10.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.597+0000 7fc5fe303640 1 --2- 172.21.15.117:0/235469563 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5f80d4130 0x7fc5f80d45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:10.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.597+0000 7fc5fdb02640 1 --2- 172.21.15.117:0/235469563 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5f80d4130 0x7fc5f80d45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.597+0000 7fc5fdb02640 1 -- 172.21.15.117:0/235469563 >> v1:172.21.15.146:6789/0 conn(0x7fc5f80d0070 legacy=0x7fc5f80d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:10.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.597+0000 7fc5fdb02640 1 -- 172.21.15.117:0/235469563 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f80cf590 con 0x7fc5f815f0d0 2024-09-19T08:38:10.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.597+0000 7fc5fe303640 1 --2- 172.21.15.117:0/235469563 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5f80d4130 0x7fc5f80d45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:10.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.598+0000 7fc5fdb02640 1 --2- 172.21.15.117:0/235469563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5f815f0d0 0x7fc5f815f4b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4009870 tx=0x7fc5f402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d460699639e9f357 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:10.600 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.598+0000 7fc5fcb00640 1 -- 172.21.15.117:0/235469563 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4037070 con 0x7fc5f815f0d0 2024-09-19T08:38:10.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.598+0000 7fc5fcb00640 1 -- 172.21.15.117:0/235469563 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f4032440 con 0x7fc5f815f0d0 2024-09-19T08:38:10.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.598+0000 7fc5fcb00640 1 -- 172.21.15.117:0/235469563 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4032810 con 0x7fc5f815f0d0 2024-09-19T08:38:10.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.598+0000 7fc5ffd66640 1 -- 172.21.15.117:0/235469563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5f815f0d0 msgr2=0x7fc5f815f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:10.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.598+0000 7fc5ffd66640 1 --2- 172.21.15.117:0/235469563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5f815f0d0 0x7fc5f815f4b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4009870 tx=0x7fc5f402a180 comp rx=0 tx=0).stop 2024-09-19T08:38:10.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.598+0000 7fc5ffd66640 1 -- 172.21.15.117:0/235469563 shutdown_connections 2024-09-19T08:38:10.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.598+0000 7fc5ffd66640 1 --2- 172.21.15.117:0/235469563 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5f80d4130 0x7fc5f80d45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.598+0000 7fc5ffd66640 1 --2- 172.21.15.117:0/235469563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5f815f0d0 0x7fc5f815f4b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.598+0000 7fc5ffd66640 1 -- 172.21.15.117:0/235469563 >> 172.21.15.117:0/235469563 conn(0x7fc5f809d760 msgr2=0x7fc5f808bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:10.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.598+0000 7fc5ffd66640 1 -- 172.21.15.117:0/235469563 shutdown_connections 2024-09-19T08:38:10.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.598+0000 7fc5ffd66640 1 -- 172.21.15.117:0/235469563 wait complete. 2024-09-19T08:38:10.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.599+0000 7fc5ffd66640 1 Processor -- start 2024-09-19T08:38:10.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.600+0000 7fc5ffd66640 1 -- start start 2024-09-19T08:38:10.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.600+0000 7fc5ffd66640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5f80d0070 0x7fc5f814b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:10.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.600+0000 7fc5ffd66640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5f80d4130 0x7fc5f80b9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:10.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.600+0000 7fc5ffd66640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5f815f0d0 0x7fc5f80b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:10.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.600+0000 7fc5ffd66640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f80cef60 con 0x7fc5f815f0d0 2024-09-19T08:38:10.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.600+0000 7fc5ffd66640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f80cfb50 con 0x7fc5f80d0070 2024-09-19T08:38:10.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.600+0000 7fc5ffd66640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f80b2f70 con 0x7fc5f80d4130 2024-09-19T08:38:10.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.600+0000 7fc5fe303640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5f815f0d0 0x7fc5f80b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:10.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.600+0000 7fc5fe303640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5f815f0d0 0x7fc5f80b35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47206/0 (socket says 172.21.15.117:47206) 2024-09-19T08:38:10.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.600+0000 7fc5fe303640 1 -- 172.21.15.117:0/2320128265 learned_addr learned my addr 172.21.15.117:0/2320128265 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:10.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.600+0000 7fc5fdb02640 1 --2- 172.21.15.117:0/2320128265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5f80d0070 0x7fc5f814b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:10.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.600+0000 7fc5fd301640 1 --2- 172.21.15.117:0/2320128265 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5f80d4130 0x7fc5f80b9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:10.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.601+0000 7fc5fe303640 1 -- 172.21.15.117:0/2320128265 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5f80d4130 msgr2=0x7fc5f80b9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:10.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.601+0000 7fc5fe303640 1 --2- 172.21.15.117:0/2320128265 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5f80d4130 0x7fc5f80b9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.601+0000 7fc5fe303640 1 -- 172.21.15.117:0/2320128265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5f80d0070 msgr2=0x7fc5f814b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:10.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.601+0000 7fc5fe303640 1 --2- 172.21.15.117:0/2320128265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5f80d0070 0x7fc5f814b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.601+0000 7fc5fe303640 1 -- 172.21.15.117:0/2320128265 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f80b3b00 con 0x7fc5f815f0d0 2024-09-19T08:38:10.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.601+0000 7fc5fe303640 1 --2- 172.21.15.117:0/2320128265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5f815f0d0 0x7fc5f80b35c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000cf20 tx=0x7fc5f000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:10.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.601+0000 7fc5ee7fc640 1 -- 172.21.15.117:0/2320128265 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f001a070 con 0x7fc5f815f0d0 2024-09-19T08:38:10.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.601+0000 7fc5ee7fc640 1 -- 172.21.15.117:0/2320128265 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f000d840 con 0x7fc5f815f0d0 2024-09-19T08:38:10.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.601+0000 7fc5ffd66640 1 -- 172.21.15.117:0/2320128265 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5f80b3da0 con 0x7fc5f815f0d0 2024-09-19T08:38:10.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.601+0000 7fc5ee7fc640 1 -- 172.21.15.117:0/2320128265 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f000dc30 con 0x7fc5f815f0d0 2024-09-19T08:38:10.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.601+0000 7fc5ffd66640 1 -- 172.21.15.117:0/2320128265 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5f80b4360 con 0x7fc5f815f0d0 2024-09-19T08:38:10.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.602+0000 7fc5ffd66640 1 -- 172.21.15.117:0/2320128265 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5f80d45a0 con 0x7fc5f815f0d0 2024-09-19T08:38:10.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.602+0000 7fc5ee7fc640 1 -- 172.21.15.117:0/2320128265 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc5f001d070 con 0x7fc5f815f0d0 2024-09-19T08:38:10.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.603+0000 7fc5ee7fc640 1 --2- 172.21.15.117:0/2320128265 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc5dc06c2b0 0x7fc5dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:10.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.603+0000 7fc5ee7fc640 1 -- 172.21.15.117:0/2320128265 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fc5f008bd20 con 0x7fc5f815f0d0 2024-09-19T08:38:10.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.603+0000 7fc5fdb02640 1 --2- 172.21.15.117:0/2320128265 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc5dc06c2b0 0x7fc5dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:10.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.604+0000 7fc5fdb02640 1 --2- 172.21.15.117:0/2320128265 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc5dc06c2b0 0x7fc5dc06e770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4034000 tx=0x7fc5f402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:10.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.607+0000 7fc5ee7fc640 1 -- 172.21.15.117:0/2320128265 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc5f0090070 con 0x7fc5f815f0d0 2024-09-19T08:38:10.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.770+0000 7fc5ffd66640 1 -- 172.21.15.117:0/2320128265 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc5f80b1290 con 0x7fc5dc06c2b0 2024-09-19T08:38:10.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.777+0000 7fc5ee7fc640 1 -- 172.21.15.117:0/2320128265 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245966 (secure 0 0 0) 0x7fc5f80b1290 con 0x7fc5dc06c2b0 2024-09-19T08:38:10.780 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:10.781 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-09-19T08:38:10.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.779+0000 7fc5ffd66640 1 -- 172.21.15.117:0/2320128265 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc5dc06c2b0 msgr2=0x7fc5dc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:10.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.779+0000 7fc5ffd66640 1 --2- 172.21.15.117:0/2320128265 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc5dc06c2b0 0x7fc5dc06e770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4034000 tx=0x7fc5f402e000 comp rx=0 tx=0).stop 2024-09-19T08:38:10.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.779+0000 7fc5ffd66640 1 -- 172.21.15.117:0/2320128265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5f815f0d0 msgr2=0x7fc5f80b35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:10.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.779+0000 7fc5ffd66640 1 --2- 172.21.15.117:0/2320128265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5f815f0d0 0x7fc5f80b35c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000cf20 tx=0x7fc5f000a7d0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.779+0000 7fc5ffd66640 1 -- 172.21.15.117:0/2320128265 shutdown_connections 2024-09-19T08:38:10.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.779+0000 7fc5ffd66640 1 --2- 172.21.15.117:0/2320128265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5f815f0d0 0x7fc5f80b35c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.779+0000 7fc5ffd66640 1 --2- 172.21.15.117:0/2320128265 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc5dc06c2b0 0x7fc5dc06e770 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.779+0000 7fc5ffd66640 1 --2- 172.21.15.117:0/2320128265 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5f80d4130 0x7fc5f80b9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.779+0000 7fc5ffd66640 1 --2- 172.21.15.117:0/2320128265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5f80d0070 0x7fc5f814b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.779+0000 7fc5ffd66640 1 -- 172.21.15.117:0/2320128265 >> 172.21.15.117:0/2320128265 conn(0x7fc5f809d760 msgr2=0x7fc5f8162570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:10.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.779+0000 7fc5ffd66640 1 -- 172.21.15.117:0/2320128265 shutdown_connections 2024-09-19T08:38:10.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.779+0000 7fc5ffd66640 1 -- 172.21.15.117:0/2320128265 wait complete. 2024-09-19T08:38:10.791 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-19T08:38:09.860076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220664,"kb_used_data":4436,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754056,"statfs":{"total":773094113280,"available":772868153344,"internally_reserved":0,"allocated":4542464,"data_stored":2579211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.354425"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515535+0000","last_change":"2024-09-19T08:38:06.515535+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515535+0000","last_undegraded":"2024-09-19T08:38:06.515535+0000","last_fullsized":"2024-09-19T08:38:06.515535+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522972+0000","last_change":"2024-09-19T08:38:06.522972+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522972+0000","last_undegraded":"2024-09-19T08:38:06.522972+0000","last_fullsized":"2024-09-19T08:38:06.522972+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515332+0000","last_change":"2024-09-19T08:38:06.515332+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515332+0000","last_undegraded":"2024-09-19T08:38:06.515332+0000","last_fullsized":"2024-09-19T08:38:06.515332+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515942+0000","last_change":"2024-09-19T08:38:06.515942+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515942+0000","last_undegraded":"2024-09-19T08:38:06.515942+0000","last_fullsized":"2024-09-19T08:38:06.515942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524194+0000","last_change":"2024-09-19T08:38:06.524194+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524194+0000","last_undegraded":"2024-09-19T08:38:06.524194+0000","last_fullsized":"2024-09-19T08:38:06.524194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.525385+0000","last_change":"2024-09-19T08:38:06.525385+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.525385+0000","last_undegraded":"2024-09-19T08:38:06.525385+0000","last_fullsized":"2024-09-19T08:38:06.525385+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.518025+0000","last_change":"2024-09-19T08:38:06.518025+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.518025+0000","last_undegraded":"2024-09-19T08:38:06.518025+0000","last_fullsized":"2024-09-19T08:38:06.518025+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524657+0000","last_change":"2024-09-19T08:38:06.524657+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524657+0000","last_undegraded":"2024-09-19T08:38:06.524657+0000","last_fullsized":"2024-09-19T08:38:06.524657+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.525829+0000","last_change":"2024-09-19T08:38:06.525829+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.525829+0000","last_undegraded":"2024-09-19T08:38:06.525829+0000","last_fullsized":"2024-09-19T08:38:06.525829+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524230+0000","last_change":"2024-09-19T08:38:06.524230+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524230+0000","last_undegraded":"2024-09-19T08:38:06.524230+0000","last_fullsized":"2024-09-19T08:38:06.524230+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520291+0000","last_change":"2024-09-19T08:38:06.520291+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520291+0000","last_undegraded":"2024-09-19T08:38:06.520291+0000","last_fullsized":"2024-09-19T08:38:06.520291+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521463+0000","last_change":"2024-09-19T08:38:06.521463+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521463+0000","last_undegraded":"2024-09-19T08:38:06.521463+0000","last_fullsized":"2024-09-19T08:38:06.521463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523791+0000","last_change":"2024-09-19T08:38:06.523791+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523791+0000","last_undegraded":"2024-09-19T08:38:06.523791+0000","last_fullsized":"2024-09-19T08:38:06.523791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522950+0000","last_change":"2024-09-19T08:38:06.522950+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522950+0000","last_undegraded":"2024-09-19T08:38:06.522950+0000","last_fullsized":"2024-09-19T08:38:06.522950+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521265+0000","last_change":"2024-09-19T08:38:06.521265+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521265+0000","last_undegraded":"2024-09-19T08:38:06.521265+0000","last_fullsized":"2024-09-19T08:38:06.521265+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519596+0000","last_change":"2024-09-19T08:38:06.519596+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519596+0000","last_undegraded":"2024-09-19T08:38:06.519596+0000","last_fullsized":"2024-09-19T08:38:06.519596+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.526134+0000","last_change":"2024-09-19T08:38:06.526134+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.526134+0000","last_undegraded":"2024-09-19T08:38:06.526134+0000","last_fullsized":"2024-09-19T08:38:06.526134+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524748+0000","last_change":"2024-09-19T08:38:06.524748+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524748+0000","last_undegraded":"2024-09-19T08:38:06.524748+0000","last_fullsized":"2024-09-19T08:38:06.524748+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523613+0000","last_change":"2024-09-19T08:38:06.523613+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523613+0000","last_undegraded":"2024-09-19T08:38:06.523613+0000","last_fullsized":"2024-09-19T08:38:06.523613+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520740+0000","last_change":"2024-09-19T08:38:06.520740+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520740+0000","last_undegraded":"2024-09-19T08:38:06.520740+0000","last_fullsized":"2024-09-19T08:38:06.520740+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.517564+0000","last_change":"2024-09-19T08:38:06.517564+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.517564+0000","last_undegraded":"2024-09-19T08:38:06.517564+0000","last_fullsized":"2024-09-19T08:38:06.517564+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519809+0000","last_change":"2024-09-19T08:38:06.519809+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519809+0000","last_undegraded":"2024-09-19T08:38:06.519809+0000","last_fullsized":"2024-09-19T08:38:06.519809+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.516283+0000","last_change":"2024-09-19T08:38:06.516283+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.516283+0000","last_undegraded":"2024-09-19T08:38:06.516283+0000","last_fullsized":"2024-09-19T08:38:06.516283+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524056+0000","last_change":"2024-09-19T08:38:06.524056+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524056+0000","last_undegraded":"2024-09-19T08:38:06.524056+0000","last_fullsized":"2024-09-19T08:38:06.524056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524230+0000","last_change":"2024-09-19T08:38:06.524230+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524230+0000","last_undegraded":"2024-09-19T08:38:06.524230+0000","last_fullsized":"2024-09-19T08:38:06.524230+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520284+0000","last_change":"2024-09-19T08:38:06.520284+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520284+0000","last_undegraded":"2024-09-19T08:38:06.520284+0000","last_fullsized":"2024-09-19T08:38:06.520284+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524644+0000","last_change":"2024-09-19T08:38:06.524644+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524644+0000","last_undegraded":"2024-09-19T08:38:06.524644+0000","last_fullsized":"2024-09-19T08:38:06.524644+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522221+0000","last_change":"2024-09-19T08:38:06.522221+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522221+0000","last_undegraded":"2024-09-19T08:38:06.522221+0000","last_fullsized":"2024-09-19T08:38:06.522221+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.517123+0000","last_change":"2024-09-19T08:38:06.517123+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.517123+0000","last_undegraded":"2024-09-19T08:38:06.517123+0000","last_fullsized":"2024-09-19T08:38:06.517123+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519849+0000","last_change":"2024-09-19T08:38:06.519849+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519849+0000","last_undegraded":"2024-09-19T08:38:06.519849+0000","last_fullsized":"2024-09-19T08:38:06.519849+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.528728+0000","last_change":"2024-09-19T08:38:06.525759+0000","last_active":"2024-09-19T08:38:06.528728+0000","last_peered":"2024-09-19T08:38:06.528728+0000","last_clean":"2024-09-19T08:38:06.528728+0000","last_became_active":"2024-09-19T08:38:06.525478+0000","last_became_peered":"2024-09-19T08:38:06.525478+0000","last_unstale":"2024-09-19T08:38:06.528728+0000","last_undegraded":"2024-09-19T08:38:06.528728+0000","last_fullsized":"2024-09-19T08:38:06.528728+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:22.876048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523934+0000","last_change":"2024-09-19T08:38:06.523934+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523934+0000","last_undegraded":"2024-09-19T08:38:06.523934+0000","last_fullsized":"2024-09-19T08:38:06.523934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.538022+0000","last_change":"2024-09-19T08:38:06.530592+0000","last_active":"2024-09-19T08:38:06.538022+0000","last_peered":"2024-09-19T08:38:06.538022+0000","last_clean":"2024-09-19T08:38:06.538022+0000","last_became_active":"2024-09-19T08:38:06.530244+0000","last_became_peered":"2024-09-19T08:38:06.530244+0000","last_unstale":"2024-09-19T08:38:06.538022+0000","last_undegraded":"2024-09-19T08:38:06.538022+0000","last_fullsized":"2024-09-19T08:38:06.538022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:49.718905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519761+0000","last_change":"2024-09-19T08:38:06.519761+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519761+0000","last_undegraded":"2024-09-19T08:38:06.519761+0000","last_fullsized":"2024-09-19T08:38:06.519761+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.538310+0000","last_change":"2024-09-19T08:38:06.533569+0000","last_active":"2024-09-19T08:38:06.538310+0000","last_peered":"2024-09-19T08:38:06.538310+0000","last_clean":"2024-09-19T08:38:06.538310+0000","last_became_active":"2024-09-19T08:38:06.533287+0000","last_became_peered":"2024-09-19T08:38:06.533287+0000","last_unstale":"2024-09-19T08:38:06.538310+0000","last_undegraded":"2024-09-19T08:38:06.538310+0000","last_fullsized":"2024-09-19T08:38:06.538310+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:36.052253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522054+0000","last_change":"2024-09-19T08:38:06.522054+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522054+0000","last_undegraded":"2024-09-19T08:38:06.522054+0000","last_fullsized":"2024-09-19T08:38:06.522054+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.525135+0000","last_change":"2024-09-19T08:38:06.523268+0000","last_active":"2024-09-19T08:38:06.525135+0000","last_peered":"2024-09-19T08:38:06.525135+0000","last_clean":"2024-09-19T08:38:06.525135+0000","last_became_active":"2024-09-19T08:38:06.523001+0000","last_became_peered":"2024-09-19T08:38:06.523001+0000","last_unstale":"2024-09-19T08:38:06.525135+0000","last_undegraded":"2024-09-19T08:38:06.525135+0000","last_fullsized":"2024-09-19T08:38:06.525135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:34.263681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.516654+0000","last_change":"2024-09-19T08:38:06.516654+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.516654+0000","last_undegraded":"2024-09-19T08:38:06.516654+0000","last_fullsized":"2024-09-19T08:38:06.516654+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.529403+0000","last_change":"2024-09-19T08:38:06.526836+0000","last_active":"2024-09-19T08:38:06.529403+0000","last_peered":"2024-09-19T08:38:06.529403+0000","last_clean":"2024-09-19T08:38:06.529403+0000","last_became_active":"2024-09-19T08:38:06.526218+0000","last_became_peered":"2024-09-19T08:38:06.526218+0000","last_unstale":"2024-09-19T08:38:06.529403+0000","last_undegraded":"2024-09-19T08:38:06.529403+0000","last_fullsized":"2024-09-19T08:38:06.529403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:56.987321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523086+0000","last_change":"2024-09-19T08:38:06.523086+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523086+0000","last_undegraded":"2024-09-19T08:38:06.523086+0000","last_fullsized":"2024-09-19T08:38:06.523086+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.536536+0000","last_change":"2024-09-19T08:38:06.536127+0000","last_active":"2024-09-19T08:38:06.536536+0000","last_peered":"2024-09-19T08:38:06.536536+0000","last_clean":"2024-09-19T08:38:06.536536+0000","last_became_active":"2024-09-19T08:38:06.535869+0000","last_became_peered":"2024-09-19T08:38:06.535869+0000","last_unstale":"2024-09-19T08:38:06.536536+0000","last_undegraded":"2024-09-19T08:38:06.536536+0000","last_fullsized":"2024-09-19T08:38:06.536536+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:45.599877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524245+0000","last_change":"2024-09-19T08:38:06.524245+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524245+0000","last_undegraded":"2024-09-19T08:38:06.524245+0000","last_fullsized":"2024-09-19T08:38:06.524245+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.527767+0000","last_change":"2024-09-19T08:38:06.524509+0000","last_active":"2024-09-19T08:38:06.527767+0000","last_peered":"2024-09-19T08:38:06.527767+0000","last_clean":"2024-09-19T08:38:06.527767+0000","last_became_active":"2024-09-19T08:38:06.524232+0000","last_became_peered":"2024-09-19T08:38:06.524232+0000","last_unstale":"2024-09-19T08:38:06.527767+0000","last_undegraded":"2024-09-19T08:38:06.527767+0000","last_fullsized":"2024-09-19T08:38:06.527767+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:07.229721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524208+0000","last_change":"2024-09-19T08:38:06.524208+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524208+0000","last_undegraded":"2024-09-19T08:38:06.524208+0000","last_fullsized":"2024-09-19T08:38:06.524208+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.534483+0000","last_change":"2024-09-19T08:38:06.533229+0000","last_active":"2024-09-19T08:38:06.534483+0000","last_peered":"2024-09-19T08:38:06.534483+0000","last_clean":"2024-09-19T08:38:06.534483+0000","last_became_active":"2024-09-19T08:38:06.532969+0000","last_became_peered":"2024-09-19T08:38:06.532969+0000","last_unstale":"2024-09-19T08:38:06.534483+0000","last_undegraded":"2024-09-19T08:38:06.534483+0000","last_fullsized":"2024-09-19T08:38:06.534483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:19.610768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515386+0000","last_change":"2024-09-19T08:38:06.515386+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515386+0000","last_undegraded":"2024-09-19T08:38:06.515386+0000","last_fullsized":"2024-09-19T08:38:06.515386+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.532787+0000","last_change":"2024-09-19T08:38:06.525562+0000","last_active":"2024-09-19T08:38:06.532787+0000","last_peered":"2024-09-19T08:38:06.532787+0000","last_clean":"2024-09-19T08:38:06.532787+0000","last_became_active":"2024-09-19T08:38:06.524991+0000","last_became_peered":"2024-09-19T08:38:06.524991+0000","last_unstale":"2024-09-19T08:38:06.532787+0000","last_undegraded":"2024-09-19T08:38:06.532787+0000","last_fullsized":"2024-09-19T08:38:06.532787+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:51.219417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519077+0000","last_change":"2024-09-19T08:38:06.519077+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519077+0000","last_undegraded":"2024-09-19T08:38:06.519077+0000","last_fullsized":"2024-09-19T08:38:06.519077+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.534055+0000","last_change":"2024-09-19T08:38:06.531379+0000","last_active":"2024-09-19T08:38:06.534055+0000","last_peered":"2024-09-19T08:38:06.534055+0000","last_clean":"2024-09-19T08:38:06.534055+0000","last_became_active":"2024-09-19T08:38:06.530810+0000","last_became_peered":"2024-09-19T08:38:06.530810+0000","last_unstale":"2024-09-19T08:38:06.534055+0000","last_undegraded":"2024-09-19T08:38:06.534055+0000","last_fullsized":"2024-09-19T08:38:06.534055+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:38.604762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.514826+0000","last_change":"2024-09-19T08:38:06.514826+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.514826+0000","last_undegraded":"2024-09-19T08:38:06.514826+0000","last_fullsized":"2024-09-19T08:38:06.514826+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.527986+0000","last_change":"2024-09-19T08:38:06.525652+0000","last_active":"2024-09-19T08:38:06.527986+0000","last_peered":"2024-09-19T08:38:06.527986+0000","last_clean":"2024-09-19T08:38:06.527986+0000","last_became_active":"2024-09-19T08:38:06.525395+0000","last_became_peered":"2024-09-19T08:38:06.525395+0000","last_unstale":"2024-09-19T08:38:06.527986+0000","last_undegraded":"2024-09-19T08:38:06.527986+0000","last_fullsized":"2024-09-19T08:38:06.527986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:20.592921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521608+0000","last_change":"2024-09-19T08:38:06.521608+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521608+0000","last_undegraded":"2024-09-19T08:38:06.521608+0000","last_fullsized":"2024-09-19T08:38:06.521608+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.527796+0000","last_change":"2024-09-19T08:38:06.524138+0000","last_active":"2024-09-19T08:38:06.527796+0000","last_peered":"2024-09-19T08:38:06.527796+0000","last_clean":"2024-09-19T08:38:06.527796+0000","last_became_active":"2024-09-19T08:38:06.523848+0000","last_became_peered":"2024-09-19T08:38:06.523848+0000","last_unstale":"2024-09-19T08:38:06.527796+0000","last_undegraded":"2024-09-19T08:38:06.527796+0000","last_fullsized":"2024-09-19T08:38:06.527796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:01.499409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.514819+0000","last_change":"2024-09-19T08:38:06.514819+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.514819+0000","last_undegraded":"2024-09-19T08:38:06.514819+0000","last_fullsized":"2024-09-19T08:38:06.514819+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.535660+0000","last_change":"2024-09-19T08:38:06.530737+0000","last_active":"2024-09-19T08:38:06.535660+0000","last_peered":"2024-09-19T08:38:06.535660+0000","last_clean":"2024-09-19T08:38:06.535660+0000","last_became_active":"2024-09-19T08:38:06.530436+0000","last_became_peered":"2024-09-19T08:38:06.530436+0000","last_unstale":"2024-09-19T08:38:06.535660+0000","last_undegraded":"2024-09-19T08:38:06.535660+0000","last_fullsized":"2024-09-19T08:38:06.535660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:35.022819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523686+0000","last_change":"2024-09-19T08:38:06.523686+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523686+0000","last_undegraded":"2024-09-19T08:38:06.523686+0000","last_fullsized":"2024-09-19T08:38:06.523686+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.538175+0000","last_change":"2024-09-19T08:38:06.533437+0000","last_active":"2024-09-19T08:38:06.538175+0000","last_peered":"2024-09-19T08:38:06.538175+0000","last_clean":"2024-09-19T08:38:06.538175+0000","last_became_active":"2024-09-19T08:38:06.533139+0000","last_became_peered":"2024-09-19T08:38:06.533139+0000","last_unstale":"2024-09-19T08:38:06.538175+0000","last_undegraded":"2024-09-19T08:38:06.538175+0000","last_fullsized":"2024-09-19T08:38:06.538175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:34.263681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521411+0000","last_change":"2024-09-19T08:38:06.521411+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521411+0000","last_undegraded":"2024-09-19T08:38:06.521411+0000","last_fullsized":"2024-09-19T08:38:06.521411+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.526852+0000","last_change":"2024-09-19T08:38:06.523001+0000","last_active":"2024-09-19T08:38:06.526852+0000","last_peered":"2024-09-19T08:38:06.526852+0000","last_clean":"2024-09-19T08:38:06.526852+0000","last_became_active":"2024-09-19T08:38:06.522686+0000","last_became_peered":"2024-09-19T08:38:06.522686+0000","last_unstale":"2024-09-19T08:38:06.526852+0000","last_undegraded":"2024-09-19T08:38:06.526852+0000","last_fullsized":"2024-09-19T08:38:06.526852+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:36.343142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.532540+0000","last_change":"2024-09-19T08:38:06.529230+0000","last_active":"2024-09-19T08:38:06.532540+0000","last_peered":"2024-09-19T08:38:06.532540+0000","last_clean":"2024-09-19T08:38:06.532540+0000","last_became_active":"2024-09-19T08:38:06.528958+0000","last_became_peered":"2024-09-19T08:38:06.528958+0000","last_unstale":"2024-09-19T08:38:06.532540+0000","last_undegraded":"2024-09-19T08:38:06.532540+0000","last_fullsized":"2024-09-19T08:38:06.532540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:01.499409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523135+0000","last_change":"2024-09-19T08:38:06.523135+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523135+0000","last_undegraded":"2024-09-19T08:38:06.523135+0000","last_fullsized":"2024-09-19T08:38:06.523135+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.535293+0000","last_change":"2024-09-19T08:38:06.534098+0000","last_active":"2024-09-19T08:38:06.535293+0000","last_peered":"2024-09-19T08:38:06.535293+0000","last_clean":"2024-09-19T08:38:06.535293+0000","last_became_active":"2024-09-19T08:38:06.533792+0000","last_became_peered":"2024-09-19T08:38:06.533792+0000","last_unstale":"2024-09-19T08:38:06.535293+0000","last_undegraded":"2024-09-19T08:38:06.535293+0000","last_fullsized":"2024-09-19T08:38:06.535293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:17.394057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520696+0000","last_change":"2024-09-19T08:38:06.520696+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520696+0000","last_undegraded":"2024-09-19T08:38:06.520696+0000","last_fullsized":"2024-09-19T08:38:06.520696+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.528660+0000","last_change":"2024-09-19T08:38:06.527561+0000","last_active":"2024-09-19T08:38:06.528660+0000","last_peered":"2024-09-19T08:38:06.528660+0000","last_clean":"2024-09-19T08:38:06.528660+0000","last_became_active":"2024-09-19T08:38:06.527305+0000","last_became_peered":"2024-09-19T08:38:06.527305+0000","last_unstale":"2024-09-19T08:38:06.528660+0000","last_undegraded":"2024-09-19T08:38:06.528660+0000","last_fullsized":"2024-09-19T08:38:06.528660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:38:37.770723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521186+0000","last_change":"2024-09-19T08:38:06.521186+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521186+0000","last_undegraded":"2024-09-19T08:38:06.521186+0000","last_fullsized":"2024-09-19T08:38:06.521186+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T08:38:05.518506+0000","last_change":"2024-09-19T08:38:05.518506+0000","last_active":"2024-09-19T08:38:05.500429+0000","last_peered":"2024-09-19T08:38:05.500429+0000","last_clean":"2024-09-19T08:38:05.500429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:05.518506+0000","last_undegraded":"2024-09-19T08:38:05.518506+0000","last_fullsized":"2024-09-19T08:38:05.518506+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521112+0000","last_change":"2024-09-19T08:38:06.521112+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521112+0000","last_undegraded":"2024-09-19T08:38:06.521112+0000","last_fullsized":"2024-09-19T08:38:06.521112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.535356+0000","last_change":"2024-09-19T08:38:06.529491+0000","last_active":"2024-09-19T08:38:06.535356+0000","last_peered":"2024-09-19T08:38:06.535356+0000","last_clean":"2024-09-19T08:38:06.535356+0000","last_became_active":"2024-09-19T08:38:06.529160+0000","last_became_peered":"2024-09-19T08:38:06.529160+0000","last_unstale":"2024-09-19T08:38:06.535356+0000","last_undegraded":"2024-09-19T08:38:06.535356+0000","last_fullsized":"2024-09-19T08:38:06.535356+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:49.654020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520861+0000","last_change":"2024-09-19T08:38:06.520861+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520861+0000","last_undegraded":"2024-09-19T08:38:06.520861+0000","last_fullsized":"2024-09-19T08:38:06.520861+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.532652+0000","last_change":"2024-09-19T08:38:06.526582+0000","last_active":"2024-09-19T08:38:06.532652+0000","last_peered":"2024-09-19T08:38:06.532652+0000","last_clean":"2024-09-19T08:38:06.532652+0000","last_became_active":"2024-09-19T08:38:06.526290+0000","last_became_peered":"2024-09-19T08:38:06.526290+0000","last_unstale":"2024-09-19T08:38:06.532652+0000","last_undegraded":"2024-09-19T08:38:06.532652+0000","last_fullsized":"2024-09-19T08:38:06.532652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:44.073925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515014+0000","last_change":"2024-09-19T08:38:06.515014+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515014+0000","last_undegraded":"2024-09-19T08:38:06.515014+0000","last_fullsized":"2024-09-19T08:38:06.515014+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.538133+0000","last_change":"2024-09-19T08:38:06.531426+0000","last_active":"2024-09-19T08:38:06.538133+0000","last_peered":"2024-09-19T08:38:06.538133+0000","last_clean":"2024-09-19T08:38:06.538133+0000","last_became_active":"2024-09-19T08:38:06.531074+0000","last_became_peered":"2024-09-19T08:38:06.531074+0000","last_unstale":"2024-09-19T08:38:06.538133+0000","last_undegraded":"2024-09-19T08:38:06.538133+0000","last_fullsized":"2024-09-19T08:38:06.538133+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:06.375637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520413+0000","last_change":"2024-09-19T08:38:06.520413+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520413+0000","last_undegraded":"2024-09-19T08:38:06.520413+0000","last_fullsized":"2024-09-19T08:38:06.520413+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.534561+0000","last_change":"2024-09-19T08:38:06.533258+0000","last_active":"2024-09-19T08:38:06.534561+0000","last_peered":"2024-09-19T08:38:06.534561+0000","last_clean":"2024-09-19T08:38:06.534561+0000","last_became_active":"2024-09-19T08:38:06.533008+0000","last_became_peered":"2024-09-19T08:38:06.533008+0000","last_unstale":"2024-09-19T08:38:06.534561+0000","last_undegraded":"2024-09-19T08:38:06.534561+0000","last_fullsized":"2024-09-19T08:38:06.534561+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:04.672846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515726+0000","last_change":"2024-09-19T08:38:06.515726+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515726+0000","last_undegraded":"2024-09-19T08:38:06.515726+0000","last_fullsized":"2024-09-19T08:38:06.515726+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.538182+0000","last_change":"2024-09-19T08:38:06.533577+0000","last_active":"2024-09-19T08:38:06.538182+0000","last_peered":"2024-09-19T08:38:06.538182+0000","last_clean":"2024-09-19T08:38:06.538182+0000","last_became_active":"2024-09-19T08:38:06.533276+0000","last_became_peered":"2024-09-19T08:38:06.533276+0000","last_unstale":"2024-09-19T08:38:06.538182+0000","last_undegraded":"2024-09-19T08:38:06.538182+0000","last_fullsized":"2024-09-19T08:38:06.538182+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:22.876048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.534078+0000","last_change":"2024-09-19T08:38:06.532515+0000","last_active":"2024-09-19T08:38:06.534078+0000","last_peered":"2024-09-19T08:38:06.534078+0000","last_clean":"2024-09-19T08:38:06.534078+0000","last_became_active":"2024-09-19T08:38:06.532253+0000","last_became_peered":"2024-09-19T08:38:06.532253+0000","last_unstale":"2024-09-19T08:38:06.534078+0000","last_undegraded":"2024-09-19T08:38:06.534078+0000","last_fullsized":"2024-09-19T08:38:06.534078+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:54.746465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519972+0000","last_change":"2024-09-19T08:38:06.519972+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519972+0000","last_undegraded":"2024-09-19T08:38:06.519972+0000","last_fullsized":"2024-09-19T08:38:06.519972+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T08:38:05.516525+0000","last_change":"2024-09-19T08:38:05.516525+0000","last_active":"2024-09-19T08:38:05.500429+0000","last_peered":"2024-09-19T08:38:05.500429+0000","last_clean":"2024-09-19T08:38:05.500429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:05.516525+0000","last_undegraded":"2024-09-19T08:38:05.516525+0000","last_fullsized":"2024-09-19T08:38:05.516525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521088+0000","last_change":"2024-09-19T08:38:06.521088+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521088+0000","last_undegraded":"2024-09-19T08:38:06.521088+0000","last_fullsized":"2024-09-19T08:38:06.521088+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T08:38:05.516323+0000","last_change":"2024-09-19T08:38:05.516323+0000","last_active":"2024-09-19T08:38:05.500429+0000","last_peered":"2024-09-19T08:38:05.500429+0000","last_clean":"2024-09-19T08:38:05.500429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:05.516323+0000","last_undegraded":"2024-09-19T08:38:05.516323+0000","last_fullsized":"2024-09-19T08:38:05.516323+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.535645+0000","last_change":"2024-09-19T08:38:06.530799+0000","last_active":"2024-09-19T08:38:06.535645+0000","last_peered":"2024-09-19T08:38:06.535645+0000","last_clean":"2024-09-19T08:38:06.535645+0000","last_became_active":"2024-09-19T08:38:06.530484+0000","last_became_peered":"2024-09-19T08:38:06.530484+0000","last_unstale":"2024-09-19T08:38:06.535645+0000","last_undegraded":"2024-09-19T08:38:06.535645+0000","last_fullsized":"2024-09-19T08:38:06.535645+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:26.454464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522886+0000","last_change":"2024-09-19T08:38:06.522886+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522886+0000","last_undegraded":"2024-09-19T08:38:06.522886+0000","last_fullsized":"2024-09-19T08:38:06.522886+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.531801+0000","last_change":"2024-09-19T08:38:06.528224+0000","last_active":"2024-09-19T08:38:06.531801+0000","last_peered":"2024-09-19T08:38:06.531801+0000","last_clean":"2024-09-19T08:38:06.531801+0000","last_became_active":"2024-09-19T08:38:06.527744+0000","last_became_peered":"2024-09-19T08:38:06.527744+0000","last_unstale":"2024-09-19T08:38:06.531801+0000","last_undegraded":"2024-09-19T08:38:06.531801+0000","last_fullsized":"2024-09-19T08:38:06.531801+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:13.093311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523853+0000","last_change":"2024-09-19T08:38:06.523853+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523853+0000","last_undegraded":"2024-09-19T08:38:06.523853+0000","last_fullsized":"2024-09-19T08:38:06.523853+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.534560+0000","last_change":"2024-09-19T08:38:06.533024+0000","last_active":"2024-09-19T08:38:06.534560+0000","last_peered":"2024-09-19T08:38:06.534560+0000","last_clean":"2024-09-19T08:38:06.534560+0000","last_became_active":"2024-09-19T08:38:06.532728+0000","last_became_peered":"2024-09-19T08:38:06.532728+0000","last_unstale":"2024-09-19T08:38:06.534560+0000","last_undegraded":"2024-09-19T08:38:06.534560+0000","last_fullsized":"2024-09-19T08:38:06.534560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:59.807121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519499+0000","last_change":"2024-09-19T08:38:06.519499+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519499+0000","last_undegraded":"2024-09-19T08:38:06.519499+0000","last_fullsized":"2024-09-19T08:38:06.519499+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.532632+0000","last_change":"2024-09-19T08:38:06.525546+0000","last_active":"2024-09-19T08:38:06.532632+0000","last_peered":"2024-09-19T08:38:06.532632+0000","last_clean":"2024-09-19T08:38:06.532632+0000","last_became_active":"2024-09-19T08:38:06.525227+0000","last_became_peered":"2024-09-19T08:38:06.525227+0000","last_unstale":"2024-09-19T08:38:06.532632+0000","last_undegraded":"2024-09-19T08:38:06.532632+0000","last_fullsized":"2024-09-19T08:38:06.532632+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:13.093311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522539+0000","last_change":"2024-09-19T08:38:06.522539+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522539+0000","last_undegraded":"2024-09-19T08:38:06.522539+0000","last_fullsized":"2024-09-19T08:38:06.522539+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.530671+0000","last_change":"2024-09-19T08:38:06.526379+0000","last_active":"2024-09-19T08:38:06.530671+0000","last_peered":"2024-09-19T08:38:06.530671+0000","last_clean":"2024-09-19T08:38:06.530671+0000","last_became_active":"2024-09-19T08:38:06.525731+0000","last_became_peered":"2024-09-19T08:38:06.525731+0000","last_unstale":"2024-09-19T08:38:06.530671+0000","last_undegraded":"2024-09-19T08:38:06.530671+0000","last_fullsized":"2024-09-19T08:38:06.530671+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:07.229721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":198,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.519210+0000","last_change":"2024-09-19T08:37:04.479071+0000","last_active":"2024-09-19T08:38:06.519210+0000","last_peered":"2024-09-19T08:38:06.519210+0000","last_clean":"2024-09-19T08:38:06.519210+0000","last_became_active":"2024-09-19T08:37:04.478199+0000","last_became_peered":"2024-09-19T08:37:04.478199+0000","last_unstale":"2024-09-19T08:38:06.519210+0000","last_undegraded":"2024-09-19T08:38:06.519210+0000","last_fullsized":"2024-09-19T08:38:06.519210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_clean_scrub_stamp":"2024-09-19T08:37:02.519738+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:32.963748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1011712,"data_stored":764344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1024000,"data_stored":771011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:38:10.795 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:38:10.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.928+0000 7f1b2c4c9640 1 Processor -- start 2024-09-19T08:38:10.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.928+0000 7f1b2c4c9640 1 -- start start 2024-09-19T08:38:10.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.929+0000 7f1b2c4c9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b2406f9e0 0x7f1b240d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:10.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.929+0000 7f1b2c4c9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b2415b500 con 0x7f1b240d09f0 2024-09-19T08:38:10.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.929+0000 7f1b2c4c9640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b2406e940 con 0x7f1b2415b120 2024-09-19T08:38:10.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.929+0000 7f1b2c4c9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f1b240d0e40 con 0x7f1b2406f9e0 2024-09-19T08:38:10.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.929+0000 7f1b2aa66640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f1b240d09f0 0x7f1b240c5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:37538/0 (socket says 172.21.15.117:37538) 2024-09-19T08:38:10.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.929+0000 7f1b2aa66640 1 -- 172.21.15.117:0/1529437838 learned_addr learned my addr 172.21.15.117:0/1529437838 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:10.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.929+0000 7f1b29a64640 1 --2- 172.21.15.117:0/1529437838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b2406f9e0 0x7f1b240d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:10.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.929+0000 7f1b29263640 1 -- 172.21.15.117:0/1529437838 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 119757679 0 0) 0x7f1b2415b500 con 0x7f1b240d09f0 2024-09-19T08:38:10.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.929+0000 7f1b29263640 1 -- 172.21.15.117:0/1529437838 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b10003520 con 0x7f1b240d09f0 2024-09-19T08:38:10.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.929+0000 7f1b29263640 1 -- 172.21.15.117:0/1529437838 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3296900581 0 0) 0x7f1b2406e940 con 0x7f1b2415b120 2024-09-19T08:38:10.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.929+0000 7f1b29263640 1 -- 172.21.15.117:0/1529437838 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b2415b500 con 0x7f1b2415b120 2024-09-19T08:38:10.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.929+0000 7f1b29263640 1 -- 172.21.15.117:0/1529437838 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1559353535 0 0) 0x7f1b10003520 con 0x7f1b240d09f0 2024-09-19T08:38:10.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.929+0000 7f1b29a64640 1 -- 172.21.15.117:0/1529437838 >> v1:172.21.15.146:6789/0 conn(0x7f1b2415b120 legacy=0x7f1b2406dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:10.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.929+0000 7f1b29a64640 1 -- 172.21.15.117:0/1529437838 >> v1:172.21.15.117:6789/0 conn(0x7f1b240d09f0 legacy=0x7f1b240c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:10.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.929+0000 7f1b29a64640 1 -- 172.21.15.117:0/1529437838 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b2406ec20 con 0x7f1b2406f9e0 2024-09-19T08:38:10.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.930+0000 7f1b29a64640 1 --2- 172.21.15.117:0/1529437838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b2406f9e0 0x7f1b240d04b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1b140097d0 tx=0x7f1b1402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=708a0e602d45036e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:10.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.930+0000 7f1b29263640 1 -- 172.21.15.117:0/1529437838 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b14037070 con 0x7f1b2406f9e0 2024-09-19T08:38:10.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.930+0000 7f1b29263640 1 -- 172.21.15.117:0/1529437838 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b1402ac30 con 0x7f1b2406f9e0 2024-09-19T08:38:10.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.930+0000 7f1b29263640 1 -- 172.21.15.117:0/1529437838 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0019f0 con 0x7f1b2406f9e0 2024-09-19T08:38:10.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.931+0000 7f1b2c4c9640 1 -- 172.21.15.117:0/1529437838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b2406f9e0 msgr2=0x7f1b240d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:10.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.931+0000 7f1b2c4c9640 1 --2- 172.21.15.117:0/1529437838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b2406f9e0 0x7f1b240d04b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1b140097d0 tx=0x7f1b1402a1a0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.931+0000 7f1b2c4c9640 1 -- 172.21.15.117:0/1529437838 shutdown_connections 2024-09-19T08:38:10.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.931+0000 7f1b2c4c9640 1 --2- 172.21.15.117:0/1529437838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b2406f9e0 0x7f1b240d04b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.931+0000 7f1b2c4c9640 1 -- 172.21.15.117:0/1529437838 >> 172.21.15.117:0/1529437838 conn(0x7f1b2406bdf0 msgr2=0x7f1b2406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:10.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.931+0000 7f1b2c4c9640 1 -- 172.21.15.117:0/1529437838 shutdown_connections 2024-09-19T08:38:10.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.931+0000 7f1b2c4c9640 1 -- 172.21.15.117:0/1529437838 wait complete. 2024-09-19T08:38:10.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.932+0000 7f1b2c4c9640 1 Processor -- start 2024-09-19T08:38:10.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.932+0000 7f1b2c4c9640 1 -- start start 2024-09-19T08:38:10.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.933+0000 7f1b2c4c9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b2406f9e0 0x7f1b24155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:10.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.933+0000 7f1b2c4c9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b240d09f0 0x7f1b241f3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:10.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.933+0000 7f1b2c4c9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b2415b120 0x7f1b240ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:10.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.933+0000 7f1b2c4c9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2406f4c0 con 0x7f1b2415b120 2024-09-19T08:38:10.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.933+0000 7f1b2c4c9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2406f1e0 con 0x7f1b2406f9e0 2024-09-19T08:38:10.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.933+0000 7f1b2c4c9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f1b2406e5d0 con 0x7f1b240d09f0 2024-09-19T08:38:10.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.933+0000 7f1b2aa66640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b2415b120 0x7f1b240ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:10.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.933+0000 7f1b2aa66640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b2415b120 0x7f1b240ae750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47214/0 (socket says 172.21.15.117:47214) 2024-09-19T08:38:10.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.933+0000 7f1b2aa66640 1 -- 172.21.15.117:0/1773033584 learned_addr learned my addr 172.21.15.117:0/1773033584 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:10.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.933+0000 7f1b29a64640 1 --2- 172.21.15.117:0/1773033584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b240d09f0 0x7f1b241f3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:10.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.933+0000 7f1b2aa66640 1 -- 172.21.15.117:0/1773033584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b240d09f0 msgr2=0x7f1b241f3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:10.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.933+0000 7f1b2a265640 1 --2- 172.21.15.117:0/1773033584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b2406f9e0 0x7f1b24155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:10.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.933+0000 7f1b2aa66640 1 --2- 172.21.15.117:0/1773033584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b240d09f0 0x7f1b241f3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.933+0000 7f1b2aa66640 1 -- 172.21.15.117:0/1773033584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b2406f9e0 msgr2=0x7f1b24155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:10.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.933+0000 7f1b2aa66640 1 --2- 172.21.15.117:0/1773033584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b2406f9e0 0x7f1b24155310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:10.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.933+0000 7f1b2aa66640 1 -- 172.21.15.117:0/1773033584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b241f4670 con 0x7f1b2415b120 2024-09-19T08:38:10.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.933+0000 7f1b2aa66640 1 --2- 172.21.15.117:0/1773033584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b2415b120 0x7f1b240ae750 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00ccd0 tx=0x7f1b1c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:10.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.934+0000 7f1b1affd640 1 -- 172.21.15.117:0/1773033584 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c017070 con 0x7f1b2415b120 2024-09-19T08:38:10.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.934+0000 7f1b1affd640 1 -- 172.21.15.117:0/1773033584 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b1c012400 con 0x7f1b2415b120 2024-09-19T08:38:10.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.934+0000 7f1b2c4c9640 1 -- 172.21.15.117:0/1773033584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b241f4950 con 0x7f1b2415b120 2024-09-19T08:38:10.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.934+0000 7f1b1affd640 1 -- 172.21.15.117:0/1773033584 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0127f0 con 0x7f1b2415b120 2024-09-19T08:38:10.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.934+0000 7f1b2c4c9640 1 -- 172.21.15.117:0/1773033584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b240b0670 con 0x7f1b2415b120 2024-09-19T08:38:10.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.935+0000 7f1b2c4c9640 1 -- 172.21.15.117:0/1773033584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b240ce060 con 0x7f1b2415b120 2024-09-19T08:38:10.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.935+0000 7f1b1affd640 1 -- 172.21.15.117:0/1773033584 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1b1c01a070 con 0x7f1b2415b120 2024-09-19T08:38:10.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.936+0000 7f1b1affd640 1 --2- 172.21.15.117:0/1773033584 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1b0806c2b0 0x7f1b0806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:10.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.936+0000 7f1b1affd640 1 -- 172.21.15.117:0/1773033584 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f1b1c08b650 con 0x7f1b2415b120 2024-09-19T08:38:10.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.936+0000 7f1b2a265640 1 --2- 172.21.15.117:0/1773033584 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1b0806c2b0 0x7f1b0806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:10.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.937+0000 7f1b2a265640 1 --2- 172.21.15.117:0/1773033584 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1b0806c2b0 0x7f1b0806e770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1b200010e0 tx=0x7f1b20009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:10.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:10.940+0000 7f1b1affd640 1 -- 172.21.15.117:0/1773033584 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1b1c059bb0 con 0x7f1b2415b120 2024-09-19T08:38:11.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.105+0000 7f1b2c4c9640 1 -- 172.21.15.117:0/1773033584 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b241f4b20 con 0x7f1b0806c2b0 2024-09-19T08:38:11.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.111+0000 7f1b1affd640 1 -- 172.21.15.117:0/1773033584 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245966 (secure 0 0 0) 0x7f1b241f4b20 con 0x7f1b0806c2b0 2024-09-19T08:38:11.114 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:11.116 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-09-19T08:38:11.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.114+0000 7f1b2c4c9640 1 -- 172.21.15.117:0/1773033584 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1b0806c2b0 msgr2=0x7f1b0806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:11.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.114+0000 7f1b2c4c9640 1 --2- 172.21.15.117:0/1773033584 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1b0806c2b0 0x7f1b0806e770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1b200010e0 tx=0x7f1b20009040 comp rx=0 tx=0).stop 2024-09-19T08:38:11.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.114+0000 7f1b2c4c9640 1 -- 172.21.15.117:0/1773033584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b2415b120 msgr2=0x7f1b240ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:11.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.114+0000 7f1b2c4c9640 1 --2- 172.21.15.117:0/1773033584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b2415b120 0x7f1b240ae750 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00ccd0 tx=0x7f1b1c00a430 comp rx=0 tx=0).stop 2024-09-19T08:38:11.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.114+0000 7f1b2c4c9640 1 -- 172.21.15.117:0/1773033584 shutdown_connections 2024-09-19T08:38:11.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.114+0000 7f1b2c4c9640 1 --2- 172.21.15.117:0/1773033584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b2415b120 0x7f1b240ae750 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:11.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.114+0000 7f1b2c4c9640 1 --2- 172.21.15.117:0/1773033584 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f1b0806c2b0 0x7f1b0806e770 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:11.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.114+0000 7f1b2c4c9640 1 --2- 172.21.15.117:0/1773033584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b240d09f0 0x7f1b241f3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:11.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.114+0000 7f1b2c4c9640 1 --2- 172.21.15.117:0/1773033584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b2406f9e0 0x7f1b24155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:11.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.114+0000 7f1b2c4c9640 1 -- 172.21.15.117:0/1773033584 >> 172.21.15.117:0/1773033584 conn(0x7f1b2406bdf0 msgr2=0x7f1b2406c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:11.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.114+0000 7f1b2c4c9640 1 -- 172.21.15.117:0/1773033584 shutdown_connections 2024-09-19T08:38:11.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.114+0000 7f1b2c4c9640 1 -- 172.21.15.117:0/1773033584 wait complete. 2024-09-19T08:38:11.126 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-19T08:38:09.860076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220664,"kb_used_data":4436,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754056,"statfs":{"total":773094113280,"available":772868153344,"internally_reserved":0,"allocated":4542464,"data_stored":2579211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.354425"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515535+0000","last_change":"2024-09-19T08:38:06.515535+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515535+0000","last_undegraded":"2024-09-19T08:38:06.515535+0000","last_fullsized":"2024-09-19T08:38:06.515535+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522972+0000","last_change":"2024-09-19T08:38:06.522972+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522972+0000","last_undegraded":"2024-09-19T08:38:06.522972+0000","last_fullsized":"2024-09-19T08:38:06.522972+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515332+0000","last_change":"2024-09-19T08:38:06.515332+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515332+0000","last_undegraded":"2024-09-19T08:38:06.515332+0000","last_fullsized":"2024-09-19T08:38:06.515332+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515942+0000","last_change":"2024-09-19T08:38:06.515942+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515942+0000","last_undegraded":"2024-09-19T08:38:06.515942+0000","last_fullsized":"2024-09-19T08:38:06.515942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524194+0000","last_change":"2024-09-19T08:38:06.524194+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524194+0000","last_undegraded":"2024-09-19T08:38:06.524194+0000","last_fullsized":"2024-09-19T08:38:06.524194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.525385+0000","last_change":"2024-09-19T08:38:06.525385+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.525385+0000","last_undegraded":"2024-09-19T08:38:06.525385+0000","last_fullsized":"2024-09-19T08:38:06.525385+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.518025+0000","last_change":"2024-09-19T08:38:06.518025+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.518025+0000","last_undegraded":"2024-09-19T08:38:06.518025+0000","last_fullsized":"2024-09-19T08:38:06.518025+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524657+0000","last_change":"2024-09-19T08:38:06.524657+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524657+0000","last_undegraded":"2024-09-19T08:38:06.524657+0000","last_fullsized":"2024-09-19T08:38:06.524657+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.525829+0000","last_change":"2024-09-19T08:38:06.525829+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.525829+0000","last_undegraded":"2024-09-19T08:38:06.525829+0000","last_fullsized":"2024-09-19T08:38:06.525829+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524230+0000","last_change":"2024-09-19T08:38:06.524230+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524230+0000","last_undegraded":"2024-09-19T08:38:06.524230+0000","last_fullsized":"2024-09-19T08:38:06.524230+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520291+0000","last_change":"2024-09-19T08:38:06.520291+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520291+0000","last_undegraded":"2024-09-19T08:38:06.520291+0000","last_fullsized":"2024-09-19T08:38:06.520291+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521463+0000","last_change":"2024-09-19T08:38:06.521463+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521463+0000","last_undegraded":"2024-09-19T08:38:06.521463+0000","last_fullsized":"2024-09-19T08:38:06.521463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523791+0000","last_change":"2024-09-19T08:38:06.523791+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523791+0000","last_undegraded":"2024-09-19T08:38:06.523791+0000","last_fullsized":"2024-09-19T08:38:06.523791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522950+0000","last_change":"2024-09-19T08:38:06.522950+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522950+0000","last_undegraded":"2024-09-19T08:38:06.522950+0000","last_fullsized":"2024-09-19T08:38:06.522950+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521265+0000","last_change":"2024-09-19T08:38:06.521265+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521265+0000","last_undegraded":"2024-09-19T08:38:06.521265+0000","last_fullsized":"2024-09-19T08:38:06.521265+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519596+0000","last_change":"2024-09-19T08:38:06.519596+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519596+0000","last_undegraded":"2024-09-19T08:38:06.519596+0000","last_fullsized":"2024-09-19T08:38:06.519596+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.526134+0000","last_change":"2024-09-19T08:38:06.526134+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.526134+0000","last_undegraded":"2024-09-19T08:38:06.526134+0000","last_fullsized":"2024-09-19T08:38:06.526134+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524748+0000","last_change":"2024-09-19T08:38:06.524748+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524748+0000","last_undegraded":"2024-09-19T08:38:06.524748+0000","last_fullsized":"2024-09-19T08:38:06.524748+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523613+0000","last_change":"2024-09-19T08:38:06.523613+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523613+0000","last_undegraded":"2024-09-19T08:38:06.523613+0000","last_fullsized":"2024-09-19T08:38:06.523613+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520740+0000","last_change":"2024-09-19T08:38:06.520740+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520740+0000","last_undegraded":"2024-09-19T08:38:06.520740+0000","last_fullsized":"2024-09-19T08:38:06.520740+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.517564+0000","last_change":"2024-09-19T08:38:06.517564+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.517564+0000","last_undegraded":"2024-09-19T08:38:06.517564+0000","last_fullsized":"2024-09-19T08:38:06.517564+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519809+0000","last_change":"2024-09-19T08:38:06.519809+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519809+0000","last_undegraded":"2024-09-19T08:38:06.519809+0000","last_fullsized":"2024-09-19T08:38:06.519809+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.516283+0000","last_change":"2024-09-19T08:38:06.516283+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.516283+0000","last_undegraded":"2024-09-19T08:38:06.516283+0000","last_fullsized":"2024-09-19T08:38:06.516283+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524056+0000","last_change":"2024-09-19T08:38:06.524056+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524056+0000","last_undegraded":"2024-09-19T08:38:06.524056+0000","last_fullsized":"2024-09-19T08:38:06.524056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524230+0000","last_change":"2024-09-19T08:38:06.524230+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524230+0000","last_undegraded":"2024-09-19T08:38:06.524230+0000","last_fullsized":"2024-09-19T08:38:06.524230+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520284+0000","last_change":"2024-09-19T08:38:06.520284+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520284+0000","last_undegraded":"2024-09-19T08:38:06.520284+0000","last_fullsized":"2024-09-19T08:38:06.520284+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524644+0000","last_change":"2024-09-19T08:38:06.524644+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524644+0000","last_undegraded":"2024-09-19T08:38:06.524644+0000","last_fullsized":"2024-09-19T08:38:06.524644+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522221+0000","last_change":"2024-09-19T08:38:06.522221+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522221+0000","last_undegraded":"2024-09-19T08:38:06.522221+0000","last_fullsized":"2024-09-19T08:38:06.522221+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.517123+0000","last_change":"2024-09-19T08:38:06.517123+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.517123+0000","last_undegraded":"2024-09-19T08:38:06.517123+0000","last_fullsized":"2024-09-19T08:38:06.517123+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519849+0000","last_change":"2024-09-19T08:38:06.519849+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519849+0000","last_undegraded":"2024-09-19T08:38:06.519849+0000","last_fullsized":"2024-09-19T08:38:06.519849+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.528728+0000","last_change":"2024-09-19T08:38:06.525759+0000","last_active":"2024-09-19T08:38:06.528728+0000","last_peered":"2024-09-19T08:38:06.528728+0000","last_clean":"2024-09-19T08:38:06.528728+0000","last_became_active":"2024-09-19T08:38:06.525478+0000","last_became_peered":"2024-09-19T08:38:06.525478+0000","last_unstale":"2024-09-19T08:38:06.528728+0000","last_undegraded":"2024-09-19T08:38:06.528728+0000","last_fullsized":"2024-09-19T08:38:06.528728+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:22.876048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523934+0000","last_change":"2024-09-19T08:38:06.523934+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523934+0000","last_undegraded":"2024-09-19T08:38:06.523934+0000","last_fullsized":"2024-09-19T08:38:06.523934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.538022+0000","last_change":"2024-09-19T08:38:06.530592+0000","last_active":"2024-09-19T08:38:06.538022+0000","last_peered":"2024-09-19T08:38:06.538022+0000","last_clean":"2024-09-19T08:38:06.538022+0000","last_became_active":"2024-09-19T08:38:06.530244+0000","last_became_peered":"2024-09-19T08:38:06.530244+0000","last_unstale":"2024-09-19T08:38:06.538022+0000","last_undegraded":"2024-09-19T08:38:06.538022+0000","last_fullsized":"2024-09-19T08:38:06.538022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:49.718905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519761+0000","last_change":"2024-09-19T08:38:06.519761+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519761+0000","last_undegraded":"2024-09-19T08:38:06.519761+0000","last_fullsized":"2024-09-19T08:38:06.519761+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.538310+0000","last_change":"2024-09-19T08:38:06.533569+0000","last_active":"2024-09-19T08:38:06.538310+0000","last_peered":"2024-09-19T08:38:06.538310+0000","last_clean":"2024-09-19T08:38:06.538310+0000","last_became_active":"2024-09-19T08:38:06.533287+0000","last_became_peered":"2024-09-19T08:38:06.533287+0000","last_unstale":"2024-09-19T08:38:06.538310+0000","last_undegraded":"2024-09-19T08:38:06.538310+0000","last_fullsized":"2024-09-19T08:38:06.538310+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:36.052253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522054+0000","last_change":"2024-09-19T08:38:06.522054+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522054+0000","last_undegraded":"2024-09-19T08:38:06.522054+0000","last_fullsized":"2024-09-19T08:38:06.522054+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.525135+0000","last_change":"2024-09-19T08:38:06.523268+0000","last_active":"2024-09-19T08:38:06.525135+0000","last_peered":"2024-09-19T08:38:06.525135+0000","last_clean":"2024-09-19T08:38:06.525135+0000","last_became_active":"2024-09-19T08:38:06.523001+0000","last_became_peered":"2024-09-19T08:38:06.523001+0000","last_unstale":"2024-09-19T08:38:06.525135+0000","last_undegraded":"2024-09-19T08:38:06.525135+0000","last_fullsized":"2024-09-19T08:38:06.525135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:34.263681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.516654+0000","last_change":"2024-09-19T08:38:06.516654+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.516654+0000","last_undegraded":"2024-09-19T08:38:06.516654+0000","last_fullsized":"2024-09-19T08:38:06.516654+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.529403+0000","last_change":"2024-09-19T08:38:06.526836+0000","last_active":"2024-09-19T08:38:06.529403+0000","last_peered":"2024-09-19T08:38:06.529403+0000","last_clean":"2024-09-19T08:38:06.529403+0000","last_became_active":"2024-09-19T08:38:06.526218+0000","last_became_peered":"2024-09-19T08:38:06.526218+0000","last_unstale":"2024-09-19T08:38:06.529403+0000","last_undegraded":"2024-09-19T08:38:06.529403+0000","last_fullsized":"2024-09-19T08:38:06.529403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:56.987321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523086+0000","last_change":"2024-09-19T08:38:06.523086+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523086+0000","last_undegraded":"2024-09-19T08:38:06.523086+0000","last_fullsized":"2024-09-19T08:38:06.523086+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.536536+0000","last_change":"2024-09-19T08:38:06.536127+0000","last_active":"2024-09-19T08:38:06.536536+0000","last_peered":"2024-09-19T08:38:06.536536+0000","last_clean":"2024-09-19T08:38:06.536536+0000","last_became_active":"2024-09-19T08:38:06.535869+0000","last_became_peered":"2024-09-19T08:38:06.535869+0000","last_unstale":"2024-09-19T08:38:06.536536+0000","last_undegraded":"2024-09-19T08:38:06.536536+0000","last_fullsized":"2024-09-19T08:38:06.536536+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:45.599877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524245+0000","last_change":"2024-09-19T08:38:06.524245+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524245+0000","last_undegraded":"2024-09-19T08:38:06.524245+0000","last_fullsized":"2024-09-19T08:38:06.524245+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.527767+0000","last_change":"2024-09-19T08:38:06.524509+0000","last_active":"2024-09-19T08:38:06.527767+0000","last_peered":"2024-09-19T08:38:06.527767+0000","last_clean":"2024-09-19T08:38:06.527767+0000","last_became_active":"2024-09-19T08:38:06.524232+0000","last_became_peered":"2024-09-19T08:38:06.524232+0000","last_unstale":"2024-09-19T08:38:06.527767+0000","last_undegraded":"2024-09-19T08:38:06.527767+0000","last_fullsized":"2024-09-19T08:38:06.527767+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:07.229721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524208+0000","last_change":"2024-09-19T08:38:06.524208+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524208+0000","last_undegraded":"2024-09-19T08:38:06.524208+0000","last_fullsized":"2024-09-19T08:38:06.524208+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.534483+0000","last_change":"2024-09-19T08:38:06.533229+0000","last_active":"2024-09-19T08:38:06.534483+0000","last_peered":"2024-09-19T08:38:06.534483+0000","last_clean":"2024-09-19T08:38:06.534483+0000","last_became_active":"2024-09-19T08:38:06.532969+0000","last_became_peered":"2024-09-19T08:38:06.532969+0000","last_unstale":"2024-09-19T08:38:06.534483+0000","last_undegraded":"2024-09-19T08:38:06.534483+0000","last_fullsized":"2024-09-19T08:38:06.534483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:19.610768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515386+0000","last_change":"2024-09-19T08:38:06.515386+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515386+0000","last_undegraded":"2024-09-19T08:38:06.515386+0000","last_fullsized":"2024-09-19T08:38:06.515386+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.532787+0000","last_change":"2024-09-19T08:38:06.525562+0000","last_active":"2024-09-19T08:38:06.532787+0000","last_peered":"2024-09-19T08:38:06.532787+0000","last_clean":"2024-09-19T08:38:06.532787+0000","last_became_active":"2024-09-19T08:38:06.524991+0000","last_became_peered":"2024-09-19T08:38:06.524991+0000","last_unstale":"2024-09-19T08:38:06.532787+0000","last_undegraded":"2024-09-19T08:38:06.532787+0000","last_fullsized":"2024-09-19T08:38:06.532787+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:51.219417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519077+0000","last_change":"2024-09-19T08:38:06.519077+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519077+0000","last_undegraded":"2024-09-19T08:38:06.519077+0000","last_fullsized":"2024-09-19T08:38:06.519077+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.534055+0000","last_change":"2024-09-19T08:38:06.531379+0000","last_active":"2024-09-19T08:38:06.534055+0000","last_peered":"2024-09-19T08:38:06.534055+0000","last_clean":"2024-09-19T08:38:06.534055+0000","last_became_active":"2024-09-19T08:38:06.530810+0000","last_became_peered":"2024-09-19T08:38:06.530810+0000","last_unstale":"2024-09-19T08:38:06.534055+0000","last_undegraded":"2024-09-19T08:38:06.534055+0000","last_fullsized":"2024-09-19T08:38:06.534055+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:38.604762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.514826+0000","last_change":"2024-09-19T08:38:06.514826+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.514826+0000","last_undegraded":"2024-09-19T08:38:06.514826+0000","last_fullsized":"2024-09-19T08:38:06.514826+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.527986+0000","last_change":"2024-09-19T08:38:06.525652+0000","last_active":"2024-09-19T08:38:06.527986+0000","last_peered":"2024-09-19T08:38:06.527986+0000","last_clean":"2024-09-19T08:38:06.527986+0000","last_became_active":"2024-09-19T08:38:06.525395+0000","last_became_peered":"2024-09-19T08:38:06.525395+0000","last_unstale":"2024-09-19T08:38:06.527986+0000","last_undegraded":"2024-09-19T08:38:06.527986+0000","last_fullsized":"2024-09-19T08:38:06.527986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:20.592921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521608+0000","last_change":"2024-09-19T08:38:06.521608+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521608+0000","last_undegraded":"2024-09-19T08:38:06.521608+0000","last_fullsized":"2024-09-19T08:38:06.521608+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.527796+0000","last_change":"2024-09-19T08:38:06.524138+0000","last_active":"2024-09-19T08:38:06.527796+0000","last_peered":"2024-09-19T08:38:06.527796+0000","last_clean":"2024-09-19T08:38:06.527796+0000","last_became_active":"2024-09-19T08:38:06.523848+0000","last_became_peered":"2024-09-19T08:38:06.523848+0000","last_unstale":"2024-09-19T08:38:06.527796+0000","last_undegraded":"2024-09-19T08:38:06.527796+0000","last_fullsized":"2024-09-19T08:38:06.527796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:01.499409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.514819+0000","last_change":"2024-09-19T08:38:06.514819+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.514819+0000","last_undegraded":"2024-09-19T08:38:06.514819+0000","last_fullsized":"2024-09-19T08:38:06.514819+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.535660+0000","last_change":"2024-09-19T08:38:06.530737+0000","last_active":"2024-09-19T08:38:06.535660+0000","last_peered":"2024-09-19T08:38:06.535660+0000","last_clean":"2024-09-19T08:38:06.535660+0000","last_became_active":"2024-09-19T08:38:06.530436+0000","last_became_peered":"2024-09-19T08:38:06.530436+0000","last_unstale":"2024-09-19T08:38:06.535660+0000","last_undegraded":"2024-09-19T08:38:06.535660+0000","last_fullsized":"2024-09-19T08:38:06.535660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:35.022819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523686+0000","last_change":"2024-09-19T08:38:06.523686+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523686+0000","last_undegraded":"2024-09-19T08:38:06.523686+0000","last_fullsized":"2024-09-19T08:38:06.523686+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.538175+0000","last_change":"2024-09-19T08:38:06.533437+0000","last_active":"2024-09-19T08:38:06.538175+0000","last_peered":"2024-09-19T08:38:06.538175+0000","last_clean":"2024-09-19T08:38:06.538175+0000","last_became_active":"2024-09-19T08:38:06.533139+0000","last_became_peered":"2024-09-19T08:38:06.533139+0000","last_unstale":"2024-09-19T08:38:06.538175+0000","last_undegraded":"2024-09-19T08:38:06.538175+0000","last_fullsized":"2024-09-19T08:38:06.538175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:34.263681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521411+0000","last_change":"2024-09-19T08:38:06.521411+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521411+0000","last_undegraded":"2024-09-19T08:38:06.521411+0000","last_fullsized":"2024-09-19T08:38:06.521411+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.526852+0000","last_change":"2024-09-19T08:38:06.523001+0000","last_active":"2024-09-19T08:38:06.526852+0000","last_peered":"2024-09-19T08:38:06.526852+0000","last_clean":"2024-09-19T08:38:06.526852+0000","last_became_active":"2024-09-19T08:38:06.522686+0000","last_became_peered":"2024-09-19T08:38:06.522686+0000","last_unstale":"2024-09-19T08:38:06.526852+0000","last_undegraded":"2024-09-19T08:38:06.526852+0000","last_fullsized":"2024-09-19T08:38:06.526852+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:36.343142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.532540+0000","last_change":"2024-09-19T08:38:06.529230+0000","last_active":"2024-09-19T08:38:06.532540+0000","last_peered":"2024-09-19T08:38:06.532540+0000","last_clean":"2024-09-19T08:38:06.532540+0000","last_became_active":"2024-09-19T08:38:06.528958+0000","last_became_peered":"2024-09-19T08:38:06.528958+0000","last_unstale":"2024-09-19T08:38:06.532540+0000","last_undegraded":"2024-09-19T08:38:06.532540+0000","last_fullsized":"2024-09-19T08:38:06.532540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:01.499409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523135+0000","last_change":"2024-09-19T08:38:06.523135+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523135+0000","last_undegraded":"2024-09-19T08:38:06.523135+0000","last_fullsized":"2024-09-19T08:38:06.523135+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.535293+0000","last_change":"2024-09-19T08:38:06.534098+0000","last_active":"2024-09-19T08:38:06.535293+0000","last_peered":"2024-09-19T08:38:06.535293+0000","last_clean":"2024-09-19T08:38:06.535293+0000","last_became_active":"2024-09-19T08:38:06.533792+0000","last_became_peered":"2024-09-19T08:38:06.533792+0000","last_unstale":"2024-09-19T08:38:06.535293+0000","last_undegraded":"2024-09-19T08:38:06.535293+0000","last_fullsized":"2024-09-19T08:38:06.535293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:17.394057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520696+0000","last_change":"2024-09-19T08:38:06.520696+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520696+0000","last_undegraded":"2024-09-19T08:38:06.520696+0000","last_fullsized":"2024-09-19T08:38:06.520696+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.528660+0000","last_change":"2024-09-19T08:38:06.527561+0000","last_active":"2024-09-19T08:38:06.528660+0000","last_peered":"2024-09-19T08:38:06.528660+0000","last_clean":"2024-09-19T08:38:06.528660+0000","last_became_active":"2024-09-19T08:38:06.527305+0000","last_became_peered":"2024-09-19T08:38:06.527305+0000","last_unstale":"2024-09-19T08:38:06.528660+0000","last_undegraded":"2024-09-19T08:38:06.528660+0000","last_fullsized":"2024-09-19T08:38:06.528660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:38:37.770723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521186+0000","last_change":"2024-09-19T08:38:06.521186+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521186+0000","last_undegraded":"2024-09-19T08:38:06.521186+0000","last_fullsized":"2024-09-19T08:38:06.521186+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T08:38:05.518506+0000","last_change":"2024-09-19T08:38:05.518506+0000","last_active":"2024-09-19T08:38:05.500429+0000","last_peered":"2024-09-19T08:38:05.500429+0000","last_clean":"2024-09-19T08:38:05.500429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:05.518506+0000","last_undegraded":"2024-09-19T08:38:05.518506+0000","last_fullsized":"2024-09-19T08:38:05.518506+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521112+0000","last_change":"2024-09-19T08:38:06.521112+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521112+0000","last_undegraded":"2024-09-19T08:38:06.521112+0000","last_fullsized":"2024-09-19T08:38:06.521112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.535356+0000","last_change":"2024-09-19T08:38:06.529491+0000","last_active":"2024-09-19T08:38:06.535356+0000","last_peered":"2024-09-19T08:38:06.535356+0000","last_clean":"2024-09-19T08:38:06.535356+0000","last_became_active":"2024-09-19T08:38:06.529160+0000","last_became_peered":"2024-09-19T08:38:06.529160+0000","last_unstale":"2024-09-19T08:38:06.535356+0000","last_undegraded":"2024-09-19T08:38:06.535356+0000","last_fullsized":"2024-09-19T08:38:06.535356+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:49.654020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520861+0000","last_change":"2024-09-19T08:38:06.520861+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520861+0000","last_undegraded":"2024-09-19T08:38:06.520861+0000","last_fullsized":"2024-09-19T08:38:06.520861+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.532652+0000","last_change":"2024-09-19T08:38:06.526582+0000","last_active":"2024-09-19T08:38:06.532652+0000","last_peered":"2024-09-19T08:38:06.532652+0000","last_clean":"2024-09-19T08:38:06.532652+0000","last_became_active":"2024-09-19T08:38:06.526290+0000","last_became_peered":"2024-09-19T08:38:06.526290+0000","last_unstale":"2024-09-19T08:38:06.532652+0000","last_undegraded":"2024-09-19T08:38:06.532652+0000","last_fullsized":"2024-09-19T08:38:06.532652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:44.073925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515014+0000","last_change":"2024-09-19T08:38:06.515014+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515014+0000","last_undegraded":"2024-09-19T08:38:06.515014+0000","last_fullsized":"2024-09-19T08:38:06.515014+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.538133+0000","last_change":"2024-09-19T08:38:06.531426+0000","last_active":"2024-09-19T08:38:06.538133+0000","last_peered":"2024-09-19T08:38:06.538133+0000","last_clean":"2024-09-19T08:38:06.538133+0000","last_became_active":"2024-09-19T08:38:06.531074+0000","last_became_peered":"2024-09-19T08:38:06.531074+0000","last_unstale":"2024-09-19T08:38:06.538133+0000","last_undegraded":"2024-09-19T08:38:06.538133+0000","last_fullsized":"2024-09-19T08:38:06.538133+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:06.375637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520413+0000","last_change":"2024-09-19T08:38:06.520413+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520413+0000","last_undegraded":"2024-09-19T08:38:06.520413+0000","last_fullsized":"2024-09-19T08:38:06.520413+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.534561+0000","last_change":"2024-09-19T08:38:06.533258+0000","last_active":"2024-09-19T08:38:06.534561+0000","last_peered":"2024-09-19T08:38:06.534561+0000","last_clean":"2024-09-19T08:38:06.534561+0000","last_became_active":"2024-09-19T08:38:06.533008+0000","last_became_peered":"2024-09-19T08:38:06.533008+0000","last_unstale":"2024-09-19T08:38:06.534561+0000","last_undegraded":"2024-09-19T08:38:06.534561+0000","last_fullsized":"2024-09-19T08:38:06.534561+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:04.672846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515726+0000","last_change":"2024-09-19T08:38:06.515726+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515726+0000","last_undegraded":"2024-09-19T08:38:06.515726+0000","last_fullsized":"2024-09-19T08:38:06.515726+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.538182+0000","last_change":"2024-09-19T08:38:06.533577+0000","last_active":"2024-09-19T08:38:06.538182+0000","last_peered":"2024-09-19T08:38:06.538182+0000","last_clean":"2024-09-19T08:38:06.538182+0000","last_became_active":"2024-09-19T08:38:06.533276+0000","last_became_peered":"2024-09-19T08:38:06.533276+0000","last_unstale":"2024-09-19T08:38:06.538182+0000","last_undegraded":"2024-09-19T08:38:06.538182+0000","last_fullsized":"2024-09-19T08:38:06.538182+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:22.876048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.534078+0000","last_change":"2024-09-19T08:38:06.532515+0000","last_active":"2024-09-19T08:38:06.534078+0000","last_peered":"2024-09-19T08:38:06.534078+0000","last_clean":"2024-09-19T08:38:06.534078+0000","last_became_active":"2024-09-19T08:38:06.532253+0000","last_became_peered":"2024-09-19T08:38:06.532253+0000","last_unstale":"2024-09-19T08:38:06.534078+0000","last_undegraded":"2024-09-19T08:38:06.534078+0000","last_fullsized":"2024-09-19T08:38:06.534078+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:54.746465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519972+0000","last_change":"2024-09-19T08:38:06.519972+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519972+0000","last_undegraded":"2024-09-19T08:38:06.519972+0000","last_fullsized":"2024-09-19T08:38:06.519972+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T08:38:05.516525+0000","last_change":"2024-09-19T08:38:05.516525+0000","last_active":"2024-09-19T08:38:05.500429+0000","last_peered":"2024-09-19T08:38:05.500429+0000","last_clean":"2024-09-19T08:38:05.500429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:05.516525+0000","last_undegraded":"2024-09-19T08:38:05.516525+0000","last_fullsized":"2024-09-19T08:38:05.516525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521088+0000","last_change":"2024-09-19T08:38:06.521088+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521088+0000","last_undegraded":"2024-09-19T08:38:06.521088+0000","last_fullsized":"2024-09-19T08:38:06.521088+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T08:38:05.516323+0000","last_change":"2024-09-19T08:38:05.516323+0000","last_active":"2024-09-19T08:38:05.500429+0000","last_peered":"2024-09-19T08:38:05.500429+0000","last_clean":"2024-09-19T08:38:05.500429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:05.516323+0000","last_undegraded":"2024-09-19T08:38:05.516323+0000","last_fullsized":"2024-09-19T08:38:05.516323+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.535645+0000","last_change":"2024-09-19T08:38:06.530799+0000","last_active":"2024-09-19T08:38:06.535645+0000","last_peered":"2024-09-19T08:38:06.535645+0000","last_clean":"2024-09-19T08:38:06.535645+0000","last_became_active":"2024-09-19T08:38:06.530484+0000","last_became_peered":"2024-09-19T08:38:06.530484+0000","last_unstale":"2024-09-19T08:38:06.535645+0000","last_undegraded":"2024-09-19T08:38:06.535645+0000","last_fullsized":"2024-09-19T08:38:06.535645+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:26.454464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522886+0000","last_change":"2024-09-19T08:38:06.522886+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522886+0000","last_undegraded":"2024-09-19T08:38:06.522886+0000","last_fullsized":"2024-09-19T08:38:06.522886+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.531801+0000","last_change":"2024-09-19T08:38:06.528224+0000","last_active":"2024-09-19T08:38:06.531801+0000","last_peered":"2024-09-19T08:38:06.531801+0000","last_clean":"2024-09-19T08:38:06.531801+0000","last_became_active":"2024-09-19T08:38:06.527744+0000","last_became_peered":"2024-09-19T08:38:06.527744+0000","last_unstale":"2024-09-19T08:38:06.531801+0000","last_undegraded":"2024-09-19T08:38:06.531801+0000","last_fullsized":"2024-09-19T08:38:06.531801+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:13.093311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523853+0000","last_change":"2024-09-19T08:38:06.523853+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523853+0000","last_undegraded":"2024-09-19T08:38:06.523853+0000","last_fullsized":"2024-09-19T08:38:06.523853+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.534560+0000","last_change":"2024-09-19T08:38:06.533024+0000","last_active":"2024-09-19T08:38:06.534560+0000","last_peered":"2024-09-19T08:38:06.534560+0000","last_clean":"2024-09-19T08:38:06.534560+0000","last_became_active":"2024-09-19T08:38:06.532728+0000","last_became_peered":"2024-09-19T08:38:06.532728+0000","last_unstale":"2024-09-19T08:38:06.534560+0000","last_undegraded":"2024-09-19T08:38:06.534560+0000","last_fullsized":"2024-09-19T08:38:06.534560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:59.807121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519499+0000","last_change":"2024-09-19T08:38:06.519499+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519499+0000","last_undegraded":"2024-09-19T08:38:06.519499+0000","last_fullsized":"2024-09-19T08:38:06.519499+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.532632+0000","last_change":"2024-09-19T08:38:06.525546+0000","last_active":"2024-09-19T08:38:06.532632+0000","last_peered":"2024-09-19T08:38:06.532632+0000","last_clean":"2024-09-19T08:38:06.532632+0000","last_became_active":"2024-09-19T08:38:06.525227+0000","last_became_peered":"2024-09-19T08:38:06.525227+0000","last_unstale":"2024-09-19T08:38:06.532632+0000","last_undegraded":"2024-09-19T08:38:06.532632+0000","last_fullsized":"2024-09-19T08:38:06.532632+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:13.093311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522539+0000","last_change":"2024-09-19T08:38:06.522539+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522539+0000","last_undegraded":"2024-09-19T08:38:06.522539+0000","last_fullsized":"2024-09-19T08:38:06.522539+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.530671+0000","last_change":"2024-09-19T08:38:06.526379+0000","last_active":"2024-09-19T08:38:06.530671+0000","last_peered":"2024-09-19T08:38:06.530671+0000","last_clean":"2024-09-19T08:38:06.530671+0000","last_became_active":"2024-09-19T08:38:06.525731+0000","last_became_peered":"2024-09-19T08:38:06.525731+0000","last_unstale":"2024-09-19T08:38:06.530671+0000","last_undegraded":"2024-09-19T08:38:06.530671+0000","last_fullsized":"2024-09-19T08:38:06.530671+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:07.229721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":198,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.519210+0000","last_change":"2024-09-19T08:37:04.479071+0000","last_active":"2024-09-19T08:38:06.519210+0000","last_peered":"2024-09-19T08:38:06.519210+0000","last_clean":"2024-09-19T08:38:06.519210+0000","last_became_active":"2024-09-19T08:37:04.478199+0000","last_became_peered":"2024-09-19T08:37:04.478199+0000","last_unstale":"2024-09-19T08:38:06.519210+0000","last_undegraded":"2024-09-19T08:38:06.519210+0000","last_fullsized":"2024-09-19T08:38:06.519210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_clean_scrub_stamp":"2024-09-19T08:37:02.519738+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:32.963748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1011712,"data_stored":764344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1024000,"data_stored":771011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:38:11.129 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3f is not active+clean 2024-09-19T08:38:11.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.515535+0000', 'last_change': '2024-09-19T08:38:06.515535+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.515535+0000', 'last_undegraded': '2024-09-19T08:38:06.515535+0000', 'last_fullsized': '2024-09-19T08:38:06.515535+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T08:38:11.130 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3e is not active+clean 2024-09-19T08:38:11.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.522972+0000', 'last_change': '2024-09-19T08:38:06.522972+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.522972+0000', 'last_undegraded': '2024-09-19T08:38:06.522972+0000', 'last_fullsized': '2024-09-19T08:38:06.522972+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T08:38:11.130 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3d is not active+clean 2024-09-19T08:38:11.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.515332+0000', 'last_change': '2024-09-19T08:38:06.515332+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.515332+0000', 'last_undegraded': '2024-09-19T08:38:06.515332+0000', 'last_fullsized': '2024-09-19T08:38:06.515332+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T08:38:11.130 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3c is not active+clean 2024-09-19T08:38:11.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.515942+0000', 'last_change': '2024-09-19T08:38:06.515942+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.515942+0000', 'last_undegraded': '2024-09-19T08:38:06.515942+0000', 'last_fullsized': '2024-09-19T08:38:06.515942+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T08:38:11.130 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3b is not active+clean 2024-09-19T08:38:11.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:06.505288+0000', 'last_change': '2024-09-19T08:38:06.505288+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.505288+0000', 'last_undegraded': '2024-09-19T08:38:06.505288+0000', 'last_fullsized': '2024-09-19T08:38:06.505288+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:11.130 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3a is not active+clean 2024-09-19T08:38:11.131 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.524194+0000', 'last_change': '2024-09-19T08:38:06.524194+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.524194+0000', 'last_undegraded': '2024-09-19T08:38:06.524194+0000', 'last_fullsized': '2024-09-19T08:38:06.524194+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T08:38:11.131 INFO:tasks.ceph.ceph_manager.ceph:PG 6.39 is not active+clean 2024-09-19T08:38:11.131 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.525385+0000', 'last_change': '2024-09-19T08:38:06.525385+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.525385+0000', 'last_undegraded': '2024-09-19T08:38:06.525385+0000', 'last_fullsized': '2024-09-19T08:38:06.525385+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T08:38:11.131 INFO:tasks.ceph.ceph_manager.ceph:PG 6.38 is not active+clean 2024-09-19T08:38:11.131 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.518025+0000', 'last_change': '2024-09-19T08:38:06.518025+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.518025+0000', 'last_undegraded': '2024-09-19T08:38:06.518025+0000', 'last_fullsized': '2024-09-19T08:38:06.518025+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T08:38:11.131 INFO:tasks.ceph.ceph_manager.ceph:PG 6.37 is not active+clean 2024-09-19T08:38:11.131 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:06.505288+0000', 'last_change': '2024-09-19T08:38:06.505288+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.505288+0000', 'last_undegraded': '2024-09-19T08:38:06.505288+0000', 'last_fullsized': '2024-09-19T08:38:06.505288+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:11.131 INFO:tasks.ceph.ceph_manager.ceph:PG 6.36 is not active+clean 2024-09-19T08:38:11.132 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.524657+0000', 'last_change': '2024-09-19T08:38:06.524657+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.524657+0000', 'last_undegraded': '2024-09-19T08:38:06.524657+0000', 'last_fullsized': '2024-09-19T08:38:06.524657+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T08:38:11.132 INFO:tasks.ceph.ceph_manager.ceph:PG 6.35 is not active+clean 2024-09-19T08:38:11.132 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.525829+0000', 'last_change': '2024-09-19T08:38:06.525829+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.525829+0000', 'last_undegraded': '2024-09-19T08:38:06.525829+0000', 'last_fullsized': '2024-09-19T08:38:06.525829+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T08:38:11.132 INFO:tasks.ceph.ceph_manager.ceph:PG 6.34 is not active+clean 2024-09-19T08:38:11.132 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:06.505288+0000', 'last_change': '2024-09-19T08:38:06.505288+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.505288+0000', 'last_undegraded': '2024-09-19T08:38:06.505288+0000', 'last_fullsized': '2024-09-19T08:38:06.505288+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:11.132 INFO:tasks.ceph.ceph_manager.ceph:PG 6.33 is not active+clean 2024-09-19T08:38:11.132 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.524230+0000', 'last_change': '2024-09-19T08:38:06.524230+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.524230+0000', 'last_undegraded': '2024-09-19T08:38:06.524230+0000', 'last_fullsized': '2024-09-19T08:38:06.524230+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T08:38:11.132 INFO:tasks.ceph.ceph_manager.ceph:PG 6.32 is not active+clean 2024-09-19T08:38:11.132 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.520291+0000', 'last_change': '2024-09-19T08:38:06.520291+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.520291+0000', 'last_undegraded': '2024-09-19T08:38:06.520291+0000', 'last_fullsized': '2024-09-19T08:38:06.520291+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T08:38:11.132 INFO:tasks.ceph.ceph_manager.ceph:PG 6.31 is not active+clean 2024-09-19T08:38:11.132 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.521463+0000', 'last_change': '2024-09-19T08:38:06.521463+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.521463+0000', 'last_undegraded': '2024-09-19T08:38:06.521463+0000', 'last_fullsized': '2024-09-19T08:38:06.521463+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T08:38:11.133 INFO:tasks.ceph.ceph_manager.ceph:PG 6.30 is not active+clean 2024-09-19T08:38:11.133 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.523791+0000', 'last_change': '2024-09-19T08:38:06.523791+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.523791+0000', 'last_undegraded': '2024-09-19T08:38:06.523791+0000', 'last_fullsized': '2024-09-19T08:38:06.523791+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T08:38:11.133 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2f is not active+clean 2024-09-19T08:38:11.133 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.522950+0000', 'last_change': '2024-09-19T08:38:06.522950+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.522950+0000', 'last_undegraded': '2024-09-19T08:38:06.522950+0000', 'last_fullsized': '2024-09-19T08:38:06.522950+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T08:38:11.133 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2e is not active+clean 2024-09-19T08:38:11.133 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.521265+0000', 'last_change': '2024-09-19T08:38:06.521265+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.521265+0000', 'last_undegraded': '2024-09-19T08:38:06.521265+0000', 'last_fullsized': '2024-09-19T08:38:06.521265+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T08:38:11.133 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2d is not active+clean 2024-09-19T08:38:11.133 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.519596+0000', 'last_change': '2024-09-19T08:38:06.519596+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.519596+0000', 'last_undegraded': '2024-09-19T08:38:06.519596+0000', 'last_fullsized': '2024-09-19T08:38:06.519596+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T08:38:11.134 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2c is not active+clean 2024-09-19T08:38:11.134 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.526134+0000', 'last_change': '2024-09-19T08:38:06.526134+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.526134+0000', 'last_undegraded': '2024-09-19T08:38:06.526134+0000', 'last_fullsized': '2024-09-19T08:38:06.526134+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T08:38:11.134 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2b is not active+clean 2024-09-19T08:38:11.134 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.524748+0000', 'last_change': '2024-09-19T08:38:06.524748+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.524748+0000', 'last_undegraded': '2024-09-19T08:38:06.524748+0000', 'last_fullsized': '2024-09-19T08:38:06.524748+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T08:38:11.134 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2a is not active+clean 2024-09-19T08:38:11.134 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.523613+0000', 'last_change': '2024-09-19T08:38:06.523613+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.523613+0000', 'last_undegraded': '2024-09-19T08:38:06.523613+0000', 'last_fullsized': '2024-09-19T08:38:06.523613+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T08:38:11.134 INFO:tasks.ceph.ceph_manager.ceph:PG 6.29 is not active+clean 2024-09-19T08:38:11.134 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.520740+0000', 'last_change': '2024-09-19T08:38:06.520740+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.520740+0000', 'last_undegraded': '2024-09-19T08:38:06.520740+0000', 'last_fullsized': '2024-09-19T08:38:06.520740+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T08:38:11.134 INFO:tasks.ceph.ceph_manager.ceph:PG 6.28 is not active+clean 2024-09-19T08:38:11.134 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.517564+0000', 'last_change': '2024-09-19T08:38:06.517564+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.517564+0000', 'last_undegraded': '2024-09-19T08:38:06.517564+0000', 'last_fullsized': '2024-09-19T08:38:06.517564+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T08:38:11.134 INFO:tasks.ceph.ceph_manager.ceph:PG 6.27 is not active+clean 2024-09-19T08:38:11.135 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.519809+0000', 'last_change': '2024-09-19T08:38:06.519809+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.519809+0000', 'last_undegraded': '2024-09-19T08:38:06.519809+0000', 'last_fullsized': '2024-09-19T08:38:06.519809+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T08:38:11.135 INFO:tasks.ceph.ceph_manager.ceph:PG 6.26 is not active+clean 2024-09-19T08:38:11.135 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.516283+0000', 'last_change': '2024-09-19T08:38:06.516283+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.516283+0000', 'last_undegraded': '2024-09-19T08:38:06.516283+0000', 'last_fullsized': '2024-09-19T08:38:06.516283+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T08:38:11.135 INFO:tasks.ceph.ceph_manager.ceph:PG 6.25 is not active+clean 2024-09-19T08:38:11.135 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.524056+0000', 'last_change': '2024-09-19T08:38:06.524056+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.524056+0000', 'last_undegraded': '2024-09-19T08:38:06.524056+0000', 'last_fullsized': '2024-09-19T08:38:06.524056+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T08:38:11.135 INFO:tasks.ceph.ceph_manager.ceph:PG 6.24 is not active+clean 2024-09-19T08:38:11.135 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.524230+0000', 'last_change': '2024-09-19T08:38:06.524230+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.524230+0000', 'last_undegraded': '2024-09-19T08:38:06.524230+0000', 'last_fullsized': '2024-09-19T08:38:06.524230+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T08:38:11.135 INFO:tasks.ceph.ceph_manager.ceph:PG 6.23 is not active+clean 2024-09-19T08:38:11.135 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.520284+0000', 'last_change': '2024-09-19T08:38:06.520284+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.520284+0000', 'last_undegraded': '2024-09-19T08:38:06.520284+0000', 'last_fullsized': '2024-09-19T08:38:06.520284+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T08:38:11.136 INFO:tasks.ceph.ceph_manager.ceph:PG 6.22 is not active+clean 2024-09-19T08:38:11.136 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.524644+0000', 'last_change': '2024-09-19T08:38:06.524644+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.524644+0000', 'last_undegraded': '2024-09-19T08:38:06.524644+0000', 'last_fullsized': '2024-09-19T08:38:06.524644+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T08:38:11.137 INFO:tasks.ceph.ceph_manager.ceph:PG 6.21 is not active+clean 2024-09-19T08:38:11.137 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.522221+0000', 'last_change': '2024-09-19T08:38:06.522221+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.522221+0000', 'last_undegraded': '2024-09-19T08:38:06.522221+0000', 'last_fullsized': '2024-09-19T08:38:06.522221+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T08:38:11.137 INFO:tasks.ceph.ceph_manager.ceph:PG 6.20 is not active+clean 2024-09-19T08:38:11.137 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.517123+0000', 'last_change': '2024-09-19T08:38:06.517123+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.517123+0000', 'last_undegraded': '2024-09-19T08:38:06.517123+0000', 'last_fullsized': '2024-09-19T08:38:06.517123+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T08:38:11.137 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1c is not active+clean 2024-09-19T08:38:11.137 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.519849+0000', 'last_change': '2024-09-19T08:38:06.519849+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.519849+0000', 'last_undegraded': '2024-09-19T08:38:06.519849+0000', 'last_fullsized': '2024-09-19T08:38:06.519849+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T08:38:11.137 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1d is not active+clean 2024-09-19T08:38:11.137 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.523934+0000', 'last_change': '2024-09-19T08:38:06.523934+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.523934+0000', 'last_undegraded': '2024-09-19T08:38:06.523934+0000', 'last_fullsized': '2024-09-19T08:38:06.523934+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T08:38:11.138 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1e is not active+clean 2024-09-19T08:38:11.138 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.519761+0000', 'last_change': '2024-09-19T08:38:06.519761+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.519761+0000', 'last_undegraded': '2024-09-19T08:38:06.519761+0000', 'last_fullsized': '2024-09-19T08:38:06.519761+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T08:38:11.138 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1f is not active+clean 2024-09-19T08:38:11.138 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.522054+0000', 'last_change': '2024-09-19T08:38:06.522054+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.522054+0000', 'last_undegraded': '2024-09-19T08:38:06.522054+0000', 'last_fullsized': '2024-09-19T08:38:06.522054+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T08:38:11.139 INFO:tasks.ceph.ceph_manager.ceph:PG 6.18 is not active+clean 2024-09-19T08:38:11.139 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.516654+0000', 'last_change': '2024-09-19T08:38:06.516654+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.516654+0000', 'last_undegraded': '2024-09-19T08:38:06.516654+0000', 'last_fullsized': '2024-09-19T08:38:06.516654+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T08:38:11.139 INFO:tasks.ceph.ceph_manager.ceph:PG 6.19 is not active+clean 2024-09-19T08:38:11.139 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.523086+0000', 'last_change': '2024-09-19T08:38:06.523086+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.523086+0000', 'last_undegraded': '2024-09-19T08:38:06.523086+0000', 'last_fullsized': '2024-09-19T08:38:06.523086+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T08:38:11.140 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1a is not active+clean 2024-09-19T08:38:11.140 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.524245+0000', 'last_change': '2024-09-19T08:38:06.524245+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.524245+0000', 'last_undegraded': '2024-09-19T08:38:06.524245+0000', 'last_fullsized': '2024-09-19T08:38:06.524245+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T08:38:11.140 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1b is not active+clean 2024-09-19T08:38:11.140 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.524208+0000', 'last_change': '2024-09-19T08:38:06.524208+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.524208+0000', 'last_undegraded': '2024-09-19T08:38:06.524208+0000', 'last_fullsized': '2024-09-19T08:38:06.524208+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T08:38:11.141 INFO:tasks.ceph.ceph_manager.ceph:PG 6.14 is not active+clean 2024-09-19T08:38:11.141 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.515386+0000', 'last_change': '2024-09-19T08:38:06.515386+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.515386+0000', 'last_undegraded': '2024-09-19T08:38:06.515386+0000', 'last_fullsized': '2024-09-19T08:38:06.515386+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T08:38:11.141 INFO:tasks.ceph.ceph_manager.ceph:PG 6.15 is not active+clean 2024-09-19T08:38:11.141 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.519077+0000', 'last_change': '2024-09-19T08:38:06.519077+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.519077+0000', 'last_undegraded': '2024-09-19T08:38:06.519077+0000', 'last_fullsized': '2024-09-19T08:38:06.519077+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T08:38:11.141 INFO:tasks.ceph.ceph_manager.ceph:PG 6.16 is not active+clean 2024-09-19T08:38:11.141 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.514826+0000', 'last_change': '2024-09-19T08:38:06.514826+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.514826+0000', 'last_undegraded': '2024-09-19T08:38:06.514826+0000', 'last_fullsized': '2024-09-19T08:38:06.514826+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T08:38:11.142 INFO:tasks.ceph.ceph_manager.ceph:PG 6.17 is not active+clean 2024-09-19T08:38:11.142 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.521608+0000', 'last_change': '2024-09-19T08:38:06.521608+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.521608+0000', 'last_undegraded': '2024-09-19T08:38:06.521608+0000', 'last_fullsized': '2024-09-19T08:38:06.521608+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T08:38:11.142 INFO:tasks.ceph.ceph_manager.ceph:PG 6.10 is not active+clean 2024-09-19T08:38:11.142 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.514819+0000', 'last_change': '2024-09-19T08:38:06.514819+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.514819+0000', 'last_undegraded': '2024-09-19T08:38:06.514819+0000', 'last_fullsized': '2024-09-19T08:38:06.514819+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T08:38:11.143 INFO:tasks.ceph.ceph_manager.ceph:PG 6.11 is not active+clean 2024-09-19T08:38:11.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.523686+0000', 'last_change': '2024-09-19T08:38:06.523686+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.523686+0000', 'last_undegraded': '2024-09-19T08:38:06.523686+0000', 'last_fullsized': '2024-09-19T08:38:06.523686+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T08:38:11.143 INFO:tasks.ceph.ceph_manager.ceph:PG 6.12 is not active+clean 2024-09-19T08:38:11.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.521411+0000', 'last_change': '2024-09-19T08:38:06.521411+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.521411+0000', 'last_undegraded': '2024-09-19T08:38:06.521411+0000', 'last_fullsized': '2024-09-19T08:38:06.521411+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T08:38:11.143 INFO:tasks.ceph.ceph_manager.ceph:PG 6.13 is not active+clean 2024-09-19T08:38:11.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:06.505288+0000', 'last_change': '2024-09-19T08:38:06.505288+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.505288+0000', 'last_undegraded': '2024-09-19T08:38:06.505288+0000', 'last_fullsized': '2024-09-19T08:38:06.505288+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:11.144 INFO:tasks.ceph.ceph_manager.ceph:PG 6.c is not active+clean 2024-09-19T08:38:11.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.523135+0000', 'last_change': '2024-09-19T08:38:06.523135+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.523135+0000', 'last_undegraded': '2024-09-19T08:38:06.523135+0000', 'last_fullsized': '2024-09-19T08:38:06.523135+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T08:38:11.144 INFO:tasks.ceph.ceph_manager.ceph:PG 6.d is not active+clean 2024-09-19T08:38:11.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.520696+0000', 'last_change': '2024-09-19T08:38:06.520696+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.520696+0000', 'last_undegraded': '2024-09-19T08:38:06.520696+0000', 'last_fullsized': '2024-09-19T08:38:06.520696+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T08:38:11.145 INFO:tasks.ceph.ceph_manager.ceph:PG 6.e is not active+clean 2024-09-19T08:38:11.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.521186+0000', 'last_change': '2024-09-19T08:38:06.521186+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.521186+0000', 'last_undegraded': '2024-09-19T08:38:06.521186+0000', 'last_fullsized': '2024-09-19T08:38:06.521186+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T08:38:11.145 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-09-19T08:38:11.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:05.518506+0000', 'last_change': '2024-09-19T08:38:05.518506+0000', 'last_active': '2024-09-19T08:38:05.500429+0000', 'last_peered': '2024-09-19T08:38:05.500429+0000', 'last_clean': '2024-09-19T08:38:05.500429+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:05.518506+0000', 'last_undegraded': '2024-09-19T08:38:05.518506+0000', 'last_fullsized': '2024-09-19T08:38:05.518506+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:05.500429+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:05.500429+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:05.500429+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T08:38:11.146 INFO:tasks.ceph.ceph_manager.ceph:PG 6.f is not active+clean 2024-09-19T08:38:11.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.521112+0000', 'last_change': '2024-09-19T08:38:06.521112+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.521112+0000', 'last_undegraded': '2024-09-19T08:38:06.521112+0000', 'last_fullsized': '2024-09-19T08:38:06.521112+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T08:38:11.146 INFO:tasks.ceph.ceph_manager.ceph:PG 6.8 is not active+clean 2024-09-19T08:38:11.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.520861+0000', 'last_change': '2024-09-19T08:38:06.520861+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.520861+0000', 'last_undegraded': '2024-09-19T08:38:06.520861+0000', 'last_fullsized': '2024-09-19T08:38:06.520861+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T08:38:11.146 INFO:tasks.ceph.ceph_manager.ceph:PG 6.9 is not active+clean 2024-09-19T08:38:11.147 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.515014+0000', 'last_change': '2024-09-19T08:38:06.515014+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.515014+0000', 'last_undegraded': '2024-09-19T08:38:06.515014+0000', 'last_fullsized': '2024-09-19T08:38:06.515014+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T08:38:11.147 INFO:tasks.ceph.ceph_manager.ceph:PG 6.a is not active+clean 2024-09-19T08:38:11.147 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.520413+0000', 'last_change': '2024-09-19T08:38:06.520413+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.520413+0000', 'last_undegraded': '2024-09-19T08:38:06.520413+0000', 'last_fullsized': '2024-09-19T08:38:06.520413+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T08:38:11.147 INFO:tasks.ceph.ceph_manager.ceph:PG 6.b is not active+clean 2024-09-19T08:38:11.147 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.515726+0000', 'last_change': '2024-09-19T08:38:06.515726+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.515726+0000', 'last_undegraded': '2024-09-19T08:38:06.515726+0000', 'last_fullsized': '2024-09-19T08:38:06.515726+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T08:38:11.148 INFO:tasks.ceph.ceph_manager.ceph:PG 6.4 is not active+clean 2024-09-19T08:38:11.148 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:06.505288+0000', 'last_change': '2024-09-19T08:38:06.505288+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.505288+0000', 'last_undegraded': '2024-09-19T08:38:06.505288+0000', 'last_fullsized': '2024-09-19T08:38:06.505288+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:11.148 INFO:tasks.ceph.ceph_manager.ceph:PG 6.5 is not active+clean 2024-09-19T08:38:11.148 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.519972+0000', 'last_change': '2024-09-19T08:38:06.519972+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.519972+0000', 'last_undegraded': '2024-09-19T08:38:06.519972+0000', 'last_fullsized': '2024-09-19T08:38:06.519972+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T08:38:11.149 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-09-19T08:38:11.149 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:05.516525+0000', 'last_change': '2024-09-19T08:38:05.516525+0000', 'last_active': '2024-09-19T08:38:05.500429+0000', 'last_peered': '2024-09-19T08:38:05.500429+0000', 'last_clean': '2024-09-19T08:38:05.500429+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:05.516525+0000', 'last_undegraded': '2024-09-19T08:38:05.516525+0000', 'last_fullsized': '2024-09-19T08:38:05.516525+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:05.500429+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:05.500429+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:05.500429+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T08:38:11.149 INFO:tasks.ceph.ceph_manager.ceph:PG 6.6 is not active+clean 2024-09-19T08:38:11.149 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.521088+0000', 'last_change': '2024-09-19T08:38:06.521088+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.521088+0000', 'last_undegraded': '2024-09-19T08:38:06.521088+0000', 'last_fullsized': '2024-09-19T08:38:06.521088+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T08:38:11.149 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-09-19T08:38:11.150 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:05.516323+0000', 'last_change': '2024-09-19T08:38:05.516323+0000', 'last_active': '2024-09-19T08:38:05.500429+0000', 'last_peered': '2024-09-19T08:38:05.500429+0000', 'last_clean': '2024-09-19T08:38:05.500429+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:05.516323+0000', 'last_undegraded': '2024-09-19T08:38:05.516323+0000', 'last_fullsized': '2024-09-19T08:38:05.516323+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:05.500429+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:05.500429+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:05.500429+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T08:38:11.150 INFO:tasks.ceph.ceph_manager.ceph:PG 6.0 is not active+clean 2024-09-19T08:38:11.150 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:06.505288+0000', 'last_change': '2024-09-19T08:38:06.505288+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.505288+0000', 'last_undegraded': '2024-09-19T08:38:06.505288+0000', 'last_fullsized': '2024-09-19T08:38:06.505288+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:11.150 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1 is not active+clean 2024-09-19T08:38:11.150 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.522886+0000', 'last_change': '2024-09-19T08:38:06.522886+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.522886+0000', 'last_undegraded': '2024-09-19T08:38:06.522886+0000', 'last_fullsized': '2024-09-19T08:38:06.522886+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T08:38:11.151 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2 is not active+clean 2024-09-19T08:38:11.151 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.523853+0000', 'last_change': '2024-09-19T08:38:06.523853+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.523853+0000', 'last_undegraded': '2024-09-19T08:38:06.523853+0000', 'last_fullsized': '2024-09-19T08:38:06.523853+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T08:38:11.151 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3 is not active+clean 2024-09-19T08:38:11.151 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.519499+0000', 'last_change': '2024-09-19T08:38:06.519499+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.519499+0000', 'last_undegraded': '2024-09-19T08:38:06.519499+0000', 'last_fullsized': '2024-09-19T08:38:06.519499+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T08:38:11.152 INFO:tasks.ceph.ceph_manager.ceph:PG 6.7 is not active+clean 2024-09-19T08:38:11.152 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 38, 'state': 'creating+peering', 'last_fresh': '2024-09-19T08:38:06.522539+0000', 'last_change': '2024-09-19T08:38:06.522539+0000', 'last_active': '2024-09-19T08:38:06.505288+0000', 'last_peered': '2024-09-19T08:38:06.505288+0000', 'last_clean': '2024-09-19T08:38:06.505288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:06.522539+0000', 'last_undegraded': '2024-09-19T08:38:06.522539+0000', 'last_fullsized': '2024-09-19T08:38:06.522539+0000', 'mapping_epoch': 38, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:06.505288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T08:38:11.153 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T08:38:11.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.264+0000 7f08eb35f640 1 Processor -- start 2024-09-19T08:38:11.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.264+0000 7f08eb35f640 1 -- start start 2024-09-19T08:38:11.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.265+0000 7f08eb35f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08e415bee0 0x7f08e40d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:11.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.265+0000 7f08eb35f640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f08e40cf910 0x7f08e40d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:11.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.265+0000 7f08eb35f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08e40cdee0 con 0x7f08e415c2c0 2024-09-19T08:38:11.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.265+0000 7f08eb35f640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f08e40ceaf0 con 0x7f08e40cf910 2024-09-19T08:38:11.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.265+0000 7f08eb35f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f08e40ce1c0 con 0x7f08e415bee0 2024-09-19T08:38:11.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.266+0000 7f08e88fa640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f08e415c2c0 0x7f08e40cf200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:37548/0 (socket says 172.21.15.117:37548) 2024-09-19T08:38:11.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.266+0000 7f08e88fa640 1 -- 172.21.15.117:0/184710938 learned_addr learned my addr 172.21.15.117:0/184710938 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:11.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.266+0000 7f08e90fb640 1 --2- 172.21.15.117:0/184710938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08e415bee0 0x7f08e40d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:11.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.266+0000 7f08e98fc640 1 --2- 172.21.15.117:0/184710938 >> v2:172.21.15.146:3300/0 conn(0x7f08e40cf910 0x7f08e40d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:11.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.266+0000 7f08dbfff640 1 -- 172.21.15.117:0/184710938 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2192587673 0 0) 0x7f08e40cdee0 con 0x7f08e415c2c0 2024-09-19T08:38:11.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.266+0000 7f08dbfff640 1 -- 172.21.15.117:0/184710938 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08d0003520 con 0x7f08e415c2c0 2024-09-19T08:38:11.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.266+0000 7f08e98fc640 1 -- 172.21.15.117:0/184710938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08e415bee0 msgr2=0x7f08e40d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:11.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.266+0000 7f08e98fc640 1 --2- 172.21.15.117:0/184710938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08e415bee0 0x7f08e40d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:11.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.266+0000 7f08e98fc640 1 -- 172.21.15.117:0/184710938 >> v1:172.21.15.117:6789/0 conn(0x7f08e415c2c0 legacy=0x7f08e40cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:11.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.266+0000 7f08e98fc640 1 -- 172.21.15.117:0/184710938 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e40ce4a0 con 0x7f08e40cf910 2024-09-19T08:38:11.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.267+0000 7f08e98fc640 1 --2- 172.21.15.117:0/184710938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08e40cf910 0x7f08e40d09f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009d90 tx=0x7f08dc02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48bfa72b99f2e64b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:11.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.267+0000 7f08dbfff640 1 -- 172.21.15.117:0/184710938 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc007740 con 0x7f08e40cf910 2024-09-19T08:38:11.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.267+0000 7f08dbfff640 1 -- 172.21.15.117:0/184710938 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08dc0078e0 con 0x7f08e40cf910 2024-09-19T08:38:11.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.267+0000 7f08dbfff640 1 -- 172.21.15.117:0/184710938 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc007c90 con 0x7f08e40cf910 2024-09-19T08:38:11.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.268+0000 7f08eb35f640 1 -- 172.21.15.117:0/184710938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08e40cf910 msgr2=0x7f08e40d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:11.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.268+0000 7f08eb35f640 1 --2- 172.21.15.117:0/184710938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08e40cf910 0x7f08e40d09f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009d90 tx=0x7f08dc02a660 comp rx=0 tx=0).stop 2024-09-19T08:38:11.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.268+0000 7f08eb35f640 1 -- 172.21.15.117:0/184710938 shutdown_connections 2024-09-19T08:38:11.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.268+0000 7f08eb35f640 1 --2- 172.21.15.117:0/184710938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08e40cf910 0x7f08e40d09f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:11.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.268+0000 7f08eb35f640 1 --2- 172.21.15.117:0/184710938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08e415bee0 0x7f08e40d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:11.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.268+0000 7f08eb35f640 1 -- 172.21.15.117:0/184710938 >> 172.21.15.117:0/184710938 conn(0x7f08e406bdf0 msgr2=0x7f08e406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:11.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.268+0000 7f08eb35f640 1 -- 172.21.15.117:0/184710938 shutdown_connections 2024-09-19T08:38:11.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.268+0000 7f08eb35f640 1 -- 172.21.15.117:0/184710938 wait complete. 2024-09-19T08:38:11.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.269+0000 7f08eb35f640 1 Processor -- start 2024-09-19T08:38:11.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.269+0000 7f08eb35f640 1 -- start start 2024-09-19T08:38:11.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.270+0000 7f08eb35f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08e40cf910 0x7f08e415e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:11.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.270+0000 7f08eb35f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e415bee0 0x7f08e4153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:11.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.270+0000 7f08eb35f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08e415c2c0 0x7f08e40ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:11.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.270+0000 7f08eb35f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f08e406e040 con 0x7f08e415bee0 2024-09-19T08:38:11.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.270+0000 7f08eb35f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f08e406dec0 con 0x7f08e40cf910 2024-09-19T08:38:11.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.270+0000 7f08eb35f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f08e406e1c0 con 0x7f08e415c2c0 2024-09-19T08:38:11.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.270+0000 7f08e88fa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e415bee0 0x7f08e4153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:11.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.270+0000 7f08e88fa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e415bee0 0x7f08e4153930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47230/0 (socket says 172.21.15.117:47230) 2024-09-19T08:38:11.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.270+0000 7f08e88fa640 1 -- 172.21.15.117:0/1700720364 learned_addr learned my addr 172.21.15.117:0/1700720364 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:11.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.270+0000 7f08e90fb640 1 --2- 172.21.15.117:0/1700720364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08e40cf910 0x7f08e415e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:11.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.270+0000 7f08e98fc640 1 --2- 172.21.15.117:0/1700720364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08e415c2c0 0x7f08e40ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:11.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.270+0000 7f08e88fa640 1 -- 172.21.15.117:0/1700720364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08e415c2c0 msgr2=0x7f08e40ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:11.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.270+0000 7f08e88fa640 1 --2- 172.21.15.117:0/1700720364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08e415c2c0 0x7f08e40ae6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:11.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.270+0000 7f08e88fa640 1 -- 172.21.15.117:0/1700720364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08e40cf910 msgr2=0x7f08e415e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:11.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.270+0000 7f08e88fa640 1 --2- 172.21.15.117:0/1700720364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08e40cf910 0x7f08e415e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:11.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.270+0000 7f08e88fa640 1 -- 172.21.15.117:0/1700720364 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e40af390 con 0x7f08e415bee0 2024-09-19T08:38:11.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.270+0000 7f08e88fa640 1 --2- 172.21.15.117:0/1700720364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e415bee0 0x7f08e4153930 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f08d400c400 tx=0x7f08d400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:11.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.271+0000 7f08d9ffb640 1 -- 172.21.15.117:0/1700720364 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d4017070 con 0x7f08e415bee0 2024-09-19T08:38:11.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.271+0000 7f08d9ffb640 1 -- 172.21.15.117:0/1700720364 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d4005d00 con 0x7f08e415bee0 2024-09-19T08:38:11.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.271+0000 7f08eb35f640 1 -- 172.21.15.117:0/1700720364 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08e415ecf0 con 0x7f08e415bee0 2024-09-19T08:38:11.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.271+0000 7f08d9ffb640 1 -- 172.21.15.117:0/1700720364 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d4007310 con 0x7f08e415bee0 2024-09-19T08:38:11.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.271+0000 7f08eb35f640 1 -- 172.21.15.117:0/1700720364 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08e40cbb10 con 0x7f08e415bee0 2024-09-19T08:38:11.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.272+0000 7f08eb35f640 1 -- 172.21.15.117:0/1700720364 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08e40cf200 con 0x7f08e415bee0 2024-09-19T08:38:11.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.272+0000 7f08d9ffb640 1 -- 172.21.15.117:0/1700720364 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f08d401a070 con 0x7f08e415bee0 2024-09-19T08:38:11.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.273+0000 7f08d9ffb640 1 --2- 172.21.15.117:0/1700720364 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f08c806c2e0 0x7f08c806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:11.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.273+0000 7f08d9ffb640 1 -- 172.21.15.117:0/1700720364 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f08d408aa10 con 0x7f08e415bee0 2024-09-19T08:38:11.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.273+0000 7f08e90fb640 1 --2- 172.21.15.117:0/1700720364 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f08c806c2e0 0x7f08c806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:11.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.273+0000 7f08e90fb640 1 --2- 172.21.15.117:0/1700720364 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f08c806c2e0 0x7f08c806e7a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009a10 tx=0x7f08e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:11.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.277+0000 7f08d9ffb640 1 -- 172.21.15.117:0/1700720364 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f08d4059000 con 0x7f08e415bee0 2024-09-19T08:38:11.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.516+0000 7f08eb35f640 1 -- 172.21.15.117:0/1700720364 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f08e415af10 con 0x7f08e415bee0 2024-09-19T08:38:11.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.516+0000 7f08d9ffb640 1 -- 172.21.15.117:0/1700720364 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1699 (secure 0 0 0) 0x7f08d4058900 con 0x7f08e415bee0 2024-09-19T08:38:11.518 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:11.518 INFO:teuthology.orchestra.run.smithi117.stdout:{"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":81,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":40,"num_osds":8,"num_up_osds":8,"osd_up_since":1726735021,"num_in_osds":8,"osd_in_since":1726735011,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":61},{"state_name":"active+clean","count":30},{"state_name":"unknown","count":6}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225959936,"bytes_avail":772868153344,"bytes_total":773094113280,"unknown_pgs_ratio":0.061855670064687729,"inactive_pgs_ratio":0.62886595726013184},"fsmap":{"epoch":16,"btime":"2024-09-19T08:38:09:528263+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":4926}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-19T08:38:03.858911+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T08:38:11.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.519+0000 7f08eb35f640 1 -- 172.21.15.117:0/1700720364 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f08c806c2e0 msgr2=0x7f08c806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:11.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.519+0000 7f08eb35f640 1 --2- 172.21.15.117:0/1700720364 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f08c806c2e0 0x7f08c806e7a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009a10 tx=0x7f08e0008040 comp rx=0 tx=0).stop 2024-09-19T08:38:11.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.519+0000 7f08eb35f640 1 -- 172.21.15.117:0/1700720364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e415bee0 msgr2=0x7f08e4153930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:11.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.519+0000 7f08eb35f640 1 --2- 172.21.15.117:0/1700720364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e415bee0 0x7f08e4153930 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f08d400c400 tx=0x7f08d400c8c0 comp rx=0 tx=0).stop 2024-09-19T08:38:11.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.519+0000 7f08eb35f640 1 -- 172.21.15.117:0/1700720364 shutdown_connections 2024-09-19T08:38:11.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.519+0000 7f08eb35f640 1 --2- 172.21.15.117:0/1700720364 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f08c806c2e0 0x7f08c806e7a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:11.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.519+0000 7f08eb35f640 1 --2- 172.21.15.117:0/1700720364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08e415c2c0 0x7f08e40ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:11.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.519+0000 7f08eb35f640 1 --2- 172.21.15.117:0/1700720364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e415bee0 0x7f08e4153930 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:11.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.519+0000 7f08eb35f640 1 --2- 172.21.15.117:0/1700720364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08e40cf910 0x7f08e415e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:11.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.519+0000 7f08eb35f640 1 -- 172.21.15.117:0/1700720364 >> 172.21.15.117:0/1700720364 conn(0x7f08e406bdf0 msgr2=0x7f08e40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:11.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.519+0000 7f08eb35f640 1 -- 172.21.15.117:0/1700720364 shutdown_connections 2024-09-19T08:38:11.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.519+0000 7f08eb35f640 1 -- 172.21.15.117:0/1700720364 wait complete. 2024-09-19T08:38:11.531 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-19T08:38:11.531 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:38:11.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.631+0000 7fdedc7c0640 1 Processor -- start 2024-09-19T08:38:11.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.631+0000 7fdedc7c0640 1 -- start start 2024-09-19T08:38:11.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.632+0000 7fdedc7c0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fded40d1ca0 0x7fded40cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:11.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.632+0000 7fdedc7c0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fded40d06d0 con 0x7fded40d02f0 2024-09-19T08:38:11.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.632+0000 7fdedc7c0640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fded40d22d0 con 0x7fded415cb00 2024-09-19T08:38:11.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.632+0000 7fdedc7c0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fded40b40b0 con 0x7fded40d1ca0 2024-09-19T08:38:11.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.632+0000 7fded9d5b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fded40d1ca0 0x7fded40cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:11.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.632+0000 7fdedad5d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fded40d02f0 0x7fded41562c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:37560/0 (socket says 172.21.15.117:37560) 2024-09-19T08:38:11.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.632+0000 7fded9d5b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fded40d1ca0 0x7fded40cfdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47238/0 (socket says 172.21.15.117:47238) 2024-09-19T08:38:11.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.632+0000 7fdedad5d640 1 -- 172.21.15.117:0/2621676979 learned_addr learned my addr 172.21.15.117:0/2621676979 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:11.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.633+0000 7fded9d5b640 1 -- 172.21.15.117:0/2621676979 >> v1:172.21.15.146:6789/0 conn(0x7fded415cb00 legacy=0x7fded415cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:11.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.633+0000 7fded9d5b640 1 -- 172.21.15.117:0/2621676979 >> v1:172.21.15.117:6789/0 conn(0x7fded40d02f0 legacy=0x7fded41562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:11.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.633+0000 7fded9d5b640 1 -- 172.21.15.117:0/2621676979 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded40d25b0 con 0x7fded40d1ca0 2024-09-19T08:38:11.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.633+0000 7fded955a640 1 -- 172.21.15.117:0/2621676979 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1986245651 0 0) 0x7fded40d06d0 con 0x7fded40d02f0 2024-09-19T08:38:11.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.633+0000 7fded9d5b640 1 --2- 172.21.15.117:0/2621676979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fded40d1ca0 0x7fded40cfdb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdec8009d90 tx=0x7fdec802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98cd4fee3b428eb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:11.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.634+0000 7fded955a640 1 -- 172.21.15.117:0/2621676979 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec8007740 con 0x7fded40d1ca0 2024-09-19T08:38:11.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.634+0000 7fded955a640 1 -- 172.21.15.117:0/2621676979 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec80078e0 con 0x7fded40d1ca0 2024-09-19T08:38:11.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.634+0000 7fded955a640 1 -- 172.21.15.117:0/2621676979 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec8007cb0 con 0x7fded40d1ca0 2024-09-19T08:38:11.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.634+0000 7fdedc7c0640 1 -- 172.21.15.117:0/2621676979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fded40d1ca0 msgr2=0x7fded40cfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:11.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.634+0000 7fdedc7c0640 1 --2- 172.21.15.117:0/2621676979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fded40d1ca0 0x7fded40cfdb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdec8009d90 tx=0x7fdec802a660 comp rx=0 tx=0).stop 2024-09-19T08:38:11.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.634+0000 7fdedc7c0640 1 -- 172.21.15.117:0/2621676979 shutdown_connections 2024-09-19T08:38:11.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.634+0000 7fdedc7c0640 1 --2- 172.21.15.117:0/2621676979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fded40d1ca0 0x7fded40cfdb0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:11.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.634+0000 7fdedc7c0640 1 -- 172.21.15.117:0/2621676979 >> 172.21.15.117:0/2621676979 conn(0x7fded4067fe0 msgr2=0x7fded406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:11.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.634+0000 7fdedc7c0640 1 -- 172.21.15.117:0/2621676979 shutdown_connections 2024-09-19T08:38:11.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.634+0000 7fdedc7c0640 1 -- 172.21.15.117:0/2621676979 wait complete. 2024-09-19T08:38:11.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.636+0000 7fdedc7c0640 1 Processor -- start 2024-09-19T08:38:11.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.636+0000 7fdedc7c0640 1 -- start start 2024-09-19T08:38:11.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.636+0000 7fdedc7c0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fded40d02f0 0x7fded413ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:11.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.636+0000 7fdedc7c0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fded40d1ca0 0x7fded40b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:11.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.636+0000 7fdedc7c0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fded415cb00 0x7fded40b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:11.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.636+0000 7fdedc7c0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fded415d5f0 con 0x7fded40d1ca0 2024-09-19T08:38:11.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.636+0000 7fdedc7c0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fded40d2b70 con 0x7fded415cb00 2024-09-19T08:38:11.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.636+0000 7fdedc7c0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fded415d770 con 0x7fded40d02f0 2024-09-19T08:38:11.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.636+0000 7fded9d5b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fded40d1ca0 0x7fded40b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:11.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.636+0000 7fded9d5b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fded40d1ca0 0x7fded40b5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47244/0 (socket says 172.21.15.117:47244) 2024-09-19T08:38:11.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.636+0000 7fded9d5b640 1 -- 172.21.15.117:0/4026455448 learned_addr learned my addr 172.21.15.117:0/4026455448 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:11.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.637+0000 7fdedad5d640 1 --2- 172.21.15.117:0/4026455448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fded415cb00 0x7fded40b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:11.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.637+0000 7fdeda55c640 1 --2- 172.21.15.117:0/4026455448 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fded40d02f0 0x7fded413ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:11.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.637+0000 7fded9d5b640 1 -- 172.21.15.117:0/4026455448 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fded40d02f0 msgr2=0x7fded413ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:11.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.637+0000 7fded9d5b640 1 --2- 172.21.15.117:0/4026455448 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fded40d02f0 0x7fded413ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:11.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.637+0000 7fded9d5b640 1 -- 172.21.15.117:0/4026455448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fded415cb00 msgr2=0x7fded40b7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:11.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.637+0000 7fded9d5b640 1 --2- 172.21.15.117:0/4026455448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fded415cb00 0x7fded40b7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:11.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.637+0000 7fded9d5b640 1 -- 172.21.15.117:0/4026455448 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded40b6b80 con 0x7fded40d1ca0 2024-09-19T08:38:11.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.637+0000 7fded9d5b640 1 --2- 172.21.15.117:0/4026455448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fded40d1ca0 0x7fded40b5b00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdec8000f80 tx=0x7fdec8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:11.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.637+0000 7fded2ffd640 1 -- 172.21.15.117:0/4026455448 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec8040070 con 0x7fded40d1ca0 2024-09-19T08:38:11.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.637+0000 7fded2ffd640 1 -- 172.21.15.117:0/4026455448 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec8031d00 con 0x7fded40d1ca0 2024-09-19T08:38:11.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.637+0000 7fdedc7c0640 1 -- 172.21.15.117:0/4026455448 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded40b65c0 con 0x7fded40d1ca0 2024-09-19T08:38:11.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.637+0000 7fded2ffd640 1 -- 172.21.15.117:0/4026455448 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec8003b90 con 0x7fded40d1ca0 2024-09-19T08:38:11.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.637+0000 7fdedc7c0640 1 -- 172.21.15.117:0/4026455448 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded40cc8b0 con 0x7fded40d1ca0 2024-09-19T08:38:11.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.638+0000 7fdedc7c0640 1 -- 172.21.15.117:0/4026455448 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fded40cfdb0 con 0x7fded40d1ca0 2024-09-19T08:38:11.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.639+0000 7fded2ffd640 1 -- 172.21.15.117:0/4026455448 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdec8039040 con 0x7fded40d1ca0 2024-09-19T08:38:11.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.640+0000 7fded2ffd640 1 --2- 172.21.15.117:0/4026455448 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fdec006c2b0 0x7fdec006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:11.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.640+0000 7fded2ffd640 1 -- 172.21.15.117:0/4026455448 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fdec80ac880 con 0x7fded40d1ca0 2024-09-19T08:38:11.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.640+0000 7fdeda55c640 1 --2- 172.21.15.117:0/4026455448 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fdec006c2b0 0x7fdec006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:11.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.641+0000 7fdeda55c640 1 --2- 172.21.15.117:0/4026455448 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fdec006c2b0 0x7fdec006e770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdecc000f60 tx=0x7fdecc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:11.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.644+0000 7fded2ffd640 1 -- 172.21.15.117:0/4026455448 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fdec807aef0 con 0x7fded40d1ca0 2024-09-19T08:38:11.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.813+0000 7fdedc7c0640 1 -- 172.21.15.117:0/4026455448 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fded413f610 con 0x7fdec006c2b0 2024-09-19T08:38:11.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.819+0000 7fded2ffd640 1 -- 172.21.15.117:0/4026455448 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245966 (secure 0 0 0) 0x7fded413f610 con 0x7fdec006c2b0 2024-09-19T08:38:11.825 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:11.826 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-09-19T08:38:11.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.822+0000 7fdedc7c0640 1 -- 172.21.15.117:0/4026455448 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fdec006c2b0 msgr2=0x7fdec006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:11.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.822+0000 7fdedc7c0640 1 --2- 172.21.15.117:0/4026455448 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fdec006c2b0 0x7fdec006e770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdecc000f60 tx=0x7fdecc009040 comp rx=0 tx=0).stop 2024-09-19T08:38:11.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.822+0000 7fdedc7c0640 1 -- 172.21.15.117:0/4026455448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fded40d1ca0 msgr2=0x7fded40b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:11.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.822+0000 7fdedc7c0640 1 --2- 172.21.15.117:0/4026455448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fded40d1ca0 0x7fded40b5b00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdec8000f80 tx=0x7fdec8004a40 comp rx=0 tx=0).stop 2024-09-19T08:38:11.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.822+0000 7fdedc7c0640 1 -- 172.21.15.117:0/4026455448 shutdown_connections 2024-09-19T08:38:11.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.822+0000 7fdedc7c0640 1 --2- 172.21.15.117:0/4026455448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fded415cb00 0x7fded40b7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:11.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.822+0000 7fdedc7c0640 1 --2- 172.21.15.117:0/4026455448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fded40d1ca0 0x7fded40b5b00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:11.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.822+0000 7fdedc7c0640 1 --2- 172.21.15.117:0/4026455448 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fdec006c2b0 0x7fdec006e770 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:11.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.822+0000 7fdedc7c0640 1 --2- 172.21.15.117:0/4026455448 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fded40d02f0 0x7fded413ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:11.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.822+0000 7fdedc7c0640 1 -- 172.21.15.117:0/4026455448 >> 172.21.15.117:0/4026455448 conn(0x7fded4067fe0 msgr2=0x7fded41590e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:11.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.822+0000 7fdedc7c0640 1 -- 172.21.15.117:0/4026455448 shutdown_connections 2024-09-19T08:38:11.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:11.822+0000 7fdedc7c0640 1 -- 172.21.15.117:0/4026455448 wait complete. 2024-09-19T08:38:11.834 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-19T08:38:09.860076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220664,"kb_used_data":4436,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754056,"statfs":{"total":773094113280,"available":772868153344,"internally_reserved":0,"allocated":4542464,"data_stored":2579211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.354425"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515535+0000","last_change":"2024-09-19T08:38:06.515535+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515535+0000","last_undegraded":"2024-09-19T08:38:06.515535+0000","last_fullsized":"2024-09-19T08:38:06.515535+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522972+0000","last_change":"2024-09-19T08:38:06.522972+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522972+0000","last_undegraded":"2024-09-19T08:38:06.522972+0000","last_fullsized":"2024-09-19T08:38:06.522972+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515332+0000","last_change":"2024-09-19T08:38:06.515332+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515332+0000","last_undegraded":"2024-09-19T08:38:06.515332+0000","last_fullsized":"2024-09-19T08:38:06.515332+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515942+0000","last_change":"2024-09-19T08:38:06.515942+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515942+0000","last_undegraded":"2024-09-19T08:38:06.515942+0000","last_fullsized":"2024-09-19T08:38:06.515942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524194+0000","last_change":"2024-09-19T08:38:06.524194+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524194+0000","last_undegraded":"2024-09-19T08:38:06.524194+0000","last_fullsized":"2024-09-19T08:38:06.524194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.525385+0000","last_change":"2024-09-19T08:38:06.525385+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.525385+0000","last_undegraded":"2024-09-19T08:38:06.525385+0000","last_fullsized":"2024-09-19T08:38:06.525385+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.518025+0000","last_change":"2024-09-19T08:38:06.518025+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.518025+0000","last_undegraded":"2024-09-19T08:38:06.518025+0000","last_fullsized":"2024-09-19T08:38:06.518025+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524657+0000","last_change":"2024-09-19T08:38:06.524657+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524657+0000","last_undegraded":"2024-09-19T08:38:06.524657+0000","last_fullsized":"2024-09-19T08:38:06.524657+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.525829+0000","last_change":"2024-09-19T08:38:06.525829+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.525829+0000","last_undegraded":"2024-09-19T08:38:06.525829+0000","last_fullsized":"2024-09-19T08:38:06.525829+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524230+0000","last_change":"2024-09-19T08:38:06.524230+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524230+0000","last_undegraded":"2024-09-19T08:38:06.524230+0000","last_fullsized":"2024-09-19T08:38:06.524230+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520291+0000","last_change":"2024-09-19T08:38:06.520291+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520291+0000","last_undegraded":"2024-09-19T08:38:06.520291+0000","last_fullsized":"2024-09-19T08:38:06.520291+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521463+0000","last_change":"2024-09-19T08:38:06.521463+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521463+0000","last_undegraded":"2024-09-19T08:38:06.521463+0000","last_fullsized":"2024-09-19T08:38:06.521463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523791+0000","last_change":"2024-09-19T08:38:06.523791+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523791+0000","last_undegraded":"2024-09-19T08:38:06.523791+0000","last_fullsized":"2024-09-19T08:38:06.523791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522950+0000","last_change":"2024-09-19T08:38:06.522950+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522950+0000","last_undegraded":"2024-09-19T08:38:06.522950+0000","last_fullsized":"2024-09-19T08:38:06.522950+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521265+0000","last_change":"2024-09-19T08:38:06.521265+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521265+0000","last_undegraded":"2024-09-19T08:38:06.521265+0000","last_fullsized":"2024-09-19T08:38:06.521265+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519596+0000","last_change":"2024-09-19T08:38:06.519596+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519596+0000","last_undegraded":"2024-09-19T08:38:06.519596+0000","last_fullsized":"2024-09-19T08:38:06.519596+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.526134+0000","last_change":"2024-09-19T08:38:06.526134+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.526134+0000","last_undegraded":"2024-09-19T08:38:06.526134+0000","last_fullsized":"2024-09-19T08:38:06.526134+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524748+0000","last_change":"2024-09-19T08:38:06.524748+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524748+0000","last_undegraded":"2024-09-19T08:38:06.524748+0000","last_fullsized":"2024-09-19T08:38:06.524748+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523613+0000","last_change":"2024-09-19T08:38:06.523613+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523613+0000","last_undegraded":"2024-09-19T08:38:06.523613+0000","last_fullsized":"2024-09-19T08:38:06.523613+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520740+0000","last_change":"2024-09-19T08:38:06.520740+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520740+0000","last_undegraded":"2024-09-19T08:38:06.520740+0000","last_fullsized":"2024-09-19T08:38:06.520740+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.517564+0000","last_change":"2024-09-19T08:38:06.517564+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.517564+0000","last_undegraded":"2024-09-19T08:38:06.517564+0000","last_fullsized":"2024-09-19T08:38:06.517564+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519809+0000","last_change":"2024-09-19T08:38:06.519809+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519809+0000","last_undegraded":"2024-09-19T08:38:06.519809+0000","last_fullsized":"2024-09-19T08:38:06.519809+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.516283+0000","last_change":"2024-09-19T08:38:06.516283+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.516283+0000","last_undegraded":"2024-09-19T08:38:06.516283+0000","last_fullsized":"2024-09-19T08:38:06.516283+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524056+0000","last_change":"2024-09-19T08:38:06.524056+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524056+0000","last_undegraded":"2024-09-19T08:38:06.524056+0000","last_fullsized":"2024-09-19T08:38:06.524056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524230+0000","last_change":"2024-09-19T08:38:06.524230+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524230+0000","last_undegraded":"2024-09-19T08:38:06.524230+0000","last_fullsized":"2024-09-19T08:38:06.524230+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520284+0000","last_change":"2024-09-19T08:38:06.520284+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520284+0000","last_undegraded":"2024-09-19T08:38:06.520284+0000","last_fullsized":"2024-09-19T08:38:06.520284+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524644+0000","last_change":"2024-09-19T08:38:06.524644+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524644+0000","last_undegraded":"2024-09-19T08:38:06.524644+0000","last_fullsized":"2024-09-19T08:38:06.524644+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522221+0000","last_change":"2024-09-19T08:38:06.522221+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522221+0000","last_undegraded":"2024-09-19T08:38:06.522221+0000","last_fullsized":"2024-09-19T08:38:06.522221+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.517123+0000","last_change":"2024-09-19T08:38:06.517123+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.517123+0000","last_undegraded":"2024-09-19T08:38:06.517123+0000","last_fullsized":"2024-09-19T08:38:06.517123+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519849+0000","last_change":"2024-09-19T08:38:06.519849+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519849+0000","last_undegraded":"2024-09-19T08:38:06.519849+0000","last_fullsized":"2024-09-19T08:38:06.519849+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.528728+0000","last_change":"2024-09-19T08:38:06.525759+0000","last_active":"2024-09-19T08:38:06.528728+0000","last_peered":"2024-09-19T08:38:06.528728+0000","last_clean":"2024-09-19T08:38:06.528728+0000","last_became_active":"2024-09-19T08:38:06.525478+0000","last_became_peered":"2024-09-19T08:38:06.525478+0000","last_unstale":"2024-09-19T08:38:06.528728+0000","last_undegraded":"2024-09-19T08:38:06.528728+0000","last_fullsized":"2024-09-19T08:38:06.528728+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:22.876048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523934+0000","last_change":"2024-09-19T08:38:06.523934+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523934+0000","last_undegraded":"2024-09-19T08:38:06.523934+0000","last_fullsized":"2024-09-19T08:38:06.523934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.538022+0000","last_change":"2024-09-19T08:38:06.530592+0000","last_active":"2024-09-19T08:38:06.538022+0000","last_peered":"2024-09-19T08:38:06.538022+0000","last_clean":"2024-09-19T08:38:06.538022+0000","last_became_active":"2024-09-19T08:38:06.530244+0000","last_became_peered":"2024-09-19T08:38:06.530244+0000","last_unstale":"2024-09-19T08:38:06.538022+0000","last_undegraded":"2024-09-19T08:38:06.538022+0000","last_fullsized":"2024-09-19T08:38:06.538022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:49.718905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519761+0000","last_change":"2024-09-19T08:38:06.519761+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519761+0000","last_undegraded":"2024-09-19T08:38:06.519761+0000","last_fullsized":"2024-09-19T08:38:06.519761+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.538310+0000","last_change":"2024-09-19T08:38:06.533569+0000","last_active":"2024-09-19T08:38:06.538310+0000","last_peered":"2024-09-19T08:38:06.538310+0000","last_clean":"2024-09-19T08:38:06.538310+0000","last_became_active":"2024-09-19T08:38:06.533287+0000","last_became_peered":"2024-09-19T08:38:06.533287+0000","last_unstale":"2024-09-19T08:38:06.538310+0000","last_undegraded":"2024-09-19T08:38:06.538310+0000","last_fullsized":"2024-09-19T08:38:06.538310+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:36.052253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522054+0000","last_change":"2024-09-19T08:38:06.522054+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522054+0000","last_undegraded":"2024-09-19T08:38:06.522054+0000","last_fullsized":"2024-09-19T08:38:06.522054+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.525135+0000","last_change":"2024-09-19T08:38:06.523268+0000","last_active":"2024-09-19T08:38:06.525135+0000","last_peered":"2024-09-19T08:38:06.525135+0000","last_clean":"2024-09-19T08:38:06.525135+0000","last_became_active":"2024-09-19T08:38:06.523001+0000","last_became_peered":"2024-09-19T08:38:06.523001+0000","last_unstale":"2024-09-19T08:38:06.525135+0000","last_undegraded":"2024-09-19T08:38:06.525135+0000","last_fullsized":"2024-09-19T08:38:06.525135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:34.263681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.516654+0000","last_change":"2024-09-19T08:38:06.516654+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.516654+0000","last_undegraded":"2024-09-19T08:38:06.516654+0000","last_fullsized":"2024-09-19T08:38:06.516654+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.529403+0000","last_change":"2024-09-19T08:38:06.526836+0000","last_active":"2024-09-19T08:38:06.529403+0000","last_peered":"2024-09-19T08:38:06.529403+0000","last_clean":"2024-09-19T08:38:06.529403+0000","last_became_active":"2024-09-19T08:38:06.526218+0000","last_became_peered":"2024-09-19T08:38:06.526218+0000","last_unstale":"2024-09-19T08:38:06.529403+0000","last_undegraded":"2024-09-19T08:38:06.529403+0000","last_fullsized":"2024-09-19T08:38:06.529403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:56.987321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523086+0000","last_change":"2024-09-19T08:38:06.523086+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523086+0000","last_undegraded":"2024-09-19T08:38:06.523086+0000","last_fullsized":"2024-09-19T08:38:06.523086+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.536536+0000","last_change":"2024-09-19T08:38:06.536127+0000","last_active":"2024-09-19T08:38:06.536536+0000","last_peered":"2024-09-19T08:38:06.536536+0000","last_clean":"2024-09-19T08:38:06.536536+0000","last_became_active":"2024-09-19T08:38:06.535869+0000","last_became_peered":"2024-09-19T08:38:06.535869+0000","last_unstale":"2024-09-19T08:38:06.536536+0000","last_undegraded":"2024-09-19T08:38:06.536536+0000","last_fullsized":"2024-09-19T08:38:06.536536+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:45.599877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524245+0000","last_change":"2024-09-19T08:38:06.524245+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524245+0000","last_undegraded":"2024-09-19T08:38:06.524245+0000","last_fullsized":"2024-09-19T08:38:06.524245+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.527767+0000","last_change":"2024-09-19T08:38:06.524509+0000","last_active":"2024-09-19T08:38:06.527767+0000","last_peered":"2024-09-19T08:38:06.527767+0000","last_clean":"2024-09-19T08:38:06.527767+0000","last_became_active":"2024-09-19T08:38:06.524232+0000","last_became_peered":"2024-09-19T08:38:06.524232+0000","last_unstale":"2024-09-19T08:38:06.527767+0000","last_undegraded":"2024-09-19T08:38:06.527767+0000","last_fullsized":"2024-09-19T08:38:06.527767+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:07.229721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.524208+0000","last_change":"2024-09-19T08:38:06.524208+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.524208+0000","last_undegraded":"2024-09-19T08:38:06.524208+0000","last_fullsized":"2024-09-19T08:38:06.524208+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.534483+0000","last_change":"2024-09-19T08:38:06.533229+0000","last_active":"2024-09-19T08:38:06.534483+0000","last_peered":"2024-09-19T08:38:06.534483+0000","last_clean":"2024-09-19T08:38:06.534483+0000","last_became_active":"2024-09-19T08:38:06.532969+0000","last_became_peered":"2024-09-19T08:38:06.532969+0000","last_unstale":"2024-09-19T08:38:06.534483+0000","last_undegraded":"2024-09-19T08:38:06.534483+0000","last_fullsized":"2024-09-19T08:38:06.534483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:19.610768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515386+0000","last_change":"2024-09-19T08:38:06.515386+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515386+0000","last_undegraded":"2024-09-19T08:38:06.515386+0000","last_fullsized":"2024-09-19T08:38:06.515386+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.532787+0000","last_change":"2024-09-19T08:38:06.525562+0000","last_active":"2024-09-19T08:38:06.532787+0000","last_peered":"2024-09-19T08:38:06.532787+0000","last_clean":"2024-09-19T08:38:06.532787+0000","last_became_active":"2024-09-19T08:38:06.524991+0000","last_became_peered":"2024-09-19T08:38:06.524991+0000","last_unstale":"2024-09-19T08:38:06.532787+0000","last_undegraded":"2024-09-19T08:38:06.532787+0000","last_fullsized":"2024-09-19T08:38:06.532787+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:51.219417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519077+0000","last_change":"2024-09-19T08:38:06.519077+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519077+0000","last_undegraded":"2024-09-19T08:38:06.519077+0000","last_fullsized":"2024-09-19T08:38:06.519077+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.534055+0000","last_change":"2024-09-19T08:38:06.531379+0000","last_active":"2024-09-19T08:38:06.534055+0000","last_peered":"2024-09-19T08:38:06.534055+0000","last_clean":"2024-09-19T08:38:06.534055+0000","last_became_active":"2024-09-19T08:38:06.530810+0000","last_became_peered":"2024-09-19T08:38:06.530810+0000","last_unstale":"2024-09-19T08:38:06.534055+0000","last_undegraded":"2024-09-19T08:38:06.534055+0000","last_fullsized":"2024-09-19T08:38:06.534055+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:38.604762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.514826+0000","last_change":"2024-09-19T08:38:06.514826+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.514826+0000","last_undegraded":"2024-09-19T08:38:06.514826+0000","last_fullsized":"2024-09-19T08:38:06.514826+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.527986+0000","last_change":"2024-09-19T08:38:06.525652+0000","last_active":"2024-09-19T08:38:06.527986+0000","last_peered":"2024-09-19T08:38:06.527986+0000","last_clean":"2024-09-19T08:38:06.527986+0000","last_became_active":"2024-09-19T08:38:06.525395+0000","last_became_peered":"2024-09-19T08:38:06.525395+0000","last_unstale":"2024-09-19T08:38:06.527986+0000","last_undegraded":"2024-09-19T08:38:06.527986+0000","last_fullsized":"2024-09-19T08:38:06.527986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:20.592921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521608+0000","last_change":"2024-09-19T08:38:06.521608+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521608+0000","last_undegraded":"2024-09-19T08:38:06.521608+0000","last_fullsized":"2024-09-19T08:38:06.521608+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.527796+0000","last_change":"2024-09-19T08:38:06.524138+0000","last_active":"2024-09-19T08:38:06.527796+0000","last_peered":"2024-09-19T08:38:06.527796+0000","last_clean":"2024-09-19T08:38:06.527796+0000","last_became_active":"2024-09-19T08:38:06.523848+0000","last_became_peered":"2024-09-19T08:38:06.523848+0000","last_unstale":"2024-09-19T08:38:06.527796+0000","last_undegraded":"2024-09-19T08:38:06.527796+0000","last_fullsized":"2024-09-19T08:38:06.527796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:01.499409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.514819+0000","last_change":"2024-09-19T08:38:06.514819+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.514819+0000","last_undegraded":"2024-09-19T08:38:06.514819+0000","last_fullsized":"2024-09-19T08:38:06.514819+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.535660+0000","last_change":"2024-09-19T08:38:06.530737+0000","last_active":"2024-09-19T08:38:06.535660+0000","last_peered":"2024-09-19T08:38:06.535660+0000","last_clean":"2024-09-19T08:38:06.535660+0000","last_became_active":"2024-09-19T08:38:06.530436+0000","last_became_peered":"2024-09-19T08:38:06.530436+0000","last_unstale":"2024-09-19T08:38:06.535660+0000","last_undegraded":"2024-09-19T08:38:06.535660+0000","last_fullsized":"2024-09-19T08:38:06.535660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:35.022819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523686+0000","last_change":"2024-09-19T08:38:06.523686+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523686+0000","last_undegraded":"2024-09-19T08:38:06.523686+0000","last_fullsized":"2024-09-19T08:38:06.523686+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.538175+0000","last_change":"2024-09-19T08:38:06.533437+0000","last_active":"2024-09-19T08:38:06.538175+0000","last_peered":"2024-09-19T08:38:06.538175+0000","last_clean":"2024-09-19T08:38:06.538175+0000","last_became_active":"2024-09-19T08:38:06.533139+0000","last_became_peered":"2024-09-19T08:38:06.533139+0000","last_unstale":"2024-09-19T08:38:06.538175+0000","last_undegraded":"2024-09-19T08:38:06.538175+0000","last_fullsized":"2024-09-19T08:38:06.538175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:34.263681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521411+0000","last_change":"2024-09-19T08:38:06.521411+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521411+0000","last_undegraded":"2024-09-19T08:38:06.521411+0000","last_fullsized":"2024-09-19T08:38:06.521411+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.526852+0000","last_change":"2024-09-19T08:38:06.523001+0000","last_active":"2024-09-19T08:38:06.526852+0000","last_peered":"2024-09-19T08:38:06.526852+0000","last_clean":"2024-09-19T08:38:06.526852+0000","last_became_active":"2024-09-19T08:38:06.522686+0000","last_became_peered":"2024-09-19T08:38:06.522686+0000","last_unstale":"2024-09-19T08:38:06.526852+0000","last_undegraded":"2024-09-19T08:38:06.526852+0000","last_fullsized":"2024-09-19T08:38:06.526852+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:36.343142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.532540+0000","last_change":"2024-09-19T08:38:06.529230+0000","last_active":"2024-09-19T08:38:06.532540+0000","last_peered":"2024-09-19T08:38:06.532540+0000","last_clean":"2024-09-19T08:38:06.532540+0000","last_became_active":"2024-09-19T08:38:06.528958+0000","last_became_peered":"2024-09-19T08:38:06.528958+0000","last_unstale":"2024-09-19T08:38:06.532540+0000","last_undegraded":"2024-09-19T08:38:06.532540+0000","last_fullsized":"2024-09-19T08:38:06.532540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:01.499409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523135+0000","last_change":"2024-09-19T08:38:06.523135+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523135+0000","last_undegraded":"2024-09-19T08:38:06.523135+0000","last_fullsized":"2024-09-19T08:38:06.523135+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.535293+0000","last_change":"2024-09-19T08:38:06.534098+0000","last_active":"2024-09-19T08:38:06.535293+0000","last_peered":"2024-09-19T08:38:06.535293+0000","last_clean":"2024-09-19T08:38:06.535293+0000","last_became_active":"2024-09-19T08:38:06.533792+0000","last_became_peered":"2024-09-19T08:38:06.533792+0000","last_unstale":"2024-09-19T08:38:06.535293+0000","last_undegraded":"2024-09-19T08:38:06.535293+0000","last_fullsized":"2024-09-19T08:38:06.535293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:17.394057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520696+0000","last_change":"2024-09-19T08:38:06.520696+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520696+0000","last_undegraded":"2024-09-19T08:38:06.520696+0000","last_fullsized":"2024-09-19T08:38:06.520696+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.528660+0000","last_change":"2024-09-19T08:38:06.527561+0000","last_active":"2024-09-19T08:38:06.528660+0000","last_peered":"2024-09-19T08:38:06.528660+0000","last_clean":"2024-09-19T08:38:06.528660+0000","last_became_active":"2024-09-19T08:38:06.527305+0000","last_became_peered":"2024-09-19T08:38:06.527305+0000","last_unstale":"2024-09-19T08:38:06.528660+0000","last_undegraded":"2024-09-19T08:38:06.528660+0000","last_fullsized":"2024-09-19T08:38:06.528660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:38:37.770723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521186+0000","last_change":"2024-09-19T08:38:06.521186+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521186+0000","last_undegraded":"2024-09-19T08:38:06.521186+0000","last_fullsized":"2024-09-19T08:38:06.521186+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T08:38:05.518506+0000","last_change":"2024-09-19T08:38:05.518506+0000","last_active":"2024-09-19T08:38:05.500429+0000","last_peered":"2024-09-19T08:38:05.500429+0000","last_clean":"2024-09-19T08:38:05.500429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:05.518506+0000","last_undegraded":"2024-09-19T08:38:05.518506+0000","last_fullsized":"2024-09-19T08:38:05.518506+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521112+0000","last_change":"2024-09-19T08:38:06.521112+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521112+0000","last_undegraded":"2024-09-19T08:38:06.521112+0000","last_fullsized":"2024-09-19T08:38:06.521112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.535356+0000","last_change":"2024-09-19T08:38:06.529491+0000","last_active":"2024-09-19T08:38:06.535356+0000","last_peered":"2024-09-19T08:38:06.535356+0000","last_clean":"2024-09-19T08:38:06.535356+0000","last_became_active":"2024-09-19T08:38:06.529160+0000","last_became_peered":"2024-09-19T08:38:06.529160+0000","last_unstale":"2024-09-19T08:38:06.535356+0000","last_undegraded":"2024-09-19T08:38:06.535356+0000","last_fullsized":"2024-09-19T08:38:06.535356+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:49.654020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520861+0000","last_change":"2024-09-19T08:38:06.520861+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520861+0000","last_undegraded":"2024-09-19T08:38:06.520861+0000","last_fullsized":"2024-09-19T08:38:06.520861+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.532652+0000","last_change":"2024-09-19T08:38:06.526582+0000","last_active":"2024-09-19T08:38:06.532652+0000","last_peered":"2024-09-19T08:38:06.532652+0000","last_clean":"2024-09-19T08:38:06.532652+0000","last_became_active":"2024-09-19T08:38:06.526290+0000","last_became_peered":"2024-09-19T08:38:06.526290+0000","last_unstale":"2024-09-19T08:38:06.532652+0000","last_undegraded":"2024-09-19T08:38:06.532652+0000","last_fullsized":"2024-09-19T08:38:06.532652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:44.073925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515014+0000","last_change":"2024-09-19T08:38:06.515014+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515014+0000","last_undegraded":"2024-09-19T08:38:06.515014+0000","last_fullsized":"2024-09-19T08:38:06.515014+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.538133+0000","last_change":"2024-09-19T08:38:06.531426+0000","last_active":"2024-09-19T08:38:06.538133+0000","last_peered":"2024-09-19T08:38:06.538133+0000","last_clean":"2024-09-19T08:38:06.538133+0000","last_became_active":"2024-09-19T08:38:06.531074+0000","last_became_peered":"2024-09-19T08:38:06.531074+0000","last_unstale":"2024-09-19T08:38:06.538133+0000","last_undegraded":"2024-09-19T08:38:06.538133+0000","last_fullsized":"2024-09-19T08:38:06.538133+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:06.375637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.520413+0000","last_change":"2024-09-19T08:38:06.520413+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.520413+0000","last_undegraded":"2024-09-19T08:38:06.520413+0000","last_fullsized":"2024-09-19T08:38:06.520413+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.534561+0000","last_change":"2024-09-19T08:38:06.533258+0000","last_active":"2024-09-19T08:38:06.534561+0000","last_peered":"2024-09-19T08:38:06.534561+0000","last_clean":"2024-09-19T08:38:06.534561+0000","last_became_active":"2024-09-19T08:38:06.533008+0000","last_became_peered":"2024-09-19T08:38:06.533008+0000","last_unstale":"2024-09-19T08:38:06.534561+0000","last_undegraded":"2024-09-19T08:38:06.534561+0000","last_fullsized":"2024-09-19T08:38:06.534561+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:04.672846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.515726+0000","last_change":"2024-09-19T08:38:06.515726+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.515726+0000","last_undegraded":"2024-09-19T08:38:06.515726+0000","last_fullsized":"2024-09-19T08:38:06.515726+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.538182+0000","last_change":"2024-09-19T08:38:06.533577+0000","last_active":"2024-09-19T08:38:06.538182+0000","last_peered":"2024-09-19T08:38:06.538182+0000","last_clean":"2024-09-19T08:38:06.538182+0000","last_became_active":"2024-09-19T08:38:06.533276+0000","last_became_peered":"2024-09-19T08:38:06.533276+0000","last_unstale":"2024-09-19T08:38:06.538182+0000","last_undegraded":"2024-09-19T08:38:06.538182+0000","last_fullsized":"2024-09-19T08:38:06.538182+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:22.876048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.534078+0000","last_change":"2024-09-19T08:38:06.532515+0000","last_active":"2024-09-19T08:38:06.534078+0000","last_peered":"2024-09-19T08:38:06.534078+0000","last_clean":"2024-09-19T08:38:06.534078+0000","last_became_active":"2024-09-19T08:38:06.532253+0000","last_became_peered":"2024-09-19T08:38:06.532253+0000","last_unstale":"2024-09-19T08:38:06.534078+0000","last_undegraded":"2024-09-19T08:38:06.534078+0000","last_fullsized":"2024-09-19T08:38:06.534078+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:54.746465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519972+0000","last_change":"2024-09-19T08:38:06.519972+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519972+0000","last_undegraded":"2024-09-19T08:38:06.519972+0000","last_fullsized":"2024-09-19T08:38:06.519972+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T08:38:05.516525+0000","last_change":"2024-09-19T08:38:05.516525+0000","last_active":"2024-09-19T08:38:05.500429+0000","last_peered":"2024-09-19T08:38:05.500429+0000","last_clean":"2024-09-19T08:38:05.500429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:05.516525+0000","last_undegraded":"2024-09-19T08:38:05.516525+0000","last_fullsized":"2024-09-19T08:38:05.516525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.521088+0000","last_change":"2024-09-19T08:38:06.521088+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.521088+0000","last_undegraded":"2024-09-19T08:38:06.521088+0000","last_fullsized":"2024-09-19T08:38:06.521088+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-19T08:38:05.516323+0000","last_change":"2024-09-19T08:38:05.516323+0000","last_active":"2024-09-19T08:38:05.500429+0000","last_peered":"2024-09-19T08:38:05.500429+0000","last_clean":"2024-09-19T08:38:05.500429+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:05.516323+0000","last_undegraded":"2024-09-19T08:38:05.516323+0000","last_fullsized":"2024-09-19T08:38:05.516323+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:06.505288+0000","last_change":"2024-09-19T08:38:06.505288+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.505288+0000","last_undegraded":"2024-09-19T08:38:06.505288+0000","last_fullsized":"2024-09-19T08:38:06.505288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.535645+0000","last_change":"2024-09-19T08:38:06.530799+0000","last_active":"2024-09-19T08:38:06.535645+0000","last_peered":"2024-09-19T08:38:06.535645+0000","last_clean":"2024-09-19T08:38:06.535645+0000","last_became_active":"2024-09-19T08:38:06.530484+0000","last_became_peered":"2024-09-19T08:38:06.530484+0000","last_unstale":"2024-09-19T08:38:06.535645+0000","last_undegraded":"2024-09-19T08:38:06.535645+0000","last_fullsized":"2024-09-19T08:38:06.535645+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:26.454464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522886+0000","last_change":"2024-09-19T08:38:06.522886+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522886+0000","last_undegraded":"2024-09-19T08:38:06.522886+0000","last_fullsized":"2024-09-19T08:38:06.522886+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.531801+0000","last_change":"2024-09-19T08:38:06.528224+0000","last_active":"2024-09-19T08:38:06.531801+0000","last_peered":"2024-09-19T08:38:06.531801+0000","last_clean":"2024-09-19T08:38:06.531801+0000","last_became_active":"2024-09-19T08:38:06.527744+0000","last_became_peered":"2024-09-19T08:38:06.527744+0000","last_unstale":"2024-09-19T08:38:06.531801+0000","last_undegraded":"2024-09-19T08:38:06.531801+0000","last_fullsized":"2024-09-19T08:38:06.531801+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:13.093311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.523853+0000","last_change":"2024-09-19T08:38:06.523853+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.523853+0000","last_undegraded":"2024-09-19T08:38:06.523853+0000","last_fullsized":"2024-09-19T08:38:06.523853+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.534560+0000","last_change":"2024-09-19T08:38:06.533024+0000","last_active":"2024-09-19T08:38:06.534560+0000","last_peered":"2024-09-19T08:38:06.534560+0000","last_clean":"2024-09-19T08:38:06.534560+0000","last_became_active":"2024-09-19T08:38:06.532728+0000","last_became_peered":"2024-09-19T08:38:06.532728+0000","last_unstale":"2024-09-19T08:38:06.534560+0000","last_undegraded":"2024-09-19T08:38:06.534560+0000","last_fullsized":"2024-09-19T08:38:06.534560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:59.807121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.519499+0000","last_change":"2024-09-19T08:38:06.519499+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.519499+0000","last_undegraded":"2024-09-19T08:38:06.519499+0000","last_fullsized":"2024-09-19T08:38:06.519499+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.532632+0000","last_change":"2024-09-19T08:38:06.525546+0000","last_active":"2024-09-19T08:38:06.532632+0000","last_peered":"2024-09-19T08:38:06.532632+0000","last_clean":"2024-09-19T08:38:06.532632+0000","last_became_active":"2024-09-19T08:38:06.525227+0000","last_became_peered":"2024-09-19T08:38:06.525227+0000","last_unstale":"2024-09-19T08:38:06.532632+0000","last_undegraded":"2024-09-19T08:38:06.532632+0000","last_fullsized":"2024-09-19T08:38:06.532632+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:13.093311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-09-19T08:38:06.522539+0000","last_change":"2024-09-19T08:38:06.522539+0000","last_active":"2024-09-19T08:38:06.505288+0000","last_peered":"2024-09-19T08:38:06.505288+0000","last_clean":"2024-09-19T08:38:06.505288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:06.522539+0000","last_undegraded":"2024-09-19T08:38:06.522539+0000","last_fullsized":"2024-09-19T08:38:06.522539+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.530671+0000","last_change":"2024-09-19T08:38:06.526379+0000","last_active":"2024-09-19T08:38:06.530671+0000","last_peered":"2024-09-19T08:38:06.530671+0000","last_clean":"2024-09-19T08:38:06.530671+0000","last_became_active":"2024-09-19T08:38:06.525731+0000","last_became_peered":"2024-09-19T08:38:06.525731+0000","last_unstale":"2024-09-19T08:38:06.530671+0000","last_undegraded":"2024-09-19T08:38:06.530671+0000","last_fullsized":"2024-09-19T08:38:06.530671+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:07.229721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":198,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T08:38:06.519210+0000","last_change":"2024-09-19T08:37:04.479071+0000","last_active":"2024-09-19T08:38:06.519210+0000","last_peered":"2024-09-19T08:38:06.519210+0000","last_clean":"2024-09-19T08:38:06.519210+0000","last_became_active":"2024-09-19T08:37:04.478199+0000","last_became_peered":"2024-09-19T08:37:04.478199+0000","last_unstale":"2024-09-19T08:38:06.519210+0000","last_undegraded":"2024-09-19T08:38:06.519210+0000","last_fullsized":"2024-09-19T08:38:06.519210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_clean_scrub_stamp":"2024-09-19T08:37:02.519738+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:32.963748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1011712,"data_stored":764344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1024000,"data_stored":771011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":173976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:38:12.502 INFO:tasks.ceph.mds.b.smithi146.stderr:2024-09-19T08:38:12.502+0000 7fa7110f5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T08:38:14.838 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:38:14.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.950+0000 7f5a0f827640 1 Processor -- start 2024-09-19T08:38:14.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.950+0000 7f5a0f827640 1 -- start start 2024-09-19T08:38:14.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.951+0000 7f5a0f827640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a0815b120 0x7f5a0806f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:14.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.951+0000 7f5a0f827640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a0815b500 con 0x7f5a080d0bc0 2024-09-19T08:38:14.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.951+0000 7f5a0f827640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a0806e940 con 0x7f5a0806dec0 2024-09-19T08:38:14.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.951+0000 7f5a0f827640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f5a0806ec20 con 0x7f5a0815b120 2024-09-19T08:38:14.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.951+0000 7f5a0ddc4640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f5a080d0bc0 0x7f5a080c5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50546/0 (socket says 172.21.15.117:50546) 2024-09-19T08:38:14.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.951+0000 7f5a0ddc4640 1 -- 172.21.15.117:0/177978167 learned_addr learned my addr 172.21.15.117:0/177978167 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:14.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.951+0000 7f5a0d5c3640 1 --2- 172.21.15.117:0/177978167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a0815b120 0x7f5a0806f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:14.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.951+0000 7f59fffff640 1 -- 172.21.15.117:0/177978167 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 772709602 0 0) 0x7f5a0815b500 con 0x7f5a080d0bc0 2024-09-19T08:38:14.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.951+0000 7f59fffff640 1 -- 172.21.15.117:0/177978167 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59f4005730 con 0x7f5a080d0bc0 2024-09-19T08:38:14.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.951+0000 7f59fffff640 1 -- 172.21.15.117:0/177978167 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 74298482 0 0) 0x7f5a0806e940 con 0x7f5a0806dec0 2024-09-19T08:38:14.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.951+0000 7f59fffff640 1 -- 172.21.15.117:0/177978167 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a0815b500 con 0x7f5a0806dec0 2024-09-19T08:38:14.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.952+0000 7f5a0d5c3640 1 -- 172.21.15.117:0/177978167 >> v1:172.21.15.146:6789/0 conn(0x7f5a0806dec0 legacy=0x7f5a080d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:14.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.952+0000 7f5a0d5c3640 1 -- 172.21.15.117:0/177978167 >> v1:172.21.15.117:6789/0 conn(0x7f5a080d0bc0 legacy=0x7f5a080c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:14.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.952+0000 7f59fffff640 1 -- 172.21.15.117:0/177978167 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2909491716 0 0) 0x7f59f4005730 con 0x7f5a080d0bc0 2024-09-19T08:38:14.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.952+0000 7f5a0d5c3640 1 -- 172.21.15.117:0/177978167 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0806ef00 con 0x7f5a0815b120 2024-09-19T08:38:14.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.952+0000 7f5a0d5c3640 1 --2- 172.21.15.117:0/177978167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a0815b120 0x7f5a0806f9e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5a040097d0 tx=0x7f5a0402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e52fb073a72ce05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:14.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.953+0000 7f59fffff640 1 -- 172.21.15.117:0/177978167 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a04037070 con 0x7f5a0815b120 2024-09-19T08:38:14.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.953+0000 7f59fffff640 1 -- 172.21.15.117:0/177978167 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a0402ac30 con 0x7f5a0815b120 2024-09-19T08:38:14.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.953+0000 7f59fffff640 1 -- 172.21.15.117:0/177978167 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a000019f0 con 0x7f5a0815b120 2024-09-19T08:38:14.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.953+0000 7f5a0f827640 1 -- 172.21.15.117:0/177978167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a0815b120 msgr2=0x7f5a0806f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:14.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.953+0000 7f5a0f827640 1 --2- 172.21.15.117:0/177978167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a0815b120 0x7f5a0806f9e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5a040097d0 tx=0x7f5a0402a1a0 comp rx=0 tx=0).stop 2024-09-19T08:38:14.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.953+0000 7f5a0f827640 1 -- 172.21.15.117:0/177978167 shutdown_connections 2024-09-19T08:38:14.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.953+0000 7f5a0f827640 1 --2- 172.21.15.117:0/177978167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a0815b120 0x7f5a0806f9e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:14.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.953+0000 7f5a0f827640 1 -- 172.21.15.117:0/177978167 >> 172.21.15.117:0/177978167 conn(0x7f5a0806bdf0 msgr2=0x7f5a0806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:14.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.953+0000 7f5a0f827640 1 -- 172.21.15.117:0/177978167 shutdown_connections 2024-09-19T08:38:14.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.953+0000 7f5a0f827640 1 -- 172.21.15.117:0/177978167 wait complete. 2024-09-19T08:38:14.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.954+0000 7f5a0f827640 1 Processor -- start 2024-09-19T08:38:14.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.954+0000 7f5a0f827640 1 -- start start 2024-09-19T08:38:14.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.955+0000 7f5a0f827640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a0806dec0 0x7f5a0815a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:14.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.955+0000 7f5a0f827640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a080d0bc0 0x7f5a080ae420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:14.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.955+0000 7f5a0f827640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a0815b120 0x7f5a0815d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:14.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.955+0000 7f5a0f827640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5a080ce060 con 0x7f5a0815b120 2024-09-19T08:38:14.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.955+0000 7f5a0f827640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0806f4c0 con 0x7f5a0806dec0 2024-09-19T08:38:14.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.955+0000 7f5a0f827640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f5a0806e300 con 0x7f5a080d0bc0 2024-09-19T08:38:14.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.955+0000 7f5a0ddc4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a0815b120 0x7f5a0815d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:14.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.955+0000 7f5a0ddc4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a0815b120 0x7f5a0815d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:60498/0 (socket says 172.21.15.117:60498) 2024-09-19T08:38:14.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.955+0000 7f5a0ddc4640 1 -- 172.21.15.117:0/3344419246 learned_addr learned my addr 172.21.15.117:0/3344419246 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:14.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.955+0000 7f5a0d5c3640 1 --2- 172.21.15.117:0/3344419246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a0806dec0 0x7f5a0815a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:14.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.955+0000 7f5a0cdc2640 1 --2- 172.21.15.117:0/3344419246 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a080d0bc0 0x7f5a080ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:14.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.956+0000 7f5a0ddc4640 1 -- 172.21.15.117:0/3344419246 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a080d0bc0 msgr2=0x7f5a080ae420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:14.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.956+0000 7f5a0ddc4640 1 --2- 172.21.15.117:0/3344419246 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a080d0bc0 0x7f5a080ae420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:14.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.956+0000 7f5a0ddc4640 1 -- 172.21.15.117:0/3344419246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a0806dec0 msgr2=0x7f5a0815a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:14.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.956+0000 7f5a0ddc4640 1 --2- 172.21.15.117:0/3344419246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a0806dec0 0x7f5a0815a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:14.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.956+0000 7f5a0ddc4640 1 -- 172.21.15.117:0/3344419246 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0815a950 con 0x7f5a0815b120 2024-09-19T08:38:14.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.956+0000 7f5a0ddc4640 1 --2- 172.21.15.117:0/3344419246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a0815b120 0x7f5a0815d140 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5a00005c00 tx=0x7f5a0000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:14.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.956+0000 7f59fdffb640 1 -- 172.21.15.117:0/3344419246 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00017070 con 0x7f5a0815b120 2024-09-19T08:38:14.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.956+0000 7f59fdffb640 1 -- 172.21.15.117:0/3344419246 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a00012400 con 0x7f5a0815b120 2024-09-19T08:38:14.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.956+0000 7f5a0f827640 1 -- 172.21.15.117:0/3344419246 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a08072ae0 con 0x7f5a0815b120 2024-09-19T08:38:14.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.956+0000 7f59fdffb640 1 -- 172.21.15.117:0/3344419246 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a000127f0 con 0x7f5a0815b120 2024-09-19T08:38:14.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.956+0000 7f5a0f827640 1 -- 172.21.15.117:0/3344419246 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a08158850 con 0x7f5a0815b120 2024-09-19T08:38:14.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.957+0000 7f5a0f827640 1 -- 172.21.15.117:0/3344419246 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a0806f9e0 con 0x7f5a0815b120 2024-09-19T08:38:14.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.958+0000 7f59fdffb640 1 -- 172.21.15.117:0/3344419246 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5a0001a070 con 0x7f5a0815b120 2024-09-19T08:38:14.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.958+0000 7f59fdffb640 1 --2- 172.21.15.117:0/3344419246 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f59ec06c2b0 0x7f59ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:14.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.958+0000 7f59fdffb640 1 -- 172.21.15.117:0/3344419246 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f5a0008b350 con 0x7f5a0815b120 2024-09-19T08:38:14.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.959+0000 7f5a0d5c3640 1 --2- 172.21.15.117:0/3344419246 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f59ec06c2b0 0x7f59ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:14.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.959+0000 7f5a0d5c3640 1 --2- 172.21.15.117:0/3344419246 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f59ec06c2b0 0x7f59ec06e770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5a04034000 tx=0x7f5a0402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:14.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:14.963+0000 7f59fdffb640 1 -- 172.21.15.117:0/3344419246 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5a00059370 con 0x7f5a0815b120 2024-09-19T08:38:15.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.126+0000 7f5a0f827640 1 -- 172.21.15.117:0/3344419246 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5a080b42b0 con 0x7f59ec06c2b0 2024-09-19T08:38:15.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.132+0000 7f59fdffb640 1 -- 172.21.15.117:0/3344419246 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251956 (secure 0 0 0) 0x7f5a080b42b0 con 0x7f59ec06c2b0 2024-09-19T08:38:15.135 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:15.136 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-09-19T08:38:15.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.135+0000 7f5a0f827640 1 -- 172.21.15.117:0/3344419246 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f59ec06c2b0 msgr2=0x7f59ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:15.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.135+0000 7f5a0f827640 1 --2- 172.21.15.117:0/3344419246 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f59ec06c2b0 0x7f59ec06e770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5a04034000 tx=0x7f5a0402e000 comp rx=0 tx=0).stop 2024-09-19T08:38:15.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.135+0000 7f5a0f827640 1 -- 172.21.15.117:0/3344419246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a0815b120 msgr2=0x7f5a0815d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:15.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.135+0000 7f5a0f827640 1 --2- 172.21.15.117:0/3344419246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a0815b120 0x7f5a0815d140 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5a00005c00 tx=0x7f5a0000a430 comp rx=0 tx=0).stop 2024-09-19T08:38:15.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.135+0000 7f5a0f827640 1 -- 172.21.15.117:0/3344419246 shutdown_connections 2024-09-19T08:38:15.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.135+0000 7f5a0f827640 1 --2- 172.21.15.117:0/3344419246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a0815b120 0x7f5a0815d140 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.135+0000 7f5a0f827640 1 --2- 172.21.15.117:0/3344419246 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f59ec06c2b0 0x7f59ec06e770 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.135+0000 7f5a0f827640 1 --2- 172.21.15.117:0/3344419246 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a080d0bc0 0x7f5a080ae420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.135+0000 7f5a0f827640 1 --2- 172.21.15.117:0/3344419246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a0806dec0 0x7f5a0815a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.135+0000 7f5a0f827640 1 -- 172.21.15.117:0/3344419246 >> 172.21.15.117:0/3344419246 conn(0x7f5a0806bdf0 msgr2=0x7f5a0806fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:15.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.135+0000 7f5a0f827640 1 -- 172.21.15.117:0/3344419246 shutdown_connections 2024-09-19T08:38:15.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.135+0000 7f5a0f827640 1 -- 172.21.15.117:0/3344419246 wait complete. 2024-09-19T08:38:15.146 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-09-19T08:38:13.860758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221040,"kb_used_data":4776,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753680,"statfs":{"total":773094113280,"available":772867768320,"internally_reserved":0,"allocated":4890624,"data_stored":2741572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.348393"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.531133+0000","last_change":"2024-09-19T08:38:07.532825+0000","last_active":"2024-09-19T08:38:08.531133+0000","last_peered":"2024-09-19T08:38:08.531133+0000","last_clean":"2024-09-19T08:38:08.531133+0000","last_became_active":"2024-09-19T08:38:07.532530+0000","last_became_peered":"2024-09-19T08:38:07.532530+0000","last_unstale":"2024-09-19T08:38:08.531133+0000","last_undegraded":"2024-09-19T08:38:08.531133+0000","last_fullsized":"2024-09-19T08:38:08.531133+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:25.089381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.656474+0000","last_change":"2024-09-19T08:38:07.533236+0000","last_active":"2024-09-19T08:38:08.656474+0000","last_peered":"2024-09-19T08:38:08.656474+0000","last_clean":"2024-09-19T08:38:08.656474+0000","last_became_active":"2024-09-19T08:38:07.532577+0000","last_became_peered":"2024-09-19T08:38:07.532577+0000","last_unstale":"2024-09-19T08:38:08.656474+0000","last_undegraded":"2024-09-19T08:38:08.656474+0000","last_fullsized":"2024-09-19T08:38:08.656474+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:37.348001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.531224+0000","last_change":"2024-09-19T08:38:07.538637+0000","last_active":"2024-09-19T08:38:08.531224+0000","last_peered":"2024-09-19T08:38:08.531224+0000","last_clean":"2024-09-19T08:38:08.531224+0000","last_became_active":"2024-09-19T08:38:07.538217+0000","last_became_peered":"2024-09-19T08:38:07.538217+0000","last_unstale":"2024-09-19T08:38:08.531224+0000","last_undegraded":"2024-09-19T08:38:08.531224+0000","last_fullsized":"2024-09-19T08:38:08.531224+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:56.122833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.531016+0000","last_change":"2024-09-19T08:38:07.540830+0000","last_active":"2024-09-19T08:38:08.531016+0000","last_peered":"2024-09-19T08:38:08.531016+0000","last_clean":"2024-09-19T08:38:08.531016+0000","last_became_active":"2024-09-19T08:38:07.540540+0000","last_became_peered":"2024-09-19T08:38:07.540540+0000","last_unstale":"2024-09-19T08:38:08.531016+0000","last_undegraded":"2024-09-19T08:38:08.531016+0000","last_fullsized":"2024-09-19T08:38:08.531016+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:48.026967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743822+0000","last_change":"2024-09-19T08:38:07.533557+0000","last_active":"2024-09-19T08:38:08.743822+0000","last_peered":"2024-09-19T08:38:08.743822+0000","last_clean":"2024-09-19T08:38:08.743822+0000","last_became_active":"2024-09-19T08:38:07.533213+0000","last_became_peered":"2024-09-19T08:38:07.533213+0000","last_unstale":"2024-09-19T08:38:08.743822+0000","last_undegraded":"2024-09-19T08:38:08.743822+0000","last_fullsized":"2024-09-19T08:38:08.743822+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:58.034797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.656072+0000","last_change":"2024-09-19T08:38:07.539926+0000","last_active":"2024-09-19T08:38:08.656072+0000","last_peered":"2024-09-19T08:38:08.656072+0000","last_clean":"2024-09-19T08:38:08.656072+0000","last_became_active":"2024-09-19T08:38:07.539615+0000","last_became_peered":"2024-09-19T08:38:07.539615+0000","last_unstale":"2024-09-19T08:38:08.656072+0000","last_undegraded":"2024-09-19T08:38:08.656072+0000","last_fullsized":"2024-09-19T08:38:08.656072+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:16.212465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.745678+0000","last_change":"2024-09-19T08:38:07.533690+0000","last_active":"2024-09-19T08:38:08.745678+0000","last_peered":"2024-09-19T08:38:08.745678+0000","last_clean":"2024-09-19T08:38:08.745678+0000","last_became_active":"2024-09-19T08:38:07.533372+0000","last_became_peered":"2024-09-19T08:38:07.533372+0000","last_unstale":"2024-09-19T08:38:08.745678+0000","last_undegraded":"2024-09-19T08:38:08.745678+0000","last_fullsized":"2024-09-19T08:38:08.745678+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:08.234580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.530625+0000","last_change":"2024-09-19T08:38:07.538559+0000","last_active":"2024-09-19T08:38:08.530625+0000","last_peered":"2024-09-19T08:38:08.530625+0000","last_clean":"2024-09-19T08:38:08.530625+0000","last_became_active":"2024-09-19T08:38:07.538280+0000","last_became_peered":"2024-09-19T08:38:07.538280+0000","last_unstale":"2024-09-19T08:38:08.530625+0000","last_undegraded":"2024-09-19T08:38:08.530625+0000","last_fullsized":"2024-09-19T08:38:08.530625+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:02.406054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.744270+0000","last_change":"2024-09-19T08:38:07.530192+0000","last_active":"2024-09-19T08:38:08.744270+0000","last_peered":"2024-09-19T08:38:08.744270+0000","last_clean":"2024-09-19T08:38:08.744270+0000","last_became_active":"2024-09-19T08:38:07.529376+0000","last_became_peered":"2024-09-19T08:38:07.529376+0000","last_unstale":"2024-09-19T08:38:08.744270+0000","last_undegraded":"2024-09-19T08:38:08.744270+0000","last_fullsized":"2024-09-19T08:38:08.744270+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:19.810561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.745924+0000","last_change":"2024-09-19T08:38:07.540282+0000","last_active":"2024-09-19T08:38:08.745924+0000","last_peered":"2024-09-19T08:38:08.745924+0000","last_clean":"2024-09-19T08:38:08.745924+0000","last_became_active":"2024-09-19T08:38:07.540012+0000","last_became_peered":"2024-09-19T08:38:07.540012+0000","last_unstale":"2024-09-19T08:38:08.745924+0000","last_undegraded":"2024-09-19T08:38:08.745924+0000","last_fullsized":"2024-09-19T08:38:08.745924+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:36.027678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743769+0000","last_change":"2024-09-19T08:38:07.537549+0000","last_active":"2024-09-19T08:38:08.743769+0000","last_peered":"2024-09-19T08:38:08.743769+0000","last_clean":"2024-09-19T08:38:08.743769+0000","last_became_active":"2024-09-19T08:38:07.537286+0000","last_became_peered":"2024-09-19T08:38:07.537286+0000","last_unstale":"2024-09-19T08:38:08.743769+0000","last_undegraded":"2024-09-19T08:38:08.743769+0000","last_fullsized":"2024-09-19T08:38:08.743769+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:00.811980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743875+0000","last_change":"2024-09-19T08:38:07.532555+0000","last_active":"2024-09-19T08:38:08.743875+0000","last_peered":"2024-09-19T08:38:08.743875+0000","last_clean":"2024-09-19T08:38:08.743875+0000","last_became_active":"2024-09-19T08:38:07.532228+0000","last_became_peered":"2024-09-19T08:38:07.532228+0000","last_unstale":"2024-09-19T08:38:08.743875+0000","last_undegraded":"2024-09-19T08:38:08.743875+0000","last_fullsized":"2024-09-19T08:38:08.743875+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:41.768135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.745823+0000","last_change":"2024-09-19T08:38:07.540966+0000","last_active":"2024-09-19T08:38:08.745823+0000","last_peered":"2024-09-19T08:38:08.745823+0000","last_clean":"2024-09-19T08:38:08.745823+0000","last_became_active":"2024-09-19T08:38:07.540712+0000","last_became_peered":"2024-09-19T08:38:07.540712+0000","last_unstale":"2024-09-19T08:38:08.745823+0000","last_undegraded":"2024-09-19T08:38:08.745823+0000","last_fullsized":"2024-09-19T08:38:08.745823+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:52.224276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743117+0000","last_change":"2024-09-19T08:38:07.529548+0000","last_active":"2024-09-19T08:38:08.743117+0000","last_peered":"2024-09-19T08:38:08.743117+0000","last_clean":"2024-09-19T08:38:08.743117+0000","last_became_active":"2024-09-19T08:38:07.529287+0000","last_became_peered":"2024-09-19T08:38:07.529287+0000","last_unstale":"2024-09-19T08:38:08.743117+0000","last_undegraded":"2024-09-19T08:38:08.743117+0000","last_fullsized":"2024-09-19T08:38:08.743117+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:50.658879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.529270+0000","last_change":"2024-09-19T08:38:07.545433+0000","last_active":"2024-09-19T08:38:08.529270+0000","last_peered":"2024-09-19T08:38:08.529270+0000","last_clean":"2024-09-19T08:38:08.529270+0000","last_became_active":"2024-09-19T08:38:07.545141+0000","last_became_peered":"2024-09-19T08:38:07.545141+0000","last_unstale":"2024-09-19T08:38:08.529270+0000","last_undegraded":"2024-09-19T08:38:08.529270+0000","last_fullsized":"2024-09-19T08:38:08.529270+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:16.471195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.745493+0000","last_change":"2024-09-19T08:38:07.544816+0000","last_active":"2024-09-19T08:38:08.745493+0000","last_peered":"2024-09-19T08:38:08.745493+0000","last_clean":"2024-09-19T08:38:08.745493+0000","last_became_active":"2024-09-19T08:38:07.544566+0000","last_became_peered":"2024-09-19T08:38:07.544566+0000","last_unstale":"2024-09-19T08:38:08.745493+0000","last_undegraded":"2024-09-19T08:38:08.745493+0000","last_fullsized":"2024-09-19T08:38:08.745493+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:57.992180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.529691+0000","last_change":"2024-09-19T08:38:07.537976+0000","last_active":"2024-09-19T08:38:08.529691+0000","last_peered":"2024-09-19T08:38:08.529691+0000","last_clean":"2024-09-19T08:38:08.529691+0000","last_became_active":"2024-09-19T08:38:07.537314+0000","last_became_peered":"2024-09-19T08:38:07.537314+0000","last_unstale":"2024-09-19T08:38:08.529691+0000","last_undegraded":"2024-09-19T08:38:08.529691+0000","last_fullsized":"2024-09-19T08:38:08.529691+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:45.461102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.529889+0000","last_change":"2024-09-19T08:38:07.534872+0000","last_active":"2024-09-19T08:38:08.529889+0000","last_peered":"2024-09-19T08:38:08.529889+0000","last_clean":"2024-09-19T08:38:08.529889+0000","last_became_active":"2024-09-19T08:38:07.534614+0000","last_became_peered":"2024-09-19T08:38:07.534614+0000","last_unstale":"2024-09-19T08:38:08.529889+0000","last_undegraded":"2024-09-19T08:38:08.529889+0000","last_fullsized":"2024-09-19T08:38:08.529889+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:42.019006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743920+0000","last_change":"2024-09-19T08:38:07.545715+0000","last_active":"2024-09-19T08:38:08.743920+0000","last_peered":"2024-09-19T08:38:08.743920+0000","last_clean":"2024-09-19T08:38:08.743920+0000","last_became_active":"2024-09-19T08:38:07.545229+0000","last_became_peered":"2024-09-19T08:38:07.545229+0000","last_unstale":"2024-09-19T08:38:08.743920+0000","last_undegraded":"2024-09-19T08:38:08.743920+0000","last_fullsized":"2024-09-19T08:38:08.743920+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:00.496992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743296+0000","last_change":"2024-09-19T08:38:07.529626+0000","last_active":"2024-09-19T08:38:08.743296+0000","last_peered":"2024-09-19T08:38:08.743296+0000","last_clean":"2024-09-19T08:38:08.743296+0000","last_became_active":"2024-09-19T08:38:07.529383+0000","last_became_peered":"2024-09-19T08:38:07.529383+0000","last_unstale":"2024-09-19T08:38:08.743296+0000","last_undegraded":"2024-09-19T08:38:08.743296+0000","last_fullsized":"2024-09-19T08:38:08.743296+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:10:19.969772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743511+0000","last_change":"2024-09-19T08:38:07.531364+0000","last_active":"2024-09-19T08:38:08.743511+0000","last_peered":"2024-09-19T08:38:08.743511+0000","last_clean":"2024-09-19T08:38:08.743511+0000","last_became_active":"2024-09-19T08:38:07.531106+0000","last_became_peered":"2024-09-19T08:38:07.531106+0000","last_unstale":"2024-09-19T08:38:08.743511+0000","last_undegraded":"2024-09-19T08:38:08.743511+0000","last_fullsized":"2024-09-19T08:38:08.743511+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:21.597780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743337+0000","last_change":"2024-09-19T08:38:07.536947+0000","last_active":"2024-09-19T08:38:08.743337+0000","last_peered":"2024-09-19T08:38:08.743337+0000","last_clean":"2024-09-19T08:38:08.743337+0000","last_became_active":"2024-09-19T08:38:07.536653+0000","last_became_peered":"2024-09-19T08:38:07.536653+0000","last_unstale":"2024-09-19T08:38:08.743337+0000","last_undegraded":"2024-09-19T08:38:08.743337+0000","last_fullsized":"2024-09-19T08:38:08.743337+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:37.348001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.529273+0000","last_change":"2024-09-19T08:38:07.534746+0000","last_active":"2024-09-19T08:38:08.529273+0000","last_peered":"2024-09-19T08:38:08.529273+0000","last_clean":"2024-09-19T08:38:08.529273+0000","last_became_active":"2024-09-19T08:38:07.534346+0000","last_became_peered":"2024-09-19T08:38:07.534346+0000","last_unstale":"2024-09-19T08:38:08.529273+0000","last_undegraded":"2024-09-19T08:38:08.529273+0000","last_fullsized":"2024-09-19T08:38:08.529273+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:16.904147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.531045+0000","last_change":"2024-09-19T08:38:07.528950+0000","last_active":"2024-09-19T08:38:08.531045+0000","last_peered":"2024-09-19T08:38:08.531045+0000","last_clean":"2024-09-19T08:38:08.531045+0000","last_became_active":"2024-09-19T08:38:07.528396+0000","last_became_peered":"2024-09-19T08:38:07.528396+0000","last_unstale":"2024-09-19T08:38:08.531045+0000","last_undegraded":"2024-09-19T08:38:08.531045+0000","last_fullsized":"2024-09-19T08:38:08.531045+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:52.058623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743368+0000","last_change":"2024-09-19T08:38:07.527573+0000","last_active":"2024-09-19T08:38:08.743368+0000","last_peered":"2024-09-19T08:38:08.743368+0000","last_clean":"2024-09-19T08:38:08.743368+0000","last_became_active":"2024-09-19T08:38:07.527292+0000","last_became_peered":"2024-09-19T08:38:07.527292+0000","last_unstale":"2024-09-19T08:38:08.743368+0000","last_undegraded":"2024-09-19T08:38:08.743368+0000","last_fullsized":"2024-09-19T08:38:08.743368+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:25.760005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.530871+0000","last_change":"2024-09-19T08:38:07.537716+0000","last_active":"2024-09-19T08:38:08.530871+0000","last_peered":"2024-09-19T08:38:08.530871+0000","last_clean":"2024-09-19T08:38:08.530871+0000","last_became_active":"2024-09-19T08:38:07.536722+0000","last_became_peered":"2024-09-19T08:38:07.536722+0000","last_unstale":"2024-09-19T08:38:08.530871+0000","last_undegraded":"2024-09-19T08:38:08.530871+0000","last_fullsized":"2024-09-19T08:38:08.530871+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:40.434105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743804+0000","last_change":"2024-09-19T08:38:07.534232+0000","last_active":"2024-09-19T08:38:08.743804+0000","last_peered":"2024-09-19T08:38:08.743804+0000","last_clean":"2024-09-19T08:38:08.743804+0000","last_became_active":"2024-09-19T08:38:07.533951+0000","last_became_peered":"2024-09-19T08:38:07.533951+0000","last_unstale":"2024-09-19T08:38:08.743804+0000","last_undegraded":"2024-09-19T08:38:08.743804+0000","last_fullsized":"2024-09-19T08:38:08.743804+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:48.072005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.745773+0000","last_change":"2024-09-19T08:38:07.545424+0000","last_active":"2024-09-19T08:38:08.745773+0000","last_peered":"2024-09-19T08:38:08.745773+0000","last_clean":"2024-09-19T08:38:08.745773+0000","last_became_active":"2024-09-19T08:38:07.545186+0000","last_became_peered":"2024-09-19T08:38:07.545186+0000","last_unstale":"2024-09-19T08:38:08.745773+0000","last_undegraded":"2024-09-19T08:38:08.745773+0000","last_fullsized":"2024-09-19T08:38:08.745773+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:14.098170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.529373+0000","last_change":"2024-09-19T08:38:07.542019+0000","last_active":"2024-09-19T08:38:08.529373+0000","last_peered":"2024-09-19T08:38:08.529373+0000","last_clean":"2024-09-19T08:38:08.529373+0000","last_became_active":"2024-09-19T08:38:07.541767+0000","last_became_peered":"2024-09-19T08:38:07.541767+0000","last_unstale":"2024-09-19T08:38:08.529373+0000","last_undegraded":"2024-09-19T08:38:08.529373+0000","last_fullsized":"2024-09-19T08:38:08.529373+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:31.432474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.529451+0000","last_change":"2024-09-19T08:38:07.535225+0000","last_active":"2024-09-19T08:38:08.529451+0000","last_peered":"2024-09-19T08:38:08.529451+0000","last_clean":"2024-09-19T08:38:08.529451+0000","last_became_active":"2024-09-19T08:38:07.534353+0000","last_became_peered":"2024-09-19T08:38:07.534353+0000","last_unstale":"2024-09-19T08:38:08.529451+0000","last_undegraded":"2024-09-19T08:38:08.529451+0000","last_fullsized":"2024-09-19T08:38:08.529451+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:38.072000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.745673+0000","last_change":"2024-09-19T08:38:07.543840+0000","last_active":"2024-09-19T08:38:08.745673+0000","last_peered":"2024-09-19T08:38:08.745673+0000","last_clean":"2024-09-19T08:38:08.745673+0000","last_became_active":"2024-09-19T08:38:07.543613+0000","last_became_peered":"2024-09-19T08:38:07.543613+0000","last_unstale":"2024-09-19T08:38:08.745673+0000","last_undegraded":"2024-09-19T08:38:08.745673+0000","last_fullsized":"2024-09-19T08:38:08.745673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:02.504268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.530942+0000","last_change":"2024-09-19T08:38:07.537876+0000","last_active":"2024-09-19T08:38:08.530942+0000","last_peered":"2024-09-19T08:38:08.530942+0000","last_clean":"2024-09-19T08:38:08.530942+0000","last_became_active":"2024-09-19T08:38:07.537597+0000","last_became_peered":"2024-09-19T08:38:07.537597+0000","last_unstale":"2024-09-19T08:38:08.530942+0000","last_undegraded":"2024-09-19T08:38:08.530942+0000","last_fullsized":"2024-09-19T08:38:08.530942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:04.135346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.529501+0000","last_change":"2024-09-19T08:38:07.524888+0000","last_active":"2024-09-19T08:38:08.529501+0000","last_peered":"2024-09-19T08:38:08.529501+0000","last_clean":"2024-09-19T08:38:08.529501+0000","last_became_active":"2024-09-19T08:38:07.524571+0000","last_became_peered":"2024-09-19T08:38:07.524571+0000","last_unstale":"2024-09-19T08:38:08.529501+0000","last_undegraded":"2024-09-19T08:38:08.529501+0000","last_fullsized":"2024-09-19T08:38:08.529501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:55:30.368630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743468+0000","last_change":"2024-09-19T08:38:06.525759+0000","last_active":"2024-09-19T08:38:08.743468+0000","last_peered":"2024-09-19T08:38:08.743468+0000","last_clean":"2024-09-19T08:38:08.743468+0000","last_became_active":"2024-09-19T08:38:06.525478+0000","last_became_peered":"2024-09-19T08:38:06.525478+0000","last_unstale":"2024-09-19T08:38:08.743468+0000","last_undegraded":"2024-09-19T08:38:08.743468+0000","last_fullsized":"2024-09-19T08:38:08.743468+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:51.219417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.656280+0000","last_change":"2024-09-19T08:38:07.531888+0000","last_active":"2024-09-19T08:38:08.656280+0000","last_peered":"2024-09-19T08:38:08.656280+0000","last_clean":"2024-09-19T08:38:08.656280+0000","last_became_active":"2024-09-19T08:38:07.531490+0000","last_became_peered":"2024-09-19T08:38:07.531490+0000","last_unstale":"2024-09-19T08:38:08.656280+0000","last_undegraded":"2024-09-19T08:38:08.656280+0000","last_fullsized":"2024-09-19T08:38:08.656280+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:10:19.969772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.656544+0000","last_change":"2024-09-19T08:38:06.530592+0000","last_active":"2024-09-19T08:38:08.656544+0000","last_peered":"2024-09-19T08:38:08.656544+0000","last_clean":"2024-09-19T08:38:08.656544+0000","last_became_active":"2024-09-19T08:38:06.530244+0000","last_became_peered":"2024-09-19T08:38:06.530244+0000","last_unstale":"2024-09-19T08:38:08.656544+0000","last_undegraded":"2024-09-19T08:38:08.656544+0000","last_fullsized":"2024-09-19T08:38:08.656544+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:13.093311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.529974+0000","last_change":"2024-09-19T08:38:07.531423+0000","last_active":"2024-09-19T08:38:08.529974+0000","last_peered":"2024-09-19T08:38:08.529974+0000","last_clean":"2024-09-19T08:38:08.529974+0000","last_became_active":"2024-09-19T08:38:07.530451+0000","last_became_peered":"2024-09-19T08:38:07.530451+0000","last_unstale":"2024-09-19T08:38:08.529974+0000","last_undegraded":"2024-09-19T08:38:08.529974+0000","last_fullsized":"2024-09-19T08:38:08.529974+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:34.707158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.531521+0000","last_change":"2024-09-19T08:38:06.533569+0000","last_active":"2024-09-19T08:38:08.531521+0000","last_peered":"2024-09-19T08:38:08.531521+0000","last_clean":"2024-09-19T08:38:08.531521+0000","last_became_active":"2024-09-19T08:38:06.533287+0000","last_became_peered":"2024-09-19T08:38:06.533287+0000","last_unstale":"2024-09-19T08:38:08.531521+0000","last_undegraded":"2024-09-19T08:38:08.531521+0000","last_fullsized":"2024-09-19T08:38:08.531521+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:38.865465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.656539+0000","last_change":"2024-09-19T08:38:07.532181+0000","last_active":"2024-09-19T08:38:08.656539+0000","last_peered":"2024-09-19T08:38:08.656539+0000","last_clean":"2024-09-19T08:38:08.656539+0000","last_became_active":"2024-09-19T08:38:07.531882+0000","last_became_peered":"2024-09-19T08:38:07.531882+0000","last_unstale":"2024-09-19T08:38:08.656539+0000","last_undegraded":"2024-09-19T08:38:08.656539+0000","last_fullsized":"2024-09-19T08:38:08.656539+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:21.597780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743514+0000","last_change":"2024-09-19T08:38:06.523268+0000","last_active":"2024-09-19T08:38:08.743514+0000","last_peered":"2024-09-19T08:38:08.743514+0000","last_clean":"2024-09-19T08:38:08.743514+0000","last_became_active":"2024-09-19T08:38:06.523001+0000","last_became_peered":"2024-09-19T08:38:06.523001+0000","last_unstale":"2024-09-19T08:38:08.743514+0000","last_undegraded":"2024-09-19T08:38:08.743514+0000","last_fullsized":"2024-09-19T08:38:08.743514+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:13.093311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.531300+0000","last_change":"2024-09-19T08:38:07.543333+0000","last_active":"2024-09-19T08:38:08.531300+0000","last_peered":"2024-09-19T08:38:08.531300+0000","last_clean":"2024-09-19T08:38:08.531300+0000","last_became_active":"2024-09-19T08:38:07.543038+0000","last_became_peered":"2024-09-19T08:38:07.543038+0000","last_unstale":"2024-09-19T08:38:08.531300+0000","last_undegraded":"2024-09-19T08:38:08.531300+0000","last_fullsized":"2024-09-19T08:38:08.531300+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:24.284414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743139+0000","last_change":"2024-09-19T08:38:06.526836+0000","last_active":"2024-09-19T08:38:08.743139+0000","last_peered":"2024-09-19T08:38:08.743139+0000","last_clean":"2024-09-19T08:38:08.743139+0000","last_became_active":"2024-09-19T08:38:06.526218+0000","last_became_peered":"2024-09-19T08:38:06.526218+0000","last_unstale":"2024-09-19T08:38:08.743139+0000","last_undegraded":"2024-09-19T08:38:08.743139+0000","last_fullsized":"2024-09-19T08:38:08.743139+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:26.454464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743306+0000","last_change":"2024-09-19T08:38:07.532263+0000","last_active":"2024-09-19T08:38:08.743306+0000","last_peered":"2024-09-19T08:38:08.743306+0000","last_clean":"2024-09-19T08:38:08.743306+0000","last_became_active":"2024-09-19T08:38:07.531859+0000","last_became_peered":"2024-09-19T08:38:07.531859+0000","last_unstale":"2024-09-19T08:38:08.743306+0000","last_undegraded":"2024-09-19T08:38:08.743306+0000","last_fullsized":"2024-09-19T08:38:08.743306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:00.496992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.745620+0000","last_change":"2024-09-19T08:38:06.536127+0000","last_active":"2024-09-19T08:38:08.745620+0000","last_peered":"2024-09-19T08:38:08.745620+0000","last_clean":"2024-09-19T08:38:08.745620+0000","last_became_active":"2024-09-19T08:38:06.535869+0000","last_became_peered":"2024-09-19T08:38:06.535869+0000","last_unstale":"2024-09-19T08:38:08.745620+0000","last_undegraded":"2024-09-19T08:38:08.745620+0000","last_fullsized":"2024-09-19T08:38:08.745620+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:42.251124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.529627+0000","last_change":"2024-09-19T08:38:07.525733+0000","last_active":"2024-09-19T08:38:08.529627+0000","last_peered":"2024-09-19T08:38:08.529627+0000","last_clean":"2024-09-19T08:38:08.529627+0000","last_became_active":"2024-09-19T08:38:07.525459+0000","last_became_peered":"2024-09-19T08:38:07.525459+0000","last_unstale":"2024-09-19T08:38:08.529627+0000","last_undegraded":"2024-09-19T08:38:08.529627+0000","last_fullsized":"2024-09-19T08:38:08.529627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:08.914692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.530553+0000","last_change":"2024-09-19T08:38:06.524509+0000","last_active":"2024-09-19T08:38:08.530553+0000","last_peered":"2024-09-19T08:38:08.530553+0000","last_clean":"2024-09-19T08:38:08.530553+0000","last_became_active":"2024-09-19T08:38:06.524232+0000","last_became_peered":"2024-09-19T08:38:06.524232+0000","last_unstale":"2024-09-19T08:38:08.530553+0000","last_undegraded":"2024-09-19T08:38:08.530553+0000","last_fullsized":"2024-09-19T08:38:08.530553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:04.695482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.656228+0000","last_change":"2024-09-19T08:38:07.532163+0000","last_active":"2024-09-19T08:38:08.656228+0000","last_peered":"2024-09-19T08:38:08.656228+0000","last_clean":"2024-09-19T08:38:08.656228+0000","last_became_active":"2024-09-19T08:38:07.531830+0000","last_became_peered":"2024-09-19T08:38:07.531830+0000","last_unstale":"2024-09-19T08:38:08.656228+0000","last_undegraded":"2024-09-19T08:38:08.656228+0000","last_fullsized":"2024-09-19T08:38:08.656228+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:28.106093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.745601+0000","last_change":"2024-09-19T08:38:06.533229+0000","last_active":"2024-09-19T08:38:08.745601+0000","last_peered":"2024-09-19T08:38:08.745601+0000","last_clean":"2024-09-19T08:38:08.745601+0000","last_became_active":"2024-09-19T08:38:06.532969+0000","last_became_peered":"2024-09-19T08:38:06.532969+0000","last_unstale":"2024-09-19T08:38:08.745601+0000","last_undegraded":"2024-09-19T08:38:08.745601+0000","last_fullsized":"2024-09-19T08:38:08.745601+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:07.762050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.531223+0000","last_change":"2024-09-19T08:38:07.540197+0000","last_active":"2024-09-19T08:38:08.531223+0000","last_peered":"2024-09-19T08:38:08.531223+0000","last_clean":"2024-09-19T08:38:08.531223+0000","last_became_active":"2024-09-19T08:38:07.539935+0000","last_became_peered":"2024-09-19T08:38:07.539935+0000","last_unstale":"2024-09-19T08:38:08.531223+0000","last_undegraded":"2024-09-19T08:38:08.531223+0000","last_fullsized":"2024-09-19T08:38:08.531223+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:22.610446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.531089+0000","last_change":"2024-09-19T08:38:06.525562+0000","last_active":"2024-09-19T08:38:08.531089+0000","last_peered":"2024-09-19T08:38:08.531089+0000","last_clean":"2024-09-19T08:38:08.531089+0000","last_became_active":"2024-09-19T08:38:06.524991+0000","last_became_peered":"2024-09-19T08:38:06.524991+0000","last_unstale":"2024-09-19T08:38:08.531089+0000","last_undegraded":"2024-09-19T08:38:08.531089+0000","last_fullsized":"2024-09-19T08:38:08.531089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:39:23.569061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743375+0000","last_change":"2024-09-19T08:38:07.530778+0000","last_active":"2024-09-19T08:38:08.743375+0000","last_peered":"2024-09-19T08:38:08.743375+0000","last_clean":"2024-09-19T08:38:08.743375+0000","last_became_active":"2024-09-19T08:38:07.530451+0000","last_became_peered":"2024-09-19T08:38:07.530451+0000","last_unstale":"2024-09-19T08:38:08.743375+0000","last_undegraded":"2024-09-19T08:38:08.743375+0000","last_fullsized":"2024-09-19T08:38:08.743375+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:39:24.573920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.529842+0000","last_change":"2024-09-19T08:38:06.531379+0000","last_active":"2024-09-19T08:38:08.529842+0000","last_peered":"2024-09-19T08:38:08.529842+0000","last_clean":"2024-09-19T08:38:08.529842+0000","last_became_active":"2024-09-19T08:38:06.530810+0000","last_became_peered":"2024-09-19T08:38:06.530810+0000","last_unstale":"2024-09-19T08:38:08.529842+0000","last_undegraded":"2024-09-19T08:38:08.529842+0000","last_fullsized":"2024-09-19T08:38:08.529842+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:09.335816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.531201+0000","last_change":"2024-09-19T08:38:07.546195+0000","last_active":"2024-09-19T08:38:08.531201+0000","last_peered":"2024-09-19T08:38:08.531201+0000","last_clean":"2024-09-19T08:38:08.531201+0000","last_became_active":"2024-09-19T08:38:07.545895+0000","last_became_peered":"2024-09-19T08:38:07.545895+0000","last_unstale":"2024-09-19T08:38:08.531201+0000","last_undegraded":"2024-09-19T08:38:08.531201+0000","last_fullsized":"2024-09-19T08:38:08.531201+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:17.549337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.529516+0000","last_change":"2024-09-19T08:38:06.525652+0000","last_active":"2024-09-19T08:38:08.529516+0000","last_peered":"2024-09-19T08:38:08.529516+0000","last_clean":"2024-09-19T08:38:08.529516+0000","last_became_active":"2024-09-19T08:38:06.525395+0000","last_became_peered":"2024-09-19T08:38:06.525395+0000","last_unstale":"2024-09-19T08:38:08.529516+0000","last_undegraded":"2024-09-19T08:38:08.529516+0000","last_fullsized":"2024-09-19T08:38:08.529516+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:47.067145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.746056+0000","last_change":"2024-09-19T08:38:07.536032+0000","last_active":"2024-09-19T08:38:08.746056+0000","last_peered":"2024-09-19T08:38:08.746056+0000","last_clean":"2024-09-19T08:38:08.746056+0000","last_became_active":"2024-09-19T08:38:07.535739+0000","last_became_peered":"2024-09-19T08:38:07.535739+0000","last_unstale":"2024-09-19T08:38:08.746056+0000","last_undegraded":"2024-09-19T08:38:08.746056+0000","last_fullsized":"2024-09-19T08:38:08.746056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:05.700341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.531288+0000","last_change":"2024-09-19T08:38:06.524138+0000","last_active":"2024-09-19T08:38:08.531288+0000","last_peered":"2024-09-19T08:38:08.531288+0000","last_clean":"2024-09-19T08:38:08.531288+0000","last_became_active":"2024-09-19T08:38:06.523848+0000","last_became_peered":"2024-09-19T08:38:06.523848+0000","last_unstale":"2024-09-19T08:38:08.531288+0000","last_undegraded":"2024-09-19T08:38:08.531288+0000","last_fullsized":"2024-09-19T08:38:08.531288+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:15.207606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.531424+0000","last_change":"2024-09-19T08:38:07.528149+0000","last_active":"2024-09-19T08:38:08.531424+0000","last_peered":"2024-09-19T08:38:08.531424+0000","last_clean":"2024-09-19T08:38:08.531424+0000","last_became_active":"2024-09-19T08:38:07.527769+0000","last_became_peered":"2024-09-19T08:38:07.527769+0000","last_unstale":"2024-09-19T08:38:08.531424+0000","last_undegraded":"2024-09-19T08:38:08.531424+0000","last_fullsized":"2024-09-19T08:38:08.531424+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:06.764017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.530788+0000","last_change":"2024-09-19T08:38:06.530737+0000","last_active":"2024-09-19T08:38:08.530788+0000","last_peered":"2024-09-19T08:38:08.530788+0000","last_clean":"2024-09-19T08:38:08.530788+0000","last_became_active":"2024-09-19T08:38:06.530436+0000","last_became_peered":"2024-09-19T08:38:06.530436+0000","last_unstale":"2024-09-19T08:38:08.530788+0000","last_undegraded":"2024-09-19T08:38:08.530788+0000","last_fullsized":"2024-09-19T08:38:08.530788+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:49.654020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.656092+0000","last_change":"2024-09-19T08:38:07.534665+0000","last_active":"2024-09-19T08:38:08.656092+0000","last_peered":"2024-09-19T08:38:08.656092+0000","last_clean":"2024-09-19T08:38:08.656092+0000","last_became_active":"2024-09-19T08:38:07.534413+0000","last_became_peered":"2024-09-19T08:38:07.534413+0000","last_unstale":"2024-09-19T08:38:08.656092+0000","last_undegraded":"2024-09-19T08:38:08.656092+0000","last_fullsized":"2024-09-19T08:38:08.656092+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:39.870324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.656074+0000","last_change":"2024-09-19T08:38:06.533437+0000","last_active":"2024-09-19T08:38:08.656074+0000","last_peered":"2024-09-19T08:38:08.656074+0000","last_clean":"2024-09-19T08:38:08.656074+0000","last_became_active":"2024-09-19T08:38:06.533139+0000","last_became_peered":"2024-09-19T08:38:06.533139+0000","last_unstale":"2024-09-19T08:38:08.656074+0000","last_undegraded":"2024-09-19T08:38:08.656074+0000","last_fullsized":"2024-09-19T08:38:08.656074+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:01.499409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743626+0000","last_change":"2024-09-19T08:38:07.528607+0000","last_active":"2024-09-19T08:38:08.743626+0000","last_peered":"2024-09-19T08:38:08.743626+0000","last_clean":"2024-09-19T08:38:08.743626+0000","last_became_active":"2024-09-19T08:38:07.528307+0000","last_became_peered":"2024-09-19T08:38:07.528307+0000","last_unstale":"2024-09-19T08:38:08.743626+0000","last_undegraded":"2024-09-19T08:38:08.743626+0000","last_fullsized":"2024-09-19T08:38:08.743626+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:39.609621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.529472+0000","last_change":"2024-09-19T08:38:06.523001+0000","last_active":"2024-09-19T08:38:08.529472+0000","last_peered":"2024-09-19T08:38:08.529472+0000","last_clean":"2024-09-19T08:38:08.529472+0000","last_became_active":"2024-09-19T08:38:06.522686+0000","last_became_peered":"2024-09-19T08:38:06.522686+0000","last_unstale":"2024-09-19T08:38:08.529472+0000","last_undegraded":"2024-09-19T08:38:08.529472+0000","last_fullsized":"2024-09-19T08:38:08.529472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:44.025597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743995+0000","last_change":"2024-09-19T08:38:07.533384+0000","last_active":"2024-09-19T08:38:08.743995+0000","last_peered":"2024-09-19T08:38:08.743995+0000","last_clean":"2024-09-19T08:38:08.743995+0000","last_became_active":"2024-09-19T08:38:07.533033+0000","last_became_peered":"2024-09-19T08:38:07.533033+0000","last_unstale":"2024-09-19T08:38:08.743995+0000","last_undegraded":"2024-09-19T08:38:08.743995+0000","last_fullsized":"2024-09-19T08:38:08.743995+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:48.100744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743124+0000","last_change":"2024-09-19T08:38:06.529230+0000","last_active":"2024-09-19T08:38:08.743124+0000","last_peered":"2024-09-19T08:38:08.743124+0000","last_clean":"2024-09-19T08:38:08.743124+0000","last_became_active":"2024-09-19T08:38:06.528958+0000","last_became_peered":"2024-09-19T08:38:06.528958+0000","last_unstale":"2024-09-19T08:38:08.743124+0000","last_undegraded":"2024-09-19T08:38:08.743124+0000","last_fullsized":"2024-09-19T08:38:08.743124+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:07.229721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.656285+0000","last_change":"2024-09-19T08:38:07.535227+0000","last_active":"2024-09-19T08:38:08.656285+0000","last_peered":"2024-09-19T08:38:08.656285+0000","last_clean":"2024-09-19T08:38:08.656285+0000","last_became_active":"2024-09-19T08:38:07.534958+0000","last_became_peered":"2024-09-19T08:38:07.534958+0000","last_unstale":"2024-09-19T08:38:08.656285+0000","last_undegraded":"2024-09-19T08:38:08.656285+0000","last_fullsized":"2024-09-19T08:38:08.656285+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:00.496992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.746010+0000","last_change":"2024-09-19T08:38:06.534098+0000","last_active":"2024-09-19T08:38:08.746010+0000","last_peered":"2024-09-19T08:38:08.746010+0000","last_clean":"2024-09-19T08:38:08.746010+0000","last_became_active":"2024-09-19T08:38:06.533792+0000","last_became_peered":"2024-09-19T08:38:06.533792+0000","last_unstale":"2024-09-19T08:38:08.746010+0000","last_undegraded":"2024-09-19T08:38:08.746010+0000","last_fullsized":"2024-09-19T08:38:08.746010+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:14.742356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.745864+0000","last_change":"2024-09-19T08:38:07.542824+0000","last_active":"2024-09-19T08:38:08.745864+0000","last_peered":"2024-09-19T08:38:08.745864+0000","last_clean":"2024-09-19T08:38:08.745864+0000","last_became_active":"2024-09-19T08:38:07.542600+0000","last_became_peered":"2024-09-19T08:38:07.542600+0000","last_unstale":"2024-09-19T08:38:08.745864+0000","last_undegraded":"2024-09-19T08:38:08.745864+0000","last_fullsized":"2024-09-19T08:38:08.745864+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:27.459323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.529978+0000","last_change":"2024-09-19T08:38:06.527561+0000","last_active":"2024-09-19T08:38:08.529978+0000","last_peered":"2024-09-19T08:38:08.529978+0000","last_clean":"2024-09-19T08:38:08.529978+0000","last_became_active":"2024-09-19T08:38:06.527305+0000","last_became_peered":"2024-09-19T08:38:06.527305+0000","last_unstale":"2024-09-19T08:38:08.529978+0000","last_undegraded":"2024-09-19T08:38:08.529978+0000","last_fullsized":"2024-09-19T08:38:08.529978+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:01.401195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.746035+0000","last_change":"2024-09-19T08:38:07.540296+0000","last_active":"2024-09-19T08:38:08.746035+0000","last_peered":"2024-09-19T08:38:08.746035+0000","last_clean":"2024-09-19T08:38:08.746035+0000","last_became_active":"2024-09-19T08:38:07.540039+0000","last_became_peered":"2024-09-19T08:38:07.540039+0000","last_unstale":"2024-09-19T08:38:08.746035+0000","last_undegraded":"2024-09-19T08:38:08.746035+0000","last_fullsized":"2024-09-19T08:38:08.746035+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:37.057112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.744025+0000","last_change":"2024-09-19T08:38:06.531385+0000","last_active":"2024-09-19T08:38:08.744025+0000","last_peered":"2024-09-19T08:38:08.744025+0000","last_clean":"2024-09-19T08:38:08.744025+0000","last_became_active":"2024-09-19T08:38:06.530719+0000","last_became_peered":"2024-09-19T08:38:06.530719+0000","last_unstale":"2024-09-19T08:38:08.744025+0000","last_undegraded":"2024-09-19T08:38:08.744025+0000","last_fullsized":"2024-09-19T08:38:08.744025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:11.876210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743897+0000","last_change":"2024-09-19T08:38:07.544987+0000","last_active":"2024-09-19T08:38:08.743897+0000","last_peered":"2024-09-19T08:38:08.743897+0000","last_clean":"2024-09-19T08:38:08.743897+0000","last_became_active":"2024-09-19T08:38:07.544698+0000","last_became_peered":"2024-09-19T08:38:07.544698+0000","last_unstale":"2024-09-19T08:38:08.743897+0000","last_undegraded":"2024-09-19T08:38:08.743897+0000","last_fullsized":"2024-09-19T08:38:08.743897+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:10:19.969772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743590+0000","last_change":"2024-09-19T08:38:06.529491+0000","last_active":"2024-09-19T08:38:08.743590+0000","last_peered":"2024-09-19T08:38:08.743590+0000","last_clean":"2024-09-19T08:38:08.743590+0000","last_became_active":"2024-09-19T08:38:06.529160+0000","last_became_peered":"2024-09-19T08:38:06.529160+0000","last_unstale":"2024-09-19T08:38:08.743590+0000","last_undegraded":"2024-09-19T08:38:08.743590+0000","last_fullsized":"2024-09-19T08:38:08.743590+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:39:23.569061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.529252+0000","last_change":"2024-09-19T08:38:07.535131+0000","last_active":"2024-09-19T08:38:08.529252+0000","last_peered":"2024-09-19T08:38:08.529252+0000","last_clean":"2024-09-19T08:38:08.529252+0000","last_became_active":"2024-09-19T08:38:07.534150+0000","last_became_peered":"2024-09-19T08:38:07.534150+0000","last_unstale":"2024-09-19T08:38:08.529252+0000","last_undegraded":"2024-09-19T08:38:08.529252+0000","last_fullsized":"2024-09-19T08:38:08.529252+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:14.191465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743769+0000","last_change":"2024-09-19T08:38:06.526582+0000","last_active":"2024-09-19T08:38:08.743769+0000","last_peered":"2024-09-19T08:38:08.743769+0000","last_clean":"2024-09-19T08:38:08.743769+0000","last_became_active":"2024-09-19T08:38:06.526290+0000","last_became_peered":"2024-09-19T08:38:06.526290+0000","last_unstale":"2024-09-19T08:38:08.743769+0000","last_undegraded":"2024-09-19T08:38:08.743769+0000","last_fullsized":"2024-09-19T08:38:08.743769+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:24.755146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.530602+0000","last_change":"2024-09-19T08:38:07.537281+0000","last_active":"2024-09-19T08:38:08.530602+0000","last_peered":"2024-09-19T08:38:08.530602+0000","last_clean":"2024-09-19T08:38:08.530602+0000","last_became_active":"2024-09-19T08:38:07.535976+0000","last_became_peered":"2024-09-19T08:38:07.535976+0000","last_unstale":"2024-09-19T08:38:08.530602+0000","last_undegraded":"2024-09-19T08:38:08.530602+0000","last_fullsized":"2024-09-19T08:38:08.530602+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:10.340675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.656233+0000","last_change":"2024-09-19T08:38:06.531426+0000","last_active":"2024-09-19T08:38:08.656233+0000","last_peered":"2024-09-19T08:38:08.656233+0000","last_clean":"2024-09-19T08:38:08.656233+0000","last_became_active":"2024-09-19T08:38:06.531074+0000","last_became_peered":"2024-09-19T08:38:06.531074+0000","last_unstale":"2024-09-19T08:38:08.656233+0000","last_undegraded":"2024-09-19T08:38:08.656233+0000","last_fullsized":"2024-09-19T08:38:08.656233+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:07.229721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743546+0000","last_change":"2024-09-19T08:38:07.536724+0000","last_active":"2024-09-19T08:38:08.743546+0000","last_peered":"2024-09-19T08:38:08.743546+0000","last_clean":"2024-09-19T08:38:08.743546+0000","last_became_active":"2024-09-19T08:38:07.536317+0000","last_became_peered":"2024-09-19T08:38:07.536317+0000","last_unstale":"2024-09-19T08:38:08.743546+0000","last_undegraded":"2024-09-19T08:38:08.743546+0000","last_fullsized":"2024-09-19T08:38:08.743546+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:38:38.775582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.745825+0000","last_change":"2024-09-19T08:38:06.533258+0000","last_active":"2024-09-19T08:38:08.745825+0000","last_peered":"2024-09-19T08:38:08.745825+0000","last_clean":"2024-09-19T08:38:08.745825+0000","last_became_active":"2024-09-19T08:38:06.533008+0000","last_became_peered":"2024-09-19T08:38:06.533008+0000","last_unstale":"2024-09-19T08:38:08.745825+0000","last_undegraded":"2024-09-19T08:38:08.745825+0000","last_fullsized":"2024-09-19T08:38:08.745825+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:07.128438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.530695+0000","last_change":"2024-09-19T08:38:07.538667+0000","last_active":"2024-09-19T08:38:08.530695+0000","last_peered":"2024-09-19T08:38:08.530695+0000","last_clean":"2024-09-19T08:38:08.530695+0000","last_became_active":"2024-09-19T08:38:07.538327+0000","last_became_peered":"2024-09-19T08:38:07.538327+0000","last_unstale":"2024-09-19T08:38:08.530695+0000","last_undegraded":"2024-09-19T08:38:08.530695+0000","last_fullsized":"2024-09-19T08:38:08.530695+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:06.339635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.655920+0000","last_change":"2024-09-19T08:38:06.533577+0000","last_active":"2024-09-19T08:38:08.655920+0000","last_peered":"2024-09-19T08:38:08.655920+0000","last_clean":"2024-09-19T08:38:08.655920+0000","last_became_active":"2024-09-19T08:38:06.533276+0000","last_became_peered":"2024-09-19T08:38:06.533276+0000","last_unstale":"2024-09-19T08:38:08.655920+0000","last_undegraded":"2024-09-19T08:38:08.655920+0000","last_fullsized":"2024-09-19T08:38:08.655920+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:56.987321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.744209+0000","last_change":"2024-09-19T08:38:07.535201+0000","last_active":"2024-09-19T08:38:08.744209+0000","last_peered":"2024-09-19T08:38:08.744209+0000","last_clean":"2024-09-19T08:38:08.744209+0000","last_became_active":"2024-09-19T08:38:07.534853+0000","last_became_peered":"2024-09-19T08:38:07.534853+0000","last_unstale":"2024-09-19T08:38:08.744209+0000","last_undegraded":"2024-09-19T08:38:08.744209+0000","last_fullsized":"2024-09-19T08:38:08.744209+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:03.807776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.529706+0000","last_change":"2024-09-19T08:38:06.532515+0000","last_active":"2024-09-19T08:38:08.529706+0000","last_peered":"2024-09-19T08:38:08.529706+0000","last_clean":"2024-09-19T08:38:08.529706+0000","last_became_active":"2024-09-19T08:38:06.532253+0000","last_became_peered":"2024-09-19T08:38:06.532253+0000","last_unstale":"2024-09-19T08:38:08.529706+0000","last_undegraded":"2024-09-19T08:38:08.529706+0000","last_fullsized":"2024-09-19T08:38:08.529706+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:40.572564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743939+0000","last_change":"2024-09-19T08:38:07.536519+0000","last_active":"2024-09-19T08:38:08.743939+0000","last_peered":"2024-09-19T08:38:08.743939+0000","last_clean":"2024-09-19T08:38:08.743939+0000","last_became_active":"2024-09-19T08:38:07.536164+0000","last_became_peered":"2024-09-19T08:38:07.536164+0000","last_unstale":"2024-09-19T08:38:08.743939+0000","last_undegraded":"2024-09-19T08:38:08.743939+0000","last_fullsized":"2024-09-19T08:38:08.743939+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:41.577423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.744058+0000","last_change":"2024-09-19T08:38:06.528829+0000","last_active":"2024-09-19T08:38:08.744058+0000","last_peered":"2024-09-19T08:38:08.744058+0000","last_clean":"2024-09-19T08:38:08.744058+0000","last_became_active":"2024-09-19T08:38:06.528539+0000","last_became_peered":"2024-09-19T08:38:06.528539+0000","last_unstale":"2024-09-19T08:38:08.744058+0000","last_undegraded":"2024-09-19T08:38:08.744058+0000","last_fullsized":"2024-09-19T08:38:08.744058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:50.333495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743799+0000","last_change":"2024-09-19T08:38:07.540502+0000","last_active":"2024-09-19T08:38:08.743799+0000","last_peered":"2024-09-19T08:38:08.743799+0000","last_clean":"2024-09-19T08:38:08.743799+0000","last_became_active":"2024-09-19T08:38:07.540240+0000","last_became_peered":"2024-09-19T08:38:07.540240+0000","last_unstale":"2024-09-19T08:38:08.743799+0000","last_undegraded":"2024-09-19T08:38:08.743799+0000","last_fullsized":"2024-09-19T08:38:08.743799+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:28.106093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.744142+0000","last_change":"2024-09-19T08:38:06.528517+0000","last_active":"2024-09-19T08:38:08.744142+0000","last_peered":"2024-09-19T08:38:08.744142+0000","last_clean":"2024-09-19T08:38:08.744142+0000","last_became_active":"2024-09-19T08:38:06.528199+0000","last_became_peered":"2024-09-19T08:38:06.528199+0000","last_unstale":"2024-09-19T08:38:08.744142+0000","last_undegraded":"2024-09-19T08:38:08.744142+0000","last_fullsized":"2024-09-19T08:38:08.744142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:40.625606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743648+0000","last_change":"2024-09-19T08:38:07.527504+0000","last_active":"2024-09-19T08:38:08.743648+0000","last_peered":"2024-09-19T08:38:08.743648+0000","last_clean":"2024-09-19T08:38:08.743648+0000","last_became_active":"2024-09-19T08:38:07.527242+0000","last_became_peered":"2024-09-19T08:38:07.527242+0000","last_unstale":"2024-09-19T08:38:08.743648+0000","last_undegraded":"2024-09-19T08:38:08.743648+0000","last_fullsized":"2024-09-19T08:38:08.743648+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:53.941293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.531232+0000","last_change":"2024-09-19T08:38:06.530799+0000","last_active":"2024-09-19T08:38:08.531232+0000","last_peered":"2024-09-19T08:38:08.531232+0000","last_clean":"2024-09-19T08:38:08.531232+0000","last_became_active":"2024-09-19T08:38:06.530484+0000","last_became_peered":"2024-09-19T08:38:06.530484+0000","last_unstale":"2024-09-19T08:38:08.531232+0000","last_undegraded":"2024-09-19T08:38:08.531232+0000","last_fullsized":"2024-09-19T08:38:08.531232+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:24.755146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.656159+0000","last_change":"2024-09-19T08:38:07.531420+0000","last_active":"2024-09-19T08:38:08.656159+0000","last_peered":"2024-09-19T08:38:08.656159+0000","last_clean":"2024-09-19T08:38:08.656159+0000","last_became_active":"2024-09-19T08:38:07.530995+0000","last_became_peered":"2024-09-19T08:38:07.530995+0000","last_unstale":"2024-09-19T08:38:08.656159+0000","last_undegraded":"2024-09-19T08:38:08.656159+0000","last_fullsized":"2024-09-19T08:38:08.656159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:23.746317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743653+0000","last_change":"2024-09-19T08:38:06.528224+0000","last_active":"2024-09-19T08:38:08.743653+0000","last_peered":"2024-09-19T08:38:08.743653+0000","last_clean":"2024-09-19T08:38:08.743653+0000","last_became_active":"2024-09-19T08:38:06.527744+0000","last_became_peered":"2024-09-19T08:38:06.527744+0000","last_unstale":"2024-09-19T08:38:08.743653+0000","last_undegraded":"2024-09-19T08:38:08.743653+0000","last_fullsized":"2024-09-19T08:38:08.743653+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:51.219417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.529739+0000","last_change":"2024-09-19T08:38:07.531244+0000","last_active":"2024-09-19T08:38:08.529739+0000","last_peered":"2024-09-19T08:38:08.529739+0000","last_clean":"2024-09-19T08:38:08.529739+0000","last_became_active":"2024-09-19T08:38:07.529928+0000","last_became_peered":"2024-09-19T08:38:07.529928+0000","last_unstale":"2024-09-19T08:38:08.529739+0000","last_undegraded":"2024-09-19T08:38:08.529739+0000","last_fullsized":"2024-09-19T08:38:08.529739+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:57.694493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.529665+0000","last_change":"2024-09-19T08:38:06.533024+0000","last_active":"2024-09-19T08:38:08.529665+0000","last_peered":"2024-09-19T08:38:08.529665+0000","last_clean":"2024-09-19T08:38:08.529665+0000","last_became_active":"2024-09-19T08:38:06.532728+0000","last_became_peered":"2024-09-19T08:38:06.532728+0000","last_unstale":"2024-09-19T08:38:08.529665+0000","last_undegraded":"2024-09-19T08:38:08.529665+0000","last_fullsized":"2024-09-19T08:38:08.529665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:47.942354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743639+0000","last_change":"2024-09-19T08:38:07.543172+0000","last_active":"2024-09-19T08:38:08.743639+0000","last_peered":"2024-09-19T08:38:08.743639+0000","last_clean":"2024-09-19T08:38:08.743639+0000","last_became_active":"2024-09-19T08:38:07.542886+0000","last_became_peered":"2024-09-19T08:38:07.542886+0000","last_unstale":"2024-09-19T08:38:08.743639+0000","last_undegraded":"2024-09-19T08:38:08.743639+0000","last_fullsized":"2024-09-19T08:38:08.743639+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:55.751324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.531402+0000","last_change":"2024-09-19T08:38:06.525546+0000","last_active":"2024-09-19T08:38:08.531402+0000","last_peered":"2024-09-19T08:38:08.531402+0000","last_clean":"2024-09-19T08:38:08.531402+0000","last_became_active":"2024-09-19T08:38:06.525227+0000","last_became_peered":"2024-09-19T08:38:06.525227+0000","last_unstale":"2024-09-19T08:38:08.531402+0000","last_undegraded":"2024-09-19T08:38:08.531402+0000","last_fullsized":"2024-09-19T08:38:08.531402+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:44.073925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.529613+0000","last_change":"2024-09-19T08:38:07.541431+0000","last_active":"2024-09-19T08:38:08.529613+0000","last_peered":"2024-09-19T08:38:08.529613+0000","last_clean":"2024-09-19T08:38:08.529613+0000","last_became_active":"2024-09-19T08:38:07.541183+0000","last_became_peered":"2024-09-19T08:38:07.541183+0000","last_unstale":"2024-09-19T08:38:08.529613+0000","last_undegraded":"2024-09-19T08:38:08.529613+0000","last_fullsized":"2024-09-19T08:38:08.529613+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:06.505288+0000","last_clean_scrub_stamp":"2024-09-19T08:38:06.505288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:25.424199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.743398+0000","last_change":"2024-09-19T08:38:06.526379+0000","last_active":"2024-09-19T08:38:08.743398+0000","last_peered":"2024-09-19T08:38:08.743398+0000","last_clean":"2024-09-19T08:38:08.743398+0000","last_became_active":"2024-09-19T08:38:06.525731+0000","last_became_peered":"2024-09-19T08:38:06.525731+0000","last_unstale":"2024-09-19T08:38:08.743398+0000","last_undegraded":"2024-09-19T08:38:08.743398+0000","last_fullsized":"2024-09-19T08:38:08.743398+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:05.500429+0000","last_clean_scrub_stamp":"2024-09-19T08:38:05.500429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:26.454464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":202,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-19T08:38:08.745670+0000","last_change":"2024-09-19T08:37:04.479071+0000","last_active":"2024-09-19T08:38:08.745670+0000","last_peered":"2024-09-19T08:38:08.745670+0000","last_clean":"2024-09-19T08:38:08.745670+0000","last_became_active":"2024-09-19T08:37:04.478199+0000","last_became_peered":"2024-09-19T08:37:04.478199+0000","last_unstale":"2024-09-19T08:38:08.745670+0000","last_undegraded":"2024-09-19T08:38:08.745670+0000","last_fullsized":"2024-09-19T08:38:08.745670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_clean_scrub_stamp":"2024-09-19T08:37:02.519738+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:32.963748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":194536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1052672,"data_stored":785452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":475136,"data_stored":196238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":194592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":471040,"data_stored":196696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1052672,"data_stored":784892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":462848,"data_stored":194594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":194572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:38:15.150 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T08:38:15.150 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T08:38:15.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.291+0000 7fda8ae47640 1 Processor -- start 2024-09-19T08:38:15.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.292+0000 7fda8ae47640 1 -- start start 2024-09-19T08:38:15.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.292+0000 7fda8ae47640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fda84145bb0 0x7fda840b0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:15.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.292+0000 7fda8ae47640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda8415fe70 0x7fda841602b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:15.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.292+0000 7fda8ae47640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fda840b5980 0x7fda840b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:15.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.292+0000 7fda8ae47640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fda840af9c0 con 0x7fda84145bb0 2024-09-19T08:38:15.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.292+0000 7fda8ae47640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fda841608c0 con 0x7fda840b5980 2024-09-19T08:38:15.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.292+0000 7fda8ae47640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fda84160ba0 con 0x7fda8415fe70 2024-09-19T08:38:15.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.292+0000 7fda88be3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fda84145bb0 0x7fda840b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:15.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.293+0000 7fda88be3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fda84145bb0 0x7fda840b0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:60514/0 (socket says 172.21.15.117:60514) 2024-09-19T08:38:15.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.293+0000 7fda88be3640 1 -- 172.21.15.117:0/2563709940 learned_addr learned my addr 172.21.15.117:0/2563709940 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:15.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.293+0000 7fda83fff640 1 --2- 172.21.15.117:0/2563709940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda8415fe70 0x7fda841602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:15.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.293+0000 7fda88be3640 1 -- 172.21.15.117:0/2563709940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda8415fe70 msgr2=0x7fda841602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:15.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.293+0000 7fda893e4640 1 --2- 172.21.15.117:0/2563709940 >> v2:172.21.15.146:3300/0 conn(0x7fda840b5980 0x7fda840b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:15.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.293+0000 7fda88be3640 1 --2- 172.21.15.117:0/2563709940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda8415fe70 0x7fda841602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.293+0000 7fda88be3640 1 -- 172.21.15.117:0/2563709940 >> v2:172.21.15.146:3300/0 conn(0x7fda840b5980 msgr2=0x7fda840b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:15.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.293+0000 7fda88be3640 1 --2- 172.21.15.117:0/2563709940 >> v2:172.21.15.146:3300/0 conn(0x7fda840b5980 0x7fda840b5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.293+0000 7fda88be3640 1 -- 172.21.15.117:0/2563709940 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda840afc60 con 0x7fda84145bb0 2024-09-19T08:38:15.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.293+0000 7fda83fff640 1 --2- 172.21.15.117:0/2563709940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda8415fe70 0x7fda841602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:15.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.293+0000 7fda893e4640 1 --2- 172.21.15.117:0/2563709940 >> v2:172.21.15.146:3300/0 conn(0x7fda840b5980 0x7fda840b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:15.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.293+0000 7fda88be3640 1 --2- 172.21.15.117:0/2563709940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda84145bb0 0x7fda840b0460 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fda8406ec10 tx=0x7fda7402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c2d3f954c9f46dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:15.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.294+0000 7fda837fe640 1 -- 172.21.15.117:0/2563709940 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda74037070 con 0x7fda84145bb0 2024-09-19T08:38:15.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.294+0000 7fda837fe640 1 -- 172.21.15.117:0/2563709940 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda74032440 con 0x7fda84145bb0 2024-09-19T08:38:15.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.294+0000 7fda837fe640 1 -- 172.21.15.117:0/2563709940 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda74032810 con 0x7fda84145bb0 2024-09-19T08:38:15.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.294+0000 7fda8ae47640 1 -- 172.21.15.117:0/2563709940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda84145bb0 msgr2=0x7fda840b0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:15.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.294+0000 7fda8ae47640 1 --2- 172.21.15.117:0/2563709940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda84145bb0 0x7fda840b0460 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fda8406ec10 tx=0x7fda7402a1e0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.294+0000 7fda8ae47640 1 -- 172.21.15.117:0/2563709940 shutdown_connections 2024-09-19T08:38:15.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.294+0000 7fda8ae47640 1 --2- 172.21.15.117:0/2563709940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda8415fe70 0x7fda841602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.294+0000 7fda8ae47640 1 --2- 172.21.15.117:0/2563709940 >> v2:172.21.15.146:3300/0 conn(0x7fda840b5980 0x7fda840b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.294+0000 7fda8ae47640 1 --2- 172.21.15.117:0/2563709940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda84145bb0 0x7fda840b0460 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.294+0000 7fda8ae47640 1 -- 172.21.15.117:0/2563709940 >> 172.21.15.117:0/2563709940 conn(0x7fda8409a9f0 msgr2=0x7fda840b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:15.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.294+0000 7fda8ae47640 1 -- 172.21.15.117:0/2563709940 shutdown_connections 2024-09-19T08:38:15.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.294+0000 7fda8ae47640 1 -- 172.21.15.117:0/2563709940 wait complete. 2024-09-19T08:38:15.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.295+0000 7fda8ae47640 1 Processor -- start 2024-09-19T08:38:15.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.295+0000 7fda8ae47640 1 -- start start 2024-09-19T08:38:15.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.296+0000 7fda8ae47640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda840b5980 0x7fda84136f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:15.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.296+0000 7fda8ae47640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda84145bb0 0x7fda84139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:15.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.296+0000 7fda8ae47640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda8415fe70 0x7fda840d1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:15.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.296+0000 7fda8ae47640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fda840ae3c0 con 0x7fda840b5980 2024-09-19T08:38:15.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.296+0000 7fda8ae47640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fda840ae240 con 0x7fda84145bb0 2024-09-19T08:38:15.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.296+0000 7fda8ae47640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fda840b09a0 con 0x7fda8415fe70 2024-09-19T08:38:15.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.296+0000 7fda88be3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda840b5980 0x7fda84136f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:15.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.296+0000 7fda88be3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda840b5980 0x7fda84136f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:60528/0 (socket says 172.21.15.117:60528) 2024-09-19T08:38:15.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.296+0000 7fda88be3640 1 -- 172.21.15.117:0/4164125516 learned_addr learned my addr 172.21.15.117:0/4164125516 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:15.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.297+0000 7fda88be3640 1 -- 172.21.15.117:0/4164125516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda8415fe70 msgr2=0x7fda840d1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:15.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.297+0000 7fda88be3640 1 --2- 172.21.15.117:0/4164125516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda8415fe70 0x7fda840d1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.297+0000 7fda88be3640 1 -- 172.21.15.117:0/4164125516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda84145bb0 msgr2=0x7fda84139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:15.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.297+0000 7fda88be3640 1 --2- 172.21.15.117:0/4164125516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda84145bb0 0x7fda84139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.297+0000 7fda88be3640 1 -- 172.21.15.117:0/4164125516 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda840d1d60 con 0x7fda840b5980 2024-09-19T08:38:15.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.297+0000 7fda88be3640 1 --2- 172.21.15.117:0/4164125516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda840b5980 0x7fda84136f40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fda7402a220 tx=0x7fda740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:15.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.297+0000 7fda817fa640 1 -- 172.21.15.117:0/4164125516 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda74037040 con 0x7fda840b5980 2024-09-19T08:38:15.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.297+0000 7fda817fa640 1 -- 172.21.15.117:0/4164125516 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda74042070 con 0x7fda840b5980 2024-09-19T08:38:15.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.297+0000 7fda817fa640 1 -- 172.21.15.117:0/4164125516 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda74030bb0 con 0x7fda840b5980 2024-09-19T08:38:15.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.297+0000 7fda8ae47640 1 -- 172.21.15.117:0/4164125516 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda841f5360 con 0x7fda840b5980 2024-09-19T08:38:15.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.297+0000 7fda8ae47640 1 -- 172.21.15.117:0/4164125516 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda841f5920 con 0x7fda840b5980 2024-09-19T08:38:15.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.298+0000 7fda8ae47640 1 -- 172.21.15.117:0/4164125516 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda84145f90 con 0x7fda840b5980 2024-09-19T08:38:15.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.299+0000 7fda817fa640 1 -- 172.21.15.117:0/4164125516 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fda74047460 con 0x7fda840b5980 2024-09-19T08:38:15.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.299+0000 7fda817fa640 1 --2- 172.21.15.117:0/4164125516 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fda7006c2b0 0x7fda7006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:15.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.299+0000 7fda817fa640 1 -- 172.21.15.117:0/4164125516 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fda740ac110 con 0x7fda840b5980 2024-09-19T08:38:15.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.299+0000 7fda83fff640 1 --2- 172.21.15.117:0/4164125516 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fda7006c2b0 0x7fda7006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:15.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.300+0000 7fda83fff640 1 --2- 172.21.15.117:0/4164125516 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fda7006c2b0 0x7fda7006e770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fda78006fd0 tx=0x7fda78008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:15.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.304+0000 7fda817fa640 1 -- 172.21.15.117:0/4164125516 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fda74045360 con 0x7fda840b5980 2024-09-19T08:38:15.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.534+0000 7fda8ae47640 1 -- 172.21.15.117:0/4164125516 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fda84073a30 con 0x7fda840b5980 2024-09-19T08:38:15.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.536+0000 7fda817fa640 1 -- 172.21.15.117:0/4164125516 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7fda7407a780 con 0x7fda840b5980 2024-09-19T08:38:15.536 INFO:teuthology.orchestra.run.smithi117.stdout:[client.0] 2024-09-19T08:38:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQB44utm6+SOJBAAd1SCpjEGh0tRc3cpmnVJDA== 2024-09-19T08:38:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: caps mds = "allow" 2024-09-19T08:38:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: caps mon = "allow r" 2024-09-19T08:38:15.536 INFO:teuthology.orchestra.run.smithi117.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T08:38:15.536 INFO:teuthology.orchestra.run.smithi117.stderr:updated caps for client.0 2024-09-19T08:38:15.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.538+0000 7fda8ae47640 1 -- 172.21.15.117:0/4164125516 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fda7006c2b0 msgr2=0x7fda7006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:15.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.538+0000 7fda8ae47640 1 --2- 172.21.15.117:0/4164125516 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fda7006c2b0 0x7fda7006e770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fda78006fd0 tx=0x7fda78008040 comp rx=0 tx=0).stop 2024-09-19T08:38:15.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.538+0000 7fda8ae47640 1 -- 172.21.15.117:0/4164125516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda840b5980 msgr2=0x7fda84136f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:15.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.538+0000 7fda8ae47640 1 --2- 172.21.15.117:0/4164125516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda840b5980 0x7fda84136f40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fda7402a220 tx=0x7fda740046c0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.538+0000 7fda8ae47640 1 -- 172.21.15.117:0/4164125516 shutdown_connections 2024-09-19T08:38:15.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.538+0000 7fda8ae47640 1 --2- 172.21.15.117:0/4164125516 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fda7006c2b0 0x7fda7006e770 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.538+0000 7fda8ae47640 1 --2- 172.21.15.117:0/4164125516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda8415fe70 0x7fda840d1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.538+0000 7fda8ae47640 1 --2- 172.21.15.117:0/4164125516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda84145bb0 0x7fda84139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.538+0000 7fda8ae47640 1 --2- 172.21.15.117:0/4164125516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda840b5980 0x7fda84136f40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.538+0000 7fda8ae47640 1 -- 172.21.15.117:0/4164125516 >> 172.21.15.117:0/4164125516 conn(0x7fda8409a9f0 msgr2=0x7fda840b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:15.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.538+0000 7fda8ae47640 1 -- 172.21.15.117:0/4164125516 shutdown_connections 2024-09-19T08:38:15.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.538+0000 7fda8ae47640 1 -- 172.21.15.117:0/4164125516 wait complete. 2024-09-19T08:38:15.549 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:38:15.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.647+0000 7ff8d1198640 1 Processor -- start 2024-09-19T08:38:15.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.647+0000 7ff8d1198640 1 -- start start 2024-09-19T08:38:15.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.648+0000 7ff8d1198640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff8cc0d21f0 0x7ff8cc0d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:15.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.648+0000 7ff8d1198640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8cc072590 0x7ff8cc06d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:15.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.648+0000 7ff8d1198640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff8cc143a60 0x7ff8cc143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:15.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.648+0000 7ff8d1198640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff8cc141750 con 0x7ff8cc143a60 2024-09-19T08:38:15.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.648+0000 7ff8d1198640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7ff8cc0d2b10 con 0x7ff8cc0d21f0 2024-09-19T08:38:15.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.648+0000 7ff8d1198640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7ff8cc1620b0 con 0x7ff8cc072590 2024-09-19T08:38:15.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.648+0000 7ff8cb59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff8cc143a60 0x7ff8cc143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:15.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.648+0000 7ff8cb59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff8cc143a60 0x7ff8cc143ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:60532/0 (socket says 172.21.15.117:60532) 2024-09-19T08:38:15.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.648+0000 7ff8cb59e640 1 -- 172.21.15.117:0/1790398140 learned_addr learned my addr 172.21.15.117:0/1790398140 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:15.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.648+0000 7ff8c259c640 1 --2- 172.21.15.117:0/1790398140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8cc072590 0x7ff8cc06d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:15.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.648+0000 7ff8cad9d640 1 --2- 172.21.15.117:0/1790398140 >> v2:172.21.15.146:3300/0 conn(0x7ff8cc0d21f0 0x7ff8cc0d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:15.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.648+0000 7ff8cb59e640 1 -- 172.21.15.117:0/1790398140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8cc072590 msgr2=0x7ff8cc06d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:15.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.648+0000 7ff8cb59e640 1 --2- 172.21.15.117:0/1790398140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8cc072590 0x7ff8cc06d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.648+0000 7ff8cb59e640 1 -- 172.21.15.117:0/1790398140 >> v2:172.21.15.146:3300/0 conn(0x7ff8cc0d21f0 msgr2=0x7ff8cc0d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:15.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.648+0000 7ff8cb59e640 1 --2- 172.21.15.117:0/1790398140 >> v2:172.21.15.146:3300/0 conn(0x7ff8cc0d21f0 0x7ff8cc0d25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.648+0000 7ff8cb59e640 1 -- 172.21.15.117:0/1790398140 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8cc162370 con 0x7ff8cc143a60 2024-09-19T08:38:15.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.649+0000 7ff8cb59e640 1 --2- 172.21.15.117:0/1790398140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8cc143a60 0x7ff8cc143ee0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc0cfd80 tx=0x7ff8c402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8af6d1a278ce3cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:15.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.649+0000 7ff8ca59c640 1 -- 172.21.15.117:0/1790398140 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4036070 con 0x7ff8cc143a60 2024-09-19T08:38:15.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.649+0000 7ff8ca59c640 1 -- 172.21.15.117:0/1790398140 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c4031600 con 0x7ff8cc143a60 2024-09-19T08:38:15.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.649+0000 7ff8ca59c640 1 -- 172.21.15.117:0/1790398140 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40319d0 con 0x7ff8cc143a60 2024-09-19T08:38:15.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.649+0000 7ff8d1198640 1 -- 172.21.15.117:0/1790398140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8cc143a60 msgr2=0x7ff8cc143ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:15.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.649+0000 7ff8d1198640 1 --2- 172.21.15.117:0/1790398140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8cc143a60 0x7ff8cc143ee0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc0cfd80 tx=0x7ff8c402a610 comp rx=0 tx=0).stop 2024-09-19T08:38:15.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.649+0000 7ff8d1198640 1 -- 172.21.15.117:0/1790398140 shutdown_connections 2024-09-19T08:38:15.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.649+0000 7ff8d1198640 1 --2- 172.21.15.117:0/1790398140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8cc072590 0x7ff8cc06d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.649+0000 7ff8d1198640 1 --2- 172.21.15.117:0/1790398140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8cc143a60 0x7ff8cc143ee0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.649+0000 7ff8d1198640 1 --2- 172.21.15.117:0/1790398140 >> v2:172.21.15.146:3300/0 conn(0x7ff8cc0d21f0 0x7ff8cc0d25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.649+0000 7ff8d1198640 1 -- 172.21.15.117:0/1790398140 >> 172.21.15.117:0/1790398140 conn(0x7ff8cc0b3ed0 msgr2=0x7ff8cc0b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:15.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.649+0000 7ff8d1198640 1 -- 172.21.15.117:0/1790398140 shutdown_connections 2024-09-19T08:38:15.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.649+0000 7ff8d1198640 1 -- 172.21.15.117:0/1790398140 wait complete. 2024-09-19T08:38:15.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.651+0000 7ff8d1198640 1 Processor -- start 2024-09-19T08:38:15.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.651+0000 7ff8d1198640 1 -- start start 2024-09-19T08:38:15.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8d1198640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8cc072590 0x7ff8cc1e7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:15.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8d1198640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8cc0d21f0 0x7ff8cc1e82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:15.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8d1198640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8cc143a60 0x7ff8cc0b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:15.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8d1198640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc162c10 con 0x7ff8cc143a60 2024-09-19T08:38:15.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8d1198640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc162930 con 0x7ff8cc072590 2024-09-19T08:38:15.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8d1198640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7ff8cc06d620 con 0x7ff8cc0d21f0 2024-09-19T08:38:15.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8cb59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8cc143a60 0x7ff8cc0b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:15.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8cb59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8cc143a60 0x7ff8cc0b63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:60544/0 (socket says 172.21.15.117:60544) 2024-09-19T08:38:15.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8cb59e640 1 -- 172.21.15.117:0/3410233696 learned_addr learned my addr 172.21.15.117:0/3410233696 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:15.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8cad9d640 1 --2- 172.21.15.117:0/3410233696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8cc072590 0x7ff8cc1e7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:15.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8c259c640 1 --2- 172.21.15.117:0/3410233696 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8cc0d21f0 0x7ff8cc1e82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:15.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8cb59e640 1 -- 172.21.15.117:0/3410233696 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8cc0d21f0 msgr2=0x7ff8cc1e82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:15.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8cb59e640 1 --2- 172.21.15.117:0/3410233696 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8cc0d21f0 0x7ff8cc1e82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8cb59e640 1 -- 172.21.15.117:0/3410233696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8cc072590 msgr2=0x7ff8cc1e7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:15.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8cb59e640 1 --2- 172.21.15.117:0/3410233696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8cc072590 0x7ff8cc1e7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8cb59e640 1 -- 172.21.15.117:0/3410233696 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8cc0b7110 con 0x7ff8cc143a60 2024-09-19T08:38:15.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8cb59e640 1 --2- 172.21.15.117:0/3410233696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8cc143a60 0x7ff8cc0b63b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4034040 tx=0x7ff8c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:15.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8c3fff640 1 -- 172.21.15.117:0/3410233696 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4036050 con 0x7ff8cc143a60 2024-09-19T08:38:15.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8c3fff640 1 -- 172.21.15.117:0/3410233696 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c4042070 con 0x7ff8cc143a60 2024-09-19T08:38:15.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8c3fff640 1 -- 172.21.15.117:0/3410233696 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4009510 con 0x7ff8cc143a60 2024-09-19T08:38:15.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8d1198640 1 -- 172.21.15.117:0/3410233696 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8cc0b73f0 con 0x7ff8cc143a60 2024-09-19T08:38:15.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.652+0000 7ff8d1198640 1 -- 172.21.15.117:0/3410233696 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8cc0b79b0 con 0x7ff8cc143a60 2024-09-19T08:38:15.655 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.653+0000 7ff8d1198640 1 -- 172.21.15.117:0/3410233696 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8cc1580f0 con 0x7ff8cc143a60 2024-09-19T08:38:15.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.654+0000 7ff8c3fff640 1 -- 172.21.15.117:0/3410233696 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff8c4007bd0 con 0x7ff8cc143a60 2024-09-19T08:38:15.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.654+0000 7ff8c3fff640 1 --2- 172.21.15.117:0/3410233696 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff8ac06c2b0 0x7ff8ac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:15.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.654+0000 7ff8c3fff640 1 -- 172.21.15.117:0/3410233696 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7ff8c40ac330 con 0x7ff8cc143a60 2024-09-19T08:38:15.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.655+0000 7ff8cad9d640 1 --2- 172.21.15.117:0/3410233696 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff8ac06c2b0 0x7ff8ac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:15.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.655+0000 7ff8cad9d640 1 --2- 172.21.15.117:0/3410233696 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff8ac06c2b0 0x7ff8ac06e770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc006fd0 tx=0x7ff8bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:15.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.659+0000 7ff8c3fff640 1 -- 172.21.15.117:0/3410233696 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff8cc1580f0 con 0x7ff8cc143a60 2024-09-19T08:38:15.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.858+0000 7ff8d1198640 1 -- 172.21.15.117:0/3410233696 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8cc158c30 con 0x7ff8cc143a60 2024-09-19T08:38:15.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.859+0000 7ff8c3fff640 1 -- 172.21.15.117:0/3410233696 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5235 (secure 0 0 0) 0x7ff8c407a2c0 con 0x7ff8cc143a60 2024-09-19T08:38:15.859 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:15.859 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":16,"btime":"2024-09-19T08:38:09:528263+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4595,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2240250216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2240250216},{"type":"v1","addr":"172.21.15.146:6836","nonce":2240250216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2165679820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2165679820},{"type":"v1","addr":"172.21.15.117:6834","nonce":2165679820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2737032516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2737032516},{"type":"v1","addr":"172.21.15.117:6835","nonce":2737032516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:38:06.852720+0000","modified":"2024-09-19T08:38:08.856085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/3614861409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":3614861409},{"type":"v1","addr":"172.21.15.146:6837","nonce":3614861409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4926,"qdb_cluster":[4926]},"id":2}]} 2024-09-19T08:38:15.859 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 16 2024-09-19T08:38:15.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.861+0000 7ff8d1198640 1 -- 172.21.15.117:0/3410233696 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff8ac06c2b0 msgr2=0x7ff8ac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:15.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.861+0000 7ff8d1198640 1 --2- 172.21.15.117:0/3410233696 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff8ac06c2b0 0x7ff8ac06e770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc006fd0 tx=0x7ff8bc008040 comp rx=0 tx=0).stop 2024-09-19T08:38:15.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.861+0000 7ff8d1198640 1 -- 172.21.15.117:0/3410233696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8cc143a60 msgr2=0x7ff8cc0b63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:15.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.861+0000 7ff8d1198640 1 --2- 172.21.15.117:0/3410233696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8cc143a60 0x7ff8cc0b63b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4034040 tx=0x7ff8c4004a40 comp rx=0 tx=0).stop 2024-09-19T08:38:15.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.861+0000 7ff8d1198640 1 -- 172.21.15.117:0/3410233696 shutdown_connections 2024-09-19T08:38:15.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.861+0000 7ff8d1198640 1 --2- 172.21.15.117:0/3410233696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8cc143a60 0x7ff8cc0b63b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.861+0000 7ff8d1198640 1 --2- 172.21.15.117:0/3410233696 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff8ac06c2b0 0x7ff8ac06e770 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.861+0000 7ff8d1198640 1 --2- 172.21.15.117:0/3410233696 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8cc0d21f0 0x7ff8cc1e82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.861+0000 7ff8d1198640 1 --2- 172.21.15.117:0/3410233696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8cc072590 0x7ff8cc1e7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:15.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.861+0000 7ff8d1198640 1 -- 172.21.15.117:0/3410233696 >> 172.21.15.117:0/3410233696 conn(0x7ff8cc0b3ed0 msgr2=0x7ff8cc1431c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:15.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.861+0000 7ff8d1198640 1 -- 172.21.15.117:0/3410233696 shutdown_connections 2024-09-19T08:38:15.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:15.861+0000 7ff8d1198640 1 -- 172.21.15.117:0/3410233696 wait complete. 2024-09-19T08:38:16.274 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T08:38:06.852720+0000', 'modified': '2024-09-19T08:38:08.856085+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4926}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4926': {'gid': 4926, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6837/3614861409', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6835', 'nonce': 3614861409}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 3614861409}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4926, 'qdb_cluster': [4926]} 2024-09-19T08:38:16.274 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T08:38:16.274 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-19T08:38:16.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.375+0000 7fcc66f98640 1 Processor -- start 2024-09-19T08:38:16.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.375+0000 7fcc66f98640 1 -- start start 2024-09-19T08:38:16.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.376+0000 7fcc66f98640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcc60072590 0x7fcc6006d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.376+0000 7fcc66f98640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc60141ad0 0x7fcc60141f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.376+0000 7fcc66f98640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc601620b0 con 0x7fcc600d21f0 2024-09-19T08:38:16.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.376+0000 7fcc66f98640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fcc60141750 con 0x7fcc60072590 2024-09-19T08:38:16.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.376+0000 7fcc66f98640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fcc60162370 con 0x7fcc60141ad0 2024-09-19T08:38:16.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.376+0000 7fcc5ffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcc60072590 0x7fcc6006d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.376+0000 7fcc64d34640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fcc600d21f0 0x7fcc600d25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50560/0 (socket says 172.21.15.117:50560) 2024-09-19T08:38:16.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.376+0000 7fcc64d34640 1 -- 172.21.15.117:0/3342436120 learned_addr learned my addr 172.21.15.117:0/3342436120 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:16.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.376+0000 7fcc65535640 1 --2- 172.21.15.117:0/3342436120 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc60141ad0 0x7fcc60141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.377+0000 7fcc5ffff640 1 -- 172.21.15.117:0/3342436120 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc60141ad0 msgr2=0x7fcc60141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:16.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.377+0000 7fcc5ffff640 1 --2- 172.21.15.117:0/3342436120 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc60141ad0 0x7fcc60141f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.377+0000 7fcc5ffff640 1 -- 172.21.15.117:0/3342436120 >> v1:172.21.15.117:6789/0 conn(0x7fcc600d21f0 legacy=0x7fcc600d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:16.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.377+0000 7fcc5f7fe640 1 -- 172.21.15.117:0/3342436120 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1403595547 0 0) 0x7fcc601620b0 con 0x7fcc600d21f0 2024-09-19T08:38:16.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.377+0000 7fcc5ffff640 1 -- 172.21.15.117:0/3342436120 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc60162650 con 0x7fcc60072590 2024-09-19T08:38:16.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.377+0000 7fcc5ffff640 1 --2- 172.21.15.117:0/3342436120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc60072590 0x7fcc6006d0e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcc540097a0 tx=0x7fcc5402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8ec5263c29141e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:16.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.377+0000 7fcc5f7fe640 1 -- 172.21.15.117:0/3342436120 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54037070 con 0x7fcc60072590 2024-09-19T08:38:16.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.377+0000 7fcc5f7fe640 1 -- 172.21.15.117:0/3342436120 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc5402ae50 con 0x7fcc60072590 2024-09-19T08:38:16.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.377+0000 7fcc5f7fe640 1 -- 172.21.15.117:0/3342436120 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54032660 con 0x7fcc60072590 2024-09-19T08:38:16.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.378+0000 7fcc66f98640 1 -- 172.21.15.117:0/3342436120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc60072590 msgr2=0x7fcc6006d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:16.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.378+0000 7fcc66f98640 1 --2- 172.21.15.117:0/3342436120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc60072590 0x7fcc6006d0e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcc540097a0 tx=0x7fcc5402a100 comp rx=0 tx=0).stop 2024-09-19T08:38:16.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.378+0000 7fcc66f98640 1 -- 172.21.15.117:0/3342436120 shutdown_connections 2024-09-19T08:38:16.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.378+0000 7fcc66f98640 1 --2- 172.21.15.117:0/3342436120 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc60141ad0 0x7fcc60141f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.378+0000 7fcc66f98640 1 --2- 172.21.15.117:0/3342436120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc60072590 0x7fcc6006d0e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.378+0000 7fcc66f98640 1 -- 172.21.15.117:0/3342436120 >> 172.21.15.117:0/3342436120 conn(0x7fcc600b3ed0 msgr2=0x7fcc600b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:16.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.378+0000 7fcc66f98640 1 -- 172.21.15.117:0/3342436120 shutdown_connections 2024-09-19T08:38:16.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.378+0000 7fcc66f98640 1 -- 172.21.15.117:0/3342436120 wait complete. 2024-09-19T08:38:16.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.379+0000 7fcc66f98640 1 Processor -- start 2024-09-19T08:38:16.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.379+0000 7fcc66f98640 1 -- start start 2024-09-19T08:38:16.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.380+0000 7fcc66f98640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc60072590 0x7fcc6015bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.380+0000 7fcc66f98640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc600d21f0 0x7fcc601f4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.380+0000 7fcc66f98640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc60141ad0 0x7fcc6015d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.380+0000 7fcc66f98640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6006d620 con 0x7fcc60141ad0 2024-09-19T08:38:16.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.380+0000 7fcc66f98640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcc60162c10 con 0x7fcc60072590 2024-09-19T08:38:16.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.380+0000 7fcc66f98640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fcc6006d7a0 con 0x7fcc600d21f0 2024-09-19T08:38:16.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.380+0000 7fcc65535640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc60141ad0 0x7fcc6015d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.380+0000 7fcc65535640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc60141ad0 0x7fcc6015d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:60558/0 (socket says 172.21.15.117:60558) 2024-09-19T08:38:16.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.380+0000 7fcc65535640 1 -- 172.21.15.117:0/1745611126 learned_addr learned my addr 172.21.15.117:0/1745611126 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:16.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.380+0000 7fcc5ffff640 1 --2- 172.21.15.117:0/1745611126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc600d21f0 0x7fcc601f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.380+0000 7fcc64d34640 1 --2- 172.21.15.117:0/1745611126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc60072590 0x7fcc6015bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.380+0000 7fcc65535640 1 -- 172.21.15.117:0/1745611126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc600d21f0 msgr2=0x7fcc601f4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:16.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.381+0000 7fcc65535640 1 --2- 172.21.15.117:0/1745611126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc600d21f0 0x7fcc601f4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.381+0000 7fcc65535640 1 -- 172.21.15.117:0/1745611126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc60072590 msgr2=0x7fcc6015bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:16.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.381+0000 7fcc65535640 1 --2- 172.21.15.117:0/1745611126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc60072590 0x7fcc6015bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.381+0000 7fcc65535640 1 -- 172.21.15.117:0/1745611126 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc60158ee0 con 0x7fcc60141ad0 2024-09-19T08:38:16.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.381+0000 7fcc5ffff640 1 --2- 172.21.15.117:0/1745611126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc600d21f0 0x7fcc601f4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:16.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.381+0000 7fcc64d34640 1 --2- 172.21.15.117:0/1745611126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc60072590 0x7fcc6015bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:16.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.381+0000 7fcc65535640 1 --2- 172.21.15.117:0/1745611126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc60141ad0 0x7fcc6015d8f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800d5d0 tx=0x7fcc5800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:16.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.381+0000 7fcc5d7fa640 1 -- 172.21.15.117:0/1745611126 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc580125f0 con 0x7fcc60141ad0 2024-09-19T08:38:16.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.381+0000 7fcc5d7fa640 1 -- 172.21.15.117:0/1745611126 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc58019070 con 0x7fcc60141ad0 2024-09-19T08:38:16.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.381+0000 7fcc5d7fa640 1 -- 172.21.15.117:0/1745611126 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc580129f0 con 0x7fcc60141ad0 2024-09-19T08:38:16.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.381+0000 7fcc66f98640 1 -- 172.21.15.117:0/1745611126 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc601f4a90 con 0x7fcc60141ad0 2024-09-19T08:38:16.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.381+0000 7fcc66f98640 1 -- 172.21.15.117:0/1745611126 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc601f4ff0 con 0x7fcc60141ad0 2024-09-19T08:38:16.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.382+0000 7fcc5d7fa640 1 -- 172.21.15.117:0/1745611126 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcc58012b90 con 0x7fcc60141ad0 2024-09-19T08:38:16.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.383+0000 7fcc5d7fa640 1 --2- 172.21.15.117:0/1745611126 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcc4c06c2b0 0x7fcc4c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.383+0000 7fcc5d7fa640 1 -- 172.21.15.117:0/1745611126 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fcc5808b990 con 0x7fcc60141ad0 2024-09-19T08:38:16.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.383+0000 7fcc64d34640 1 --2- 172.21.15.117:0/1745611126 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcc4c06c2b0 0x7fcc4c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.383+0000 7fcc64d34640 1 --2- 172.21.15.117:0/1745611126 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcc4c06c2b0 0x7fcc4c06e770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcc500012e0 tx=0x7fcc50007f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:16.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.384+0000 7fcc69e13740 1 Processor -- start 2024-09-19T08:38:16.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.384+0000 7fcc69e13740 1 -- start start 2024-09-19T08:38:16.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.385+0000 7fcc69e13740 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f9ed5b32c0 0x55f9ed5f8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.385+0000 7fcc69e13740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5b0a80 0x55f9ed5b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.385+0000 7fcc69e13740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9ed5b4a50 0x55f9ed5ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.385+0000 7fcc69e13740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f9ed515520 con 0x55f9ed5b0a80 2024-09-19T08:38:16.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.385+0000 7fcc69e13740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f9ed4bd3e0 con 0x55f9ed5b4a50 2024-09-19T08:38:16.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.385+0000 7fcc69e13740 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x55f9ed5114e0 con 0x55f9ed5b32c0 2024-09-19T08:38:16.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.385+0000 7fcc5ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5b0a80 0x55f9ed5b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.385+0000 7fcc5ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5b0a80 0x55f9ed5b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:60570/0 (socket says 172.21.15.117:60570) 2024-09-19T08:38:16.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.385+0000 7fcc5ffff640 1 -- 172.21.15.117:0/1369721939 learned_addr learned my addr 172.21.15.117:0/1369721939 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:16.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.385+0000 7fcc65535640 1 --2- 172.21.15.117:0/1369721939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9ed5b4a50 0x55f9ed5ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.385+0000 7fcc64d34640 1 --2- 172.21.15.117:0/1369721939 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f9ed5b32c0 0x55f9ed5f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.385+0000 7fcc5ffff640 1 -- 172.21.15.117:0/1369721939 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f9ed5b32c0 msgr2=0x55f9ed5f8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:16.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.385+0000 7fcc5ffff640 1 --2- 172.21.15.117:0/1369721939 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f9ed5b32c0 0x55f9ed5f8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.385+0000 7fcc5ffff640 1 -- 172.21.15.117:0/1369721939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9ed5b4a50 msgr2=0x55f9ed5ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:16.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.385+0000 7fcc5ffff640 1 --2- 172.21.15.117:0/1369721939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9ed5b4a50 0x55f9ed5ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.385+0000 7fcc5ffff640 1 -- 172.21.15.117:0/1369721939 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9ed4d82f0 con 0x55f9ed5b0a80 2024-09-19T08:38:16.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.385+0000 7fcc5ffff640 1 --2- 172.21.15.117:0/1369721939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5b0a80 0x55f9ed5b36a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcc54009890 tx=0x7fcc5402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44a819e7de0fd90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:16.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.385+0000 7fcc46ffd640 1 -- 172.21.15.117:0/1369721939 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54037040 con 0x55f9ed5b0a80 2024-09-19T08:38:16.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.385+0000 7fcc46ffd640 1 -- 172.21.15.117:0/1369721939 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc54032800 con 0x55f9ed5b0a80 2024-09-19T08:38:16.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.385+0000 7fcc46ffd640 1 -- 172.21.15.117:0/1369721939 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54032bb0 con 0x55f9ed5b0a80 2024-09-19T08:38:16.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.386+0000 7fcc69e13740 1 -- 172.21.15.117:0/1369721939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5b0a80 msgr2=0x55f9ed5b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:16.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.386+0000 7fcc69e13740 1 --2- 172.21.15.117:0/1369721939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5b0a80 0x55f9ed5b36a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcc54009890 tx=0x7fcc5402c000 comp rx=0 tx=0).stop 2024-09-19T08:38:16.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.386+0000 7fcc69e13740 1 -- 172.21.15.117:0/1369721939 shutdown_connections 2024-09-19T08:38:16.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.386+0000 7fcc69e13740 1 --2- 172.21.15.117:0/1369721939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9ed5b4a50 0x55f9ed5ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.386+0000 7fcc69e13740 1 --2- 172.21.15.117:0/1369721939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5b0a80 0x55f9ed5b36a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.386+0000 7fcc69e13740 1 --2- 172.21.15.117:0/1369721939 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f9ed5b32c0 0x55f9ed5f8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.386+0000 7fcc69e13740 1 -- 172.21.15.117:0/1369721939 >> 172.21.15.117:0/1369721939 conn(0x55f9ed5afa80 msgr2=0x55f9ed5f7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:16.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.386+0000 7fcc69e13740 1 -- 172.21.15.117:0/1369721939 shutdown_connections 2024-09-19T08:38:16.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.386+0000 7fcc69e13740 1 -- 172.21.15.117:0/1369721939 wait complete. 2024-09-19T08:38:16.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.387+0000 7fcc69e13740 1 -- start start 2024-09-19T08:38:16.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.387+0000 7fcc69e13740 1 Processor -- start 2024-09-19T08:38:16.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.387+0000 7fcc69e13740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5b32c0 0x55f9ed5d2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.387+0000 7fcc69e13740 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f9ed5b4a50 0x55f9ed5d33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.387+0000 7fcc69e13740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9ed5d3dc0 0x55f9ed5d4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.387+0000 7fcc69e13740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f9ed5aef20 con 0x55f9ed5b32c0 2024-09-19T08:38:16.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.387+0000 7fcc69e13740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f9ed49e450 con 0x55f9ed5d3dc0 2024-09-19T08:38:16.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.387+0000 7fcc69e13740 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x55f9ed5f9290 con 0x55f9ed5b4a50 2024-09-19T08:38:16.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.387+0000 7fcc69e13740 10 client.0 _ll_register_callbacks cb 0x55f9ed227ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:38:16.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc64d34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5b32c0 0x55f9ed5d2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc64d34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5b32c0 0x55f9ed5d2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:60586/0 (socket says 172.21.15.117:60586) 2024-09-19T08:38:16.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc64d34640 1 -- 172.21.15.117:0/3654202882 learned_addr learned my addr 172.21.15.117:0/3654202882 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:16.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc5ffff640 1 --2- 172.21.15.117:0/3654202882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f9ed5b4a50 0x55f9ed5d33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc65535640 1 --2- 172.21.15.117:0/3654202882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9ed5d3dc0 0x55f9ed5d4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc64d34640 1 -- 172.21.15.117:0/3654202882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f9ed5b4a50 msgr2=0x55f9ed5d33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:16.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc64d34640 1 --2- 172.21.15.117:0/3654202882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f9ed5b4a50 0x55f9ed5d33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc64d34640 1 -- 172.21.15.117:0/3654202882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9ed5d3dc0 msgr2=0x55f9ed5d4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:16.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc64d34640 1 --2- 172.21.15.117:0/3654202882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9ed5d3dc0 0x55f9ed5d4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc64d34640 1 -- 172.21.15.117:0/3654202882 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9ed2282d0 con 0x55f9ed5b32c0 2024-09-19T08:38:16.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc65535640 1 --2- 172.21.15.117:0/3654202882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9ed5d3dc0 0x55f9ed5d4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:16.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc5ffff640 1 --2- 172.21.15.117:0/3654202882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f9ed5b4a50 0x55f9ed5d33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:16.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc64d34640 1 --2- 172.21.15.117:0/3654202882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5b32c0 0x55f9ed5d2a50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcc50014690 tx=0x7fcc50001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8a14f5a6a60e3e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:16.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-19T08:38:16.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc3f7fe640 1 -- 172.21.15.117:0/3654202882 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc50004b60 con 0x55f9ed5b32c0 2024-09-19T08:38:16.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc3f7fe640 1 -- 172.21.15.117:0/3654202882 <== mon.0 v2:172.21.15.117:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fcc5001e040 con 0x55f9ed5b32c0 2024-09-19T08:38:16.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc69e13740 1 -- 172.21.15.117:0/3654202882 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc54032800 con 0x55f9ed5b32c0 2024-09-19T08:38:16.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc3f7fe640 1 -- 172.21.15.117:0/3654202882 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fcc5002d050 con 0x55f9ed5b32c0 2024-09-19T08:38:16.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc69e13740 10 client.5112 fetch_fsmap learned FSMap version 16 2024-09-19T08:38:16.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc69e13740 1 -- 172.21.15.117:0/3654202882 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55f9ed2f26b0 con 0x55f9ed5b32c0 2024-09-19T08:38:16.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc3f7fe640 1 -- 172.21.15.117:0/3654202882 <== mon.0 v2:172.21.15.117:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc54032800 con 0x55f9ed5b32c0 2024-09-19T08:38:16.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc3f7fe640 1 -- 172.21.15.117:0/3654202882 <== mon.0 v2:172.21.15.117:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7fcc50030020 con 0x55f9ed5b32c0 2024-09-19T08:38:16.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc69e13740 10 client.5112 fetch_fsmap finished waiting for FSMap version 16 2024-09-19T08:38:16.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.388+0000 7fcc69e13740 10 client.5112 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:38:16.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.389+0000 7fcc69e13740 20 client.5112 populate_metadata read hostname 'smithi117' 2024-09-19T08:38:16.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.389+0000 7fcc69e13740 1 --2- 172.21.15.117:0/3654202882 >> [v2:172.21.15.146:6835/3614861409,v1:172.21.15.146:6837/3614861409] conn(0x55f9ed6083d0 0x55f9ed6087b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.389+0000 7fcc69e13740 4 client.5112 mds_command: new command op to 4926 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:38:16.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.389+0000 7fcc69e13740 1 -- 172.21.15.117:0/3654202882 --> [v2:172.21.15.146:6835/3614861409,v1:172.21.15.146:6837/3614861409] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9ed522c50 con 0x55f9ed6083d0 2024-09-19T08:38:16.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.389+0000 7fcc5ffff640 1 --2- 172.21.15.117:0/3654202882 >> [v2:172.21.15.146:6835/3614861409,v1:172.21.15.146:6837/3614861409] conn(0x55f9ed6083d0 0x55f9ed6087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.389+0000 7fcc5ffff640 1 --2- 172.21.15.117:0/3654202882 >> [v2:172.21.15.146:6835/3614861409,v1:172.21.15.146:6837/3614861409] conn(0x55f9ed6083d0 0x55f9ed6087b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de8abffdd45dee2f server_cookie=daa48df6e839df29 in_seq=0 out_seq=0 2024-09-19T08:38:16.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.389+0000 7fcc3f7fe640 10 client.5112 ms_handle_connect on v2:172.21.15.146:6835/3614861409 2024-09-19T08:38:16.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.390+0000 7fcc3f7fe640 1 -- 172.21.15.117:0/3654202882 <== mds.0 v2:172.21.15.146:6835/3614861409 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f9ed522c50 con 0x55f9ed6083d0 2024-09-19T08:38:16.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.390+0000 7fcc3f7fe640 10 client.5112 handle_command_reply: tid=0 2024-09-19T08:38:16.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.390+0000 7fcc69e13740 1 client.5112 shutdown 2024-09-19T08:38:16.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.390+0000 7fcc69e13740 1 -- 172.21.15.117:0/3654202882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5b32c0 msgr2=0x55f9ed5d2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:16.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.390+0000 7fcc69e13740 1 --2- 172.21.15.117:0/3654202882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5b32c0 0x55f9ed5d2a50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcc50014690 tx=0x7fcc50001250 comp rx=0 tx=0).stop 2024-09-19T08:38:16.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.390+0000 7fcc69e13740 1 -- 172.21.15.117:0/3654202882 shutdown_connections 2024-09-19T08:38:16.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.390+0000 7fcc69e13740 1 --2- 172.21.15.117:0/3654202882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9ed5d3dc0 0x55f9ed5d4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.390+0000 7fcc69e13740 1 --2- 172.21.15.117:0/3654202882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f9ed5b4a50 0x55f9ed5d33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.390+0000 7fcc69e13740 1 --2- 172.21.15.117:0/3654202882 >> [v2:172.21.15.146:6835/3614861409,v1:172.21.15.146:6837/3614861409] conn(0x55f9ed6083d0 0x55f9ed6087b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.390+0000 7fcc69e13740 1 --2- 172.21.15.117:0/3654202882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5b32c0 0x55f9ed5d2a50 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.390+0000 7fcc3f7fe640 0 client.5112 ms_handle_reset on v2:172.21.15.146:6835/3614861409 2024-09-19T08:38:16.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.390+0000 7fcc69e13740 1 -- 172.21.15.117:0/3654202882 >> 172.21.15.117:0/3654202882 conn(0x55f9ed5b0a80 msgr2=0x55f9ed5fb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:16.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.390+0000 7fcc69e13740 1 -- 172.21.15.117:0/3654202882 shutdown_connections 2024-09-19T08:38:16.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.390+0000 7fcc69e13740 1 -- 172.21.15.117:0/3654202882 wait complete. 2024-09-19T08:38:16.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.390+0000 7fcc69e13740 20 client.5112 trim_cache size 0 max 16384 2024-09-19T08:38:16.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.408+0000 7fcc69e13740 1 Processor -- start 2024-09-19T08:38:16.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.408+0000 7fcc69e13740 1 -- start start 2024-09-19T08:38:16.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.408+0000 7fcc69e13740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9ed5b32c0 0x55f9ed5d9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.408+0000 7fcc69e13740 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f9ed5b4a50 0x55f9ed5d5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.408+0000 7fcc69e13740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5d3dc0 0x55f9ed66ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.408+0000 7fcc69e13740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcc601ffcf0 con 0x55f9ed5d3dc0 2024-09-19T08:38:16.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.408+0000 7fcc69e13740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6015a1e0 con 0x55f9ed5b32c0 2024-09-19T08:38:16.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.408+0000 7fcc69e13740 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fcc6015d2c0 con 0x55f9ed5b4a50 2024-09-19T08:38:16.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.409+0000 7fcc65535640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5d3dc0 0x55f9ed66ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.409+0000 7fcc65535640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5d3dc0 0x55f9ed66ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:60602/0 (socket says 172.21.15.117:60602) 2024-09-19T08:38:16.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.409+0000 7fcc65535640 1 -- 172.21.15.117:0/2093337872 learned_addr learned my addr 172.21.15.117:0/2093337872 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:16.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.409+0000 7fcc65535640 1 -- 172.21.15.117:0/2093337872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f9ed5b4a50 msgr2=0x55f9ed5d5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:16.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.409+0000 7fcc65535640 1 --2- 172.21.15.117:0/2093337872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f9ed5b4a50 0x55f9ed5d5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.409+0000 7fcc65535640 1 -- 172.21.15.117:0/2093337872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9ed5b32c0 msgr2=0x55f9ed5d9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:16.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.409+0000 7fcc65535640 1 --2- 172.21.15.117:0/2093337872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9ed5b32c0 0x55f9ed5d9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.409+0000 7fcc65535640 1 -- 172.21.15.117:0/2093337872 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9ed49bf70 con 0x55f9ed5d3dc0 2024-09-19T08:38:16.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.409+0000 7fcc65535640 1 --2- 172.21.15.117:0/2093337872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5d3dc0 0x55f9ed66ffc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcc58089dc0 tx=0x7fcc5805a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83f8f73a8cacf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:16.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.409+0000 7fcc467fc640 1 -- 172.21.15.117:0/2093337872 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc58071020 con 0x55f9ed5d3dc0 2024-09-19T08:38:16.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.409+0000 7fcc467fc640 1 -- 172.21.15.117:0/2093337872 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc58062460 con 0x55f9ed5d3dc0 2024-09-19T08:38:16.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.409+0000 7fcc467fc640 1 -- 172.21.15.117:0/2093337872 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc58012e80 con 0x55f9ed5d3dc0 2024-09-19T08:38:16.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.410+0000 7fcc69e13740 1 -- 172.21.15.117:0/2093337872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5d3dc0 msgr2=0x55f9ed66ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:16.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.410+0000 7fcc69e13740 1 --2- 172.21.15.117:0/2093337872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5d3dc0 0x55f9ed66ffc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcc58089dc0 tx=0x7fcc5805a040 comp rx=0 tx=0).stop 2024-09-19T08:38:16.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.410+0000 7fcc69e13740 1 -- 172.21.15.117:0/2093337872 shutdown_connections 2024-09-19T08:38:16.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.410+0000 7fcc69e13740 1 --2- 172.21.15.117:0/2093337872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5d3dc0 0x55f9ed66ffc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.410+0000 7fcc69e13740 1 --2- 172.21.15.117:0/2093337872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f9ed5b4a50 0x55f9ed5d5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.410+0000 7fcc69e13740 1 --2- 172.21.15.117:0/2093337872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9ed5b32c0 0x55f9ed5d9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.410+0000 7fcc69e13740 1 -- 172.21.15.117:0/2093337872 >> 172.21.15.117:0/2093337872 conn(0x55f9ed5b0a80 msgr2=0x55f9ed61c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:16.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.410+0000 7fcc69e13740 1 -- 172.21.15.117:0/2093337872 shutdown_connections 2024-09-19T08:38:16.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.410+0000 7fcc69e13740 1 -- 172.21.15.117:0/2093337872 wait complete. 2024-09-19T08:38:16.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.410+0000 7fcc69e13740 1 -- start start 2024-09-19T08:38:16.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.410+0000 7fcc69e13740 1 Processor -- start 2024-09-19T08:38:16.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.411+0000 7fcc69e13740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5b32c0 0x55f9ed61baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.411+0000 7fcc69e13740 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f9ed5b4a50 0x55f9ed5d8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.411+0000 7fcc69e13740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9ed5d3dc0 0x55f9ed61afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.411+0000 7fcc69e13740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f9ed5d2f90 con 0x55f9ed5b32c0 2024-09-19T08:38:16.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.411+0000 7fcc69e13740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f9ed60c720 con 0x55f9ed5d3dc0 2024-09-19T08:38:16.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.411+0000 7fcc69e13740 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x55f9ed5d77b0 con 0x55f9ed5b4a50 2024-09-19T08:38:16.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.411+0000 7fcc69e13740 10 client.0 _ll_register_callbacks cb 0x7fcc50002140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:38:16.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.411+0000 7fcc64d34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5b32c0 0x55f9ed61baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.411+0000 7fcc64d34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5b32c0 0x55f9ed61baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:60616/0 (socket says 172.21.15.117:60616) 2024-09-19T08:38:16.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.411+0000 7fcc64d34640 1 -- 172.21.15.117:0/4227985701 learned_addr learned my addr 172.21.15.117:0/4227985701 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:16.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.411+0000 7fcc64d34640 1 -- 172.21.15.117:0/4227985701 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f9ed5b4a50 msgr2=0x55f9ed5d8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:16.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.411+0000 7fcc64d34640 1 --2- 172.21.15.117:0/4227985701 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f9ed5b4a50 0x55f9ed5d8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.411+0000 7fcc64d34640 1 -- 172.21.15.117:0/4227985701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9ed5d3dc0 msgr2=0x55f9ed61afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:16.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.411+0000 7fcc64d34640 1 --2- 172.21.15.117:0/4227985701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9ed5d3dc0 0x55f9ed61afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.411+0000 7fcc64d34640 1 -- 172.21.15.117:0/4227985701 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9ed5d9a00 con 0x55f9ed5b32c0 2024-09-19T08:38:16.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.411+0000 7fcc64d34640 1 --2- 172.21.15.117:0/4227985701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5b32c0 0x55f9ed61baa0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcc50005d40 tx=0x7fcc50001400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530050eca781c599 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:16.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.411+0000 7fcc3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-19T08:38:16.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.412+0000 7fcc3f7fe640 1 -- 172.21.15.117:0/4227985701 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc50004b60 con 0x55f9ed5b32c0 2024-09-19T08:38:16.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.412+0000 7fcc3f7fe640 1 -- 172.21.15.117:0/4227985701 <== mon.0 v2:172.21.15.117:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fcc50010040 con 0x55f9ed5b32c0 2024-09-19T08:38:16.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.412+0000 7fcc69e13740 1 -- 172.21.15.117:0/4227985701 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc58062460 con 0x55f9ed5b32c0 2024-09-19T08:38:16.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.412+0000 7fcc3f7fe640 1 -- 172.21.15.117:0/4227985701 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fcc50012750 con 0x55f9ed5b32c0 2024-09-19T08:38:16.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.412+0000 7fcc69e13740 10 client.5118 fetch_fsmap learned FSMap version 16 2024-09-19T08:38:16.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.412+0000 7fcc69e13740 1 -- 172.21.15.117:0/4227985701 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55f9ed607400 con 0x55f9ed5b32c0 2024-09-19T08:38:16.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.412+0000 7fcc3f7fe640 1 -- 172.21.15.117:0/4227985701 <== mon.0 v2:172.21.15.117:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc58062460 con 0x55f9ed5b32c0 2024-09-19T08:38:16.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.412+0000 7fcc3f7fe640 1 -- 172.21.15.117:0/4227985701 <== mon.0 v2:172.21.15.117:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7fcc50030070 con 0x55f9ed5b32c0 2024-09-19T08:38:16.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.412+0000 7fcc69e13740 10 client.5118 fetch_fsmap finished waiting for FSMap version 16 2024-09-19T08:38:16.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.412+0000 7fcc69e13740 10 client.5118 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:38:16.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.412+0000 7fcc69e13740 20 client.5118 populate_metadata read hostname 'smithi117' 2024-09-19T08:38:16.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.412+0000 7fcc69e13740 1 --2- 172.21.15.117:0/4227985701 >> [v2:172.21.15.146:6835/3614861409,v1:172.21.15.146:6837/3614861409] conn(0x55f9ed60ad10 0x55f9ed60b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.412+0000 7fcc69e13740 4 client.5118 mds_command: new command op to 4926 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:38:16.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.412+0000 7fcc69e13740 1 -- 172.21.15.117:0/4227985701 --> [v2:172.21.15.146:6835/3614861409,v1:172.21.15.146:6837/3614861409] -- command(tid 0: {"prefix": "status"}) -- 0x55f9ed51cfa0 con 0x55f9ed60ad10 2024-09-19T08:38:16.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.412+0000 7fcc5ffff640 1 --2- 172.21.15.117:0/4227985701 >> [v2:172.21.15.146:6835/3614861409,v1:172.21.15.146:6837/3614861409] conn(0x55f9ed60ad10 0x55f9ed60b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.413+0000 7fcc5ffff640 1 --2- 172.21.15.117:0/4227985701 >> [v2:172.21.15.146:6835/3614861409,v1:172.21.15.146:6837/3614861409] conn(0x55f9ed60ad10 0x55f9ed60b0f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4daccacbdfe77b6 server_cookie=c93ad396c54a8be7 in_seq=0 out_seq=0 2024-09-19T08:38:16.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.413+0000 7fcc3f7fe640 10 client.5118 ms_handle_connect on v2:172.21.15.146:6835/3614861409 2024-09-19T08:38:16.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.413+0000 7fcc3f7fe640 1 -- 172.21.15.117:0/4227985701 <== mds.0 v2:172.21.15.146:6835/3614861409 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55f9ed51cfa0 con 0x55f9ed60ad10 2024-09-19T08:38:16.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.413+0000 7fcc3f7fe640 10 client.5118 handle_command_reply: tid=0 2024-09-19T08:38:16.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.413+0000 7fcc69e13740 1 client.5118 shutdown 2024-09-19T08:38:16.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.413+0000 7fcc69e13740 1 -- 172.21.15.117:0/4227985701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5b32c0 msgr2=0x55f9ed61baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:16.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.413+0000 7fcc69e13740 1 --2- 172.21.15.117:0/4227985701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5b32c0 0x55f9ed61baa0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcc50005d40 tx=0x7fcc50001400 comp rx=0 tx=0).stop 2024-09-19T08:38:16.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.413+0000 7fcc69e13740 1 -- 172.21.15.117:0/4227985701 shutdown_connections 2024-09-19T08:38:16.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.413+0000 7fcc69e13740 1 --2- 172.21.15.117:0/4227985701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9ed5d3dc0 0x55f9ed61afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.413+0000 7fcc69e13740 1 --2- 172.21.15.117:0/4227985701 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55f9ed5b4a50 0x55f9ed5d8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.413+0000 7fcc69e13740 1 --2- 172.21.15.117:0/4227985701 >> [v2:172.21.15.146:6835/3614861409,v1:172.21.15.146:6837/3614861409] conn(0x55f9ed60ad10 0x55f9ed60b0f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.413+0000 7fcc69e13740 1 --2- 172.21.15.117:0/4227985701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f9ed5b32c0 0x55f9ed61baa0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.413+0000 7fcc3f7fe640 0 client.5118 ms_handle_reset on v2:172.21.15.146:6835/3614861409 2024-09-19T08:38:16.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.413+0000 7fcc69e13740 1 -- 172.21.15.117:0/4227985701 >> 172.21.15.117:0/4227985701 conn(0x55f9ed5b0a80 msgr2=0x55f9ed5d4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:16.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.413+0000 7fcc69e13740 1 -- 172.21.15.117:0/4227985701 shutdown_connections 2024-09-19T08:38:16.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.413+0000 7fcc69e13740 1 -- 172.21.15.117:0/4227985701 wait complete. 2024-09-19T08:38:16.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.413+0000 7fcc69e13740 20 client.5118 trim_cache size 0 max 16384 2024-09-19T08:38:16.419 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T08:38:16.419 INFO:teuthology.orchestra.run.smithi117.stdout: "cluster_fsid": "3be30853-f236-48ec-b905-15ecac86fc3f", 2024-09-19T08:38:16.420 INFO:teuthology.orchestra.run.smithi117.stdout: "whoami": 0, 2024-09-19T08:38:16.420 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 4926, 2024-09-19T08:38:16.420 INFO:teuthology.orchestra.run.smithi117.stdout: "want_state": "up:active", 2024-09-19T08:38:16.420 INFO:teuthology.orchestra.run.smithi117.stdout: "state": "up:active", 2024-09-19T08:38:16.420 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs", 2024-09-19T08:38:16.420 INFO:teuthology.orchestra.run.smithi117.stdout: "rank_uptime": 8.9007786979999999, 2024-09-19T08:38:16.420 INFO:teuthology.orchestra.run.smithi117.stdout: "mdsmap_epoch": 16, 2024-09-19T08:38:16.420 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_epoch": 40, 2024-09-19T08:38:16.420 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_epoch_barrier": 40, 2024-09-19T08:38:16.420 INFO:teuthology.orchestra.run.smithi117.stdout: "uptime": 15.772162729 2024-09-19T08:38:16.420 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T08:38:16.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.414+0000 7fcc66f98640 1 -- 172.21.15.117:0/1745611126 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcc4c06c2b0 msgr2=0x7fcc4c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:16.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.414+0000 7fcc66f98640 1 --2- 172.21.15.117:0/1745611126 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcc4c06c2b0 0x7fcc4c06e770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcc500012e0 tx=0x7fcc50007f90 comp rx=0 tx=0).stop 2024-09-19T08:38:16.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.414+0000 7fcc66f98640 1 -- 172.21.15.117:0/1745611126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc60141ad0 msgr2=0x7fcc6015d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:16.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.414+0000 7fcc66f98640 1 --2- 172.21.15.117:0/1745611126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc60141ad0 0x7fcc6015d8f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800d5d0 tx=0x7fcc5800da90 comp rx=0 tx=0).stop 2024-09-19T08:38:16.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.414+0000 7fcc66f98640 1 -- 172.21.15.117:0/1745611126 shutdown_connections 2024-09-19T08:38:16.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.414+0000 7fcc66f98640 1 --2- 172.21.15.117:0/1745611126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc60141ad0 0x7fcc6015d8f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.414+0000 7fcc66f98640 1 --2- 172.21.15.117:0/1745611126 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcc4c06c2b0 0x7fcc4c06e770 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.414+0000 7fcc66f98640 1 --2- 172.21.15.117:0/1745611126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc600d21f0 0x7fcc601f4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.414+0000 7fcc66f98640 1 --2- 172.21.15.117:0/1745611126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc60072590 0x7fcc6015bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.414+0000 7fcc66f98640 1 -- 172.21.15.117:0/1745611126 >> 172.21.15.117:0/1745611126 conn(0x7fcc600b3ed0 msgr2=0x7fcc601427a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:16.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.414+0000 7fcc66f98640 1 -- 172.21.15.117:0/1745611126 shutdown_connections 2024-09-19T08:38:16.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.414+0000 7fcc66f98640 1 -- 172.21.15.117:0/1745611126 wait complete. 2024-09-19T08:38:16.424 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T08:38:16.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.523+0000 7f6d3eb11640 1 Processor -- start 2024-09-19T08:38:16.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.523+0000 7f6d3eb11640 1 -- start start 2024-09-19T08:38:16.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.523+0000 7f6d3eb11640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d3815a7b0 0x7f6d380c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.523+0000 7f6d3eb11640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d380cd040 0x7f6d380b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.523+0000 7f6d3eb11640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d380b4540 con 0x7f6d380cde40 2024-09-19T08:38:16.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.523+0000 7f6d3eb11640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f6d380b4870 con 0x7f6d380cd040 2024-09-19T08:38:16.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.523+0000 7f6d3eb11640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f6d380cf9b0 con 0x7f6d3815a7b0 2024-09-19T08:38:16.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.524+0000 7f6d3d0ae640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d380cd040 0x7f6d380b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.524+0000 7f6d3c8ad640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d3815a7b0 0x7f6d380c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.524+0000 7f6d3d0ae640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d380cd040 0x7f6d380b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.117:36792/0 (socket says 172.21.15.117:36792) 2024-09-19T08:38:16.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.524+0000 7f6d3d0ae640 1 -- 172.21.15.117:0/3942606898 learned_addr learned my addr 172.21.15.117:0/3942606898 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:16.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.524+0000 7f6d37fff640 1 --1- 172.21.15.117:0/3942606898 >> v1:172.21.15.146:6789/0 conn(0x7f6d380cde40 0x7f6d380cc930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.117:58888/0 (socket says 172.21.15.117:58888) 2024-09-19T08:38:16.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.524+0000 7f6d3c8ad640 1 -- 172.21.15.117:0/3942606898 >> v2:172.21.15.146:3300/0 conn(0x7f6d380cd040 msgr2=0x7f6d380b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:16.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.524+0000 7f6d3c8ad640 1 --2- 172.21.15.117:0/3942606898 >> v2:172.21.15.146:3300/0 conn(0x7f6d380cd040 0x7f6d380b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.524+0000 7f6d3c8ad640 1 -- 172.21.15.117:0/3942606898 >> v1:172.21.15.146:6789/0 conn(0x7f6d380cde40 legacy=0x7f6d380cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:16.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.524+0000 7f6d3c8ad640 1 -- 172.21.15.117:0/3942606898 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d380cfc90 con 0x7f6d3815a7b0 2024-09-19T08:38:16.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.524+0000 7f6d3d0ae640 1 --2- 172.21.15.117:0/3942606898 >> v2:172.21.15.146:3300/0 conn(0x7f6d380cd040 0x7f6d380b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:38:16.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.525+0000 7f6d3c8ad640 1 --2- 172.21.15.117:0/3942606898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d3815a7b0 0x7f6d380c5b00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0097a0 tx=0x7f6d2c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8493ae0ce4c308a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:16.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.525+0000 7f6d377fe640 1 -- 172.21.15.117:0/3942606898 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c037070 con 0x7f6d3815a7b0 2024-09-19T08:38:16.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.525+0000 7f6d377fe640 1 -- 172.21.15.117:0/3942606898 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d2c032440 con 0x7f6d3815a7b0 2024-09-19T08:38:16.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.525+0000 7f6d377fe640 1 -- 172.21.15.117:0/3942606898 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c032810 con 0x7f6d3815a7b0 2024-09-19T08:38:16.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.526+0000 7f6d3eb11640 1 -- 172.21.15.117:0/3942606898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d3815a7b0 msgr2=0x7f6d380c5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:16.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.526+0000 7f6d3eb11640 1 --2- 172.21.15.117:0/3942606898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d3815a7b0 0x7f6d380c5b00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0097a0 tx=0x7f6d2c02a180 comp rx=0 tx=0).stop 2024-09-19T08:38:16.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.526+0000 7f6d3eb11640 1 -- 172.21.15.117:0/3942606898 shutdown_connections 2024-09-19T08:38:16.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.526+0000 7f6d3eb11640 1 --2- 172.21.15.117:0/3942606898 >> v2:172.21.15.146:3300/0 conn(0x7f6d380cd040 0x7f6d380b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.526+0000 7f6d3eb11640 1 --2- 172.21.15.117:0/3942606898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d3815a7b0 0x7f6d380c5b00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.526+0000 7f6d3eb11640 1 -- 172.21.15.117:0/3942606898 >> 172.21.15.117:0/3942606898 conn(0x7f6d3806bdf0 msgr2=0x7f6d3806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:16.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.526+0000 7f6d3eb11640 1 -- 172.21.15.117:0/3942606898 shutdown_connections 2024-09-19T08:38:16.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.526+0000 7f6d3eb11640 1 -- 172.21.15.117:0/3942606898 wait complete. 2024-09-19T08:38:16.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.527+0000 7f6d3eb11640 1 Processor -- start 2024-09-19T08:38:16.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.527+0000 7f6d3eb11640 1 -- start start 2024-09-19T08:38:16.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.528+0000 7f6d3eb11640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d380cd040 0x7f6d380aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.528+0000 7f6d3eb11640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d380cde40 0x7f6d38148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.528+0000 7f6d3eb11640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d3815a7b0 0x7f6d380ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.528+0000 7f6d3eb11640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6d380ca8c0 con 0x7f6d380cd040 2024-09-19T08:38:16.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.528+0000 7f6d3eb11640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3815ab90 con 0x7f6d3815a7b0 2024-09-19T08:38:16.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.528+0000 7f6d3eb11640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f6d380ce280 con 0x7f6d380cde40 2024-09-19T08:38:16.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.528+0000 7f6d3c8ad640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d380cd040 0x7f6d380aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.528+0000 7f6d3c8ad640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d380cd040 0x7f6d380aee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:60618/0 (socket says 172.21.15.117:60618) 2024-09-19T08:38:16.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.528+0000 7f6d3c8ad640 1 -- 172.21.15.117:0/1234464076 learned_addr learned my addr 172.21.15.117:0/1234464076 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:16.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.528+0000 7f6d3d0ae640 1 --2- 172.21.15.117:0/1234464076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d3815a7b0 0x7f6d380ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.528+0000 7f6d37fff640 1 --2- 172.21.15.117:0/1234464076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d380cde40 0x7f6d38148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.528+0000 7f6d3c8ad640 1 -- 172.21.15.117:0/1234464076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d380cde40 msgr2=0x7f6d38148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:16.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.528+0000 7f6d3c8ad640 1 --2- 172.21.15.117:0/1234464076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d380cde40 0x7f6d38148920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.528+0000 7f6d3c8ad640 1 -- 172.21.15.117:0/1234464076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d3815a7b0 msgr2=0x7f6d380ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:16.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.528+0000 7f6d3c8ad640 1 --2- 172.21.15.117:0/1234464076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d3815a7b0 0x7f6d380ad9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.528+0000 7f6d3c8ad640 1 -- 172.21.15.117:0/1234464076 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d380adf30 con 0x7f6d380cd040 2024-09-19T08:38:16.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.528+0000 7f6d3c8ad640 1 --2- 172.21.15.117:0/1234464076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d380cd040 0x7f6d380aee90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c035040 tx=0x7f6d2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:16.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.529+0000 7f6d357fa640 1 -- 172.21.15.117:0/1234464076 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c041020 con 0x7f6d380cd040 2024-09-19T08:38:16.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.529+0000 7f6d357fa640 1 -- 172.21.15.117:0/1234464076 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d2c030700 con 0x7f6d380cd040 2024-09-19T08:38:16.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.529+0000 7f6d357fa640 1 -- 172.21.15.117:0/1234464076 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c037040 con 0x7f6d380cd040 2024-09-19T08:38:16.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.529+0000 7f6d3eb11640 1 -- 172.21.15.117:0/1234464076 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d3814ebc0 con 0x7f6d380cd040 2024-09-19T08:38:16.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.529+0000 7f6d3eb11640 1 -- 172.21.15.117:0/1234464076 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d3814f180 con 0x7f6d380cd040 2024-09-19T08:38:16.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.530+0000 7f6d3eb11640 1 -- 172.21.15.117:0/1234464076 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d380c5b00 con 0x7f6d380cd040 2024-09-19T08:38:16.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.530+0000 7f6d357fa640 1 -- 172.21.15.117:0/1234464076 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6d2c044020 con 0x7f6d380cd040 2024-09-19T08:38:16.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.530+0000 7f6d357fa640 1 --2- 172.21.15.117:0/1234464076 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6d1c06c2b0 0x7f6d1c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:16.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.530+0000 7f6d357fa640 1 -- 172.21.15.117:0/1234464076 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f6d2c0abc90 con 0x7f6d380cd040 2024-09-19T08:38:16.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.531+0000 7f6d37fff640 1 --2- 172.21.15.117:0/1234464076 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6d1c06c2b0 0x7f6d1c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:16.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.531+0000 7f6d37fff640 1 --2- 172.21.15.117:0/1234464076 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6d1c06c2b0 0x7f6d1c06e770 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6d38153a60 tx=0x7f6d24000ed0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:16.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.535+0000 7f6d357fa640 1 -- 172.21.15.117:0/1234464076 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6d2c04b030 con 0x7f6d380cd040 2024-09-19T08:38:16.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.736+0000 7f6d3eb11640 1 -- 172.21.15.117:0/1234464076 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6d380c5e00 con 0x7f6d380cd040 2024-09-19T08:38:16.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.736+0000 7f6d357fa640 1 -- 172.21.15.117:0/1234464076 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f6d2c079c20 con 0x7f6d380cd040 2024-09-19T08:38:16.736 INFO:teuthology.orchestra.run.smithi117.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T08:38:16.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.738+0000 7f6d3eb11640 1 -- 172.21.15.117:0/1234464076 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6d1c06c2b0 msgr2=0x7f6d1c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:16.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.738+0000 7f6d3eb11640 1 --2- 172.21.15.117:0/1234464076 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6d1c06c2b0 0x7f6d1c06e770 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6d38153a60 tx=0x7f6d24000ed0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.738+0000 7f6d3eb11640 1 -- 172.21.15.117:0/1234464076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d380cd040 msgr2=0x7f6d380aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:16.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.738+0000 7f6d3eb11640 1 --2- 172.21.15.117:0/1234464076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d380cd040 0x7f6d380aee90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c035040 tx=0x7f6d2c0046c0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.738+0000 7f6d3eb11640 1 -- 172.21.15.117:0/1234464076 shutdown_connections 2024-09-19T08:38:16.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.738+0000 7f6d3eb11640 1 --2- 172.21.15.117:0/1234464076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d3815a7b0 0x7f6d380ad9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.738+0000 7f6d3eb11640 1 --2- 172.21.15.117:0/1234464076 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6d1c06c2b0 0x7f6d1c06e770 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.738+0000 7f6d3eb11640 1 --2- 172.21.15.117:0/1234464076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d380cde40 0x7f6d38148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.738+0000 7f6d3eb11640 1 --2- 172.21.15.117:0/1234464076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d380cd040 0x7f6d380aee90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:16.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.738+0000 7f6d3eb11640 1 -- 172.21.15.117:0/1234464076 >> 172.21.15.117:0/1234464076 conn(0x7f6d3806bdf0 msgr2=0x7f6d38153fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:16.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.738+0000 7f6d3eb11640 1 -- 172.21.15.117:0/1234464076 shutdown_connections 2024-09-19T08:38:16.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16.738+0000 7f6d3eb11640 1 -- 172.21.15.117:0/1234464076 wait complete. 2024-09-19T08:38:16.749 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T08:38:16.749 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T08:38:16.749 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2024-09-19T08:38:16.749 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T08:38:16.750 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T08:38:16.750 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T08:38:16.750 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T08:38:16.750 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T08:38:16.750 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T08:38:16.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:16.750 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2024-09-19T08:38:16.766 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T08:38:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T08:38:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T08:38:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:38:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-09-19T08:38:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:38:16.766 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:38:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2024-09-19T08:38:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2024-09-19T08:38:16.767 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:38:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2024-09-19T08:38:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2024-09-19T08:38:16.767 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:38:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:38:16.767 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T08:38:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:38:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T08:38:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42731sec preferred_lft 42731sec 2024-09-19T08:38:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link noprefixroute 2024-09-19T08:38:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:38:16.767 INFO:teuthology.orchestra.run.smithi117.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T08:38:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 3e:bb:c2:de:61:b2 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:38:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T08:38:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:38:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c454:b1ff:fe51:4d57/64 scope link 2024-09-19T08:38:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:38:16.768 INFO:teuthology.orchestra.run.smithi117.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T08:38:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 3e:bb:c2:de:61:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:38:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::3cbb:c2ff:fede:61b2/64 scope link 2024-09-19T08:38:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:38:16.768 INFO:teuthology.orchestra.run.smithi117.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T08:38:16.769 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether b2:58:c7:32:45:fe brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T08:38:16.769 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::b058:c7ff:fe32:45fe/64 scope link 2024-09-19T08:38:16.769 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:38:16.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:16.769 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T08:38:16.830 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-09-19T08:38:16.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:16.831 DEBUG:teuthology.orchestra.run.smithi117:> route 2024-09-19T08:38:16.889 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2024-09-19T08:38:16.889 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T08:38:16.889 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T08:38:16.890 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T08:38:16.890 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T08:38:16.890 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:38:16.890 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-09-19T08:38:16.890 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T08:38:16.890 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T08:38:16.891 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T08:38:16.891 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-09-19T08:38:16.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:38:17.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:38:17.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:17.017 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-09-19T08:38:17.032 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T08:38:17.032 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T08:38:17.032 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T08:38:17.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:17.033 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2024-09-19T08:38:17.098 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-19T08:38:17.098 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:38:17.098 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T08:38:17.153 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T08:38:17.153 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:38:17.154 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T08:38:17.209 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-09-19T08:38:17.274 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T08:38:17.331 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-09-19T08:38:17.331 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-09-19T08:38:17.331 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-09-19T08:38:17.331 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-09-19T08:38:17.331 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-09-19T08:38:17.331 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-09-19T08:38:17.331 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-09-19T08:38:17.331 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-09-19T08:38:17.331 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-09-19T08:38:17.331 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-09-19T08:38:17.331 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-09-19T08:38:17.331 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-09-19T08:38:17.332 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:38:17.332 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-09-19T08:38:17.332 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-09-19T08:38:17.332 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-09-19T08:38:17.332 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-09-19T08:38:17.332 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-09-19T08:38:17.332 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T08:38:17.332 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-09-19T08:38:17.332 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T08:38:17.332 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T08:38:17.332 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T08:38:17.332 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-09-19T08:38:17.332 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-09-19T08:38:17.332 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T08:38:17.332 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T08:38:17.333 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T08:38:17.333 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T08:38:17.333 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-09-19T08:38:17.333 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:38:17.333 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:38:17.333 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T08:38:17.333 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T08:38:17.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:17.333 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-09-19T08:38:17.386 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T08:38:17.386 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-19T08:38:17.428 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-09-19T08:38:17.452 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T08:38:17.508 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-09-19T08:38:17.508 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-09-19T08:38:17.509 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-09-19T08:38:17.509 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-09-19T08:38:17.509 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-09-19T08:38:17.509 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-09-19T08:38:17.509 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-09-19T08:38:17.509 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-09-19T08:38:17.509 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-09-19T08:38:17.509 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-09-19T08:38:17.509 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-09-19T08:38:17.509 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-09-19T08:38:17.509 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:38:17.509 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-09-19T08:38:17.509 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-09-19T08:38:17.510 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-09-19T08:38:17.510 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-09-19T08:38:17.510 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-09-19T08:38:17.510 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T08:38:17.510 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-09-19T08:38:17.510 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T08:38:17.510 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T08:38:17.510 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T08:38:17.510 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-09-19T08:38:17.510 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-09-19T08:38:17.510 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T08:38:17.510 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T08:38:17.510 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T08:38:17.511 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T08:38:17.511 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-09-19T08:38:17.511 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:38:17.511 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:38:17.511 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T08:38:17.511 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T08:38:17.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:17.512 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-09-19T08:38:17.513 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi117.stderr:2024-09-19T08:38:17.510+0000 7f81012cb480 -1 init, newargv = 0x5653cc21d5d0 newargc=15 2024-09-19T08:38:17.513 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi117.stderr:ceph-fuse[49486]: starting ceph client 2024-09-19T08:38:17.514 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi117.stderr:ceph-fuse[49486]: starting fuse 2024-09-19T08:38:17.529 INFO:teuthology.orchestra.run.smithi117.stdout:41 2024-09-19T08:38:17.530 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-19T08:38:17.530 DEBUG:teuthology.orchestra.run.smithi117:> sudo stdin-killer -- python3 -c ' 2024-09-19T08:38:17.530 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2024-09-19T08:38:17.530 DEBUG:teuthology.orchestra.run.smithi117:> import re 2024-09-19T08:38:17.530 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-09-19T08:38:17.530 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2024-09-19T08:38:17.530 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:38:17.530 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2024-09-19T08:38:17.530 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T08:38:17.530 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2024-09-19T08:38:17.530 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T08:38:17.530 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:38:17.531 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2024-09-19T08:38:17.531 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2024-09-19T08:38:17.531 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2024-09-19T08:38:17.531 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2024-09-19T08:38:17.531 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:38:17.531 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2024-09-19T08:38:17.531 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T08:38:17.531 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T08:38:17.531 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T08:38:17.531 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2024-09-19T08:38:17.531 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2024-09-19T08:38:17.531 DEBUG:teuthology.orchestra.run.smithi117:> return f 2024-09-19T08:38:17.531 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T08:38:17.531 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:38:17.532 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.0")) 2024-09-19T08:38:17.532 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-09-19T08:38:17.648 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.0.49486.asok 2024-09-19T08:38:17.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:38:17.658 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49486.asok 2024-09-19T08:38:17.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:17.658 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49486.asok status 2024-09-19T08:38:17.790 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T08:38:17.790 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2024-09-19T08:38:17.790 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T08:38:17.790 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:38:17.791 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "0", 2024-09-19T08:38:17.791 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2024-09-19T08:38:17.791 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T08:38:17.791 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "49486", 2024-09-19T08:38:17.791 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2024-09-19T08:38:17.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:17.791 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2024-09-19T08:38:17.791 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2024-09-19T08:38:17.791 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 5130, 2024-09-19T08:38:17.791 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2024-09-19T08:38:17.791 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2024-09-19T08:38:17.791 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2024-09-19T08:38:17.791 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 5130 2024-09-19T08:38:17.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:17.791 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-09-19T08:38:17.792 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-09-19T08:38:17.792 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-09-19T08:38:17.792 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 1333512015 2024-09-19T08:38:17.792 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:17.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:17.792 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-09-19T08:38:17.792 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-09-19T08:38:17.792 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-09-19T08:38:17.792 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 1333512015 2024-09-19T08:38:17.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:17.792 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.5130 192.168.0.1:0/1333512015", 2024-09-19T08:38:17.793 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/1333512015", 2024-09-19T08:38:17.793 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2024-09-19T08:38:17.793 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 16, 2024-09-19T08:38:17.793 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 40, 2024-09-19T08:38:17.793 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2024-09-19T08:38:17.793 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2024-09-19T08:38:17.793 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2024-09-19T08:38:17.793 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T08:38:17.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:17.799 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2024-09-19T08:38:17.799 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T08:38:17.815 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2024-09-19T08:38:17.815 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T08:38:17.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:17.815 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T08:38:17.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:17.881 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2024-09-19T08:38:17.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:17.944 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2024-09-19T08:38:18.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:18.002 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2024-09-19T08:38:18.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:18.061 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2024-09-19T08:38:18.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:18.122 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2024-09-19T08:38:18.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:18.181 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-09-19T08:38:18.245 INFO:teuthology.orchestra.run.smithi117.stdout:./ 2024-09-19T08:38:18.245 INFO:teuthology.orchestra.run.smithi117.stdout:./rfile 2024-09-19T08:38:18.245 INFO:teuthology.orchestra.run.smithi117.stdout:./parentdir 2024-09-19T08:38:18.246 INFO:teuthology.orchestra.run.smithi117.stdout:./parentdir/pfile 2024-09-19T08:38:18.246 INFO:teuthology.orchestra.run.smithi117.stdout:./parentdir/childdir 2024-09-19T08:38:18.246 INFO:teuthology.orchestra.run.smithi117.stdout:./parentdir/childdir/cfile 2024-09-19T08:38:18.247 DEBUG:teuthology.orchestra.run.smithi117:> stdin-killer -- python3 -c ' 2024-09-19T08:38:18.247 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-09-19T08:38:18.247 DEBUG:teuthology.orchestra.run.smithi117:> import stat 2024-09-19T08:38:18.247 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:38:18.247 DEBUG:teuthology.orchestra.run.smithi117:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-09-19T08:38:18.248 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-09-19T08:38:18.350 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-09-19T08:38:18.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:38:18.359 DEBUG:teuthology.orchestra.run.smithi117:> stdin-killer -- python3 -c ' 2024-09-19T08:38:18.359 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-09-19T08:38:18.359 DEBUG:teuthology.orchestra.run.smithi117:> import stat 2024-09-19T08:38:18.360 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:38:18.360 DEBUG:teuthology.orchestra.run.smithi117:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2024-09-19T08:38:18.360 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-09-19T08:38:18.464 INFO:teuthology.orchestra.run.smithi117.stdout:1099511627778 2024-09-19T08:38:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:38:18.472 DEBUG:teuthology.orchestra.run.smithi117:> stdin-killer -- python3 -c ' 2024-09-19T08:38:18.472 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-09-19T08:38:18.473 DEBUG:teuthology.orchestra.run.smithi117:> import stat 2024-09-19T08:38:18.473 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:38:18.473 DEBUG:teuthology.orchestra.run.smithi117:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2024-09-19T08:38:18.473 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-09-19T08:38:18.579 INFO:teuthology.orchestra.run.smithi117.stdout:1099511627776 2024-09-19T08:38:18.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:38:18.588 DEBUG:teuthology.orchestra.run.smithi117:> stdin-killer -- python3 -c ' 2024-09-19T08:38:18.588 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-09-19T08:38:18.588 DEBUG:teuthology.orchestra.run.smithi117:> import stat 2024-09-19T08:38:18.588 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:38:18.589 DEBUG:teuthology.orchestra.run.smithi117:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2024-09-19T08:38:18.589 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-09-19T08:38:18.694 INFO:teuthology.orchestra.run.smithi117.stdout:1099511628279 2024-09-19T08:38:18.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:38:18.703 DEBUG:teuthology.orchestra.run.smithi117:> stdin-killer -- python3 -c ' 2024-09-19T08:38:18.703 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-09-19T08:38:18.703 DEBUG:teuthology.orchestra.run.smithi117:> import stat 2024-09-19T08:38:18.703 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:38:18.703 DEBUG:teuthology.orchestra.run.smithi117:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2024-09-19T08:38:18.703 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-09-19T08:38:18.808 INFO:teuthology.orchestra.run.smithi117.stdout:1099511627777 2024-09-19T08:38:18.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:38:18.818 DEBUG:teuthology.orchestra.run.smithi117:> stdin-killer -- python3 -c ' 2024-09-19T08:38:18.818 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-09-19T08:38:18.818 DEBUG:teuthology.orchestra.run.smithi117:> import stat 2024-09-19T08:38:18.818 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:38:18.819 DEBUG:teuthology.orchestra.run.smithi117:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2024-09-19T08:38:18.819 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-09-19T08:38:18.923 INFO:teuthology.orchestra.run.smithi117.stdout:1099511628280 2024-09-19T08:38:18.925 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:38:18.932 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:38:18.932 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:38:18.989 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T08:38:19.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.129+0000 7f3d458dd640 1 Processor -- start 2024-09-19T08:38:19.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.129+0000 7f3d458dd640 1 -- start start 2024-09-19T08:38:19.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d458dd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d4015f0d0 0x7f3d4015f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:19.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d458dd640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3d400d0070 0x7f3d400d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:19.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d458dd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d400cf2b0 con 0x7f3d400d1940 2024-09-19T08:38:19.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d458dd640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f3d400cf590 con 0x7f3d400d0070 2024-09-19T08:38:19.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d458dd640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f3d400cf870 con 0x7f3d4015f0d0 2024-09-19T08:38:19.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d3f7fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f3d400d1940 0x7f3d400d4130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50566/0 (socket says 172.21.15.117:50566) 2024-09-19T08:38:19.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d3f7fe640 1 -- 172.21.15.117:0/835431171 learned_addr learned my addr 172.21.15.117:0/835431171 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:19.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d37fff640 1 --2- 172.21.15.117:0/835431171 >> v2:172.21.15.146:3300/0 conn(0x7f3d400d0070 0x7f3d400d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:19.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d3effd640 1 --2- 172.21.15.117:0/835431171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d4015f0d0 0x7f3d4015f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:19.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d3e7fc640 1 -- 172.21.15.117:0/835431171 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 342166455 0 0) 0x7f3d400cf2b0 con 0x7f3d400d1940 2024-09-19T08:38:19.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d3e7fc640 1 -- 172.21.15.117:0/835431171 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d2c003520 con 0x7f3d400d1940 2024-09-19T08:38:19.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d3e7fc640 1 -- 172.21.15.117:0/835431171 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4223982216 0 0) 0x7f3d2c003520 con 0x7f3d400d1940 2024-09-19T08:38:19.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d3e7fc640 1 -- 172.21.15.117:0/835431171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d4015f0d0 msgr2=0x7f3d4015f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:19.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d3e7fc640 1 --2- 172.21.15.117:0/835431171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d4015f0d0 0x7f3d4015f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d3e7fc640 1 -- 172.21.15.117:0/835431171 >> v2:172.21.15.146:3300/0 conn(0x7f3d400d0070 msgr2=0x7f3d400d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:19.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d3e7fc640 1 --2- 172.21.15.117:0/835431171 >> v2:172.21.15.146:3300/0 conn(0x7f3d400d0070 0x7f3d400d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d3e7fc640 1 -- 172.21.15.117:0/835431171 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d400cfb50 con 0x7f3d400d1940 2024-09-19T08:38:19.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d3e7fc640 1 -- 172.21.15.117:0/835431171 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f3d380019f0 con 0x7f3d400d1940 2024-09-19T08:38:19.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d3effd640 1 --2- 172.21.15.117:0/835431171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d4015f0d0 0x7f3d4015f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:38:19.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d3e7fc640 1 -- 172.21.15.117:0/835431171 >> v1:172.21.15.117:6789/0 conn(0x7f3d400d1940 legacy=0x7f3d400d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:19.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d3e7fc640 1 --2- 172.21.15.117:0/835431171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d4015f0d0 0x7f3d2c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:19.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d3e7fc640 1 --2- 172.21.15.117:0/835431171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c003ef0 0x7f3d2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:19.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d3e7fc640 1 --2- 172.21.15.117:0/835431171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d2c004d40 0x7f3d2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:19.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d3e7fc640 1 -- 172.21.15.117:0/835431171 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3d400cf590 con 0x7f3d2c003ef0 2024-09-19T08:38:19.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d3e7fc640 1 -- 172.21.15.117:0/835431171 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3d400cf870 con 0x7f3d2c004d40 2024-09-19T08:38:19.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d3e7fc640 1 -- 172.21.15.117:0/835431171 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f3d2c00b9c0 con 0x7f3d4015f0d0 2024-09-19T08:38:19.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.130+0000 7f3d37fff640 1 --2- 172.21.15.117:0/835431171 >> v2:172.21.15.146:3300/0 conn(0x7f3d400d0070 0x7f3d400d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:38:19.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.131+0000 7f3d37fff640 1 --2- 172.21.15.117:0/835431171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c003ef0 0x7f3d2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:19.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.131+0000 7f3d3effd640 1 --2- 172.21.15.117:0/835431171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d4015f0d0 0x7f3d2c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:19.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.131+0000 7f3d3f7fe640 1 --2- 172.21.15.117:0/835431171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d2c004d40 0x7f3d2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:19.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.131+0000 7f3d37fff640 1 -- 172.21.15.117:0/835431171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d4015f0d0 msgr2=0x7f3d2c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:19.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.131+0000 7f3d37fff640 1 --2- 172.21.15.117:0/835431171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d4015f0d0 0x7f3d2c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.131+0000 7f3d37fff640 1 -- 172.21.15.117:0/835431171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d2c004d40 msgr2=0x7f3d2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:19.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.131+0000 7f3d37fff640 1 --2- 172.21.15.117:0/835431171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d2c004d40 0x7f3d2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.131+0000 7f3d37fff640 1 -- 172.21.15.117:0/835431171 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d2c003520 con 0x7f3d2c003ef0 2024-09-19T08:38:19.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.132+0000 7f3d37fff640 1 --2- 172.21.15.117:0/835431171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c003ef0 0x7f3d2c004800 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3d28009c60 tx=0x7f3d2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da79451cb56f41f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:19.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.132+0000 7f3d3e7fc640 1 -- 172.21.15.117:0/835431171 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d28036070 con 0x7f3d2c003ef0 2024-09-19T08:38:19.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.132+0000 7f3d3e7fc640 1 -- 172.21.15.117:0/835431171 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d28031400 con 0x7f3d2c003ef0 2024-09-19T08:38:19.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.132+0000 7f3d3e7fc640 1 -- 172.21.15.117:0/835431171 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d28009860 con 0x7f3d2c003ef0 2024-09-19T08:38:19.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.132+0000 7f3d458dd640 1 -- 172.21.15.117:0/835431171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c003ef0 msgr2=0x7f3d2c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:19.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.132+0000 7f3d458dd640 1 --2- 172.21.15.117:0/835431171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c003ef0 0x7f3d2c004800 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3d28009c60 tx=0x7f3d2c005830 comp rx=0 tx=0).stop 2024-09-19T08:38:19.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.132+0000 7f3d3f7fe640 1 -- 172.21.15.117:0/835431171 reap_dead start 2024-09-19T08:38:19.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.132+0000 7f3d458dd640 1 -- 172.21.15.117:0/835431171 shutdown_connections 2024-09-19T08:38:19.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.132+0000 7f3d458dd640 1 -- 172.21.15.117:0/835431171 >> 172.21.15.117:0/835431171 conn(0x7f3d4009d760 msgr2=0x7f3d4008bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:19.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.132+0000 7f3d458dd640 1 -- 172.21.15.117:0/835431171 shutdown_connections 2024-09-19T08:38:19.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.132+0000 7f3d458dd640 1 -- 172.21.15.117:0/835431171 wait complete. 2024-09-19T08:38:19.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.134+0000 7f3d458dd640 1 Processor -- start 2024-09-19T08:38:19.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.134+0000 7f3d458dd640 1 -- start start 2024-09-19T08:38:19.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.134+0000 7f3d458dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c003ef0 0x7f3d400b9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:19.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.134+0000 7f3d458dd640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d40157f40 0x7f3d401574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:19.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.134+0000 7f3d458dd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d40160500 0x7f3d401609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:19.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.134+0000 7f3d458dd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3d400d49c0 con 0x7f3d2c003ef0 2024-09-19T08:38:19.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.134+0000 7f3d458dd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3d400d4840 con 0x7f3d40160500 2024-09-19T08:38:19.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.134+0000 7f3d458dd640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f3d400d4b40 con 0x7f3d40157f40 2024-09-19T08:38:19.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.134+0000 7f3d3effd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c003ef0 0x7f3d400b9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:19.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.134+0000 7f3d3effd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c003ef0 0x7f3d400b9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:60634/0 (socket says 172.21.15.117:60634) 2024-09-19T08:38:19.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.134+0000 7f3d3effd640 1 -- 172.21.15.117:0/3391253951 learned_addr learned my addr 172.21.15.117:0/3391253951 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:19.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.135+0000 7f3d37fff640 1 --2- 172.21.15.117:0/3391253951 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d40157f40 0x7f3d401574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:19.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.135+0000 7f3d3f7fe640 1 --2- 172.21.15.117:0/3391253951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d40160500 0x7f3d401609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:19.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.135+0000 7f3d3effd640 1 -- 172.21.15.117:0/3391253951 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d40157f40 msgr2=0x7f3d401574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:19.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.135+0000 7f3d3effd640 1 --2- 172.21.15.117:0/3391253951 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d40157f40 0x7f3d401574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.135+0000 7f3d3effd640 1 -- 172.21.15.117:0/3391253951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d40160500 msgr2=0x7f3d401609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:19.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.135+0000 7f3d3effd640 1 --2- 172.21.15.117:0/3391253951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d40160500 0x7f3d401609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.135+0000 7f3d3effd640 1 -- 172.21.15.117:0/3391253951 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d40157cd0 con 0x7f3d2c003ef0 2024-09-19T08:38:19.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.135+0000 7f3d3f7fe640 1 --2- 172.21.15.117:0/3391253951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d40160500 0x7f3d401609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:19.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.135+0000 7f3d3effd640 1 --2- 172.21.15.117:0/3391253951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c003ef0 0x7f3d400b9e00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3d30011a00 tx=0x7f3d30011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:19.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.135+0000 7f3d3cff9640 1 -- 172.21.15.117:0/3391253951 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3000faf0 con 0x7f3d2c003ef0 2024-09-19T08:38:19.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.135+0000 7f3d3cff9640 1 -- 172.21.15.117:0/3391253951 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d3000fc90 con 0x7f3d2c003ef0 2024-09-19T08:38:19.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.135+0000 7f3d458dd640 1 -- 172.21.15.117:0/3391253951 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d400b72b0 con 0x7f3d2c003ef0 2024-09-19T08:38:19.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.135+0000 7f3d3cff9640 1 -- 172.21.15.117:0/3391253951 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d30004030 con 0x7f3d2c003ef0 2024-09-19T08:38:19.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.135+0000 7f3d458dd640 1 -- 172.21.15.117:0/3391253951 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d400b7870 con 0x7f3d2c003ef0 2024-09-19T08:38:19.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.136+0000 7f3d458dd640 1 -- 172.21.15.117:0/3391253951 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d400d5120 con 0x7f3d2c003ef0 2024-09-19T08:38:19.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.136+0000 7f3d3cff9640 1 -- 172.21.15.117:0/3391253951 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3d30012040 con 0x7f3d2c003ef0 2024-09-19T08:38:19.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.137+0000 7f3d3cff9640 1 --2- 172.21.15.117:0/3391253951 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3d2006c2e0 0x7f3d2006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:19.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.137+0000 7f3d3cff9640 1 -- 172.21.15.117:0/3391253951 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f3d3008b8a0 con 0x7f3d2c003ef0 2024-09-19T08:38:19.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.137+0000 7f3d37fff640 1 --2- 172.21.15.117:0/3391253951 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3d2006c2e0 0x7f3d2006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:19.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.138+0000 7f3d37fff640 1 --2- 172.21.15.117:0/3391253951 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3d2006c2e0 0x7f3d2006e7a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3d28033000 tx=0x7f3d28008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:19.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.141+0000 7f3d3cff9640 1 -- 172.21.15.117:0/3391253951 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3d400d5120 con 0x7f3d2c003ef0 2024-09-19T08:38:19.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.322+0000 7f3d458dd640 1 -- 172.21.15.117:0/3391253951 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3d400d1400 con 0x7f3d2c003ef0 2024-09-19T08:38:19.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.322+0000 7f3d3cff9640 1 -- 172.21.15.117:0/3391253951 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) ==== 80+0+0 (secure 0 0 0) 0x7f3d30019070 con 0x7f3d2c003ef0 2024-09-19T08:38:19.322 INFO:teuthology.orchestra.run.smithi117.stderr:listed 0 entries 2024-09-19T08:38:19.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.324+0000 7f3d458dd640 1 -- 172.21.15.117:0/3391253951 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3d2006c2e0 msgr2=0x7f3d2006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:19.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.324+0000 7f3d458dd640 1 --2- 172.21.15.117:0/3391253951 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3d2006c2e0 0x7f3d2006e7a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3d28033000 tx=0x7f3d28008030 comp rx=0 tx=0).stop 2024-09-19T08:38:19.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.324+0000 7f3d458dd640 1 -- 172.21.15.117:0/3391253951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c003ef0 msgr2=0x7f3d400b9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:19.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.324+0000 7f3d458dd640 1 --2- 172.21.15.117:0/3391253951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c003ef0 0x7f3d400b9e00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3d30011a00 tx=0x7f3d30011ec0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.324+0000 7f3d458dd640 1 -- 172.21.15.117:0/3391253951 shutdown_connections 2024-09-19T08:38:19.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.324+0000 7f3d458dd640 1 --2- 172.21.15.117:0/3391253951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d40160500 0x7f3d401609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.324+0000 7f3d458dd640 1 --2- 172.21.15.117:0/3391253951 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3d2006c2e0 0x7f3d2006e7a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.324+0000 7f3d458dd640 1 --2- 172.21.15.117:0/3391253951 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d40157f40 0x7f3d401574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.324+0000 7f3d458dd640 1 --2- 172.21.15.117:0/3391253951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d2c003ef0 0x7f3d400b9e00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.324+0000 7f3d458dd640 1 -- 172.21.15.117:0/3391253951 >> 172.21.15.117:0/3391253951 conn(0x7f3d4009d760 msgr2=0x7f3d4015d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:19.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.324+0000 7f3d458dd640 1 -- 172.21.15.117:0/3391253951 shutdown_connections 2024-09-19T08:38:19.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.324+0000 7f3d458dd640 1 -- 172.21.15.117:0/3391253951 wait complete. 2024-09-19T08:38:19.335 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:38:19.335 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:38:19.351 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T08:38:19.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.489+0000 7f873d19f640 1 Processor -- start 2024-09-19T08:38:19.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.489+0000 7f873d19f640 1 -- start start 2024-09-19T08:38:19.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.490+0000 7f873d19f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87380d1ca0 0x7f87380cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:19.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.490+0000 7f873d19f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f87380d02f0 0x7f87381562c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:19.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.490+0000 7f873d19f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87380d22d0 con 0x7f873815cb00 2024-09-19T08:38:19.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.490+0000 7f873d19f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f87380b40b0 con 0x7f87380d02f0 2024-09-19T08:38:19.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.490+0000 7f873d19f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f87380d0760 con 0x7f87380d1ca0 2024-09-19T08:38:19.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.490+0000 7f873759e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f87380d02f0 0x7f87381562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:19.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.490+0000 7f8736d9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f873815cb00 0x7f873815cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50576/0 (socket says 172.21.15.117:50576) 2024-09-19T08:38:19.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.490+0000 7f8736d9d640 1 -- 172.21.15.117:0/1372471474 learned_addr learned my addr 172.21.15.117:0/1372471474 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:19.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.491+0000 7f873659c640 1 --2- 172.21.15.117:0/1372471474 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87380d1ca0 0x7f87380cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:19.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.491+0000 7f873759e640 1 -- 172.21.15.117:0/1372471474 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87380d1ca0 msgr2=0x7f87380cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:19.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.491+0000 7f873759e640 1 --2- 172.21.15.117:0/1372471474 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87380d1ca0 0x7f87380cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.491+0000 7f873759e640 1 -- 172.21.15.117:0/1372471474 >> v1:172.21.15.117:6789/0 conn(0x7f873815cb00 legacy=0x7f873815cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:19.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.491+0000 7f873759e640 1 -- 172.21.15.117:0/1372471474 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87380d25b0 con 0x7f87380d02f0 2024-09-19T08:38:19.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.491+0000 7f8735d9b640 1 -- 172.21.15.117:0/1372471474 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2705689026 0 0) 0x7f87380d22d0 con 0x7f873815cb00 2024-09-19T08:38:19.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.491+0000 7f873659c640 1 --2- 172.21.15.117:0/1372471474 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87380d1ca0 0x7f87380cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:19.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.491+0000 7f873759e640 1 --2- 172.21.15.117:0/1372471474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87380d02f0 0x7f87381562c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8730009d90 tx=0x7f873002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6ed5b46d65d7a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:19.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.491+0000 7f8735d9b640 1 -- 172.21.15.117:0/1372471474 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8730031600 con 0x7f87380d02f0 2024-09-19T08:38:19.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.492+0000 7f8735d9b640 1 -- 172.21.15.117:0/1372471474 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87300317a0 con 0x7f87380d02f0 2024-09-19T08:38:19.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.492+0000 7f8735d9b640 1 -- 172.21.15.117:0/1372471474 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8730031b70 con 0x7f87380d02f0 2024-09-19T08:38:19.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.492+0000 7f873d19f640 1 -- 172.21.15.117:0/1372471474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87380d02f0 msgr2=0x7f87381562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:19.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.492+0000 7f873d19f640 1 --2- 172.21.15.117:0/1372471474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87380d02f0 0x7f87381562c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8730009d90 tx=0x7f873002a5d0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.492+0000 7f873d19f640 1 -- 172.21.15.117:0/1372471474 shutdown_connections 2024-09-19T08:38:19.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.492+0000 7f873d19f640 1 --2- 172.21.15.117:0/1372471474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87380d02f0 0x7f87381562c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.492+0000 7f873d19f640 1 --2- 172.21.15.117:0/1372471474 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87380d1ca0 0x7f87380cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.492+0000 7f873d19f640 1 -- 172.21.15.117:0/1372471474 >> 172.21.15.117:0/1372471474 conn(0x7f8738067fe0 msgr2=0x7f873806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:19.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.492+0000 7f873d19f640 1 -- 172.21.15.117:0/1372471474 shutdown_connections 2024-09-19T08:38:19.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.492+0000 7f873d19f640 1 -- 172.21.15.117:0/1372471474 wait complete. 2024-09-19T08:38:19.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.494+0000 7f873d19f640 1 Processor -- start 2024-09-19T08:38:19.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.494+0000 7f873d19f640 1 -- start start 2024-09-19T08:38:19.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.494+0000 7f873d19f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87380d02f0 0x7f87380cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:19.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.494+0000 7f873d19f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87380d1ca0 0x7f87380b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:19.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.494+0000 7f873d19f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f873815cb00 0x7f87380b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:19.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.494+0000 7f873d19f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f873815d5f0 con 0x7f87380d1ca0 2024-09-19T08:38:19.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.494+0000 7f873d19f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f87380d2b70 con 0x7f873815cb00 2024-09-19T08:38:19.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.494+0000 7f873d19f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f873815d770 con 0x7f87380d02f0 2024-09-19T08:38:19.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.494+0000 7f873659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87380d1ca0 0x7f87380b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:19.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.494+0000 7f873659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87380d1ca0 0x7f87380b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:60654/0 (socket says 172.21.15.117:60654) 2024-09-19T08:38:19.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.494+0000 7f873659c640 1 -- 172.21.15.117:0/3659341668 learned_addr learned my addr 172.21.15.117:0/3659341668 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:19.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.495+0000 7f873759e640 1 --2- 172.21.15.117:0/3659341668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f873815cb00 0x7f87380b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:19.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.495+0000 7f8736d9d640 1 --2- 172.21.15.117:0/3659341668 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87380d02f0 0x7f87380cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:19.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.495+0000 7f873659c640 1 -- 172.21.15.117:0/3659341668 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87380d02f0 msgr2=0x7f87380cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:19.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.495+0000 7f873659c640 1 --2- 172.21.15.117:0/3659341668 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87380d02f0 0x7f87380cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.495+0000 7f873659c640 1 -- 172.21.15.117:0/3659341668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f873815cb00 msgr2=0x7f87380b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:19.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.495+0000 7f873659c640 1 --2- 172.21.15.117:0/3659341668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f873815cb00 0x7f87380b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.495+0000 7f873659c640 1 -- 172.21.15.117:0/3659341668 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87380b6a60 con 0x7f87380d1ca0 2024-09-19T08:38:19.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.495+0000 7f873659c640 1 --2- 172.21.15.117:0/3659341668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87380d1ca0 0x7f87380b2cb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f872c00c7f0 tx=0x7f872c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:19.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.495+0000 7f871f7fe640 1 -- 172.21.15.117:0/3659341668 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c015070 con 0x7f87380d1ca0 2024-09-19T08:38:19.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.495+0000 7f871f7fe640 1 -- 172.21.15.117:0/3659341668 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f872c007820 con 0x7f87380d1ca0 2024-09-19T08:38:19.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.495+0000 7f873d19f640 1 -- 172.21.15.117:0/3659341668 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87380b6d40 con 0x7f87380d1ca0 2024-09-19T08:38:19.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.495+0000 7f871f7fe640 1 -- 172.21.15.117:0/3659341668 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c007bd0 con 0x7f87380d1ca0 2024-09-19T08:38:19.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.495+0000 7f873d19f640 1 -- 172.21.15.117:0/3659341668 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87380b7300 con 0x7f87380d1ca0 2024-09-19T08:38:19.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.496+0000 7f873d19f640 1 -- 172.21.15.117:0/3659341668 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87380b7540 con 0x7f87380d1ca0 2024-09-19T08:38:19.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.497+0000 7f871f7fe640 1 -- 172.21.15.117:0/3659341668 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f872c018070 con 0x7f87380d1ca0 2024-09-19T08:38:19.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.497+0000 7f871f7fe640 1 --2- 172.21.15.117:0/3659341668 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f872406c2b0 0x7f872406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:19.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.497+0000 7f871f7fe640 1 -- 172.21.15.117:0/3659341668 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f872c08b520 con 0x7f87380d1ca0 2024-09-19T08:38:19.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.497+0000 7f8736d9d640 1 --2- 172.21.15.117:0/3659341668 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f872406c2b0 0x7f872406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:19.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.498+0000 7f8736d9d640 1 --2- 172.21.15.117:0/3659341668 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f872406c2b0 0x7f872406e770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8728000f60 tx=0x7f8728007b50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:19.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.501+0000 7f871f7fe640 1 -- 172.21.15.117:0/3659341668 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f87380b7540 con 0x7f87380d1ca0 2024-09-19T08:38:19.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.680+0000 7f873d19f640 1 -- 172.21.15.117:0/3659341668 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f87380cfdb0 con 0x7f87380d1ca0 2024-09-19T08:38:19.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.680+0000 7f871f7fe640 1 -- 172.21.15.117:0/3659341668 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) ==== 80+0+0 (secure 0 0 0) 0x7f872c059ae0 con 0x7f87380d1ca0 2024-09-19T08:38:19.680 INFO:teuthology.orchestra.run.smithi117.stderr:listed 0 entries 2024-09-19T08:38:19.682 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.682+0000 7f873d19f640 1 -- 172.21.15.117:0/3659341668 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f872406c2b0 msgr2=0x7f872406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:19.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.682+0000 7f873d19f640 1 --2- 172.21.15.117:0/3659341668 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f872406c2b0 0x7f872406e770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8728000f60 tx=0x7f8728007b50 comp rx=0 tx=0).stop 2024-09-19T08:38:19.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.682+0000 7f873d19f640 1 -- 172.21.15.117:0/3659341668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87380d1ca0 msgr2=0x7f87380b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:19.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.682+0000 7f873d19f640 1 --2- 172.21.15.117:0/3659341668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87380d1ca0 0x7f87380b2cb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f872c00c7f0 tx=0x7f872c00ccb0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.682+0000 7f873d19f640 1 -- 172.21.15.117:0/3659341668 shutdown_connections 2024-09-19T08:38:19.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.682+0000 7f873d19f640 1 --2- 172.21.15.117:0/3659341668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f873815cb00 0x7f87380b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.682+0000 7f873d19f640 1 --2- 172.21.15.117:0/3659341668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87380d1ca0 0x7f87380b2cb0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.682+0000 7f873d19f640 1 --2- 172.21.15.117:0/3659341668 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f872406c2b0 0x7f872406e770 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.682+0000 7f873d19f640 1 --2- 172.21.15.117:0/3659341668 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87380d02f0 0x7f87380cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:19.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.682+0000 7f873d19f640 1 -- 172.21.15.117:0/3659341668 >> 172.21.15.117:0/3659341668 conn(0x7f8738067fe0 msgr2=0x7f87380c8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:19.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.683+0000 7f873d19f640 1 -- 172.21.15.117:0/3659341668 shutdown_connections 2024-09-19T08:38:19.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:19.683+0000 7f873d19f640 1 -- 172.21.15.117:0/3659341668 wait complete. 2024-09-19T08:38:19.693 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2024-09-19T08:38:19.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:19.694 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T08:38:19.716 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi117.stderr:ceph-fuse[49486]: fuse finished with error 0 and tester_r 0 2024-09-19T08:38:19.718 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:38:25.820 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T08:38:25.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:25.821 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T08:38:25.841 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:38:25.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.990+0000 7fa2364b7640 1 Processor -- start 2024-09-19T08:38:25.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.990+0000 7fa2364b7640 1 -- start start 2024-09-19T08:38:25.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.991+0000 7fa2364b7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa23015b120 0x7fa23006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:25.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.991+0000 7fa2364b7640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa2300d0bc0 0x7fa23006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:25.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.991+0000 7fa2364b7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa23015b500 con 0x7fa23006dec0 2024-09-19T08:38:25.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.991+0000 7fa2364b7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa23006e940 con 0x7fa23015b120 2024-09-19T08:38:25.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.991+0000 7fa2364b7640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fa23006ec20 con 0x7fa2300d0bc0 2024-09-19T08:38:25.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.991+0000 7fa22ffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa23015b120 0x7fa23006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:25.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.991+0000 7fa22f7fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fa23006dec0 0x7fa2300d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:41328/0 (socket says 172.21.15.117:41328) 2024-09-19T08:38:25.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.991+0000 7fa22f7fe640 1 -- 172.21.15.117:0/2478261672 learned_addr learned my addr 172.21.15.117:0/2478261672 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:25.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.991+0000 7fa234a54640 1 --2- 172.21.15.117:0/2478261672 >> v2:172.21.15.146:3300/0 conn(0x7fa2300d0bc0 0x7fa23006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:25.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.991+0000 7fa22ffff640 1 -- 172.21.15.117:0/2478261672 >> v2:172.21.15.146:3300/0 conn(0x7fa2300d0bc0 msgr2=0x7fa23006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:25.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.991+0000 7fa22ffff640 1 --2- 172.21.15.117:0/2478261672 >> v2:172.21.15.146:3300/0 conn(0x7fa2300d0bc0 0x7fa23006e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:25.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.991+0000 7fa22ffff640 1 -- 172.21.15.117:0/2478261672 >> v1:172.21.15.117:6789/0 conn(0x7fa23006dec0 legacy=0x7fa2300d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:25.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.991+0000 7fa22ffff640 1 -- 172.21.15.117:0/2478261672 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23006ef00 con 0x7fa23015b120 2024-09-19T08:38:25.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.991+0000 7fa22effd640 1 -- 172.21.15.117:0/2478261672 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3889159908 0 0) 0x7fa23015b500 con 0x7fa23006dec0 2024-09-19T08:38:25.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.992+0000 7fa22ffff640 1 --2- 172.21.15.117:0/2478261672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa23015b120 0x7fa23006f9e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa23015eb60 tx=0x7fa22002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd61be1e42a704a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:25.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.992+0000 7fa22effd640 1 -- 172.21.15.117:0/2478261672 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa220037070 con 0x7fa23015b120 2024-09-19T08:38:25.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.992+0000 7fa22effd640 1 -- 172.21.15.117:0/2478261672 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa220032440 con 0x7fa23015b120 2024-09-19T08:38:25.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.992+0000 7fa22effd640 1 -- 172.21.15.117:0/2478261672 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa220032810 con 0x7fa23015b120 2024-09-19T08:38:25.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.993+0000 7fa2364b7640 1 -- 172.21.15.117:0/2478261672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa23015b120 msgr2=0x7fa23006f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:25.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.993+0000 7fa2364b7640 1 --2- 172.21.15.117:0/2478261672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa23015b120 0x7fa23006f9e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa23015eb60 tx=0x7fa22002a1a0 comp rx=0 tx=0).stop 2024-09-19T08:38:25.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.993+0000 7fa2364b7640 1 -- 172.21.15.117:0/2478261672 shutdown_connections 2024-09-19T08:38:25.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.993+0000 7fa2364b7640 1 --2- 172.21.15.117:0/2478261672 >> v2:172.21.15.146:3300/0 conn(0x7fa2300d0bc0 0x7fa23006e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:25.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.993+0000 7fa2364b7640 1 --2- 172.21.15.117:0/2478261672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa23015b120 0x7fa23006f9e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:25.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.993+0000 7fa2364b7640 1 -- 172.21.15.117:0/2478261672 >> 172.21.15.117:0/2478261672 conn(0x7fa23006bdf0 msgr2=0x7fa23006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:25.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.993+0000 7fa2364b7640 1 -- 172.21.15.117:0/2478261672 shutdown_connections 2024-09-19T08:38:25.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.993+0000 7fa2364b7640 1 -- 172.21.15.117:0/2478261672 wait complete. 2024-09-19T08:38:25.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.994+0000 7fa2364b7640 1 Processor -- start 2024-09-19T08:38:25.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.994+0000 7fa2364b7640 1 -- start start 2024-09-19T08:38:25.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.995+0000 7fa2364b7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa23006dec0 0x7fa230153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:25.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.995+0000 7fa2364b7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2300d0bc0 0x7fa2300afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:25.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.995+0000 7fa2364b7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa23015b120 0x7fa2300cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:25.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.995+0000 7fa2364b7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa2300ce060 con 0x7fa2300d0bc0 2024-09-19T08:38:25.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.995+0000 7fa2364b7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa23006f4c0 con 0x7fa23015b120 2024-09-19T08:38:25.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.995+0000 7fa2364b7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fa2300c5160 con 0x7fa23006dec0 2024-09-19T08:38:25.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.995+0000 7fa22f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2300d0bc0 0x7fa2300afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:25.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.995+0000 7fa22f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2300d0bc0 0x7fa2300afdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52288/0 (socket says 172.21.15.117:52288) 2024-09-19T08:38:25.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.995+0000 7fa22f7fe640 1 -- 172.21.15.117:0/1817915313 learned_addr learned my addr 172.21.15.117:0/1817915313 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:25.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.995+0000 7fa22ffff640 1 --2- 172.21.15.117:0/1817915313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa23006dec0 0x7fa230153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:25.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.995+0000 7fa234a54640 1 --2- 172.21.15.117:0/1817915313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa23015b120 0x7fa2300cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:25.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.995+0000 7fa22f7fe640 1 -- 172.21.15.117:0/1817915313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa23006dec0 msgr2=0x7fa230153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:25.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.995+0000 7fa22f7fe640 1 --2- 172.21.15.117:0/1817915313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa23006dec0 0x7fa230153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:25.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.995+0000 7fa22f7fe640 1 -- 172.21.15.117:0/1817915313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa23015b120 msgr2=0x7fa2300cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:25.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.995+0000 7fa22f7fe640 1 --2- 172.21.15.117:0/1817915313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa23015b120 0x7fa2300cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:25.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.995+0000 7fa22f7fe640 1 -- 172.21.15.117:0/1817915313 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2300b2610 con 0x7fa2300d0bc0 2024-09-19T08:38:25.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.996+0000 7fa22f7fe640 1 --2- 172.21.15.117:0/1817915313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2300d0bc0 0x7fa2300afdc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa22400c500 tx=0x7fa22400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:25.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.996+0000 7fa22cff9640 1 -- 172.21.15.117:0/1817915313 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa224018070 con 0x7fa2300d0bc0 2024-09-19T08:38:25.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.996+0000 7fa22cff9640 1 -- 172.21.15.117:0/1817915313 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa224007580 con 0x7fa2300d0bc0 2024-09-19T08:38:25.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.996+0000 7fa2364b7640 1 -- 172.21.15.117:0/1817915313 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2300b0530 con 0x7fa2300d0bc0 2024-09-19T08:38:25.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.996+0000 7fa22cff9640 1 -- 172.21.15.117:0/1817915313 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa224004a20 con 0x7fa2300d0bc0 2024-09-19T08:38:25.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.996+0000 7fa2364b7640 1 -- 172.21.15.117:0/1817915313 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2300b0af0 con 0x7fa2300d0bc0 2024-09-19T08:38:26.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.997+0000 7fa2364b7640 1 -- 172.21.15.117:0/1817915313 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa23006e330 con 0x7fa2300d0bc0 2024-09-19T08:38:26.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.997+0000 7fa22cff9640 1 -- 172.21.15.117:0/1817915313 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa22401b070 con 0x7fa2300d0bc0 2024-09-19T08:38:26.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.998+0000 7fa22cff9640 1 --2- 172.21.15.117:0/1817915313 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa21c06c2b0 0x7fa21c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:26.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.998+0000 7fa22cff9640 1 -- 172.21.15.117:0/1817915313 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fa22408a780 con 0x7fa2300d0bc0 2024-09-19T08:38:26.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.998+0000 7fa22ffff640 1 --2- 172.21.15.117:0/1817915313 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa21c06c2b0 0x7fa21c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:26.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:25.999+0000 7fa22ffff640 1 --2- 172.21.15.117:0/1817915313 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa21c06c2b0 0x7fa21c06e770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa220034000 tx=0x7fa22002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:26.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.002+0000 7fa22cff9640 1 -- 172.21.15.117:0/1817915313 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa2300b2610 con 0x7fa2300d0bc0 2024-09-19T08:38:26.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.199+0000 7fa2364b7640 1 -- 172.21.15.117:0/1817915313 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa23015a6f0 con 0x7fa2300d0bc0 2024-09-19T08:38:26.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.200+0000 7fa22cff9640 1 -- 172.21.15.117:0/1817915313 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5235 (secure 0 0 0) 0x7fa2240587a0 con 0x7fa2300d0bc0 2024-09-19T08:38:26.200 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:26.201 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":16,"btime":"2024-09-19T08:38:09:528263+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4595,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2240250216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2240250216},{"type":"v1","addr":"172.21.15.146:6836","nonce":2240250216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2165679820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2165679820},{"type":"v1","addr":"172.21.15.117:6834","nonce":2165679820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2737032516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2737032516},{"type":"v1","addr":"172.21.15.117:6835","nonce":2737032516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:38:06.852720+0000","modified":"2024-09-19T08:38:08.856085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/3614861409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":3614861409},{"type":"v1","addr":"172.21.15.146:6837","nonce":3614861409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4926,"qdb_cluster":[4926]},"id":2}]} 2024-09-19T08:38:26.201 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 16 2024-09-19T08:38:26.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.202+0000 7fa2364b7640 1 -- 172.21.15.117:0/1817915313 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa21c06c2b0 msgr2=0x7fa21c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:26.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.202+0000 7fa2364b7640 1 --2- 172.21.15.117:0/1817915313 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa21c06c2b0 0x7fa21c06e770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa220034000 tx=0x7fa22002e000 comp rx=0 tx=0).stop 2024-09-19T08:38:26.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.202+0000 7fa2364b7640 1 -- 172.21.15.117:0/1817915313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2300d0bc0 msgr2=0x7fa2300afdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:26.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.202+0000 7fa2364b7640 1 --2- 172.21.15.117:0/1817915313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2300d0bc0 0x7fa2300afdc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa22400c500 tx=0x7fa22400c9c0 comp rx=0 tx=0).stop 2024-09-19T08:38:26.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.202+0000 7fa2364b7640 1 -- 172.21.15.117:0/1817915313 shutdown_connections 2024-09-19T08:38:26.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.202+0000 7fa2364b7640 1 --2- 172.21.15.117:0/1817915313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa23015b120 0x7fa2300cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:26.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.202+0000 7fa2364b7640 1 --2- 172.21.15.117:0/1817915313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2300d0bc0 0x7fa2300afdc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:26.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.202+0000 7fa2364b7640 1 --2- 172.21.15.117:0/1817915313 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa21c06c2b0 0x7fa21c06e770 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:26.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.202+0000 7fa2364b7640 1 --2- 172.21.15.117:0/1817915313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa23006dec0 0x7fa230153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:26.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.202+0000 7fa2364b7640 1 -- 172.21.15.117:0/1817915313 >> 172.21.15.117:0/1817915313 conn(0x7fa23006bdf0 msgr2=0x7fa2300ad160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:26.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.202+0000 7fa2364b7640 1 -- 172.21.15.117:0/1817915313 shutdown_connections 2024-09-19T08:38:26.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.202+0000 7fa2364b7640 1 -- 172.21.15.117:0/1817915313 wait complete. 2024-09-19T08:38:26.213 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-09-19T08:38:26.352 INFO:teuthology.orchestra.run.smithi146.stdout:{"message":"","return_code":0} 2024-09-19T08:38:26.353 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-19T08:38:26.353 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:38:26.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.452+0000 7fc8aa8d9640 1 Processor -- start 2024-09-19T08:38:26.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.452+0000 7fc8aa8d9640 1 -- start start 2024-09-19T08:38:26.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.453+0000 7fc8aa8d9640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8a406fb40 0x7fc8a4070180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:26.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.453+0000 7fc8aa8d9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc8a40706c0 0x7fc8a40b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:26.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.453+0000 7fc8aa8d9640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8a406e9e0 con 0x7fc8a415e360 2024-09-19T08:38:26.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.453+0000 7fc8aa8d9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc8a406e700 con 0x7fc8a40706c0 2024-09-19T08:38:26.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.453+0000 7fc8aa8d9640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fc8a40b3cd0 con 0x7fc8a406fb40 2024-09-19T08:38:26.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.453+0000 7fc8a8e76640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc8a40706c0 0x7fc8a40b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:26.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.453+0000 7fc8a8e76640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc8a40706c0 0x7fc8a40b4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52292/0 (socket says 172.21.15.117:52292) 2024-09-19T08:38:26.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.453+0000 7fc8a8e76640 1 -- 172.21.15.117:0/3995400036 learned_addr learned my addr 172.21.15.117:0/3995400036 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:26.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.453+0000 7fc8a37fe640 1 --2- 172.21.15.117:0/3995400036 >> v2:172.21.15.146:3300/0 conn(0x7fc8a406fb40 0x7fc8a4070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:26.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.453+0000 7fc8a8e76640 1 -- 172.21.15.117:0/3995400036 >> v2:172.21.15.146:3300/0 conn(0x7fc8a406fb40 msgr2=0x7fc8a4070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:26.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.453+0000 7fc8a8e76640 1 --2- 172.21.15.117:0/3995400036 >> v2:172.21.15.146:3300/0 conn(0x7fc8a406fb40 0x7fc8a4070180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:26.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.453+0000 7fc8a8e76640 1 -- 172.21.15.117:0/3995400036 >> v1:172.21.15.146:6789/0 conn(0x7fc8a415e360 legacy=0x7fc8a40ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:26.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.453+0000 7fc8a8e76640 1 -- 172.21.15.117:0/3995400036 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a40b3fb0 con 0x7fc8a40706c0 2024-09-19T08:38:26.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.454+0000 7fc8a8e76640 1 --2- 172.21.15.117:0/3995400036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8a40706c0 0x7fc8a40b4a90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40722f0 tx=0x7fc89c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ac347780a42241 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:26.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.454+0000 7fc8a2ffd640 1 -- 172.21.15.117:0/3995400036 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c036070 con 0x7fc8a40706c0 2024-09-19T08:38:26.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.454+0000 7fc8a2ffd640 1 -- 172.21.15.117:0/3995400036 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c031600 con 0x7fc8a40706c0 2024-09-19T08:38:26.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.454+0000 7fc8a2ffd640 1 -- 172.21.15.117:0/3995400036 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c0319d0 con 0x7fc8a40706c0 2024-09-19T08:38:26.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.454+0000 7fc8aa8d9640 1 -- 172.21.15.117:0/3995400036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8a40706c0 msgr2=0x7fc8a40b4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:26.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.454+0000 7fc8aa8d9640 1 --2- 172.21.15.117:0/3995400036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8a40706c0 0x7fc8a40b4a90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40722f0 tx=0x7fc89c02a730 comp rx=0 tx=0).stop 2024-09-19T08:38:26.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.454+0000 7fc8aa8d9640 1 -- 172.21.15.117:0/3995400036 shutdown_connections 2024-09-19T08:38:26.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.454+0000 7fc8aa8d9640 1 --2- 172.21.15.117:0/3995400036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8a40706c0 0x7fc8a40b4a90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:26.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.454+0000 7fc8aa8d9640 1 --2- 172.21.15.117:0/3995400036 >> v2:172.21.15.146:3300/0 conn(0x7fc8a406fb40 0x7fc8a4070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:26.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.454+0000 7fc8aa8d9640 1 -- 172.21.15.117:0/3995400036 >> 172.21.15.117:0/3995400036 conn(0x7fc8a4073560 msgr2=0x7fc8a406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:26.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.455+0000 7fc8aa8d9640 1 -- 172.21.15.117:0/3995400036 shutdown_connections 2024-09-19T08:38:26.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.455+0000 7fc8aa8d9640 1 -- 172.21.15.117:0/3995400036 wait complete. 2024-09-19T08:38:26.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.456+0000 7fc8aa8d9640 1 Processor -- start 2024-09-19T08:38:26.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.456+0000 7fc8aa8d9640 1 -- start start 2024-09-19T08:38:26.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8aa8d9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8a406fb40 0x7fc8a4160650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:26.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8aa8d9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8a40706c0 0x7fc8a4141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:26.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8aa8d9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8a415e360 0x7fc8a4158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:26.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8aa8d9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a415e740 con 0x7fc8a406fb40 2024-09-19T08:38:26.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8aa8d9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a406f6d0 con 0x7fc8a415e360 2024-09-19T08:38:26.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8aa8d9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fc8a4067d90 con 0x7fc8a40706c0 2024-09-19T08:38:26.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8a3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8a406fb40 0x7fc8a4160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:26.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8a3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8a406fb40 0x7fc8a4160650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52300/0 (socket says 172.21.15.117:52300) 2024-09-19T08:38:26.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8a3fff640 1 -- 172.21.15.117:0/3172705374 learned_addr learned my addr 172.21.15.117:0/3172705374 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:26.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8a8e76640 1 --2- 172.21.15.117:0/3172705374 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8a415e360 0x7fc8a4158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:26.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8a37fe640 1 --2- 172.21.15.117:0/3172705374 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8a40706c0 0x7fc8a4141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:26.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8a3fff640 1 -- 172.21.15.117:0/3172705374 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8a40706c0 msgr2=0x7fc8a4141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:26.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8a3fff640 1 --2- 172.21.15.117:0/3172705374 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8a40706c0 0x7fc8a4141dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:26.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8a3fff640 1 -- 172.21.15.117:0/3172705374 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8a415e360 msgr2=0x7fc8a4158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:26.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8a3fff640 1 --2- 172.21.15.117:0/3172705374 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8a415e360 0x7fc8a4158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:26.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8a3fff640 1 -- 172.21.15.117:0/3172705374 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a4160df0 con 0x7fc8a406fb40 2024-09-19T08:38:26.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8a3fff640 1 --2- 172.21.15.117:0/3172705374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8a406fb40 0x7fc8a4160650 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc89400c400 tx=0x7fc89400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:26.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8a0ff9640 1 -- 172.21.15.117:0/3172705374 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8940052d0 con 0x7fc8a406fb40 2024-09-19T08:38:26.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8a0ff9640 1 -- 172.21.15.117:0/3172705374 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc894005490 con 0x7fc8a406fb40 2024-09-19T08:38:26.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8aa8d9640 1 -- 172.21.15.117:0/3172705374 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a4142bc0 con 0x7fc8a406fb40 2024-09-19T08:38:26.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8a0ff9640 1 -- 172.21.15.117:0/3172705374 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc894007260 con 0x7fc8a406fb40 2024-09-19T08:38:26.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.457+0000 7fc8aa8d9640 1 -- 172.21.15.117:0/3172705374 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8a4143180 con 0x7fc8a406fb40 2024-09-19T08:38:26.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.458+0000 7fc8aa8d9640 1 -- 172.21.15.117:0/3172705374 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8a4143890 con 0x7fc8a406fb40 2024-09-19T08:38:26.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.459+0000 7fc8a0ff9640 1 -- 172.21.15.117:0/3172705374 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc894007400 con 0x7fc8a406fb40 2024-09-19T08:38:26.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.459+0000 7fc8a0ff9640 1 --2- 172.21.15.117:0/3172705374 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc89006c2e0 0x7fc89006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:26.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.459+0000 7fc8a0ff9640 1 -- 172.21.15.117:0/3172705374 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fc89408a970 con 0x7fc8a406fb40 2024-09-19T08:38:26.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.460+0000 7fc8a37fe640 1 --2- 172.21.15.117:0/3172705374 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc89006c2e0 0x7fc89006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:26.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.460+0000 7fc8a37fe640 1 --2- 172.21.15.117:0/3172705374 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc89006c2e0 0x7fc89006e7a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4159230 tx=0x7fc898009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:26.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.464+0000 7fc8a0ff9640 1 -- 172.21.15.117:0/3172705374 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc894058990 con 0x7fc8a406fb40 2024-09-19T08:38:26.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.670+0000 7fc8aa8d9640 1 -- 172.21.15.117:0/3172705374 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8a40b0550 con 0x7fc8a406fb40 2024-09-19T08:38:26.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.670+0000 7fc8a0ff9640 1 -- 172.21.15.117:0/3172705374 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5235 (secure 0 0 0) 0x7fc89405de20 con 0x7fc8a406fb40 2024-09-19T08:38:26.670 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:26.671 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":16,"btime":"2024-09-19T08:38:09:528263+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4595,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2240250216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2240250216},{"type":"v1","addr":"172.21.15.146:6836","nonce":2240250216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2165679820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2165679820},{"type":"v1","addr":"172.21.15.117:6834","nonce":2165679820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2737032516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2737032516},{"type":"v1","addr":"172.21.15.117:6835","nonce":2737032516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:38:06.852720+0000","modified":"2024-09-19T08:38:08.856085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/3614861409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":3614861409},{"type":"v1","addr":"172.21.15.146:6837","nonce":3614861409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4926,"qdb_cluster":[4926]},"id":2}]} 2024-09-19T08:38:26.671 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 16 2024-09-19T08:38:26.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.673+0000 7fc8aa8d9640 1 -- 172.21.15.117:0/3172705374 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc89006c2e0 msgr2=0x7fc89006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:26.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.673+0000 7fc8aa8d9640 1 --2- 172.21.15.117:0/3172705374 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc89006c2e0 0x7fc89006e7a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4159230 tx=0x7fc898009190 comp rx=0 tx=0).stop 2024-09-19T08:38:26.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.673+0000 7fc8aa8d9640 1 -- 172.21.15.117:0/3172705374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8a406fb40 msgr2=0x7fc8a4160650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:26.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.673+0000 7fc8aa8d9640 1 --2- 172.21.15.117:0/3172705374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8a406fb40 0x7fc8a4160650 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc89400c400 tx=0x7fc89400c8c0 comp rx=0 tx=0).stop 2024-09-19T08:38:26.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.673+0000 7fc8aa8d9640 1 -- 172.21.15.117:0/3172705374 shutdown_connections 2024-09-19T08:38:26.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.673+0000 7fc8aa8d9640 1 --2- 172.21.15.117:0/3172705374 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8a415e360 0x7fc8a4158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:26.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.673+0000 7fc8aa8d9640 1 --2- 172.21.15.117:0/3172705374 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc89006c2e0 0x7fc89006e7a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:26.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.673+0000 7fc8aa8d9640 1 --2- 172.21.15.117:0/3172705374 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8a40706c0 0x7fc8a4141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:26.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.673+0000 7fc8aa8d9640 1 --2- 172.21.15.117:0/3172705374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8a406fb40 0x7fc8a4160650 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:26.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.673+0000 7fc8aa8d9640 1 -- 172.21.15.117:0/3172705374 >> 172.21.15.117:0/3172705374 conn(0x7fc8a4073560 msgr2=0x7fc8a40ae9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:26.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.673+0000 7fc8aa8d9640 1 -- 172.21.15.117:0/3172705374 shutdown_connections 2024-09-19T08:38:26.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:26.673+0000 7fc8aa8d9640 1 -- 172.21.15.117:0/3172705374 wait complete. 2024-09-19T08:38:26.684 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json tag path /parentdir mytag 2024-09-19T08:38:26.802 INFO:teuthology.orchestra.run.smithi146.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2024-09-19T08:38:26.803 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2024-09-19T08:38:36.008 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T08:38:36.012 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T08:38:36.804 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2024-09-19T08:38:36.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.854+0000 7f5d0c7d3f40 1 Processor -- start 2024-09-19T08:38:36.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.854+0000 7f5d0c7d3f40 1 -- start start 2024-09-19T08:38:36.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.855+0000 7f5d0c7d3f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421335f1f0 0x56421335b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.855+0000 7f5d0c7d3f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56421335f5d0 0x5642134143e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.855+0000 7f5d0c7d3f40 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5642133a6b00 0x564213414920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.855+0000 7f5d0c7d3f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5642132ae510 con 0x56421335f5d0 2024-09-19T08:38:36.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.855+0000 7f5d0c7d3f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564213307c50 con 0x56421335f1f0 2024-09-19T08:38:36.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.855+0000 7f5d0c7d3f40 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x5642134339e0 con 0x5642133a6b00 2024-09-19T08:38:36.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.855+0000 7f5d01ac8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56421335f5d0 0x5642134143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.855+0000 7f5d01ac8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56421335f5d0 0x5642134143e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50358/0 (socket says 172.21.15.117:50358) 2024-09-19T08:38:36.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.855+0000 7f5d01ac8640 1 -- 172.21.15.117:0/2411196256 learned_addr learned my addr 172.21.15.117:0/2411196256 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:36.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.856+0000 7f5d0aaca640 1 --2- 172.21.15.117:0/2411196256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5642133a6b00 0x564213414920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.856+0000 7f5d0a2c9640 1 --2- 172.21.15.117:0/2411196256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421335f1f0 0x56421335b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.856+0000 7f5d01ac8640 1 -- 172.21.15.117:0/2411196256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5642133a6b00 msgr2=0x564213414920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:36.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.856+0000 7f5d01ac8640 1 --2- 172.21.15.117:0/2411196256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5642133a6b00 0x564213414920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.856+0000 7f5d01ac8640 1 -- 172.21.15.117:0/2411196256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421335f1f0 msgr2=0x56421335b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:36.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.856+0000 7f5d01ac8640 1 --2- 172.21.15.117:0/2411196256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421335f1f0 0x56421335b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.856+0000 7f5d01ac8640 1 -- 172.21.15.117:0/2411196256 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564213432dd0 con 0x56421335f5d0 2024-09-19T08:38:36.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.856+0000 7f5d01ac8640 1 --2- 172.21.15.117:0/2411196256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56421335f5d0 0x5642134143e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4001e00 tx=0x7f5cf400b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5769839a4303472 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:36.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.856+0000 7f5d092c7640 1 -- 172.21.15.117:0/2411196256 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf400be40 con 0x56421335f5d0 2024-09-19T08:38:36.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.856+0000 7f5d092c7640 1 -- 172.21.15.117:0/2411196256 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf400f400 con 0x56421335f5d0 2024-09-19T08:38:36.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.856+0000 7f5d092c7640 1 -- 172.21.15.117:0/2411196256 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf400f7d0 con 0x56421335f5d0 2024-09-19T08:38:36.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.857+0000 7f5d0c7d3f40 1 -- 172.21.15.117:0/2411196256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56421335f5d0 msgr2=0x5642134143e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:36.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.857+0000 7f5d0c7d3f40 1 --2- 172.21.15.117:0/2411196256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56421335f5d0 0x5642134143e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4001e00 tx=0x7f5cf400b670 comp rx=0 tx=0).stop 2024-09-19T08:38:36.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.857+0000 7f5d0c7d3f40 1 -- 172.21.15.117:0/2411196256 shutdown_connections 2024-09-19T08:38:36.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.857+0000 7f5d0c7d3f40 1 --2- 172.21.15.117:0/2411196256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5642133a6b00 0x564213414920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.857+0000 7f5d0c7d3f40 1 --2- 172.21.15.117:0/2411196256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56421335f5d0 0x5642134143e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.857+0000 7f5d0c7d3f40 1 --2- 172.21.15.117:0/2411196256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421335f1f0 0x56421335b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.857+0000 7f5d0c7d3f40 1 -- 172.21.15.117:0/2411196256 >> 172.21.15.117:0/2411196256 conn(0x56421335cd60 msgr2=0x564213431120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:36.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.857+0000 7f5d0c7d3f40 1 -- 172.21.15.117:0/2411196256 shutdown_connections 2024-09-19T08:38:36.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.857+0000 7f5d0c7d3f40 1 -- 172.21.15.117:0/2411196256 wait complete. 2024-09-19T08:38:36.859 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.857+0000 7f5d0c7d3f40 1 Processor -- start 2024-09-19T08:38:36.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.857+0000 7f5d0c7d3f40 1 -- start start 2024-09-19T08:38:36.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.858+0000 7f5d0c7d3f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56421335f1f0 0x5642134144d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.858+0000 7f5d0c7d3f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421335f5d0 0x564213431b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.858+0000 7f5d0c7d3f40 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5642133a6b00 0x5642134cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.858+0000 7f5d0c7d3f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x564213433390 con 0x56421335f1f0 2024-09-19T08:38:36.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.858+0000 7f5d0c7d3f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564213433170 con 0x56421335f5d0 2024-09-19T08:38:36.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.858+0000 7f5d0c7d3f40 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x564213433670 con 0x5642133a6b00 2024-09-19T08:38:36.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.858+0000 7f5d0a2c9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56421335f1f0 0x5642134144d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.858+0000 7f5d0a2c9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56421335f1f0 0x5642134144d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50368/0 (socket says 172.21.15.117:50368) 2024-09-19T08:38:36.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.858+0000 7f5d0a2c9640 1 -- 172.21.15.117:0/3810664003 learned_addr learned my addr 172.21.15.117:0/3810664003 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:36.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.858+0000 7f5d0aaca640 1 --2- 172.21.15.117:0/3810664003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5642133a6b00 0x5642134cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.858+0000 7f5d01ac8640 1 --2- 172.21.15.117:0/3810664003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421335f5d0 0x564213431b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.858+0000 7f5d0a2c9640 1 -- 172.21.15.117:0/3810664003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5642133a6b00 msgr2=0x5642134cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:36.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.858+0000 7f5d0a2c9640 1 --2- 172.21.15.117:0/3810664003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5642133a6b00 0x5642134cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.858+0000 7f5d0a2c9640 1 -- 172.21.15.117:0/3810664003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421335f5d0 msgr2=0x564213431b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:36.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.858+0000 7f5d0a2c9640 1 --2- 172.21.15.117:0/3810664003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421335f5d0 0x564213431b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.858+0000 7f5d0a2c9640 1 -- 172.21.15.117:0/3810664003 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56421335eb20 con 0x56421335f1f0 2024-09-19T08:38:36.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.859+0000 7f5d0a2c9640 1 --2- 172.21.15.117:0/3810664003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56421335f1f0 0x5642134144d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc046070 tx=0x7f5cfc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:36.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.859+0000 7f5d03fff640 1 -- 172.21.15.117:0/3810664003 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc055040 con 0x56421335f1f0 2024-09-19T08:38:36.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.859+0000 7f5d03fff640 1 -- 172.21.15.117:0/3810664003 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cfc06a070 con 0x56421335f1f0 2024-09-19T08:38:36.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.859+0000 7f5d03fff640 1 -- 172.21.15.117:0/3810664003 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc051e40 con 0x56421335f1f0 2024-09-19T08:38:36.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.859+0000 7f5d0c7d3f40 1 -- 172.21.15.117:0/3810664003 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56421339e760 con 0x56421335f1f0 2024-09-19T08:38:36.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.859+0000 7f5d0c7d3f40 1 -- 172.21.15.117:0/3810664003 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56421342e730 con 0x56421335f1f0 2024-09-19T08:38:36.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.860+0000 7f5d03fff640 1 -- 172.21.15.117:0/3810664003 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5cfc058070 con 0x56421335f1f0 2024-09-19T08:38:36.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.861+0000 7f5d03fff640 1 --2- 172.21.15.117:0/3810664003 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f5cec06ac90 0x7f5cec06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.861+0000 7f5d03fff640 1 -- 172.21.15.117:0/3810664003 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f5cfc0ce530 con 0x56421335f1f0 2024-09-19T08:38:36.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.861+0000 7f5d0c7d3f40 1 --2- 172.21.15.117:0/3810664003 >> [v2:172.21.15.117:6800/2056750572,v1:172.21.15.117:6801/2056750572] conn(0x56421338c110 0x5642134cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.861+0000 7f5d0c7d3f40 1 -- 172.21.15.117:0/3810664003 --> [v2:172.21.15.117:6800/2056750572,v1:172.21.15.117:6801/2056750572] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) -- 0x5642134320d0 con 0x56421338c110 2024-09-19T08:38:36.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.861+0000 7f5d01ac8640 1 --2- 172.21.15.117:0/3810664003 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f5cec06ac90 0x7f5cec06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.861+0000 7f5d0aaca640 1 --2- 172.21.15.117:0/3810664003 >> [v2:172.21.15.117:6800/2056750572,v1:172.21.15.117:6801/2056750572] conn(0x56421338c110 0x5642134cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.862+0000 7f5d0aaca640 1 --2- 172.21.15.117:0/3810664003 >> [v2:172.21.15.117:6800/2056750572,v1:172.21.15.117:6801/2056750572] conn(0x56421338c110 0x5642134cc850 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:36.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.862+0000 7f5d01ac8640 1 --2- 172.21.15.117:0/3810664003 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f5cec06ac90 0x7f5cec06d150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x564213415900 tx=0x7f5cf4009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:36.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.862+0000 7f5d0aaca640 1 -- 172.21.15.117:0/3810664003 <== osd.2 v2:172.21.15.117:6800/2056750572 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7f5d040044c0 con 0x56421338c110 2024-09-19T08:38:36.865 INFO:teuthology.orchestra.run.smithi117.stdout:mytag 2024-09-19T08:38:36.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.862+0000 7f5d0c7d3f40 1 -- 172.21.15.117:0/3810664003 >> [v2:172.21.15.117:6800/2056750572,v1:172.21.15.117:6801/2056750572] conn(0x56421338c110 msgr2=0x5642134cc850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:36.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.862+0000 7f5d0c7d3f40 1 --2- 172.21.15.117:0/3810664003 >> [v2:172.21.15.117:6800/2056750572,v1:172.21.15.117:6801/2056750572] conn(0x56421338c110 0x5642134cc850 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.862+0000 7f5d0c7d3f40 1 -- 172.21.15.117:0/3810664003 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f5cec06ac90 msgr2=0x7f5cec06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:36.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.862+0000 7f5d0c7d3f40 1 --2- 172.21.15.117:0/3810664003 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f5cec06ac90 0x7f5cec06d150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x564213415900 tx=0x7f5cf4009000 comp rx=0 tx=0).stop 2024-09-19T08:38:36.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.862+0000 7f5d0c7d3f40 1 -- 172.21.15.117:0/3810664003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56421335f1f0 msgr2=0x5642134144d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:36.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.862+0000 7f5d0c7d3f40 1 --2- 172.21.15.117:0/3810664003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56421335f1f0 0x5642134144d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc046070 tx=0x7f5cfc002fb0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.862+0000 7f5d0aaca640 1 -- 172.21.15.117:0/3810664003 reap_dead start 2024-09-19T08:38:36.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.862+0000 7f5d0c7d3f40 1 -- 172.21.15.117:0/3810664003 shutdown_connections 2024-09-19T08:38:36.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.862+0000 7f5d0c7d3f40 1 -- 172.21.15.117:0/3810664003 >> 172.21.15.117:0/3810664003 conn(0x56421335cd60 msgr2=0x564213433cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:36.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.862+0000 7f5d0c7d3f40 1 -- 172.21.15.117:0/3810664003 shutdown_connections 2024-09-19T08:38:36.868 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.862+0000 7f5d0c7d3f40 1 -- 172.21.15.117:0/3810664003 wait complete. 2024-09-19T08:38:36.868 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2024-09-19T08:38:36.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.914+0000 7f28a48d2f40 1 Processor -- start 2024-09-19T08:38:36.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.914+0000 7f28a48d2f40 1 -- start start 2024-09-19T08:38:36.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.915+0000 7f28a48d2f40 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5565ec08fdc0 0x5565ec12a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.915+0000 7f28a48d2f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5565ec0a7bf0 0x5565ec0a6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.915+0000 7f28a48d2f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5565ec136e80 0x5565ec0a7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.915+0000 7f28a48d2f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5565ebfb1510 con 0x5565ec136e80 2024-09-19T08:38:36.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.915+0000 7f28a48d2f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5565ec05fd70 con 0x5565ec0a7bf0 2024-09-19T08:38:36.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.915+0000 7f28a48d2f40 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x5565ec13b580 con 0x5565ec08fdc0 2024-09-19T08:38:36.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.915+0000 7f28a2bcb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5565ec136e80 0x5565ec0a7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.915+0000 7f28a2bcb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5565ec136e80 0x5565ec0a7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50384/0 (socket says 172.21.15.117:50384) 2024-09-19T08:38:36.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.915+0000 7f28a2bcb640 1 -- 172.21.15.117:0/2376303535 learned_addr learned my addr 172.21.15.117:0/2376303535 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:36.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.915+0000 7f28a2bcb640 1 -- 172.21.15.117:0/2376303535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5565ec08fdc0 msgr2=0x5565ec12a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:36.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.915+0000 7f28a2bcb640 1 --2- 172.21.15.117:0/2376303535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5565ec08fdc0 0x5565ec12a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.915+0000 7f28a2bcb640 1 -- 172.21.15.117:0/2376303535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5565ec0a7bf0 msgr2=0x5565ec0a6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:36.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.915+0000 7f2899bc9640 1 --2- 172.21.15.117:0/2376303535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5565ec0a7bf0 0x5565ec0a6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.915+0000 7f28a2bcb640 1 --2- 172.21.15.117:0/2376303535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5565ec0a7bf0 0x5565ec0a6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.915+0000 7f28a2bcb640 1 -- 172.21.15.117:0/2376303535 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565ec13b2a0 con 0x5565ec136e80 2024-09-19T08:38:36.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.915+0000 7f2899bc9640 1 --2- 172.21.15.117:0/2376303535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5565ec0a7bf0 0x5565ec0a6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:36.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.915+0000 7f28a2bcb640 1 --2- 172.21.15.117:0/2376303535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5565ec136e80 0x5565ec0a7450 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f289c057040 tx=0x7f289c04f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970e57f28128ea16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:36.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.915+0000 7f28a13c8640 1 -- 172.21.15.117:0/2376303535 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c04d650 con 0x5565ec136e80 2024-09-19T08:38:36.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.915+0000 7f28a13c8640 1 -- 172.21.15.117:0/2376303535 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289c065070 con 0x5565ec136e80 2024-09-19T08:38:36.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.915+0000 7f28a13c8640 1 -- 172.21.15.117:0/2376303535 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c04da30 con 0x5565ec136e80 2024-09-19T08:38:36.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.916+0000 7f28a48d2f40 1 -- 172.21.15.117:0/2376303535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5565ec136e80 msgr2=0x5565ec0a7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:36.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.916+0000 7f28a48d2f40 1 --2- 172.21.15.117:0/2376303535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5565ec136e80 0x5565ec0a7450 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f289c057040 tx=0x7f289c04f000 comp rx=0 tx=0).stop 2024-09-19T08:38:36.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.916+0000 7f28a48d2f40 1 -- 172.21.15.117:0/2376303535 shutdown_connections 2024-09-19T08:38:36.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.916+0000 7f28a48d2f40 1 --2- 172.21.15.117:0/2376303535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5565ec136e80 0x5565ec0a7450 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.916+0000 7f28a48d2f40 1 --2- 172.21.15.117:0/2376303535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5565ec0a7bf0 0x5565ec0a6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.916+0000 7f28a48d2f40 1 --2- 172.21.15.117:0/2376303535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5565ec08fdc0 0x5565ec12a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.916+0000 7f28a48d2f40 1 -- 172.21.15.117:0/2376303535 >> 172.21.15.117:0/2376303535 conn(0x5565ec05eaf0 msgr2=0x5565ec136000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:36.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.916+0000 7f28a48d2f40 1 -- 172.21.15.117:0/2376303535 shutdown_connections 2024-09-19T08:38:36.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.916+0000 7f28a48d2f40 1 -- 172.21.15.117:0/2376303535 wait complete. 2024-09-19T08:38:36.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.916+0000 7f28a48d2f40 1 Processor -- start 2024-09-19T08:38:36.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.916+0000 7f28a48d2f40 1 -- start start 2024-09-19T08:38:36.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.917+0000 7f28a48d2f40 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5565ec08fdc0 0x5565ec0a7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.917+0000 7f28a48d2f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5565ec0a7bf0 0x5565ec0a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.917+0000 7f28a48d2f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5565ec136e80 0x5565ec0a4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.917+0000 7f28a48d2f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5565ec135890 con 0x5565ec136e80 2024-09-19T08:38:36.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.917+0000 7f28a48d2f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5565ec133d40 con 0x5565ec0a7bf0 2024-09-19T08:38:36.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.917+0000 7f28a48d2f40 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x5565ec135be0 con 0x5565ec08fdc0 2024-09-19T08:38:36.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.917+0000 7f28a2bcb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5565ec136e80 0x5565ec0a4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.917+0000 7f28a2bcb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5565ec136e80 0x5565ec0a4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50392/0 (socket says 172.21.15.117:50392) 2024-09-19T08:38:36.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.917+0000 7f28a2bcb640 1 -- 172.21.15.117:0/3571779596 learned_addr learned my addr 172.21.15.117:0/3571779596 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:36.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.918+0000 7f28a23ca640 1 --2- 172.21.15.117:0/3571779596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5565ec08fdc0 0x5565ec0a7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.918+0000 7f28a2bcb640 1 -- 172.21.15.117:0/3571779596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5565ec08fdc0 msgr2=0x5565ec0a7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:36.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.918+0000 7f28a2bcb640 1 --2- 172.21.15.117:0/3571779596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5565ec08fdc0 0x5565ec0a7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.918+0000 7f2899bc9640 1 --2- 172.21.15.117:0/3571779596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5565ec0a7bf0 0x5565ec0a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.918+0000 7f28a2bcb640 1 -- 172.21.15.117:0/3571779596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5565ec0a7bf0 msgr2=0x5565ec0a4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:36.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.918+0000 7f28a2bcb640 1 --2- 172.21.15.117:0/3571779596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5565ec0a7bf0 0x5565ec0a4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.918+0000 7f28a2bcb640 1 -- 172.21.15.117:0/3571779596 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565ec0a9240 con 0x5565ec136e80 2024-09-19T08:38:36.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.918+0000 7f28a2bcb640 1 --2- 172.21.15.117:0/3571779596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5565ec136e80 0x5565ec0a4e90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f289c005fd0 tx=0x7f289c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:36.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.918+0000 7f289bfff640 1 -- 172.21.15.117:0/3571779596 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c060470 con 0x5565ec136e80 2024-09-19T08:38:36.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.918+0000 7f289bfff640 1 -- 172.21.15.117:0/3571779596 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289c060610 con 0x5565ec136e80 2024-09-19T08:38:36.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.918+0000 7f28a48d2f40 1 -- 172.21.15.117:0/3571779596 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5565ec0a94e0 con 0x5565ec136e80 2024-09-19T08:38:36.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.918+0000 7f289bfff640 1 -- 172.21.15.117:0/3571779596 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c060a00 con 0x5565ec136e80 2024-09-19T08:38:36.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.918+0000 7f28a48d2f40 1 -- 172.21.15.117:0/3571779596 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565ec0a6080 con 0x5565ec136e80 2024-09-19T08:38:36.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.919+0000 7f289bfff640 1 -- 172.21.15.117:0/3571779596 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f289c05e040 con 0x5565ec136e80 2024-09-19T08:38:36.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.920+0000 7f289bfff640 1 --2- 172.21.15.117:0/3571779596 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f288406ac90 0x7f288406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.920+0000 7f289bfff640 1 -- 172.21.15.117:0/3571779596 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f289c0cf7b0 con 0x5565ec136e80 2024-09-19T08:38:36.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.920+0000 7f28a48d2f40 1 --2- 172.21.15.117:0/3571779596 >> [v2:172.21.15.117:6816/1107529373,v1:172.21.15.117:6817/1107529373] conn(0x5565ec0a7580 0x5565ec1272d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.920+0000 7f28a23ca640 1 --2- 172.21.15.117:0/3571779596 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f288406ac90 0x7f288406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.920+0000 7f28a48d2f40 1 -- 172.21.15.117:0/3571779596 --> [v2:172.21.15.117:6816/1107529373,v1:172.21.15.117:6817/1107529373] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) -- 0x5565ec12aa10 con 0x5565ec0a7580 2024-09-19T08:38:36.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.920+0000 7f2899bc9640 1 --2- 172.21.15.117:0/3571779596 >> [v2:172.21.15.117:6816/1107529373,v1:172.21.15.117:6817/1107529373] conn(0x5565ec0a7580 0x5565ec1272d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.920+0000 7f2899bc9640 1 --2- 172.21.15.117:0/3571779596 >> [v2:172.21.15.117:6816/1107529373,v1:172.21.15.117:6817/1107529373] conn(0x5565ec0a7580 0x5565ec1272d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:36.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.920+0000 7f28a23ca640 1 --2- 172.21.15.117:0/3571779596 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f288406ac90 0x7f288406d150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x5565ec12bf70 tx=0x7f28940075a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:36.924 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.921+0000 7f2899bc9640 1 -- 172.21.15.117:0/3571779596 <== osd.3 v2:172.21.15.117:6816/1107529373 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7f288c00b040 con 0x5565ec0a7580 2024-09-19T08:38:36.924 INFO:teuthology.orchestra.run.smithi117.stdout:mytag 2024-09-19T08:38:36.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.921+0000 7f28a48d2f40 1 -- 172.21.15.117:0/3571779596 >> [v2:172.21.15.117:6816/1107529373,v1:172.21.15.117:6817/1107529373] conn(0x5565ec0a7580 msgr2=0x5565ec1272d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:36.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.921+0000 7f28a48d2f40 1 --2- 172.21.15.117:0/3571779596 >> [v2:172.21.15.117:6816/1107529373,v1:172.21.15.117:6817/1107529373] conn(0x5565ec0a7580 0x5565ec1272d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.921+0000 7f28a48d2f40 1 -- 172.21.15.117:0/3571779596 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f288406ac90 msgr2=0x7f288406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:36.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.921+0000 7f28a48d2f40 1 --2- 172.21.15.117:0/3571779596 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f288406ac90 0x7f288406d150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x5565ec12bf70 tx=0x7f28940075a0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.921+0000 7f28a48d2f40 1 -- 172.21.15.117:0/3571779596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5565ec136e80 msgr2=0x5565ec0a4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:36.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.921+0000 7f28a48d2f40 1 --2- 172.21.15.117:0/3571779596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5565ec136e80 0x5565ec0a4e90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f289c005fd0 tx=0x7f289c003330 comp rx=0 tx=0).stop 2024-09-19T08:38:36.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.921+0000 7f28a2bcb640 1 -- 172.21.15.117:0/3571779596 reap_dead start 2024-09-19T08:38:36.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.921+0000 7f28a48d2f40 1 -- 172.21.15.117:0/3571779596 shutdown_connections 2024-09-19T08:38:36.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.921+0000 7f28a48d2f40 1 -- 172.21.15.117:0/3571779596 >> 172.21.15.117:0/3571779596 conn(0x5565ec05eaf0 msgr2=0x5565ec136000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:36.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.921+0000 7f28a48d2f40 1 -- 172.21.15.117:0/3571779596 shutdown_connections 2024-09-19T08:38:36.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.921+0000 7f28a48d2f40 1 -- 172.21.15.117:0/3571779596 wait complete. 2024-09-19T08:38:36.927 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-09-19T08:38:36.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.970+0000 7f4eb1228f40 1 Processor -- start 2024-09-19T08:38:36.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.971+0000 7f4eb1228f40 1 -- start start 2024-09-19T08:38:36.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.971+0000 7f4eb1228f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55708862aef0 0x55708861fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.971+0000 7f4eb1228f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570886b9650 0x5570886cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.971+0000 7f4eb1228f40 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5570886d0470 0x557088626950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.971+0000 7f4eb1228f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55708854d510 con 0x55708862aef0 2024-09-19T08:38:36.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.971+0000 7f4eb1228f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5570885a6c50 con 0x5570886b9650 2024-09-19T08:38:36.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.971+0000 7f4eb1228f40 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x5570886d1940 con 0x5570886d0470 2024-09-19T08:38:36.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.971+0000 7f4eaed1e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55708862aef0 0x55708861fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.971+0000 7f4eaed1e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55708862aef0 0x55708861fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50396/0 (socket says 172.21.15.117:50396) 2024-09-19T08:38:36.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.971+0000 7f4eaed1e640 1 -- 172.21.15.117:0/2360857472 learned_addr learned my addr 172.21.15.117:0/2360857472 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:36.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4eaf51f640 1 --2- 172.21.15.117:0/2360857472 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5570886d0470 0x557088626950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4eae51d640 1 --2- 172.21.15.117:0/2360857472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570886b9650 0x5570886cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4eaed1e640 1 -- 172.21.15.117:0/2360857472 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5570886d0470 msgr2=0x557088626950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:36.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4eaed1e640 1 --2- 172.21.15.117:0/2360857472 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5570886d0470 0x557088626950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4eaed1e640 1 -- 172.21.15.117:0/2360857472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570886b9650 msgr2=0x5570886cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:36.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4eaed1e640 1 --2- 172.21.15.117:0/2360857472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570886b9650 0x5570886cfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4eaed1e640 1 -- 172.21.15.117:0/2360857472 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55708875a780 con 0x55708862aef0 2024-09-19T08:38:36.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4eaf51f640 1 --2- 172.21.15.117:0/2360857472 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5570886d0470 0x557088626950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:36.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4eae51d640 1 --2- 172.21.15.117:0/2360857472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570886b9650 0x5570886cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:36.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4eaed1e640 1 --2- 172.21.15.117:0/2360857472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55708862aef0 0x55708861fc30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000b1f0 tx=0x7f4ea000b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238947d1856f9ecf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:36.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4ead51b640 1 -- 172.21.15.117:0/2360857472 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0016070 con 0x55708862aef0 2024-09-19T08:38:36.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4ead51b640 1 -- 172.21.15.117:0/2360857472 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea000d6d0 con 0x55708862aef0 2024-09-19T08:38:36.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4ead51b640 1 -- 172.21.15.117:0/2360857472 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea000dac0 con 0x55708862aef0 2024-09-19T08:38:36.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4eb1228f40 1 -- 172.21.15.117:0/2360857472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55708862aef0 msgr2=0x55708861fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:36.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4eb1228f40 1 --2- 172.21.15.117:0/2360857472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55708862aef0 0x55708861fc30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000b1f0 tx=0x7f4ea000b6b0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4eb1228f40 1 -- 172.21.15.117:0/2360857472 shutdown_connections 2024-09-19T08:38:36.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4eb1228f40 1 --2- 172.21.15.117:0/2360857472 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5570886d0470 0x557088626950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4eb1228f40 1 --2- 172.21.15.117:0/2360857472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570886b9650 0x5570886cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4eb1228f40 1 --2- 172.21.15.117:0/2360857472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55708862aef0 0x55708861fc30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4eb1228f40 1 -- 172.21.15.117:0/2360857472 >> 172.21.15.117:0/2360857472 conn(0x5570885fd260 msgr2=0x5570885fa410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:36.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4eb1228f40 1 -- 172.21.15.117:0/2360857472 shutdown_connections 2024-09-19T08:38:36.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.972+0000 7f4eb1228f40 1 -- 172.21.15.117:0/2360857472 wait complete. 2024-09-19T08:38:36.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.973+0000 7f4eb1228f40 1 Processor -- start 2024-09-19T08:38:36.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.973+0000 7f4eb1228f40 1 -- start start 2024-09-19T08:38:36.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4eb1228f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55708862aef0 0x5570886cf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4eb1228f40 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5570886b9650 0x5570886b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4eb1228f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570886d0470 0x557088626aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4eb1228f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55708875c460 con 0x55708862aef0 2024-09-19T08:38:36.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4eb1228f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5570886202a0 con 0x5570886d0470 2024-09-19T08:38:36.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4eb1228f40 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x55708875aa20 con 0x5570886b9650 2024-09-19T08:38:36.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4eaed1e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55708862aef0 0x5570886cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4eaed1e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55708862aef0 0x5570886cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50410/0 (socket says 172.21.15.117:50410) 2024-09-19T08:38:36.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4eaed1e640 1 -- 172.21.15.117:0/622360281 learned_addr learned my addr 172.21.15.117:0/622360281 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:36.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4eae51d640 1 --2- 172.21.15.117:0/622360281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5570886b9650 0x5570886b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4eaf51f640 1 --2- 172.21.15.117:0/622360281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570886d0470 0x557088626aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4eaed1e640 1 -- 172.21.15.117:0/622360281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5570886b9650 msgr2=0x5570886b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:36.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4eaed1e640 1 --2- 172.21.15.117:0/622360281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5570886b9650 0x5570886b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4eaed1e640 1 -- 172.21.15.117:0/622360281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570886d0470 msgr2=0x557088626aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:36.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4eaed1e640 1 --2- 172.21.15.117:0/622360281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570886d0470 0x557088626aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4eaed1e640 1 -- 172.21.15.117:0/622360281 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570886cf860 con 0x55708862aef0 2024-09-19T08:38:36.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4eaf51f640 1 --2- 172.21.15.117:0/622360281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5570886d0470 0x557088626aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:36.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4eaed1e640 1 --2- 172.21.15.117:0/622360281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55708862aef0 0x5570886cf320 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000b6f0 tx=0x7f4ea0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:36.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4e97fff640 1 -- 172.21.15.117:0/622360281 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0016070 con 0x55708862aef0 2024-09-19T08:38:36.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4e97fff640 1 -- 172.21.15.117:0/622360281 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea0010850 con 0x55708862aef0 2024-09-19T08:38:36.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4eb1228f40 1 -- 172.21.15.117:0/622360281 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55708875d990 con 0x55708862aef0 2024-09-19T08:38:36.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.974+0000 7f4e97fff640 1 -- 172.21.15.117:0/622360281 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0010c80 con 0x55708862aef0 2024-09-19T08:38:36.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.975+0000 7f4eb1228f40 1 -- 172.21.15.117:0/622360281 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55708875df50 con 0x55708862aef0 2024-09-19T08:38:36.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.976+0000 7f4e97fff640 1 -- 172.21.15.117:0/622360281 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4ea0026400 con 0x55708862aef0 2024-09-19T08:38:36.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.976+0000 7f4e97fff640 1 --2- 172.21.15.117:0/622360281 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4e9c06acc0 0x7f4e9c06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.976+0000 7f4e97fff640 1 -- 172.21.15.117:0/622360281 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f4ea008b800 con 0x55708862aef0 2024-09-19T08:38:36.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.976+0000 7f4eb1228f40 1 --2- 172.21.15.117:0/622360281 >> [v2:172.21.15.117:6824/782460519,v1:172.21.15.117:6825/782460519] conn(0x5570886b3920 0x5570886b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:36.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.976+0000 7f4eb1228f40 1 -- 172.21.15.117:0/622360281 --> [v2:172.21.15.117:6824/782460519,v1:172.21.15.117:6825/782460519] -- osd_op(unknown.0.0:1 6.36 6:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) -- 0x5570886b3550 con 0x5570886b3920 2024-09-19T08:38:36.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.977+0000 7f4eaf51f640 1 --2- 172.21.15.117:0/622360281 >> [v2:172.21.15.117:6824/782460519,v1:172.21.15.117:6825/782460519] conn(0x5570886b3920 0x5570886b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.977+0000 7f4eae51d640 1 --2- 172.21.15.117:0/622360281 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4e9c06acc0 0x7f4e9c06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:36.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.977+0000 7f4eaf51f640 1 --2- 172.21.15.117:0/622360281 >> [v2:172.21.15.117:6824/782460519,v1:172.21.15.117:6825/782460519] conn(0x5570886b3920 0x5570886b3d00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:36.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.977+0000 7f4eaf51f640 1 -- 172.21.15.117:0/622360281 <== osd.1 v2:172.21.15.117:6824/782460519 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7f4ea8004a20 con 0x5570886b3920 2024-09-19T08:38:36.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.977+0000 7f4eae51d640 1 --2- 172.21.15.117:0/622360281 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4e9c06acc0 0x7f4e9c06d180 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4056000 tx=0x7f4ea4050000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:36.982 INFO:teuthology.orchestra.run.smithi117.stdout:mytag 2024-09-19T08:38:36.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.977+0000 7f4eb1228f40 1 -- 172.21.15.117:0/622360281 >> [v2:172.21.15.117:6824/782460519,v1:172.21.15.117:6825/782460519] conn(0x5570886b3920 msgr2=0x5570886b3d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:36.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.977+0000 7f4eb1228f40 1 --2- 172.21.15.117:0/622360281 >> [v2:172.21.15.117:6824/782460519,v1:172.21.15.117:6825/782460519] conn(0x5570886b3920 0x5570886b3d00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.977+0000 7f4eb1228f40 1 -- 172.21.15.117:0/622360281 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4e9c06acc0 msgr2=0x7f4e9c06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:36.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.977+0000 7f4eb1228f40 1 --2- 172.21.15.117:0/622360281 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4e9c06acc0 0x7f4e9c06d180 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4056000 tx=0x7f4ea4050000 comp rx=0 tx=0).stop 2024-09-19T08:38:36.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.977+0000 7f4eb1228f40 1 -- 172.21.15.117:0/622360281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55708862aef0 msgr2=0x5570886cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:36.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.977+0000 7f4eb1228f40 1 --2- 172.21.15.117:0/622360281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55708862aef0 0x5570886cf320 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000b6f0 tx=0x7f4ea0000ed0 comp rx=0 tx=0).stop 2024-09-19T08:38:36.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.977+0000 7f4eaf51f640 1 -- 172.21.15.117:0/622360281 reap_dead start 2024-09-19T08:38:36.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.977+0000 7f4eb1228f40 1 -- 172.21.15.117:0/622360281 shutdown_connections 2024-09-19T08:38:36.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.977+0000 7f4eb1228f40 1 -- 172.21.15.117:0/622360281 >> 172.21.15.117:0/622360281 conn(0x5570885fd260 msgr2=0x5570885fa800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:36.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.977+0000 7f4eb1228f40 1 -- 172.21.15.117:0/622360281 shutdown_connections 2024-09-19T08:38:36.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:36.977+0000 7f4eb1228f40 1 -- 172.21.15.117:0/622360281 wait complete. 2024-09-19T08:38:36.985 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-09-19T08:38:37.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.028+0000 7fc3cf0d2f40 1 Processor -- start 2024-09-19T08:38:37.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.028+0000 7fc3cf0d2f40 1 -- start start 2024-09-19T08:38:37.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.028+0000 7fc3cf0d2f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55607f108dc0 0x55607f105c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.028+0000 7fc3cf0d2f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55607f120bf0 0x55607f1acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.028+0000 7fc3cf0d2f40 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55607f1afe80 0x55607f11f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.028+0000 7fc3cf0d2f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55607f0d8d70 con 0x55607f108dc0 2024-09-19T08:38:37.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.028+0000 7fc3cf0d2f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55607f1088f0 con 0x55607f120bf0 2024-09-19T08:38:37.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.028+0000 7fc3cf0d2f40 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x55607f0d8a00 con 0x55607f1afe80 2024-09-19T08:38:37.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.028+0000 7fc3ccbca640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55607f108dc0 0x55607f105c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.028+0000 7fc3ccbca640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55607f108dc0 0x55607f105c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50414/0 (socket says 172.21.15.117:50414) 2024-09-19T08:38:37.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.028+0000 7fc3ccbca640 1 -- 172.21.15.117:0/1965699043 learned_addr learned my addr 172.21.15.117:0/1965699043 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:37.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.029+0000 7fc3cd3cb640 1 --2- 172.21.15.117:0/1965699043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55607f1afe80 0x55607f11f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.029+0000 7fc3c7fff640 1 --2- 172.21.15.117:0/1965699043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55607f120bf0 0x55607f1acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.029+0000 7fc3ccbca640 1 -- 172.21.15.117:0/1965699043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55607f1afe80 msgr2=0x55607f11f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:37.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.029+0000 7fc3ccbca640 1 --2- 172.21.15.117:0/1965699043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55607f1afe80 0x55607f11f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.029+0000 7fc3ccbca640 1 -- 172.21.15.117:0/1965699043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55607f120bf0 msgr2=0x55607f1acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:37.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.029+0000 7fc3ccbca640 1 --2- 172.21.15.117:0/1965699043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55607f120bf0 0x55607f1acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.029+0000 7fc3ccbca640 1 -- 172.21.15.117:0/1965699043 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55607f003cb0 con 0x55607f108dc0 2024-09-19T08:38:37.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.029+0000 7fc3ccbca640 1 --2- 172.21.15.117:0/1965699043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55607f108dc0 0x55607f105c60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0055040 tx=0x7fc3c0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bec5fc5e75755b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:37.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.029+0000 7fc3c6ffd640 1 -- 172.21.15.117:0/1965699043 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0056050 con 0x55607f108dc0 2024-09-19T08:38:37.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.029+0000 7fc3c6ffd640 1 -- 172.21.15.117:0/1965699043 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3c0052ad0 con 0x55607f108dc0 2024-09-19T08:38:37.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.029+0000 7fc3c6ffd640 1 -- 172.21.15.117:0/1965699043 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0065480 con 0x55607f108dc0 2024-09-19T08:38:37.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.029+0000 7fc3cf0d2f40 1 -- 172.21.15.117:0/1965699043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55607f108dc0 msgr2=0x55607f105c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:37.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.029+0000 7fc3cf0d2f40 1 --2- 172.21.15.117:0/1965699043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55607f108dc0 0x55607f105c60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0055040 tx=0x7fc3c0051000 comp rx=0 tx=0).stop 2024-09-19T08:38:37.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.029+0000 7fc3cf0d2f40 1 -- 172.21.15.117:0/1965699043 shutdown_connections 2024-09-19T08:38:37.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.030+0000 7fc3cf0d2f40 1 --2- 172.21.15.117:0/1965699043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55607f1afe80 0x55607f11f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.030+0000 7fc3cf0d2f40 1 --2- 172.21.15.117:0/1965699043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55607f120bf0 0x55607f1acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.030+0000 7fc3cf0d2f40 1 --2- 172.21.15.117:0/1965699043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55607f108dc0 0x55607f105c60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.030+0000 7fc3cf0d2f40 1 -- 172.21.15.117:0/1965699043 >> 172.21.15.117:0/1965699043 conn(0x55607f0d7af0 msgr2=0x55607f0da000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:37.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.030+0000 7fc3cf0d2f40 1 -- 172.21.15.117:0/1965699043 shutdown_connections 2024-09-19T08:38:37.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.030+0000 7fc3cf0d2f40 1 -- 172.21.15.117:0/1965699043 wait complete. 2024-09-19T08:38:37.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.030+0000 7fc3cf0d2f40 1 Processor -- start 2024-09-19T08:38:37.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.030+0000 7fc3cf0d2f40 1 -- start start 2024-09-19T08:38:37.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.031+0000 7fc3cf0d2f40 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55607f108dc0 0x55607f19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.031+0000 7fc3cf0d2f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55607f120bf0 0x55607f1a9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.031+0000 7fc3cf0d2f40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55607f1afe80 0x55607f1aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.031+0000 7fc3cf0d2f40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55607f0d8d70 con 0x55607f1afe80 2024-09-19T08:38:37.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.031+0000 7fc3cf0d2f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55607f1a3ce0 con 0x55607f120bf0 2024-09-19T08:38:37.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.031+0000 7fc3cf0d2f40 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x55607f1223d0 con 0x55607f108dc0 2024-09-19T08:38:37.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.031+0000 7fc3cd3cb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55607f1afe80 0x55607f1aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.031+0000 7fc3cd3cb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55607f1afe80 0x55607f1aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50430/0 (socket says 172.21.15.117:50430) 2024-09-19T08:38:37.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.031+0000 7fc3cd3cb640 1 -- 172.21.15.117:0/2133491027 learned_addr learned my addr 172.21.15.117:0/2133491027 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:37.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.031+0000 7fc3ccbca640 1 --2- 172.21.15.117:0/2133491027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55607f108dc0 0x55607f19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.031+0000 7fc3c7fff640 1 --2- 172.21.15.117:0/2133491027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55607f120bf0 0x55607f1a9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.031+0000 7fc3cd3cb640 1 -- 172.21.15.117:0/2133491027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55607f108dc0 msgr2=0x55607f19a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:37.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.031+0000 7fc3cd3cb640 1 --2- 172.21.15.117:0/2133491027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55607f108dc0 0x55607f19a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.031+0000 7fc3cd3cb640 1 -- 172.21.15.117:0/2133491027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55607f120bf0 msgr2=0x55607f1a9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:37.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.031+0000 7fc3cd3cb640 1 --2- 172.21.15.117:0/2133491027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55607f120bf0 0x55607f1a9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.031+0000 7fc3cd3cb640 1 -- 172.21.15.117:0/2133491027 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55607f120290 con 0x55607f1afe80 2024-09-19T08:38:37.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.031+0000 7fc3cd3cb640 1 --2- 172.21.15.117:0/2133491027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55607f1afe80 0x55607f1aea80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800eed0 tx=0x7fc3c800c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:37.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.031+0000 7fc3c5ffb640 1 -- 172.21.15.117:0/2133491027 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8018020 con 0x55607f1afe80 2024-09-19T08:38:37.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.032+0000 7fc3c5ffb640 1 -- 172.21.15.117:0/2133491027 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3c8013660 con 0x55607f1afe80 2024-09-19T08:38:37.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.032+0000 7fc3cf0d2f40 1 -- 172.21.15.117:0/2133491027 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55607f120570 con 0x55607f1afe80 2024-09-19T08:38:37.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.032+0000 7fc3c5ffb640 1 -- 172.21.15.117:0/2133491027 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8013a30 con 0x55607f1afe80 2024-09-19T08:38:37.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.032+0000 7fc3cf0d2f40 1 -- 172.21.15.117:0/2133491027 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55607f1a7160 con 0x55607f1afe80 2024-09-19T08:38:37.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.033+0000 7fc3c5ffb640 1 -- 172.21.15.117:0/2133491027 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc3c801b020 con 0x55607f1afe80 2024-09-19T08:38:37.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.033+0000 7fc3c5ffb640 1 --2- 172.21.15.117:0/2133491027 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc3b006ac90 0x7fc3b006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.033+0000 7fc3c5ffb640 1 -- 172.21.15.117:0/2133491027 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fc3c808a740 con 0x55607f1afe80 2024-09-19T08:38:37.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.034+0000 7fc3cf0d2f40 1 --2- 172.21.15.117:0/2133491027 >> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] conn(0x55607f19f410 0x55607f1a7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.034+0000 7fc3cf0d2f40 1 -- 172.21.15.117:0/2133491027 --> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] -- osd_op(unknown.0.0:1 6.19 6:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) -- 0x55607f1a83b0 con 0x55607f19f410 2024-09-19T08:38:37.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.034+0000 7fc3ccbca640 1 --2- 172.21.15.117:0/2133491027 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc3b006ac90 0x7fc3b006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.034+0000 7fc3c7fff640 1 --2- 172.21.15.117:0/2133491027 >> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] conn(0x55607f19f410 0x55607f1a7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.034+0000 7fc3c7fff640 1 --2- 172.21.15.117:0/2133491027 >> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] conn(0x55607f19f410 0x55607f1a7e70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:37.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.034+0000 7fc3ccbca640 1 --2- 172.21.15.117:0/2133491027 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc3b006ac90 0x7fc3b006d150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0045ae0 tx=0x7fc3c0053000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:37.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.034+0000 7fc3c7fff640 1 -- 172.21.15.117:0/2133491027 <== osd.0 v2:172.21.15.117:6808/1962525121 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7fc3b8007980 con 0x55607f19f410 2024-09-19T08:38:37.039 INFO:teuthology.orchestra.run.smithi117.stdout:mytag 2024-09-19T08:38:37.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.034+0000 7fc3cf0d2f40 1 -- 172.21.15.117:0/2133491027 >> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] conn(0x55607f19f410 msgr2=0x55607f1a7e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:37.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.034+0000 7fc3cf0d2f40 1 --2- 172.21.15.117:0/2133491027 >> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] conn(0x55607f19f410 0x55607f1a7e70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.034+0000 7fc3cf0d2f40 1 -- 172.21.15.117:0/2133491027 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc3b006ac90 msgr2=0x7fc3b006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:37.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.034+0000 7fc3cf0d2f40 1 --2- 172.21.15.117:0/2133491027 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc3b006ac90 0x7fc3b006d150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0045ae0 tx=0x7fc3c0053000 comp rx=0 tx=0).stop 2024-09-19T08:38:37.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.034+0000 7fc3cf0d2f40 1 -- 172.21.15.117:0/2133491027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55607f1afe80 msgr2=0x55607f1aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:37.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.034+0000 7fc3cf0d2f40 1 --2- 172.21.15.117:0/2133491027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55607f1afe80 0x55607f1aea80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800eed0 tx=0x7fc3c800c530 comp rx=0 tx=0).stop 2024-09-19T08:38:37.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.034+0000 7fc3cd3cb640 1 -- 172.21.15.117:0/2133491027 reap_dead start 2024-09-19T08:38:37.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.034+0000 7fc3cf0d2f40 1 -- 172.21.15.117:0/2133491027 shutdown_connections 2024-09-19T08:38:37.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.034+0000 7fc3cf0d2f40 1 -- 172.21.15.117:0/2133491027 >> 172.21.15.117:0/2133491027 conn(0x55607f0d7af0 msgr2=0x55607f1a2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:37.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.034+0000 7fc3cf0d2f40 1 -- 172.21.15.117:0/2133491027 shutdown_connections 2024-09-19T08:38:37.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.034+0000 7fc3cf0d2f40 1 -- 172.21.15.117:0/2133491027 wait complete. 2024-09-19T08:38:37.042 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-09-19T08:38:37.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.125+0000 7f87a2f5af40 1 Processor -- start 2024-09-19T08:38:37.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.125+0000 7f87a2f5af40 1 -- start start 2024-09-19T08:38:37.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.126+0000 7f87a2f5af40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559104444230 0x55910450d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.126+0000 7f87a2f5af40 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x559104444b10 0x55910450deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.126+0000 7f87a2f5af40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559104515b60 0x559104470560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.126+0000 7f87a2f5af40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5591044893d0 con 0x559104515b60 2024-09-19T08:38:37.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.126+0000 7f87a2f5af40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559104393510 con 0x559104444230 2024-09-19T08:38:37.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.126+0000 7f87a2f5af40 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x5591044446a0 con 0x559104444b10 2024-09-19T08:38:37.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.126+0000 7f87a1251640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559104515b60 0x559104470560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.126+0000 7f87a1251640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559104515b60 0x559104470560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50452/0 (socket says 172.21.15.117:50452) 2024-09-19T08:38:37.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.126+0000 7f87a1251640 1 -- 172.21.15.117:0/2146886695 learned_addr learned my addr 172.21.15.117:0/2146886695 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:37.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.126+0000 7f87a024f640 1 --2- 172.21.15.117:0/2146886695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x559104444b10 0x55910450deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.126+0000 7f87a0a50640 1 --2- 172.21.15.117:0/2146886695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559104444230 0x55910450d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.126+0000 7f87a1251640 1 -- 172.21.15.117:0/2146886695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x559104444b10 msgr2=0x55910450deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:37.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.126+0000 7f87a1251640 1 --2- 172.21.15.117:0/2146886695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x559104444b10 0x55910450deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.126+0000 7f87a1251640 1 -- 172.21.15.117:0/2146886695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559104444230 msgr2=0x55910450d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:37.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.126+0000 7f87a1251640 1 --2- 172.21.15.117:0/2146886695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559104444230 0x55910450d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.126+0000 7f87a1251640 1 -- 172.21.15.117:0/2146886695 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591045142b0 con 0x559104515b60 2024-09-19T08:38:37.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.126+0000 7f87a0a50640 1 --2- 172.21.15.117:0/2146886695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559104444230 0x55910450d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:37.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.126+0000 7f87a1251640 1 --2- 172.21.15.117:0/2146886695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559104515b60 0x559104470560 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f87980460e0 tx=0x7f8798051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e429518918ba764 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:37.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.126+0000 7f879f24d640 1 -- 172.21.15.117:0/2146886695 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8798067070 con 0x559104515b60 2024-09-19T08:38:37.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.126+0000 7f879f24d640 1 -- 172.21.15.117:0/2146886695 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8798058b50 con 0x559104515b60 2024-09-19T08:38:37.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.126+0000 7f879f24d640 1 -- 172.21.15.117:0/2146886695 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87980623f0 con 0x559104515b60 2024-09-19T08:38:37.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.127+0000 7f87a2f5af40 1 -- 172.21.15.117:0/2146886695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559104515b60 msgr2=0x559104470560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:37.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.127+0000 7f87a2f5af40 1 --2- 172.21.15.117:0/2146886695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559104515b60 0x559104470560 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f87980460e0 tx=0x7f8798051000 comp rx=0 tx=0).stop 2024-09-19T08:38:37.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.127+0000 7f87a2f5af40 1 -- 172.21.15.117:0/2146886695 shutdown_connections 2024-09-19T08:38:37.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.127+0000 7f87a2f5af40 1 --2- 172.21.15.117:0/2146886695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559104515b60 0x559104470560 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.127+0000 7f87a2f5af40 1 --2- 172.21.15.117:0/2146886695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x559104444b10 0x55910450deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.127+0000 7f87a2f5af40 1 --2- 172.21.15.117:0/2146886695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559104444230 0x55910450d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.127+0000 7f87a2f5af40 1 -- 172.21.15.117:0/2146886695 >> 172.21.15.117:0/2146886695 conn(0x5591044419b0 msgr2=0x559104441d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:37.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.127+0000 7f87a2f5af40 1 -- 172.21.15.117:0/2146886695 shutdown_connections 2024-09-19T08:38:37.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.127+0000 7f87a2f5af40 1 -- 172.21.15.117:0/2146886695 wait complete. 2024-09-19T08:38:37.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.128+0000 7f87a2f5af40 1 Processor -- start 2024-09-19T08:38:37.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.128+0000 7f87a2f5af40 1 -- start start 2024-09-19T08:38:37.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.128+0000 7f87a2f5af40 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x559104444230 0x55910450be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.128+0000 7f87a2f5af40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559104444b10 0x55910450a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.128+0000 7f87a2f5af40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559104515b60 0x559104510010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.128+0000 7f87a2f5af40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559104514550 con 0x559104444b10 2024-09-19T08:38:37.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.128+0000 7f87a2f5af40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559104470fa0 con 0x559104515b60 2024-09-19T08:38:37.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.128+0000 7f87a2f5af40 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x559104443f20 con 0x559104444230 2024-09-19T08:38:37.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.128+0000 7f87a024f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559104444b10 0x55910450a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.128+0000 7f87a024f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559104444b10 0x55910450a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50468/0 (socket says 172.21.15.117:50468) 2024-09-19T08:38:37.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.128+0000 7f87a024f640 1 -- 172.21.15.117:0/3489422700 learned_addr learned my addr 172.21.15.117:0/3489422700 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:37.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.128+0000 7f87a1251640 1 --2- 172.21.15.117:0/3489422700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559104515b60 0x559104510010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.128+0000 7f87a0a50640 1 --2- 172.21.15.117:0/3489422700 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x559104444230 0x55910450be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.129+0000 7f87a024f640 1 -- 172.21.15.117:0/3489422700 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x559104444230 msgr2=0x55910450be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:37.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.129+0000 7f87a024f640 1 --2- 172.21.15.117:0/3489422700 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x559104444230 0x55910450be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.129+0000 7f87a024f640 1 -- 172.21.15.117:0/3489422700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559104515b60 msgr2=0x559104510010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:37.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.129+0000 7f87a024f640 1 --2- 172.21.15.117:0/3489422700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559104515b60 0x559104510010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.129+0000 7f87a024f640 1 -- 172.21.15.117:0/3489422700 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559104513db0 con 0x559104444b10 2024-09-19T08:38:37.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.129+0000 7f87a1251640 1 --2- 172.21.15.117:0/3489422700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559104515b60 0x559104510010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:37.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.129+0000 7f87a0a50640 1 --2- 172.21.15.117:0/3489422700 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x559104444230 0x55910450be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:37.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.129+0000 7f87a024f640 1 --2- 172.21.15.117:0/3489422700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559104444b10 0x55910450a0f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f87940086f0 tx=0x7f8794008bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:37.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.129+0000 7f879e24b640 1 -- 172.21.15.117:0/3489422700 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8794018070 con 0x559104444b10 2024-09-19T08:38:37.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.129+0000 7f879e24b640 1 -- 172.21.15.117:0/3489422700 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8794006970 con 0x559104444b10 2024-09-19T08:38:37.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.129+0000 7f879e24b640 1 -- 172.21.15.117:0/3489422700 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8794006d60 con 0x559104444b10 2024-09-19T08:38:37.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.129+0000 7f87a2f5af40 1 -- 172.21.15.117:0/3489422700 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55910450c410 con 0x559104444b10 2024-09-19T08:38:37.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.129+0000 7f87a2f5af40 1 -- 172.21.15.117:0/3489422700 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55910450c9d0 con 0x559104444b10 2024-09-19T08:38:37.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:38:37.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.130+0000 7f879e24b640 1 -- 172.21.15.117:0/3489422700 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f879401b070 con 0x559104444b10 2024-09-19T08:38:37.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.131+0000 7f879e24b640 1 --2- 172.21.15.117:0/3489422700 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f878c06ac90 0x7f878c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.131+0000 7f879e24b640 1 -- 172.21.15.117:0/3489422700 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f8794089c90 con 0x559104444b10 2024-09-19T08:38:37.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.131+0000 7f87a2f5af40 1 --2- 172.21.15.117:0/3489422700 >> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] conn(0x55910446bc40 0x5591045ada50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.131+0000 7f87a2f5af40 1 -- 172.21.15.117:0/3489422700 --> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] -- osd_op(unknown.0.0:1 6.12 6:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) -- 0x5591045adf90 con 0x55910446bc40 2024-09-19T08:38:37.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.131+0000 7f87a0a50640 1 --2- 172.21.15.117:0/3489422700 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f878c06ac90 0x7f878c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.131+0000 7f87a1251640 1 --2- 172.21.15.117:0/3489422700 >> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] conn(0x55910446bc40 0x5591045ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.132+0000 7f87a1251640 1 --2- 172.21.15.117:0/3489422700 >> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] conn(0x55910446bc40 0x5591045ada50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:37.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.132+0000 7f87a0a50640 1 --2- 172.21.15.117:0/3489422700 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f878c06ac90 0x7f878c06d150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8790001ed0 tx=0x7f8790001670 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:37.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.132+0000 7f87a1251640 1 -- 172.21.15.117:0/3489422700 <== osd.0 v2:172.21.15.117:6808/1962525121 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) ==== 164+0+0 (crc 0 0 0) 0x7f879804e040 con 0x55910446bc40 2024-09-19T08:38:37.138 INFO:teuthology.orchestra.run.smithi117.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2024-09-19T08:38:37.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.132+0000 7f87a2f5af40 1 -- 172.21.15.117:0/3489422700 >> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] conn(0x55910446bc40 msgr2=0x5591045ada50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:37.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.132+0000 7f87a2f5af40 1 --2- 172.21.15.117:0/3489422700 >> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] conn(0x55910446bc40 0x5591045ada50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.132+0000 7f87a2f5af40 1 -- 172.21.15.117:0/3489422700 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f878c06ac90 msgr2=0x7f878c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:37.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.132+0000 7f87a2f5af40 1 --2- 172.21.15.117:0/3489422700 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f878c06ac90 0x7f878c06d150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8790001ed0 tx=0x7f8790001670 comp rx=0 tx=0).stop 2024-09-19T08:38:37.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.132+0000 7f87a2f5af40 1 -- 172.21.15.117:0/3489422700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559104444b10 msgr2=0x55910450a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:37.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.132+0000 7f87a2f5af40 1 --2- 172.21.15.117:0/3489422700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559104444b10 0x55910450a0f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f87940086f0 tx=0x7f8794008bb0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.132+0000 7f87a1251640 1 -- 172.21.15.117:0/3489422700 reap_dead start 2024-09-19T08:38:37.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.132+0000 7f87a2f5af40 1 -- 172.21.15.117:0/3489422700 shutdown_connections 2024-09-19T08:38:37.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.132+0000 7f87a2f5af40 1 -- 172.21.15.117:0/3489422700 >> 172.21.15.117:0/3489422700 conn(0x5591044419b0 msgr2=0x559104441d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:37.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.132+0000 7f87a2f5af40 1 -- 172.21.15.117:0/3489422700 shutdown_connections 2024-09-19T08:38:37.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.132+0000 7f87a2f5af40 1 -- 172.21.15.117:0/3489422700 wait complete. 2024-09-19T08:38:37.140 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T08:38:37.140 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T08:38:37.213 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T08:38:37.262 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T08:38:37.262 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T08:38:37.262 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:38:37.262 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:38:37.278 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20491 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T08:38:37.278 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T08:38:37.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:37.278 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T08:38:37.334 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:38:37.334 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-19T08:38:37.334 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T08:38:37.335 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:38:37.335 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:38:37.354 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15971 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T08:38:37.354 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-19T08:38:37.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:37.354 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T08:38:37.412 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:38:37.412 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-19T08:38:37.413 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T08:38:37.413 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:38:37.413 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:38:37.429 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20491 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T08:38:37.429 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T08:38:37.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:37.429 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-19T08:38:37.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:38:37.485 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-19T08:38:37.486 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T08:38:37.486 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:38:37.486 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:38:37.504 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15971 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T08:38:37.504 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-19T08:38:37.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:37.505 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-19T08:38:37.565 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:38:37.566 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-19T08:38:37.566 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:38:37.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.664+0000 7f3c1485e640 1 Processor -- start 2024-09-19T08:38:37.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.665+0000 7f3c1485e640 1 -- start start 2024-09-19T08:38:37.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.665+0000 7f3c1485e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3c1015f0d0 0x7f3c1015f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.665+0000 7f3c1485e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c100d0070 0x7f3c100d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.665+0000 7f3c1485e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3c100d1940 0x7f3c100d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.665+0000 7f3c1485e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f3c100cf2b0 con 0x7f3c100d1940 2024-09-19T08:38:37.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.665+0000 7f3c1485e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f3c100cf590 con 0x7f3c1015f0d0 2024-09-19T08:38:37.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.665+0000 7f3c1485e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f3c100cf870 con 0x7f3c100d0070 2024-09-19T08:38:37.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.665+0000 7f3c0ed9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3c100d1940 0x7f3c100d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.665+0000 7f3c0ed9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3c100d1940 0x7f3c100d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50472/0 (socket says 172.21.15.117:50472) 2024-09-19T08:38:37.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.666+0000 7f3c0ed9d640 1 -- 172.21.15.117:0/2861510352 learned_addr learned my addr 172.21.15.117:0/2861510352 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:37.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.666+0000 7f3c07fff640 1 --2- 172.21.15.117:0/2861510352 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c100d0070 0x7f3c100d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.666+0000 7f3c0e59c640 1 --2- 172.21.15.117:0/2861510352 >> v2:172.21.15.146:3300/0 conn(0x7f3c1015f0d0 0x7f3c1015f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.666+0000 7f3c0ed9d640 1 -- 172.21.15.117:0/2861510352 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c100d0070 msgr2=0x7f3c100d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:37.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.666+0000 7f3c0ed9d640 1 --2- 172.21.15.117:0/2861510352 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c100d0070 0x7f3c100d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.666+0000 7f3c0ed9d640 1 -- 172.21.15.117:0/2861510352 >> v2:172.21.15.146:3300/0 conn(0x7f3c1015f0d0 msgr2=0x7f3c1015f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:37.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.666+0000 7f3c0ed9d640 1 --2- 172.21.15.117:0/2861510352 >> v2:172.21.15.146:3300/0 conn(0x7f3c1015f0d0 0x7f3c1015f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.666+0000 7f3c0ed9d640 1 -- 172.21.15.117:0/2861510352 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c100cfb50 con 0x7f3c100d1940 2024-09-19T08:38:37.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.666+0000 7f3c0ed9d640 1 --2- 172.21.15.117:0/2861510352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c100d1940 0x7f3c100d4130 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3c100b6f40 tx=0x7f3c0802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e503bfca9e3dcd15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:37.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.667+0000 7f3c0dd9b640 1 -- 172.21.15.117:0/2861510352 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c08036070 con 0x7f3c100d1940 2024-09-19T08:38:37.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.667+0000 7f3c0dd9b640 1 -- 172.21.15.117:0/2861510352 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c08031600 con 0x7f3c100d1940 2024-09-19T08:38:37.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.667+0000 7f3c0dd9b640 1 -- 172.21.15.117:0/2861510352 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c080319d0 con 0x7f3c100d1940 2024-09-19T08:38:37.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.667+0000 7f3c1485e640 1 -- 172.21.15.117:0/2861510352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c100d1940 msgr2=0x7f3c100d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:37.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.667+0000 7f3c1485e640 1 --2- 172.21.15.117:0/2861510352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c100d1940 0x7f3c100d4130 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3c100b6f40 tx=0x7f3c0802a610 comp rx=0 tx=0).stop 2024-09-19T08:38:37.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.667+0000 7f3c1485e640 1 -- 172.21.15.117:0/2861510352 shutdown_connections 2024-09-19T08:38:37.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.667+0000 7f3c1485e640 1 --2- 172.21.15.117:0/2861510352 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c100d0070 0x7f3c100d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.667+0000 7f3c1485e640 1 --2- 172.21.15.117:0/2861510352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c100d1940 0x7f3c100d4130 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.667+0000 7f3c1485e640 1 --2- 172.21.15.117:0/2861510352 >> v2:172.21.15.146:3300/0 conn(0x7f3c1015f0d0 0x7f3c1015f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.667+0000 7f3c1485e640 1 -- 172.21.15.117:0/2861510352 >> 172.21.15.117:0/2861510352 conn(0x7f3c1009d760 msgr2=0x7f3c1008bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:37.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.667+0000 7f3c1485e640 1 -- 172.21.15.117:0/2861510352 shutdown_connections 2024-09-19T08:38:37.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.667+0000 7f3c1485e640 1 -- 172.21.15.117:0/2861510352 wait complete. 2024-09-19T08:38:37.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.669+0000 7f3c1485e640 1 Processor -- start 2024-09-19T08:38:37.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.669+0000 7f3c1485e640 1 -- start start 2024-09-19T08:38:37.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.669+0000 7f3c1485e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c100d0070 0x7f3c101517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.669+0000 7f3c1485e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c100d1940 0x7f3c100a0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.669+0000 7f3c1485e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c1015f0d0 0x7f3c100b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.669+0000 7f3c1485e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3c100d47f0 con 0x7f3c100d1940 2024-09-19T08:38:37.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.669+0000 7f3c1485e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3c100d4670 con 0x7f3c100d0070 2024-09-19T08:38:37.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.669+0000 7f3c1485e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f3c100d4970 con 0x7f3c1015f0d0 2024-09-19T08:38:37.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.669+0000 7f3c07fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c100d1940 0x7f3c100a0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.669+0000 7f3c07fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c100d1940 0x7f3c100a0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50488/0 (socket says 172.21.15.117:50488) 2024-09-19T08:38:37.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.669+0000 7f3c07fff640 1 -- 172.21.15.117:0/2048164702 learned_addr learned my addr 172.21.15.117:0/2048164702 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:37.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.670+0000 7f3c0ed9d640 1 --2- 172.21.15.117:0/2048164702 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c1015f0d0 0x7f3c100b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.670+0000 7f3c0e59c640 1 --2- 172.21.15.117:0/2048164702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c100d0070 0x7f3c101517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.670+0000 7f3c07fff640 1 -- 172.21.15.117:0/2048164702 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c1015f0d0 msgr2=0x7f3c100b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:37.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.670+0000 7f3c07fff640 1 --2- 172.21.15.117:0/2048164702 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c1015f0d0 0x7f3c100b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.670+0000 7f3c07fff640 1 -- 172.21.15.117:0/2048164702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c100d0070 msgr2=0x7f3c101517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:37.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.670+0000 7f3c07fff640 1 --2- 172.21.15.117:0/2048164702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c100d0070 0x7f3c101517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.670+0000 7f3c07fff640 1 -- 172.21.15.117:0/2048164702 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c100a2050 con 0x7f3c100d1940 2024-09-19T08:38:37.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.670+0000 7f3c07fff640 1 --2- 172.21.15.117:0/2048164702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c100d1940 0x7f3c100a0fb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800d800 tx=0x7f3bf800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:37.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.670+0000 7f3c06ffd640 1 -- 172.21.15.117:0/2048164702 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8018030 con 0x7f3c100d1940 2024-09-19T08:38:37.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.670+0000 7f3c06ffd640 1 -- 172.21.15.117:0/2048164702 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf80096a0 con 0x7f3c100d1940 2024-09-19T08:38:37.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.670+0000 7f3c1485e640 1 -- 172.21.15.117:0/2048164702 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c100a1a90 con 0x7f3c100d1940 2024-09-19T08:38:37.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.670+0000 7f3c06ffd640 1 -- 172.21.15.117:0/2048164702 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8009870 con 0x7f3c100d1940 2024-09-19T08:38:37.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.670+0000 7f3c1485e640 1 -- 172.21.15.117:0/2048164702 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c100cd030 con 0x7f3c100d1940 2024-09-19T08:38:37.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.671+0000 7f3c1485e640 1 -- 172.21.15.117:0/2048164702 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c10151d80 con 0x7f3c100d1940 2024-09-19T08:38:37.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.672+0000 7f3c06ffd640 1 -- 172.21.15.117:0/2048164702 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3bf801b070 con 0x7f3c100d1940 2024-09-19T08:38:37.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.672+0000 7f3c06ffd640 1 --2- 172.21.15.117:0/2048164702 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3bf006c2b0 0x7f3bf006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.672+0000 7f3c06ffd640 1 -- 172.21.15.117:0/2048164702 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f3bf808b6f0 con 0x7f3c100d1940 2024-09-19T08:38:37.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.672+0000 7f3c0e59c640 1 --2- 172.21.15.117:0/2048164702 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3bf006c2b0 0x7f3bf006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.673+0000 7f3c0e59c640 1 --2- 172.21.15.117:0/2048164702 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3bf006c2b0 0x7f3bf006e770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3c00006fd0 tx=0x7f3c00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:37.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.676+0000 7f3c06ffd640 1 -- 172.21.15.117:0/2048164702 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3bf8059680 con 0x7f3c100d1940 2024-09-19T08:38:37.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.875+0000 7f3c1485e640 1 -- 172.21.15.117:0/2048164702 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c1006cf30 con 0x7f3c100d1940 2024-09-19T08:38:37.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.876+0000 7f3c06ffd640 1 -- 172.21.15.117:0/2048164702 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5235 (secure 0 0 0) 0x7f3bf805d980 con 0x7f3c100d1940 2024-09-19T08:38:37.876 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:37.876 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":16,"btime":"2024-09-19T08:38:09:528263+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4595,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2240250216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2240250216},{"type":"v1","addr":"172.21.15.146:6836","nonce":2240250216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2165679820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2165679820},{"type":"v1","addr":"172.21.15.117:6834","nonce":2165679820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2737032516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2737032516},{"type":"v1","addr":"172.21.15.117:6835","nonce":2737032516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:38:06.852720+0000","modified":"2024-09-19T08:38:08.856085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/3614861409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":3614861409},{"type":"v1","addr":"172.21.15.146:6837","nonce":3614861409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4926,"qdb_cluster":[4926]},"id":2}]} 2024-09-19T08:38:37.876 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 16 2024-09-19T08:38:37.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.878+0000 7f3c1485e640 1 -- 172.21.15.117:0/2048164702 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3bf006c2b0 msgr2=0x7f3bf006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:37.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.878+0000 7f3c1485e640 1 --2- 172.21.15.117:0/2048164702 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3bf006c2b0 0x7f3bf006e770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3c00006fd0 tx=0x7f3c00008040 comp rx=0 tx=0).stop 2024-09-19T08:38:37.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.878+0000 7f3c1485e640 1 -- 172.21.15.117:0/2048164702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c100d1940 msgr2=0x7f3c100a0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:37.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.878+0000 7f3c1485e640 1 --2- 172.21.15.117:0/2048164702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c100d1940 0x7f3c100a0fb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800d800 tx=0x7f3bf800dcc0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.878+0000 7f3c1485e640 1 -- 172.21.15.117:0/2048164702 shutdown_connections 2024-09-19T08:38:37.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.878+0000 7f3c1485e640 1 --2- 172.21.15.117:0/2048164702 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3bf006c2b0 0x7f3bf006e770 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.878+0000 7f3c1485e640 1 --2- 172.21.15.117:0/2048164702 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c1015f0d0 0x7f3c100b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.878+0000 7f3c1485e640 1 --2- 172.21.15.117:0/2048164702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c100d1940 0x7f3c100a0fb0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.878+0000 7f3c1485e640 1 --2- 172.21.15.117:0/2048164702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c100d0070 0x7f3c101517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.878+0000 7f3c1485e640 1 -- 172.21.15.117:0/2048164702 >> 172.21.15.117:0/2048164702 conn(0x7f3c1009d760 msgr2=0x7f3c1006e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:37.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.878+0000 7f3c1485e640 1 -- 172.21.15.117:0/2048164702 shutdown_connections 2024-09-19T08:38:37.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.878+0000 7f3c1485e640 1 -- 172.21.15.117:0/2048164702 wait complete. 2024-09-19T08:38:37.889 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:38:37.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.987+0000 7f2e5b766640 1 Processor -- start 2024-09-19T08:38:37.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.988+0000 7f2e5b766640 1 -- start start 2024-09-19T08:38:37.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.988+0000 7f2e5b766640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2e5415e4f0 0x7f2e540b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.988+0000 7f2e5b766640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2e54070930 0x7f2e540b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.988+0000 7f2e5b766640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e540b5590 con 0x7f2e540add30 2024-09-19T08:38:37.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.988+0000 7f2e5b766640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2e54070ea0 con 0x7f2e54070930 2024-09-19T08:38:37.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.989+0000 7f2e5b766640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f2e5406e8c0 con 0x7f2e5415e4f0 2024-09-19T08:38:37.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.989+0000 7f2e59d03640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2e54070930 0x7f2e540b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.989+0000 7f2e59d03640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2e54070930 0x7f2e540b00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50504/0 (socket says 172.21.15.117:50504) 2024-09-19T08:38:37.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.989+0000 7f2e59d03640 1 -- 172.21.15.117:0/1764578282 learned_addr learned my addr 172.21.15.117:0/1764578282 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:37.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.989+0000 7f2e58d01640 1 --2- 172.21.15.117:0/1764578282 >> v2:172.21.15.146:3300/0 conn(0x7f2e5415e4f0 0x7f2e540b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.989+0000 7f2e59d03640 1 -- 172.21.15.117:0/1764578282 >> v2:172.21.15.146:3300/0 conn(0x7f2e5415e4f0 msgr2=0x7f2e540b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:37.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.989+0000 7f2e59d03640 1 --2- 172.21.15.117:0/1764578282 >> v2:172.21.15.146:3300/0 conn(0x7f2e5415e4f0 0x7f2e540b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.989+0000 7f2e59d03640 1 -- 172.21.15.117:0/1764578282 >> v1:172.21.15.146:6789/0 conn(0x7f2e540add30 legacy=0x7f2e540ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:37.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.989+0000 7f2e59d03640 1 -- 172.21.15.117:0/1764578282 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5406eba0 con 0x7f2e54070930 2024-09-19T08:38:37.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.990+0000 7f2e59d03640 1 --2- 172.21.15.117:0/1764578282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e54070930 0x7f2e540b00f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2e540b4ae0 tx=0x7f2e4c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11aed64f94717a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:37.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.990+0000 7f2e47fff640 1 -- 172.21.15.117:0/1764578282 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c036070 con 0x7f2e54070930 2024-09-19T08:38:37.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.990+0000 7f2e47fff640 1 -- 172.21.15.117:0/1764578282 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e4c031600 con 0x7f2e54070930 2024-09-19T08:38:37.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.990+0000 7f2e47fff640 1 -- 172.21.15.117:0/1764578282 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0319d0 con 0x7f2e54070930 2024-09-19T08:38:37.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.990+0000 7f2e5b766640 1 -- 172.21.15.117:0/1764578282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e54070930 msgr2=0x7f2e540b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:37.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.990+0000 7f2e5b766640 1 --2- 172.21.15.117:0/1764578282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e54070930 0x7f2e540b00f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2e540b4ae0 tx=0x7f2e4c02a730 comp rx=0 tx=0).stop 2024-09-19T08:38:37.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.990+0000 7f2e5b766640 1 -- 172.21.15.117:0/1764578282 shutdown_connections 2024-09-19T08:38:37.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.990+0000 7f2e5b766640 1 --2- 172.21.15.117:0/1764578282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e54070930 0x7f2e540b00f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.990+0000 7f2e5b766640 1 --2- 172.21.15.117:0/1764578282 >> v2:172.21.15.146:3300/0 conn(0x7f2e5415e4f0 0x7f2e540b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.990+0000 7f2e5b766640 1 -- 172.21.15.117:0/1764578282 >> 172.21.15.117:0/1764578282 conn(0x7f2e5406bc10 msgr2=0x7f2e5406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:37.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.990+0000 7f2e5b766640 1 -- 172.21.15.117:0/1764578282 shutdown_connections 2024-09-19T08:38:37.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.990+0000 7f2e5b766640 1 -- 172.21.15.117:0/1764578282 wait complete. 2024-09-19T08:38:37.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.992+0000 7f2e5b766640 1 Processor -- start 2024-09-19T08:38:37.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.992+0000 7f2e5b766640 1 -- start start 2024-09-19T08:38:37.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.992+0000 7f2e5b766640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e54070930 0x7f2e540cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.992+0000 7f2e5b766640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e540add30 0x7f2e541527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.992+0000 7f2e5b766640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e5415e4f0 0x7f2e541595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.992+0000 7f2e5b766640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5406f3a0 con 0x7f2e5415e4f0 2024-09-19T08:38:37.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.992+0000 7f2e5b766640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2e540b0630 con 0x7f2e54070930 2024-09-19T08:38:37.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.992+0000 7f2e5b766640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f2e5406f520 con 0x7f2e540add30 2024-09-19T08:38:37.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.993+0000 7f2e59d03640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e5415e4f0 0x7f2e541595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.993+0000 7f2e59d03640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e5415e4f0 0x7f2e541595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50518/0 (socket says 172.21.15.117:50518) 2024-09-19T08:38:37.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.993+0000 7f2e59d03640 1 -- 172.21.15.117:0/90521239 learned_addr learned my addr 172.21.15.117:0/90521239 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:37.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.993+0000 7f2e59502640 1 --2- 172.21.15.117:0/90521239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e54070930 0x7f2e540cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.993+0000 7f2e58d01640 1 --2- 172.21.15.117:0/90521239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e540add30 0x7f2e541527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.993+0000 7f2e59d03640 1 -- 172.21.15.117:0/90521239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e540add30 msgr2=0x7f2e541527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:37.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.993+0000 7f2e59d03640 1 --2- 172.21.15.117:0/90521239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e540add30 0x7f2e541527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.993+0000 7f2e59d03640 1 -- 172.21.15.117:0/90521239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e54070930 msgr2=0x7f2e540cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:37.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.993+0000 7f2e59d03640 1 --2- 172.21.15.117:0/90521239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e54070930 0x7f2e540cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:37.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.993+0000 7f2e59d03640 1 -- 172.21.15.117:0/90521239 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e54151720 con 0x7f2e5415e4f0 2024-09-19T08:38:37.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.993+0000 7f2e59d03640 1 --2- 172.21.15.117:0/90521239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e5415e4f0 0x7f2e541595b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c02ad20 tx=0x7f2e4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:37.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.993+0000 7f2e45ffb640 1 -- 172.21.15.117:0/90521239 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c03f020 con 0x7f2e5415e4f0 2024-09-19T08:38:37.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.993+0000 7f2e45ffb640 1 -- 172.21.15.117:0/90521239 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e4c037040 con 0x7f2e5415e4f0 2024-09-19T08:38:37.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.993+0000 7f2e5b766640 1 -- 172.21.15.117:0/90521239 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e54151a00 con 0x7f2e5415e4f0 2024-09-19T08:38:37.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.993+0000 7f2e45ffb640 1 -- 172.21.15.117:0/90521239 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c036070 con 0x7f2e5415e4f0 2024-09-19T08:38:37.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.993+0000 7f2e5b766640 1 -- 172.21.15.117:0/90521239 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e54151fc0 con 0x7f2e5415e4f0 2024-09-19T08:38:37.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.994+0000 7f2e5b766640 1 -- 172.21.15.117:0/90521239 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e54071090 con 0x7f2e5415e4f0 2024-09-19T08:38:37.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.995+0000 7f2e45ffb640 1 -- 172.21.15.117:0/90521239 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2e4c042020 con 0x7f2e5415e4f0 2024-09-19T08:38:37.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.995+0000 7f2e45ffb640 1 --2- 172.21.15.117:0/90521239 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2e3806c2b0 0x7f2e3806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:37.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.996+0000 7f2e45ffb640 1 -- 172.21.15.117:0/90521239 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f2e4c0abbf0 con 0x7f2e5415e4f0 2024-09-19T08:38:37.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.996+0000 7f2e59502640 1 --2- 172.21.15.117:0/90521239 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2e3806c2b0 0x7f2e3806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:37.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:37.996+0000 7f2e59502640 1 --2- 172.21.15.117:0/90521239 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2e3806c2b0 0x7f2e3806e770 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2e48001780 tx=0x7f2e48009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:37.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.000+0000 7f2e45ffb640 1 -- 172.21.15.117:0/90521239 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2e54071090 con 0x7f2e5415e4f0 2024-09-19T08:38:38.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.199+0000 7f2e5b766640 1 -- 172.21.15.117:0/90521239 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e540b00f0 con 0x7f2e5415e4f0 2024-09-19T08:38:38.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.200+0000 7f2e45ffb640 1 -- 172.21.15.117:0/90521239 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5235 (secure 0 0 0) 0x7f2e4c049020 con 0x7f2e5415e4f0 2024-09-19T08:38:38.200 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:38.200 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":16,"btime":"2024-09-19T08:38:09:528263+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4595,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2240250216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2240250216},{"type":"v1","addr":"172.21.15.146:6836","nonce":2240250216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2165679820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2165679820},{"type":"v1","addr":"172.21.15.117:6834","nonce":2165679820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2737032516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2737032516},{"type":"v1","addr":"172.21.15.117:6835","nonce":2737032516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:38:06.852720+0000","modified":"2024-09-19T08:38:08.856085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/3614861409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":3614861409},{"type":"v1","addr":"172.21.15.146:6837","nonce":3614861409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4926,"qdb_cluster":[4926]},"id":2}]} 2024-09-19T08:38:38.200 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 16 2024-09-19T08:38:38.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.202+0000 7f2e5b766640 1 -- 172.21.15.117:0/90521239 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2e3806c2b0 msgr2=0x7f2e3806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:38.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.202+0000 7f2e5b766640 1 --2- 172.21.15.117:0/90521239 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2e3806c2b0 0x7f2e3806e770 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2e48001780 tx=0x7f2e48009040 comp rx=0 tx=0).stop 2024-09-19T08:38:38.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.202+0000 7f2e5b766640 1 -- 172.21.15.117:0/90521239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e5415e4f0 msgr2=0x7f2e541595b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:38.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.202+0000 7f2e5b766640 1 --2- 172.21.15.117:0/90521239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e5415e4f0 0x7f2e541595b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c02ad20 tx=0x7f2e4c004a40 comp rx=0 tx=0).stop 2024-09-19T08:38:38.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.202+0000 7f2e5b766640 1 -- 172.21.15.117:0/90521239 shutdown_connections 2024-09-19T08:38:38.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.202+0000 7f2e5b766640 1 --2- 172.21.15.117:0/90521239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e5415e4f0 0x7f2e541595b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.202+0000 7f2e5b766640 1 --2- 172.21.15.117:0/90521239 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2e3806c2b0 0x7f2e3806e770 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.202+0000 7f2e5b766640 1 --2- 172.21.15.117:0/90521239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e540add30 0x7f2e541527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.202+0000 7f2e5b766640 1 --2- 172.21.15.117:0/90521239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e54070930 0x7f2e540cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.202+0000 7f2e5b766640 1 -- 172.21.15.117:0/90521239 >> 172.21.15.117:0/90521239 conn(0x7f2e5406bc10 msgr2=0x7f2e540b5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:38.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.202+0000 7f2e5b766640 1 -- 172.21.15.117:0/90521239 shutdown_connections 2024-09-19T08:38:38.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.202+0000 7f2e5b766640 1 -- 172.21.15.117:0/90521239 wait complete. 2024-09-19T08:38:38.213 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:38:38.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.311+0000 7f2c21323640 1 Processor -- start 2024-09-19T08:38:38.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.311+0000 7f2c21323640 1 -- start start 2024-09-19T08:38:38.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.312+0000 7f2c21323640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2c1c15f0d0 0x7f2c1c15f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:38.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.312+0000 7f2c21323640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2c1c0d0070 0x7f2c1c0d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:38.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.312+0000 7f2c21323640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c1c0d1940 0x7f2c1c0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:38.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.312+0000 7f2c21323640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2c1c0cf2b0 con 0x7f2c1c0d0070 2024-09-19T08:38:38.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.312+0000 7f2c21323640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f2c1c0cf590 con 0x7f2c1c15f0d0 2024-09-19T08:38:38.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.312+0000 7f2c21323640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f2c1c0cf870 con 0x7f2c1c0d1940 2024-09-19T08:38:38.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.312+0000 7f2c1a7fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2c1c0d0070 0x7f2c1c0d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:38.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.312+0000 7f2c1a7fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2c1c0d0070 0x7f2c1c0d1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50522/0 (socket says 172.21.15.117:50522) 2024-09-19T08:38:38.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.312+0000 7f2c1a7fc640 1 -- 172.21.15.117:0/3985077161 learned_addr learned my addr 172.21.15.117:0/3985077161 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:38.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.312+0000 7f2c1b7fe640 1 --2- 172.21.15.117:0/3985077161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c1c0d1940 0x7f2c1c0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:38.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.312+0000 7f2c1affd640 1 --2- 172.21.15.117:0/3985077161 >> v2:172.21.15.146:3300/0 conn(0x7f2c1c15f0d0 0x7f2c1c15f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:38.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.312+0000 7f2c1a7fc640 1 -- 172.21.15.117:0/3985077161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c1c0d1940 msgr2=0x7f2c1c0d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:38.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.312+0000 7f2c1a7fc640 1 --2- 172.21.15.117:0/3985077161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c1c0d1940 0x7f2c1c0d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.312+0000 7f2c1a7fc640 1 -- 172.21.15.117:0/3985077161 >> v2:172.21.15.146:3300/0 conn(0x7f2c1c15f0d0 msgr2=0x7f2c1c15f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:38.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.312+0000 7f2c1a7fc640 1 --2- 172.21.15.117:0/3985077161 >> v2:172.21.15.146:3300/0 conn(0x7f2c1c15f0d0 0x7f2c1c15f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.312+0000 7f2c1a7fc640 1 -- 172.21.15.117:0/3985077161 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1c0cfb50 con 0x7f2c1c0d0070 2024-09-19T08:38:38.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.312+0000 7f2c1affd640 1 --2- 172.21.15.117:0/3985077161 >> v2:172.21.15.146:3300/0 conn(0x7f2c1c15f0d0 0x7f2c1c15f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:38.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.313+0000 7f2c1a7fc640 1 --2- 172.21.15.117:0/3985077161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c1c0d0070 0x7f2c1c0d1400 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0b6f40 tx=0x7f2c1002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6935d3d0f51e2b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:38.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.313+0000 7f2c19ffb640 1 -- 172.21.15.117:0/3985077161 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c10037070 con 0x7f2c1c0d0070 2024-09-19T08:38:38.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.313+0000 7f2c19ffb640 1 -- 172.21.15.117:0/3985077161 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c10032440 con 0x7f2c1c0d0070 2024-09-19T08:38:38.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.313+0000 7f2c19ffb640 1 -- 172.21.15.117:0/3985077161 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c10032810 con 0x7f2c1c0d0070 2024-09-19T08:38:38.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.314+0000 7f2c21323640 1 -- 172.21.15.117:0/3985077161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c1c0d0070 msgr2=0x7f2c1c0d1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:38.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.314+0000 7f2c21323640 1 --2- 172.21.15.117:0/3985077161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c1c0d0070 0x7f2c1c0d1400 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0b6f40 tx=0x7f2c1002a140 comp rx=0 tx=0).stop 2024-09-19T08:38:38.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.314+0000 7f2c21323640 1 -- 172.21.15.117:0/3985077161 shutdown_connections 2024-09-19T08:38:38.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.314+0000 7f2c21323640 1 --2- 172.21.15.117:0/3985077161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c1c0d1940 0x7f2c1c0d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.314+0000 7f2c21323640 1 --2- 172.21.15.117:0/3985077161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c1c0d0070 0x7f2c1c0d1400 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.314+0000 7f2c21323640 1 --2- 172.21.15.117:0/3985077161 >> v2:172.21.15.146:3300/0 conn(0x7f2c1c15f0d0 0x7f2c1c15f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.314+0000 7f2c21323640 1 -- 172.21.15.117:0/3985077161 >> 172.21.15.117:0/3985077161 conn(0x7f2c1c09d760 msgr2=0x7f2c1c08bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:38.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.314+0000 7f2c21323640 1 -- 172.21.15.117:0/3985077161 shutdown_connections 2024-09-19T08:38:38.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.314+0000 7f2c21323640 1 -- 172.21.15.117:0/3985077161 wait complete. 2024-09-19T08:38:38.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.315+0000 7f2c21323640 1 Processor -- start 2024-09-19T08:38:38.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.315+0000 7f2c21323640 1 -- start start 2024-09-19T08:38:38.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.316+0000 7f2c21323640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c1c0d0070 0x7f2c1c0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:38.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.316+0000 7f2c21323640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c1c0d1940 0x7f2c1c1f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:38.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.316+0000 7f2c21323640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c1c15f0d0 0x7f2c1c0c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:38.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.316+0000 7f2c21323640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c0d47f0 con 0x7f2c1c0d0070 2024-09-19T08:38:38.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.316+0000 7f2c21323640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c0d4670 con 0x7f2c1c15f0d0 2024-09-19T08:38:38.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.316+0000 7f2c21323640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f2c1c0d4970 con 0x7f2c1c0d1940 2024-09-19T08:38:38.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.316+0000 7f2c1affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c1c0d0070 0x7f2c1c0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:38.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.316+0000 7f2c1affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c1c0d0070 0x7f2c1c0cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50524/0 (socket says 172.21.15.117:50524) 2024-09-19T08:38:38.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.316+0000 7f2c1affd640 1 -- 172.21.15.117:0/4184998407 learned_addr learned my addr 172.21.15.117:0/4184998407 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:38.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.316+0000 7f2c1a7fc640 1 --2- 172.21.15.117:0/4184998407 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c1c0d1940 0x7f2c1c1f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:38.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.316+0000 7f2c1b7fe640 1 --2- 172.21.15.117:0/4184998407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c1c15f0d0 0x7f2c1c0c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:38.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.316+0000 7f2c1affd640 1 -- 172.21.15.117:0/4184998407 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c1c0d1940 msgr2=0x7f2c1c1f49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:38.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.316+0000 7f2c1affd640 1 --2- 172.21.15.117:0/4184998407 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c1c0d1940 0x7f2c1c1f49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.316+0000 7f2c1affd640 1 -- 172.21.15.117:0/4184998407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c1c15f0d0 msgr2=0x7f2c1c0c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:38.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.316+0000 7f2c1affd640 1 --2- 172.21.15.117:0/4184998407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c1c15f0d0 0x7f2c1c0c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.316+0000 7f2c1affd640 1 -- 172.21.15.117:0/4184998407 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1c0ce2f0 con 0x7f2c1c0d0070 2024-09-19T08:38:38.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.316+0000 7f2c1b7fe640 1 --2- 172.21.15.117:0/4184998407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c1c15f0d0 0x7f2c1c0c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:38.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.317+0000 7f2c1affd640 1 --2- 172.21.15.117:0/4184998407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c1c0d0070 0x7f2c1c0cdc80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00c7f0 tx=0x7f2c0c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:38.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.317+0000 7f2c037fe640 1 -- 172.21.15.117:0/4184998407 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c015070 con 0x7f2c1c0d0070 2024-09-19T08:38:38.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.317+0000 7f2c037fe640 1 -- 172.21.15.117:0/4184998407 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c0c007a30 con 0x7f2c1c0d0070 2024-09-19T08:38:38.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.317+0000 7f2c21323640 1 -- 172.21.15.117:0/4184998407 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c1c1f51f0 con 0x7f2c1c0d0070 2024-09-19T08:38:38.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.317+0000 7f2c037fe640 1 -- 172.21.15.117:0/4184998407 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c007e00 con 0x7f2c1c0d0070 2024-09-19T08:38:38.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.317+0000 7f2c21323640 1 -- 172.21.15.117:0/4184998407 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c1c1f5770 con 0x7f2c1c0d0070 2024-09-19T08:38:38.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.318+0000 7f2c21323640 1 -- 172.21.15.117:0/4184998407 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c1c0d1400 con 0x7f2c1c0d0070 2024-09-19T08:38:38.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.318+0000 7f2c037fe640 1 -- 172.21.15.117:0/4184998407 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2c0c018070 con 0x7f2c1c0d0070 2024-09-19T08:38:38.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.319+0000 7f2c037fe640 1 --2- 172.21.15.117:0/4184998407 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2c0806c2b0 0x7f2c0806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:38.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.319+0000 7f2c037fe640 1 -- 172.21.15.117:0/4184998407 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f2c0c08b540 con 0x7f2c1c0d0070 2024-09-19T08:38:38.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.319+0000 7f2c1a7fc640 1 --2- 172.21.15.117:0/4184998407 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2c0806c2b0 0x7f2c0806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:38.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.319+0000 7f2c1a7fc640 1 --2- 172.21.15.117:0/4184998407 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2c0806c2b0 0x7f2c0806e770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2c10034000 tx=0x7f2c1002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:38.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.323+0000 7f2c037fe640 1 -- 172.21.15.117:0/4184998407 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2c0c059b90 con 0x7f2c1c0d0070 2024-09-19T08:38:38.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.489+0000 7f2c21323640 1 -- 172.21.15.117:0/4184998407 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c1c0c88a0 con 0x7f2c1c0d0070 2024-09-19T08:38:38.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.490+0000 7f2c037fe640 1 -- 172.21.15.117:0/4184998407 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17050 (secure 0 0 0) 0x7f2c0c059490 con 0x7f2c1c0d0070 2024-09-19T08:38:38.490 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:38.490 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":40,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:38:08.520988+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:38:04.617092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-19T08:38:05.827922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:38:38.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.492+0000 7f2c21323640 1 -- 172.21.15.117:0/4184998407 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2c0806c2b0 msgr2=0x7f2c0806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:38.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.492+0000 7f2c21323640 1 --2- 172.21.15.117:0/4184998407 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2c0806c2b0 0x7f2c0806e770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2c10034000 tx=0x7f2c1002e000 comp rx=0 tx=0).stop 2024-09-19T08:38:38.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.492+0000 7f2c21323640 1 -- 172.21.15.117:0/4184998407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c1c0d0070 msgr2=0x7f2c1c0cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:38.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.492+0000 7f2c21323640 1 --2- 172.21.15.117:0/4184998407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c1c0d0070 0x7f2c1c0cdc80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00c7f0 tx=0x7f2c0c00cbf0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.492+0000 7f2c21323640 1 -- 172.21.15.117:0/4184998407 shutdown_connections 2024-09-19T08:38:38.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.492+0000 7f2c21323640 1 --2- 172.21.15.117:0/4184998407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c1c15f0d0 0x7f2c1c0c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.492+0000 7f2c21323640 1 --2- 172.21.15.117:0/4184998407 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2c0806c2b0 0x7f2c0806e770 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.492+0000 7f2c21323640 1 --2- 172.21.15.117:0/4184998407 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c1c0d1940 0x7f2c1c1f49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.492+0000 7f2c21323640 1 --2- 172.21.15.117:0/4184998407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c1c0d0070 0x7f2c1c0cdc80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.492+0000 7f2c21323640 1 -- 172.21.15.117:0/4184998407 >> 172.21.15.117:0/4184998407 conn(0x7f2c1c09d760 msgr2=0x7f2c1c15d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:38.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.492+0000 7f2c21323640 1 -- 172.21.15.117:0/4184998407 shutdown_connections 2024-09-19T08:38:38.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.492+0000 7f2c21323640 1 -- 172.21.15.117:0/4184998407 wait complete. 2024-09-19T08:38:38.504 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T08:38:38.504 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:38:38.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.604+0000 7fc6e3245640 1 Processor -- start 2024-09-19T08:38:38.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.604+0000 7fc6e3245640 1 -- start start 2024-09-19T08:38:38.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.605+0000 7fc6e3245640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc6dc15c3c0 0x7fc6dc0cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:38.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.605+0000 7fc6e3245640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6dc0cd030 con 0x7fc6dc0d0790 2024-09-19T08:38:38.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.605+0000 7fc6e3245640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6dc0cd310 con 0x7fc6dc09b100 2024-09-19T08:38:38.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.605+0000 7fc6e3245640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc6dc0cd5f0 con 0x7fc6dc15c3c0 2024-09-19T08:38:38.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.605+0000 7fc6e0fe1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc6dc15c3c0 0x7fc6dc0cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:38.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.605+0000 7fc6e0fe1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc6dc15c3c0 0x7fc6dc0cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50538/0 (socket says 172.21.15.117:50538) 2024-09-19T08:38:38.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.605+0000 7fc6e0fe1640 1 -- 172.21.15.117:0/4143356224 learned_addr learned my addr 172.21.15.117:0/4143356224 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:38.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.605+0000 7fc6dbfff640 1 --1- 172.21.15.117:0/4143356224 >> v1:172.21.15.117:6789/0 conn(0x7fc6dc0d0790 0x7fc6dc09a9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:49852/0 (socket says 172.21.15.117:49852) 2024-09-19T08:38:38.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.606+0000 7fc6e0fe1640 1 -- 172.21.15.117:0/4143356224 >> v1:172.21.15.146:6789/0 conn(0x7fc6dc09b100 legacy=0x7fc6dc0c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:38.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.606+0000 7fc6e0fe1640 1 -- 172.21.15.117:0/4143356224 >> v1:172.21.15.117:6789/0 conn(0x7fc6dc0d0790 legacy=0x7fc6dc09a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:38.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.606+0000 7fc6e0fe1640 1 -- 172.21.15.117:0/4143356224 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6dc0cd8d0 con 0x7fc6dc15c3c0 2024-09-19T08:38:38.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.606+0000 7fc6e0fe1640 1 --2- 172.21.15.117:0/4143356224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6dc15c3c0 0x7fc6dc0cddf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00098a0 tx=0x7fc6d002a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38745170d74d1adf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:38.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.608+0000 7fc6db7fe640 1 -- 172.21.15.117:0/4143356224 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0037070 con 0x7fc6dc15c3c0 2024-09-19T08:38:38.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.608+0000 7fc6db7fe640 1 -- 172.21.15.117:0/4143356224 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d0032640 con 0x7fc6dc15c3c0 2024-09-19T08:38:38.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.608+0000 7fc6db7fe640 1 -- 172.21.15.117:0/4143356224 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0032a10 con 0x7fc6dc15c3c0 2024-09-19T08:38:38.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.608+0000 7fc6e3245640 1 -- 172.21.15.117:0/4143356224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6dc15c3c0 msgr2=0x7fc6dc0cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:38.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.608+0000 7fc6e3245640 1 --2- 172.21.15.117:0/4143356224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6dc15c3c0 0x7fc6dc0cddf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00098a0 tx=0x7fc6d002a320 comp rx=0 tx=0).stop 2024-09-19T08:38:38.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.609+0000 7fc6e3245640 1 -- 172.21.15.117:0/4143356224 shutdown_connections 2024-09-19T08:38:38.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.609+0000 7fc6e3245640 1 --2- 172.21.15.117:0/4143356224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6dc15c3c0 0x7fc6dc0cddf0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.609+0000 7fc6e3245640 1 -- 172.21.15.117:0/4143356224 >> 172.21.15.117:0/4143356224 conn(0x7fc6dc0b3ca0 msgr2=0x7fc6dc0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:38.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.609+0000 7fc6e3245640 1 -- 172.21.15.117:0/4143356224 shutdown_connections 2024-09-19T08:38:38.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.609+0000 7fc6e3245640 1 -- 172.21.15.117:0/4143356224 wait complete. 2024-09-19T08:38:38.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.610+0000 7fc6e3245640 1 Processor -- start 2024-09-19T08:38:38.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.610+0000 7fc6e3245640 1 -- start start 2024-09-19T08:38:38.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.611+0000 7fc6e3245640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6dc09b100 0x7fc6dc158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:38.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.611+0000 7fc6e3245640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6dc0d0790 0x7fc6dc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:38.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.611+0000 7fc6e3245640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6dc15c3c0 0x7fc6dc09c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:38.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.611+0000 7fc6e3245640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc09bd30 con 0x7fc6dc15c3c0 2024-09-19T08:38:38.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.611+0000 7fc6e3245640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc6dc09bbb0 con 0x7fc6dc0d0790 2024-09-19T08:38:38.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.611+0000 7fc6e3245640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fc6dc0ccc50 con 0x7fc6dc09b100 2024-09-19T08:38:38.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.611+0000 7fc6e17e2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6dc15c3c0 0x7fc6dc09c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:38.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.611+0000 7fc6e17e2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6dc15c3c0 0x7fc6dc09c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50546/0 (socket says 172.21.15.117:50546) 2024-09-19T08:38:38.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.611+0000 7fc6e17e2640 1 -- 172.21.15.117:0/1105161891 learned_addr learned my addr 172.21.15.117:0/1105161891 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:38.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.611+0000 7fc6dbfff640 1 --2- 172.21.15.117:0/1105161891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6dc0d0790 0x7fc6dc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:38.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.611+0000 7fc6e0fe1640 1 --2- 172.21.15.117:0/1105161891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6dc09b100 0x7fc6dc158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:38.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.611+0000 7fc6e17e2640 1 -- 172.21.15.117:0/1105161891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6dc09b100 msgr2=0x7fc6dc158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:38.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.611+0000 7fc6e17e2640 1 --2- 172.21.15.117:0/1105161891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6dc09b100 0x7fc6dc158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.611+0000 7fc6e17e2640 1 -- 172.21.15.117:0/1105161891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6dc0d0790 msgr2=0x7fc6dc0709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:38.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.611+0000 7fc6e17e2640 1 --2- 172.21.15.117:0/1105161891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6dc0d0790 0x7fc6dc0709e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.611+0000 7fc6e17e2640 1 -- 172.21.15.117:0/1105161891 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6dc071150 con 0x7fc6dc15c3c0 2024-09-19T08:38:38.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.611+0000 7fc6e17e2640 1 --2- 172.21.15.117:0/1105161891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6dc15c3c0 0x7fc6dc09c2c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400c760 tx=0x7fc6d400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:38.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.611+0000 7fc6d97fa640 1 -- 172.21.15.117:0/1105161891 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4003b70 con 0x7fc6dc15c3c0 2024-09-19T08:38:38.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.611+0000 7fc6d97fa640 1 -- 172.21.15.117:0/1105161891 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d4003d10 con 0x7fc6dc15c3c0 2024-09-19T08:38:38.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.612+0000 7fc6e3245640 1 -- 172.21.15.117:0/1105161891 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6dc071430 con 0x7fc6dc15c3c0 2024-09-19T08:38:38.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.612+0000 7fc6d97fa640 1 -- 172.21.15.117:0/1105161891 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d400aa90 con 0x7fc6dc15c3c0 2024-09-19T08:38:38.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.612+0000 7fc6e3245640 1 -- 172.21.15.117:0/1105161891 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6dc0ca5a0 con 0x7fc6dc15c3c0 2024-09-19T08:38:38.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.612+0000 7fc6e3245640 1 -- 172.21.15.117:0/1105161891 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6dc0cddf0 con 0x7fc6dc15c3c0 2024-09-19T08:38:38.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.613+0000 7fc6d97fa640 1 -- 172.21.15.117:0/1105161891 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc6d400ac30 con 0x7fc6dc15c3c0 2024-09-19T08:38:38.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.613+0000 7fc6d97fa640 1 --2- 172.21.15.117:0/1105161891 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc6c006c2b0 0x7fc6c006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:38.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.613+0000 7fc6d97fa640 1 -- 172.21.15.117:0/1105161891 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fc6d408b290 con 0x7fc6dc15c3c0 2024-09-19T08:38:38.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.614+0000 7fc6e0fe1640 1 --2- 172.21.15.117:0/1105161891 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc6c006c2b0 0x7fc6c006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:38.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.614+0000 7fc6e0fe1640 1 --2- 172.21.15.117:0/1105161891 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc6c006c2b0 0x7fc6c006e770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0034000 tx=0x7fc6d002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:38.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.618+0000 7fc6d97fa640 1 -- 172.21.15.117:0/1105161891 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc6d4059220 con 0x7fc6dc15c3c0 2024-09-19T08:38:38.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.817+0000 7fc6e3245640 1 -- 172.21.15.117:0/1105161891 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6dc0ca770 con 0x7fc6dc15c3c0 2024-09-19T08:38:38.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.818+0000 7fc6d97fa640 1 -- 172.21.15.117:0/1105161891 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5235 (secure 0 0 0) 0x7fc6d405d520 con 0x7fc6dc15c3c0 2024-09-19T08:38:38.818 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:38.818 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":16,"btime":"2024-09-19T08:38:09:528263+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4595,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2240250216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2240250216},{"type":"v1","addr":"172.21.15.146:6836","nonce":2240250216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2165679820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2165679820},{"type":"v1","addr":"172.21.15.117:6834","nonce":2165679820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2737032516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2737032516},{"type":"v1","addr":"172.21.15.117:6835","nonce":2737032516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:38:06.852720+0000","modified":"2024-09-19T08:38:08.856085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/3614861409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":3614861409},{"type":"v1","addr":"172.21.15.146:6837","nonce":3614861409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4926,"qdb_cluster":[4926]},"id":2}]} 2024-09-19T08:38:38.819 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 16 2024-09-19T08:38:38.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.820+0000 7fc6e3245640 1 -- 172.21.15.117:0/1105161891 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc6c006c2b0 msgr2=0x7fc6c006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:38.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.820+0000 7fc6e3245640 1 --2- 172.21.15.117:0/1105161891 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc6c006c2b0 0x7fc6c006e770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0034000 tx=0x7fc6d002e000 comp rx=0 tx=0).stop 2024-09-19T08:38:38.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.820+0000 7fc6e3245640 1 -- 172.21.15.117:0/1105161891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6dc15c3c0 msgr2=0x7fc6dc09c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:38.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.820+0000 7fc6e3245640 1 --2- 172.21.15.117:0/1105161891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6dc15c3c0 0x7fc6dc09c2c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400c760 tx=0x7fc6d400cc20 comp rx=0 tx=0).stop 2024-09-19T08:38:38.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.820+0000 7fc6e3245640 1 -- 172.21.15.117:0/1105161891 shutdown_connections 2024-09-19T08:38:38.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.820+0000 7fc6e3245640 1 --2- 172.21.15.117:0/1105161891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6dc15c3c0 0x7fc6dc09c2c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.820+0000 7fc6e3245640 1 --2- 172.21.15.117:0/1105161891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6dc0d0790 0x7fc6dc0709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.820+0000 7fc6e3245640 1 --2- 172.21.15.117:0/1105161891 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc6c006c2b0 0x7fc6c006e770 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.820+0000 7fc6e3245640 1 --2- 172.21.15.117:0/1105161891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6dc09b100 0x7fc6dc158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.820+0000 7fc6e3245640 1 -- 172.21.15.117:0/1105161891 >> 172.21.15.117:0/1105161891 conn(0x7fc6dc0b3ca0 msgr2=0x7fc6dc0b5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:38.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.820+0000 7fc6e3245640 1 -- 172.21.15.117:0/1105161891 shutdown_connections 2024-09-19T08:38:38.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.820+0000 7fc6e3245640 1 -- 172.21.15.117:0/1105161891 wait complete. 2024-09-19T08:38:38.831 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:38:38.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.929+0000 7fcfa7f8d640 1 Processor -- start 2024-09-19T08:38:38.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.929+0000 7fcfa7f8d640 1 -- start start 2024-09-19T08:38:38.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.930+0000 7fcfa7f8d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcfa006f9e0 0x7fcfa00d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:38.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.930+0000 7fcfa7f8d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfa00d0e00 con 0x7fcfa015b120 2024-09-19T08:38:38.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.930+0000 7fcfa7f8d640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfa015b500 con 0x7fcfa00d09f0 2024-09-19T08:38:38.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.930+0000 7fcfa7f8d640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fcfa006e940 con 0x7fcfa006f9e0 2024-09-19T08:38:38.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.930+0000 7fcfa5d29640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fcfa015b120 0x7fcfa006dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:49868/0 (socket says 172.21.15.117:49868) 2024-09-19T08:38:38.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.930+0000 7fcfa5d29640 1 -- 172.21.15.117:0/1794223896 learned_addr learned my addr 172.21.15.117:0/1794223896 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:38.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.930+0000 7fcfa4d27640 1 -- 172.21.15.117:0/1794223896 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 968787182 0 0) 0x7fcf9c001110 con 0x7fcfa015b120 2024-09-19T08:38:38.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.930+0000 7fcfa5528640 1 --2- 172.21.15.117:0/1794223896 >> v2:172.21.15.146:3300/0 conn(0x7fcfa006f9e0 0x7fcfa00d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:38.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.930+0000 7fcfa4d27640 1 -- 172.21.15.117:0/1794223896 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf8c003520 con 0x7fcfa015b120 2024-09-19T08:38:38.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa4d27640 1 -- 172.21.15.117:0/1794223896 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1961523048 0 0) 0x7fcf8c003520 con 0x7fcfa015b120 2024-09-19T08:38:38.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa4d27640 1 -- 172.21.15.117:0/1794223896 >> v2:172.21.15.146:3300/0 conn(0x7fcfa006f9e0 msgr2=0x7fcfa00d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:38.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa4d27640 1 --2- 172.21.15.117:0/1794223896 >> v2:172.21.15.146:3300/0 conn(0x7fcfa006f9e0 0x7fcfa00d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa4d27640 1 -- 172.21.15.117:0/1794223896 >> v1:172.21.15.146:6789/0 conn(0x7fcfa00d09f0 legacy=0x7fcfa00c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:38.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa4d27640 1 -- 172.21.15.117:0/1794223896 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa006ec20 con 0x7fcfa015b120 2024-09-19T08:38:38.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa4d27640 1 -- 172.21.15.117:0/1794223896 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7fcf9c001840 con 0x7fcfa015b120 2024-09-19T08:38:38.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa4d27640 1 -- 172.21.15.117:0/1794223896 >> v1:172.21.15.117:6789/0 conn(0x7fcfa015b120 legacy=0x7fcfa006dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:38.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa4d27640 1 --2- 172.21.15.117:0/1794223896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c0039b0 0x7fcf8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:38.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa4d27640 1 --2- 172.21.15.117:0/1794223896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf8c004800 0x7fcf8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:38.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa4d27640 1 --2- 172.21.15.117:0/1794223896 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf8c0051c0 0x7fcf8c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:38.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa4d27640 1 -- 172.21.15.117:0/1794223896 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa006e940 con 0x7fcf8c0039b0 2024-09-19T08:38:38.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa4d27640 1 -- 172.21.15.117:0/1794223896 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8c00c060 con 0x7fcf8c004800 2024-09-19T08:38:38.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa4d27640 1 -- 172.21.15.117:0/1794223896 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fcf8c00c260 con 0x7fcf8c0051c0 2024-09-19T08:38:38.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa5d29640 1 --2- 172.21.15.117:0/1794223896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c0039b0 0x7fcf8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:38.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa5528640 1 --2- 172.21.15.117:0/1794223896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf8c004800 0x7fcf8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:38.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa652a640 1 --2- 172.21.15.117:0/1794223896 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf8c0051c0 0x7fcf8c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:38.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa5d29640 1 -- 172.21.15.117:0/1794223896 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf8c0051c0 msgr2=0x7fcf8c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:38.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa5d29640 1 --2- 172.21.15.117:0/1794223896 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf8c0051c0 0x7fcf8c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa5d29640 1 -- 172.21.15.117:0/1794223896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf8c004800 msgr2=0x7fcf8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:38.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa5d29640 1 --2- 172.21.15.117:0/1794223896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf8c004800 0x7fcf8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa5d29640 1 -- 172.21.15.117:0/1794223896 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf8c003520 con 0x7fcf8c0039b0 2024-09-19T08:38:38.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa652a640 1 --2- 172.21.15.117:0/1794223896 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf8c0051c0 0x7fcf8c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:38.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa5528640 1 --2- 172.21.15.117:0/1794223896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf8c004800 0x7fcf8c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:38.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.931+0000 7fcfa652a640 1 -- 172.21.15.117:0/1794223896 reap_dead start 2024-09-19T08:38:38.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.932+0000 7fcfa5d29640 1 --2- 172.21.15.117:0/1794223896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c0039b0 0x7fcf8c003dd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00c4c0 tx=0x7fcf8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d594a2c4cc6722 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:38.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.932+0000 7fcfa4d27640 1 -- 172.21.15.117:0/1794223896 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c00c0e0 con 0x7fcf8c0039b0 2024-09-19T08:38:38.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.932+0000 7fcfa4d27640 1 -- 172.21.15.117:0/1794223896 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf9c034070 con 0x7fcf8c0039b0 2024-09-19T08:38:38.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.932+0000 7fcfa4d27640 1 -- 172.21.15.117:0/1794223896 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c005d70 con 0x7fcf8c0039b0 2024-09-19T08:38:38.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.932+0000 7fcfa7f8d640 1 -- 172.21.15.117:0/1794223896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c0039b0 msgr2=0x7fcf8c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:38.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.933+0000 7fcfa7f8d640 1 --2- 172.21.15.117:0/1794223896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c0039b0 0x7fcf8c003dd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00c4c0 tx=0x7fcf8c005830 comp rx=0 tx=0).stop 2024-09-19T08:38:38.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.933+0000 7fcfa7f8d640 1 -- 172.21.15.117:0/1794223896 shutdown_connections 2024-09-19T08:38:38.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.933+0000 7fcfa7f8d640 1 --2- 172.21.15.117:0/1794223896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c0039b0 0x7fcf8c003dd0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.933+0000 7fcfa7f8d640 1 -- 172.21.15.117:0/1794223896 >> 172.21.15.117:0/1794223896 conn(0x7fcfa006bdf0 msgr2=0x7fcfa006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:38.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.933+0000 7fcfa7f8d640 1 -- 172.21.15.117:0/1794223896 shutdown_connections 2024-09-19T08:38:38.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.933+0000 7fcfa7f8d640 1 -- 172.21.15.117:0/1794223896 wait complete. 2024-09-19T08:38:38.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.934+0000 7fcfa7f8d640 1 Processor -- start 2024-09-19T08:38:38.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.934+0000 7fcfa7f8d640 1 -- start start 2024-09-19T08:38:38.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.934+0000 7fcfa7f8d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c0039b0 0x7fcfa00adb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:38.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.934+0000 7fcfa7f8d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfa00998b0 0x7fcfa00cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:38.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.934+0000 7fcfa7f8d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfa00cbe30 0x7fcfa00c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:38.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.934+0000 7fcfa7f8d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa006f4c0 con 0x7fcf8c0039b0 2024-09-19T08:38:38.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.934+0000 7fcfa7f8d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa006f1e0 con 0x7fcfa00cbe30 2024-09-19T08:38:38.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.934+0000 7fcfa7f8d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fcfa00ce060 con 0x7fcfa00998b0 2024-09-19T08:38:38.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.935+0000 7fcfa5d29640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c0039b0 0x7fcfa00adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:38.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.935+0000 7fcfa5d29640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c0039b0 0x7fcfa00adb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50560/0 (socket says 172.21.15.117:50560) 2024-09-19T08:38:38.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.935+0000 7fcfa5d29640 1 -- 172.21.15.117:0/3780197905 learned_addr learned my addr 172.21.15.117:0/3780197905 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:38.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.935+0000 7fcfa5528640 1 --2- 172.21.15.117:0/3780197905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfa00998b0 0x7fcfa00cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:38.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.935+0000 7fcfa5d29640 1 -- 172.21.15.117:0/3780197905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfa00998b0 msgr2=0x7fcfa00cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:38.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.935+0000 7fcfa5d29640 1 --2- 172.21.15.117:0/3780197905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfa00998b0 0x7fcfa00cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.935+0000 7fcfa5d29640 1 -- 172.21.15.117:0/3780197905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfa00cbe30 msgr2=0x7fcfa00c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:38.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.935+0000 7fcfa5d29640 1 --2- 172.21.15.117:0/3780197905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfa00cbe30 0x7fcfa00c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:38.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.935+0000 7fcfa5d29640 1 -- 172.21.15.117:0/3780197905 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa00aea00 con 0x7fcf8c0039b0 2024-09-19T08:38:38.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.935+0000 7fcfa5d29640 1 --2- 172.21.15.117:0/3780197905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c0039b0 0x7fcfa00adb20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00c4c0 tx=0x7fcfa006edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:38.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.935+0000 7fcf967fc640 1 -- 172.21.15.117:0/3780197905 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c007480 con 0x7fcf8c0039b0 2024-09-19T08:38:38.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.935+0000 7fcf967fc640 1 -- 172.21.15.117:0/3780197905 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf9c03f030 con 0x7fcf8c0039b0 2024-09-19T08:38:38.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.935+0000 7fcfa7f8d640 1 -- 172.21.15.117:0/3780197905 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfa00c8d30 con 0x7fcf8c0039b0 2024-09-19T08:38:38.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.935+0000 7fcf967fc640 1 -- 172.21.15.117:0/3780197905 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c000ed0 con 0x7fcf8c0039b0 2024-09-19T08:38:38.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.935+0000 7fcfa7f8d640 1 -- 172.21.15.117:0/3780197905 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfa00c92f0 con 0x7fcf8c0039b0 2024-09-19T08:38:38.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.936+0000 7fcfa7f8d640 1 -- 172.21.15.117:0/3780197905 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfa00cc250 con 0x7fcf8c0039b0 2024-09-19T08:38:38.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.937+0000 7fcf967fc640 1 -- 172.21.15.117:0/3780197905 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcf9c02f460 con 0x7fcf8c0039b0 2024-09-19T08:38:38.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.937+0000 7fcf967fc640 1 --2- 172.21.15.117:0/3780197905 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf8406c450 0x7fcf8406e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:38.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.937+0000 7fcf967fc640 1 -- 172.21.15.117:0/3780197905 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fcf9c0abf40 con 0x7fcf8c0039b0 2024-09-19T08:38:38.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.937+0000 7fcfa5528640 1 --2- 172.21.15.117:0/3780197905 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf8406c450 0x7fcf8406e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:38.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.938+0000 7fcfa5528640 1 --2- 172.21.15.117:0/3780197905 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf8406c450 0x7fcf8406e910 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00700b0 tx=0x7fcf90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:38.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:38.941+0000 7fcf967fc640 1 -- 172.21.15.117:0/3780197905 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcf9c049030 con 0x7fcf8c0039b0 2024-09-19T08:38:39.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.141+0000 7fcfa7f8d640 1 -- 172.21.15.117:0/3780197905 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcfa00cdb60 con 0x7fcf8c0039b0 2024-09-19T08:38:39.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.142+0000 7fcf967fc640 1 -- 172.21.15.117:0/3780197905 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5235 (secure 0 0 0) 0x7fcfa00d0e00 con 0x7fcf8c0039b0 2024-09-19T08:38:39.142 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:39.142 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":16,"btime":"2024-09-19T08:38:09:528263+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4595,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2240250216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2240250216},{"type":"v1","addr":"172.21.15.146:6836","nonce":2240250216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2165679820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2165679820},{"type":"v1","addr":"172.21.15.117:6834","nonce":2165679820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2737032516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2737032516},{"type":"v1","addr":"172.21.15.117:6835","nonce":2737032516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:38:06.852720+0000","modified":"2024-09-19T08:38:08.856085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/3614861409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":3614861409},{"type":"v1","addr":"172.21.15.146:6837","nonce":3614861409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4926,"qdb_cluster":[4926]},"id":2}]} 2024-09-19T08:38:39.142 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 16 2024-09-19T08:38:39.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.144+0000 7fcfa7f8d640 1 -- 172.21.15.117:0/3780197905 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf8406c450 msgr2=0x7fcf8406e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:39.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.144+0000 7fcfa7f8d640 1 --2- 172.21.15.117:0/3780197905 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf8406c450 0x7fcf8406e910 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00700b0 tx=0x7fcf90008040 comp rx=0 tx=0).stop 2024-09-19T08:38:39.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.144+0000 7fcfa7f8d640 1 -- 172.21.15.117:0/3780197905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c0039b0 msgr2=0x7fcfa00adb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:39.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.144+0000 7fcfa7f8d640 1 --2- 172.21.15.117:0/3780197905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c0039b0 0x7fcfa00adb20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00c4c0 tx=0x7fcfa006edf0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.144+0000 7fcfa7f8d640 1 -- 172.21.15.117:0/3780197905 shutdown_connections 2024-09-19T08:38:39.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.144+0000 7fcfa7f8d640 1 --2- 172.21.15.117:0/3780197905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfa00cbe30 0x7fcfa00c7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.144+0000 7fcfa7f8d640 1 --2- 172.21.15.117:0/3780197905 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf8406c450 0x7fcf8406e910 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.144+0000 7fcfa7f8d640 1 --2- 172.21.15.117:0/3780197905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfa00998b0 0x7fcfa00cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.144+0000 7fcfa7f8d640 1 --2- 172.21.15.117:0/3780197905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c0039b0 0x7fcfa00adb20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.144+0000 7fcfa7f8d640 1 -- 172.21.15.117:0/3780197905 >> 172.21.15.117:0/3780197905 conn(0x7fcfa006bdf0 msgr2=0x7fcfa014d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:39.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.144+0000 7fcfa7f8d640 1 -- 172.21.15.117:0/3780197905 shutdown_connections 2024-09-19T08:38:39.145 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.144+0000 7fcfa7f8d640 1 -- 172.21.15.117:0/3780197905 wait complete. 2024-09-19T08:38:39.154 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:38:39.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.252+0000 7fb9e5847640 1 Processor -- start 2024-09-19T08:38:39.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.252+0000 7fb9e5847640 1 -- start start 2024-09-19T08:38:39.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.253+0000 7fb9e5847640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9e006d580 0x7fb9e0141b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:39.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.253+0000 7fb9e5847640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb9e00d2130 0x7fb9e00d2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:39.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.253+0000 7fb9e5847640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9e00d2ac0 con 0x7fb9e0141470 2024-09-19T08:38:39.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.253+0000 7fb9e5847640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb9e0161f10 con 0x7fb9e00d2130 2024-09-19T08:38:39.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.253+0000 7fb9e5847640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e0141850 con 0x7fb9e006d580 2024-09-19T08:38:39.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.253+0000 7fb9df7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb9e00d2130 0x7fb9e00d2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:39.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.253+0000 7fb9df7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb9e00d2130 0x7fb9e00d2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50572/0 (socket says 172.21.15.117:50572) 2024-09-19T08:38:39.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.253+0000 7fb9df7fe640 1 -- 172.21.15.117:0/3713772663 learned_addr learned my addr 172.21.15.117:0/3713772663 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:39.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.254+0000 7fb9de7fc640 1 --2- 172.21.15.117:0/3713772663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9e006d580 0x7fb9e0141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:39.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.254+0000 7fb9df7fe640 1 -- 172.21.15.117:0/3713772663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9e006d580 msgr2=0x7fb9e0141b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:39.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.254+0000 7fb9df7fe640 1 --2- 172.21.15.117:0/3713772663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9e006d580 0x7fb9e0141b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.254+0000 7fb9df7fe640 1 -- 172.21.15.117:0/3713772663 >> v1:172.21.15.146:6789/0 conn(0x7fb9e0141470 legacy=0x7fb9e006ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:39.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.254+0000 7fb9df7fe640 1 -- 172.21.15.117:0/3713772663 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e01621b0 con 0x7fb9e00d2130 2024-09-19T08:38:39.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.254+0000 7fb9df7fe640 1 --2- 172.21.15.117:0/3713772663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9e00d2130 0x7fb9e00d2580 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009870 tx=0x7fb9d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a06c081ba77f0fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:39.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.255+0000 7fb9ddffb640 1 -- 172.21.15.117:0/3713772663 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8037070 con 0x7fb9e00d2130 2024-09-19T08:38:39.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.255+0000 7fb9ddffb640 1 -- 172.21.15.117:0/3713772663 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d8032440 con 0x7fb9e00d2130 2024-09-19T08:38:39.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.255+0000 7fb9ddffb640 1 -- 172.21.15.117:0/3713772663 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8032810 con 0x7fb9e00d2130 2024-09-19T08:38:39.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.255+0000 7fb9e5847640 1 -- 172.21.15.117:0/3713772663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9e00d2130 msgr2=0x7fb9e00d2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:39.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.255+0000 7fb9e5847640 1 --2- 172.21.15.117:0/3713772663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9e00d2130 0x7fb9e00d2580 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009870 tx=0x7fb9d802a270 comp rx=0 tx=0).stop 2024-09-19T08:38:39.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.255+0000 7fb9e5847640 1 -- 172.21.15.117:0/3713772663 shutdown_connections 2024-09-19T08:38:39.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.255+0000 7fb9e5847640 1 --2- 172.21.15.117:0/3713772663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9e00d2130 0x7fb9e00d2580 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.255+0000 7fb9e5847640 1 --2- 172.21.15.117:0/3713772663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9e006d580 0x7fb9e0141b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.255+0000 7fb9e5847640 1 -- 172.21.15.117:0/3713772663 >> 172.21.15.117:0/3713772663 conn(0x7fb9e00b4040 msgr2=0x7fb9e00b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:39.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.255+0000 7fb9e5847640 1 -- 172.21.15.117:0/3713772663 shutdown_connections 2024-09-19T08:38:39.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.255+0000 7fb9e5847640 1 -- 172.21.15.117:0/3713772663 wait complete. 2024-09-19T08:38:39.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.256+0000 7fb9e5847640 1 Processor -- start 2024-09-19T08:38:39.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.257+0000 7fb9e5847640 1 -- start start 2024-09-19T08:38:39.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.257+0000 7fb9e5847640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9e006d580 0x7fb9e01f8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:39.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.257+0000 7fb9e5847640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9e00d2130 0x7fb9e0142820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:39.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.257+0000 7fb9e5847640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e0141470 0x7fb9e0147220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:39.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.257+0000 7fb9e5847640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0162a50 con 0x7fb9e00d2130 2024-09-19T08:38:39.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.257+0000 7fb9e5847640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0162770 con 0x7fb9e0141470 2024-09-19T08:38:39.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.257+0000 7fb9e5847640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e0162d30 con 0x7fb9e006d580 2024-09-19T08:38:39.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.257+0000 7fb9de7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9e00d2130 0x7fb9e0142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:39.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.257+0000 7fb9de7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9e00d2130 0x7fb9e0142820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50576/0 (socket says 172.21.15.117:50576) 2024-09-19T08:38:39.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.257+0000 7fb9de7fc640 1 -- 172.21.15.117:0/2258801383 learned_addr learned my addr 172.21.15.117:0/2258801383 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:39.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.257+0000 7fb9deffd640 1 --2- 172.21.15.117:0/2258801383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9e006d580 0x7fb9e01f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:39.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.257+0000 7fb9df7fe640 1 --2- 172.21.15.117:0/2258801383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e0141470 0x7fb9e0147220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:39.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.258+0000 7fb9de7fc640 1 -- 172.21.15.117:0/2258801383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9e006d580 msgr2=0x7fb9e01f8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:39.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.258+0000 7fb9de7fc640 1 --2- 172.21.15.117:0/2258801383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9e006d580 0x7fb9e01f8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.258+0000 7fb9de7fc640 1 -- 172.21.15.117:0/2258801383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e0141470 msgr2=0x7fb9e0147220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:39.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.258+0000 7fb9de7fc640 1 --2- 172.21.15.117:0/2258801383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e0141470 0x7fb9e0147220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.258+0000 7fb9de7fc640 1 -- 172.21.15.117:0/2258801383 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e00b6060 con 0x7fb9e00d2130 2024-09-19T08:38:39.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.258+0000 7fb9de7fc640 1 --2- 172.21.15.117:0/2258801383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9e00d2130 0x7fb9e0142820 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400e9e0 tx=0x7fb9d400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:39.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.258+0000 7fb9c7fff640 1 -- 172.21.15.117:0/2258801383 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4017070 con 0x7fb9e00d2130 2024-09-19T08:38:39.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.258+0000 7fb9c7fff640 1 -- 172.21.15.117:0/2258801383 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d400c9d0 con 0x7fb9e00d2130 2024-09-19T08:38:39.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.258+0000 7fb9e5847640 1 -- 172.21.15.117:0/2258801383 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e00b6340 con 0x7fb9e00d2130 2024-09-19T08:38:39.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.258+0000 7fb9c7fff640 1 -- 172.21.15.117:0/2258801383 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d400cdc0 con 0x7fb9e00d2130 2024-09-19T08:38:39.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.258+0000 7fb9e5847640 1 -- 172.21.15.117:0/2258801383 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e0142d60 con 0x7fb9e00d2130 2024-09-19T08:38:39.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.259+0000 7fb9e5847640 1 -- 172.21.15.117:0/2258801383 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e0141b70 con 0x7fb9e00d2130 2024-09-19T08:38:39.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.259+0000 7fb9c7fff640 1 -- 172.21.15.117:0/2258801383 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb9d401a070 con 0x7fb9e00d2130 2024-09-19T08:38:39.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.260+0000 7fb9c7fff640 1 --2- 172.21.15.117:0/2258801383 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb9cc06c2b0 0x7fb9cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:39.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.260+0000 7fb9c7fff640 1 -- 172.21.15.117:0/2258801383 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fb9d408b8c0 con 0x7fb9e00d2130 2024-09-19T08:38:39.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.260+0000 7fb9deffd640 1 --2- 172.21.15.117:0/2258801383 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb9cc06c2b0 0x7fb9cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:39.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.260+0000 7fb9deffd640 1 --2- 172.21.15.117:0/2258801383 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb9cc06c2b0 0x7fb9cc06e770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0001e70 tx=0x7fb9d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:39.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.264+0000 7fb9c7fff640 1 -- 172.21.15.117:0/2258801383 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb9d4059850 con 0x7fb9e00d2130 2024-09-19T08:38:39.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.431+0000 7fb9e5847640 1 -- 172.21.15.117:0/2258801383 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9e00d19d0 con 0x7fb9e00d2130 2024-09-19T08:38:39.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.432+0000 7fb9c7fff640 1 -- 172.21.15.117:0/2258801383 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17050 (secure 0 0 0) 0x7fb9d405db50 con 0x7fb9e00d2130 2024-09-19T08:38:39.432 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:39.432 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":40,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:38:08.520988+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:38:04.617092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-19T08:38:05.827922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:38:39.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.434+0000 7fb9e5847640 1 -- 172.21.15.117:0/2258801383 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb9cc06c2b0 msgr2=0x7fb9cc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:39.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.434+0000 7fb9e5847640 1 --2- 172.21.15.117:0/2258801383 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb9cc06c2b0 0x7fb9cc06e770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0001e70 tx=0x7fb9d0009040 comp rx=0 tx=0).stop 2024-09-19T08:38:39.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.434+0000 7fb9e5847640 1 -- 172.21.15.117:0/2258801383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9e00d2130 msgr2=0x7fb9e0142820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:39.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.434+0000 7fb9e5847640 1 --2- 172.21.15.117:0/2258801383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9e00d2130 0x7fb9e0142820 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400e9e0 tx=0x7fb9d400eea0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.434+0000 7fb9e5847640 1 -- 172.21.15.117:0/2258801383 shutdown_connections 2024-09-19T08:38:39.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.434+0000 7fb9e5847640 1 --2- 172.21.15.117:0/2258801383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e0141470 0x7fb9e0147220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.434+0000 7fb9e5847640 1 --2- 172.21.15.117:0/2258801383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9e00d2130 0x7fb9e0142820 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.434+0000 7fb9e5847640 1 --2- 172.21.15.117:0/2258801383 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb9cc06c2b0 0x7fb9cc06e770 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.434+0000 7fb9e5847640 1 --2- 172.21.15.117:0/2258801383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9e006d580 0x7fb9e01f8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.434+0000 7fb9e5847640 1 -- 172.21.15.117:0/2258801383 >> 172.21.15.117:0/2258801383 conn(0x7fb9e00b4040 msgr2=0x7fb9e00b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:39.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.434+0000 7fb9e5847640 1 -- 172.21.15.117:0/2258801383 shutdown_connections 2024-09-19T08:38:39.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.434+0000 7fb9e5847640 1 -- 172.21.15.117:0/2258801383 wait complete. 2024-09-19T08:38:39.445 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T08:38:39.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.546+0000 7fcf6440a640 1 Processor -- start 2024-09-19T08:38:39.546 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.546+0000 7fcf6440a640 1 -- start start 2024-09-19T08:38:39.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.547+0000 7fcf6440a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf5c15f0d0 0x7fcf5c15f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:39.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.547+0000 7fcf6440a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcf5c0d4130 0x7fcf5c0d45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:39.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.547+0000 7fcf6440a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf5c0d4b20 con 0x7fcf5c0d0070 2024-09-19T08:38:39.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.547+0000 7fcf6440a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fcf5c0d1b10 con 0x7fcf5c0d4130 2024-09-19T08:38:39.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.547+0000 7fcf6440a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5c0cf2b0 con 0x7fcf5c15f0d0 2024-09-19T08:38:39.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.547+0000 7fcf629a7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcf5c0d4130 0x7fcf5c0d45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:39.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.547+0000 7fcf629a7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcf5c0d4130 0x7fcf5c0d45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50590/0 (socket says 172.21.15.117:50590) 2024-09-19T08:38:39.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.547+0000 7fcf629a7640 1 -- 172.21.15.117:0/1697123833 learned_addr learned my addr 172.21.15.117:0/1697123833 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:39.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.547+0000 7fcf621a6640 1 --2- 172.21.15.117:0/1697123833 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf5c15f0d0 0x7fcf5c15f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:39.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.547+0000 7fcf629a7640 1 -- 172.21.15.117:0/1697123833 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf5c15f0d0 msgr2=0x7fcf5c15f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:39.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.547+0000 7fcf629a7640 1 --2- 172.21.15.117:0/1697123833 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf5c15f0d0 0x7fcf5c15f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.547+0000 7fcf629a7640 1 -- 172.21.15.117:0/1697123833 >> v1:172.21.15.146:6789/0 conn(0x7fcf5c0d0070 legacy=0x7fcf5c0d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:39.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.547+0000 7fcf629a7640 1 -- 172.21.15.117:0/1697123833 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5c0cf590 con 0x7fcf5c0d4130 2024-09-19T08:38:39.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.548+0000 7fcf629a7640 1 --2- 172.21.15.117:0/1697123833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c0d4130 0x7fcf5c0d45e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c0d2fc0 tx=0x7fcf4c02a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca04aa04c882019 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:39.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.548+0000 7fcf611a4640 1 -- 172.21.15.117:0/1697123833 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c037070 con 0x7fcf5c0d4130 2024-09-19T08:38:39.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.548+0000 7fcf611a4640 1 -- 172.21.15.117:0/1697123833 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf4c032440 con 0x7fcf5c0d4130 2024-09-19T08:38:39.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.548+0000 7fcf611a4640 1 -- 172.21.15.117:0/1697123833 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c032810 con 0x7fcf5c0d4130 2024-09-19T08:38:39.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.549+0000 7fcf6440a640 1 -- 172.21.15.117:0/1697123833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c0d4130 msgr2=0x7fcf5c0d45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:39.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.549+0000 7fcf6440a640 1 --2- 172.21.15.117:0/1697123833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c0d4130 0x7fcf5c0d45e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c0d2fc0 tx=0x7fcf4c02a160 comp rx=0 tx=0).stop 2024-09-19T08:38:39.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.549+0000 7fcf6440a640 1 -- 172.21.15.117:0/1697123833 shutdown_connections 2024-09-19T08:38:39.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.549+0000 7fcf6440a640 1 --2- 172.21.15.117:0/1697123833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c0d4130 0x7fcf5c0d45e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.549+0000 7fcf6440a640 1 --2- 172.21.15.117:0/1697123833 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf5c15f0d0 0x7fcf5c15f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.549+0000 7fcf6440a640 1 -- 172.21.15.117:0/1697123833 >> 172.21.15.117:0/1697123833 conn(0x7fcf5c09d760 msgr2=0x7fcf5c08bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:39.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.549+0000 7fcf6440a640 1 -- 172.21.15.117:0/1697123833 shutdown_connections 2024-09-19T08:38:39.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.549+0000 7fcf6440a640 1 -- 172.21.15.117:0/1697123833 wait complete. 2024-09-19T08:38:39.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.550+0000 7fcf6440a640 1 Processor -- start 2024-09-19T08:38:39.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.550+0000 7fcf6440a640 1 -- start start 2024-09-19T08:38:39.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf6440a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf5c0d0070 0x7fcf5c0b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:39.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf6440a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf5c0d4130 0x7fcf5c0cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:39.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf6440a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c15f0d0 0x7fcf5c14d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:39.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf6440a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c0cef60 con 0x7fcf5c15f0d0 2024-09-19T08:38:39.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf6440a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c0cfb50 con 0x7fcf5c0d4130 2024-09-19T08:38:39.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf6440a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5c0b2f70 con 0x7fcf5c0d0070 2024-09-19T08:38:39.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf629a7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c15f0d0 0x7fcf5c14d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:39.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf629a7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c15f0d0 0x7fcf5c14d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50604/0 (socket says 172.21.15.117:50604) 2024-09-19T08:38:39.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf629a7640 1 -- 172.21.15.117:0/2373405022 learned_addr learned my addr 172.21.15.117:0/2373405022 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:39.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf621a6640 1 --2- 172.21.15.117:0/2373405022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf5c0d0070 0x7fcf5c0b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:39.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf619a5640 1 --2- 172.21.15.117:0/2373405022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf5c0d4130 0x7fcf5c0cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:39.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf629a7640 1 -- 172.21.15.117:0/2373405022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf5c0d0070 msgr2=0x7fcf5c0b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:39.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf629a7640 1 --2- 172.21.15.117:0/2373405022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf5c0d0070 0x7fcf5c0b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf629a7640 1 -- 172.21.15.117:0/2373405022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf5c0d4130 msgr2=0x7fcf5c0cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:39.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf629a7640 1 --2- 172.21.15.117:0/2373405022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf5c0d4130 0x7fcf5c0cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf629a7640 1 -- 172.21.15.117:0/2373405022 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5c0b3c20 con 0x7fcf5c15f0d0 2024-09-19T08:38:39.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf629a7640 1 --2- 172.21.15.117:0/2373405022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c15f0d0 0x7fcf5c14d240 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0090b0 tx=0x7fcf4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:39.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf5affd640 1 -- 172.21.15.117:0/2373405022 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c041020 con 0x7fcf5c15f0d0 2024-09-19T08:38:39.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf5affd640 1 -- 172.21.15.117:0/2373405022 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf4c0306c0 con 0x7fcf5c15f0d0 2024-09-19T08:38:39.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf6440a640 1 -- 172.21.15.117:0/2373405022 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf5c0b3f00 con 0x7fcf5c15f0d0 2024-09-19T08:38:39.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf5affd640 1 -- 172.21.15.117:0/2373405022 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c037040 con 0x7fcf5c15f0d0 2024-09-19T08:38:39.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.551+0000 7fcf6440a640 1 -- 172.21.15.117:0/2373405022 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf5c0b44c0 con 0x7fcf5c15f0d0 2024-09-19T08:38:39.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.552+0000 7fcf6440a640 1 -- 172.21.15.117:0/2373405022 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf5c0d45e0 con 0x7fcf5c15f0d0 2024-09-19T08:38:39.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.553+0000 7fcf5affd640 1 -- 172.21.15.117:0/2373405022 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcf4c044020 con 0x7fcf5c15f0d0 2024-09-19T08:38:39.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.553+0000 7fcf5affd640 1 --2- 172.21.15.117:0/2373405022 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf4806c2b0 0x7fcf4806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:39.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.553+0000 7fcf5affd640 1 -- 172.21.15.117:0/2373405022 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fcf4c0abe00 con 0x7fcf5c15f0d0 2024-09-19T08:38:39.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.553+0000 7fcf621a6640 1 --2- 172.21.15.117:0/2373405022 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf4806c2b0 0x7fcf4806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:39.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.554+0000 7fcf621a6640 1 --2- 172.21.15.117:0/2373405022 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf4806c2b0 0x7fcf4806e770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcf54006fd0 tx=0x7fcf54008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:39.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.558+0000 7fcf5affd640 1 -- 172.21.15.117:0/2373405022 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcf4c04b030 con 0x7fcf5c15f0d0 2024-09-19T08:38:39.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.758+0000 7fcf6440a640 1 -- 172.21.15.117:0/2373405022 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fcf5c0b4cc0 con 0x7fcf5c15f0d0 2024-09-19T08:38:39.759 INFO:tasks.ceph.mon.a.smithi117.stderr:2024-09-19T08:38:39.759+0000 7f8064cfe640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:38:39.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.762+0000 7fcf5affd640 1 -- 172.21.15.117:0/2373405022 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7fcf5c0d4b20 con 0x7fcf5c15f0d0 2024-09-19T08:38:39.762 INFO:teuthology.orchestra.run.smithi117.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T08:38:39.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.764+0000 7fcf6440a640 1 -- 172.21.15.117:0/2373405022 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf4806c2b0 msgr2=0x7fcf4806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:39.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.764+0000 7fcf6440a640 1 --2- 172.21.15.117:0/2373405022 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf4806c2b0 0x7fcf4806e770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcf54006fd0 tx=0x7fcf54008040 comp rx=0 tx=0).stop 2024-09-19T08:38:39.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.764+0000 7fcf6440a640 1 -- 172.21.15.117:0/2373405022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c15f0d0 msgr2=0x7fcf5c14d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:39.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.764+0000 7fcf6440a640 1 --2- 172.21.15.117:0/2373405022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c15f0d0 0x7fcf5c14d240 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0090b0 tx=0x7fcf4c0046c0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.764+0000 7fcf6440a640 1 -- 172.21.15.117:0/2373405022 shutdown_connections 2024-09-19T08:38:39.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.764+0000 7fcf6440a640 1 --2- 172.21.15.117:0/2373405022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c15f0d0 0x7fcf5c14d240 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.764+0000 7fcf6440a640 1 --2- 172.21.15.117:0/2373405022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf5c0d4130 0x7fcf5c0cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.764+0000 7fcf6440a640 1 --2- 172.21.15.117:0/2373405022 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf4806c2b0 0x7fcf4806e770 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.764+0000 7fcf6440a640 1 --2- 172.21.15.117:0/2373405022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf5c0d0070 0x7fcf5c0b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.764+0000 7fcf6440a640 1 -- 172.21.15.117:0/2373405022 >> 172.21.15.117:0/2373405022 conn(0x7fcf5c09d760 msgr2=0x7fcf5c0b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:39.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.764+0000 7fcf6440a640 1 -- 172.21.15.117:0/2373405022 shutdown_connections 2024-09-19T08:38:39.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.764+0000 7fcf6440a640 1 -- 172.21.15.117:0/2373405022 wait complete. 2024-09-19T08:38:39.769 INFO:tasks.ceph.mds.b.smithi146.stderr: -5864> 2024-09-19T08:38:12.502+0000 7fa7110f5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T08:38:39.776 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T08:38:39.805 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2024-09-19T08:38:39.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.878+0000 7fc107c65640 1 Processor -- start 2024-09-19T08:38:39.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.879+0000 7fc107c65640 1 -- start start 2024-09-19T08:38:39.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.881+0000 7fc107c65640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc1000cd910 0x7fc1000cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:39.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.881+0000 7fc107c65640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1000707b0 con 0x7fc100070020 2024-09-19T08:38:39.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.881+0000 7fc107c65640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc100160140 con 0x7fc1000cdfd0 2024-09-19T08:38:39.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.881+0000 7fc107c65640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fc100070510 con 0x7fc1000cd910 2024-09-19T08:38:39.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.881+0000 7fc105200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc1000cd910 0x7fc1000cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:39.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.881+0000 7fc105200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc1000cd910 0x7fc1000cfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.117:34726/0 (socket says 172.21.15.117:34726) 2024-09-19T08:38:39.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.881+0000 7fc105200640 1 -- 172.21.15.117:0/2975349864 learned_addr learned my addr 172.21.15.117:0/2975349864 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:39.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.881+0000 7fc1049ff640 1 -- 172.21.15.117:0/2975349864 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1517661944 0 0) 0x7fc1000707b0 con 0x7fc100070020 2024-09-19T08:38:39.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.881+0000 7fc1049ff640 1 -- 172.21.15.117:0/2975349864 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0ec003520 con 0x7fc100070020 2024-09-19T08:38:39.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.881+0000 7fc105200640 1 -- 172.21.15.117:0/2975349864 >> v1:172.21.15.146:6789/0 conn(0x7fc1000cdfd0 legacy=0x7fc10015f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:39.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.881+0000 7fc105200640 1 -- 172.21.15.117:0/2975349864 >> v1:172.21.15.117:6789/0 conn(0x7fc100070020 legacy=0x7fc10015fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:39.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.881+0000 7fc1049ff640 1 -- 172.21.15.117:0/2975349864 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3756892318 0 0) 0x7fc100160140 con 0x7fc1000cdfd0 2024-09-19T08:38:39.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.881+0000 7fc105200640 1 -- 172.21.15.117:0/2975349864 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1000cba60 con 0x7fc1000cd910 2024-09-19T08:38:39.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.882+0000 7fc105200640 1 --2- 172.21.15.117:0/2975349864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1000cd910 0x7fc1000cfc20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009870 tx=0x7fc0f002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3575214e641f2c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:39.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.882+0000 7fc1049ff640 1 -- 172.21.15.117:0/2975349864 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0037070 con 0x7fc1000cd910 2024-09-19T08:38:39.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.882+0000 7fc1049ff640 1 -- 172.21.15.117:0/2975349864 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f002ae50 con 0x7fc1000cd910 2024-09-19T08:38:39.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.882+0000 7fc1049ff640 1 -- 172.21.15.117:0/2975349864 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0032860 con 0x7fc1000cd910 2024-09-19T08:38:39.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.883+0000 7fc107c65640 1 -- 172.21.15.117:0/2975349864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1000cd910 msgr2=0x7fc1000cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:39.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.883+0000 7fc107c65640 1 --2- 172.21.15.117:0/2975349864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1000cd910 0x7fc1000cfc20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009870 tx=0x7fc0f002a300 comp rx=0 tx=0).stop 2024-09-19T08:38:39.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.883+0000 7fc107c65640 1 -- 172.21.15.117:0/2975349864 shutdown_connections 2024-09-19T08:38:39.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.883+0000 7fc107c65640 1 --2- 172.21.15.117:0/2975349864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1000cd910 0x7fc1000cfc20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.883+0000 7fc107c65640 1 -- 172.21.15.117:0/2975349864 >> 172.21.15.117:0/2975349864 conn(0x7fc10009a9f0 msgr2=0x7fc1000b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:39.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.883+0000 7fc107c65640 1 -- 172.21.15.117:0/2975349864 shutdown_connections 2024-09-19T08:38:39.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.883+0000 7fc107c65640 1 -- 172.21.15.117:0/2975349864 wait complete. 2024-09-19T08:38:39.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.884+0000 7fc107c65640 1 Processor -- start 2024-09-19T08:38:39.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.884+0000 7fc107c65640 1 -- start start 2024-09-19T08:38:39.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.885+0000 7fc107c65640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc100070020 0x7fc10015a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:39.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.885+0000 7fc107c65640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1000cd910 0x7fc1000b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:39.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.885+0000 7fc107c65640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1000cdfd0 0x7fc1000b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:39.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.885+0000 7fc107c65640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc1000ccf50 con 0x7fc1000cdfd0 2024-09-19T08:38:39.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.885+0000 7fc107c65640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc100070db0 con 0x7fc1000cd910 2024-09-19T08:38:39.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.885+0000 7fc107c65640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fc1000cd0d0 con 0x7fc100070020 2024-09-19T08:38:39.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.885+0000 7fc106202640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1000cdfd0 0x7fc1000b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:39.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.885+0000 7fc106202640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1000cdfd0 0x7fc1000b43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50616/0 (socket says 172.21.15.117:50616) 2024-09-19T08:38:39.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.885+0000 7fc106202640 1 -- 172.21.15.117:0/208384012 learned_addr learned my addr 172.21.15.117:0/208384012 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:39.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.885+0000 7fc105a01640 1 --2- 172.21.15.117:0/208384012 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc100070020 0x7fc10015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:39.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.885+0000 7fc105200640 1 --2- 172.21.15.117:0/208384012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1000cd910 0x7fc1000b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:39.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.885+0000 7fc106202640 1 -- 172.21.15.117:0/208384012 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc100070020 msgr2=0x7fc10015a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:39.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.885+0000 7fc106202640 1 --2- 172.21.15.117:0/208384012 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc100070020 0x7fc10015a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.885+0000 7fc106202640 1 -- 172.21.15.117:0/208384012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1000cd910 msgr2=0x7fc1000b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:39.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.885+0000 7fc106202640 1 --2- 172.21.15.117:0/208384012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1000cd910 0x7fc1000b6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:39.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.885+0000 7fc106202640 1 -- 172.21.15.117:0/208384012 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1001f50c0 con 0x7fc1000cdfd0 2024-09-19T08:38:39.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.886+0000 7fc106202640 1 --2- 172.21.15.117:0/208384012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1000cdfd0 0x7fc1000b43e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800c7d0 tx=0x7fc0f800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:39.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.886+0000 7fc0f67fc640 1 -- 172.21.15.117:0/208384012 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8003b70 con 0x7fc1000cdfd0 2024-09-19T08:38:39.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.886+0000 7fc0f67fc640 1 -- 172.21.15.117:0/208384012 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f8003d30 con 0x7fc1000cdfd0 2024-09-19T08:38:39.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.886+0000 7fc0f67fc640 1 -- 172.21.15.117:0/208384012 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f800aa30 con 0x7fc1000cdfd0 2024-09-19T08:38:39.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.886+0000 7fc107c65640 1 -- 172.21.15.117:0/208384012 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1000ca1b0 con 0x7fc1000cdfd0 2024-09-19T08:38:39.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.886+0000 7fc107c65640 1 -- 172.21.15.117:0/208384012 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1000ca770 con 0x7fc1000cdfd0 2024-09-19T08:38:39.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.887+0000 7fc107c65640 1 -- 172.21.15.117:0/208384012 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1000ca970 con 0x7fc1000cdfd0 2024-09-19T08:38:39.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.887+0000 7fc0f67fc640 1 -- 172.21.15.117:0/208384012 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc0f800abd0 con 0x7fc1000cdfd0 2024-09-19T08:38:39.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.888+0000 7fc0f67fc640 1 --2- 172.21.15.117:0/208384012 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc0e406c2e0 0x7fc0e406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:39.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.888+0000 7fc0f67fc640 1 -- 172.21.15.117:0/208384012 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7fc0f808b510 con 0x7fc1000cdfd0 2024-09-19T08:38:39.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.888+0000 7fc105a01640 1 --2- 172.21.15.117:0/208384012 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc0e406c2e0 0x7fc0e406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:39.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.888+0000 7fc105a01640 1 --2- 172.21.15.117:0/208384012 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc0e406c2e0 0x7fc0e406e7a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc007fd0 tx=0x7fc0fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:39.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:39.892+0000 7fc0f67fc640 1 -- 172.21.15.117:0/208384012 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc1000ca970 con 0x7fc1000cdfd0 2024-09-19T08:38:40.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.093+0000 7fc107c65640 1 -- 172.21.15.117:0/208384012 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc1000ce3b0 con 0x7fc1000cdfd0 2024-09-19T08:38:40.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.767+0000 7fc0f67fc640 1 -- 172.21.15.117:0/208384012 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) ==== 104+0+0 (secure 0 0 0) 0x7fc0f8059aa0 con 0x7fc1000cdfd0 2024-09-19T08:38:40.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.769+0000 7fc107c65640 1 -- 172.21.15.117:0/208384012 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc0e406c2e0 msgr2=0x7fc0e406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:40.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.769+0000 7fc107c65640 1 --2- 172.21.15.117:0/208384012 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc0e406c2e0 0x7fc0e406e7a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc007fd0 tx=0x7fc0fc009040 comp rx=0 tx=0).stop 2024-09-19T08:38:40.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.769+0000 7fc107c65640 1 -- 172.21.15.117:0/208384012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1000cdfd0 msgr2=0x7fc1000b43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:40.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.769+0000 7fc107c65640 1 --2- 172.21.15.117:0/208384012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1000cdfd0 0x7fc1000b43e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800c7d0 tx=0x7fc0f800cc90 comp rx=0 tx=0).stop 2024-09-19T08:38:40.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.769+0000 7fc107c65640 1 -- 172.21.15.117:0/208384012 shutdown_connections 2024-09-19T08:38:40.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.769+0000 7fc107c65640 1 --2- 172.21.15.117:0/208384012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1000cdfd0 0x7fc1000b43e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:40.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.769+0000 7fc107c65640 1 --2- 172.21.15.117:0/208384012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1000cd910 0x7fc1000b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:40.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.769+0000 7fc107c65640 1 --2- 172.21.15.117:0/208384012 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc0e406c2e0 0x7fc0e406e7a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:40.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.769+0000 7fc107c65640 1 --2- 172.21.15.117:0/208384012 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc100070020 0x7fc10015a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:40.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.769+0000 7fc107c65640 1 -- 172.21.15.117:0/208384012 >> 172.21.15.117:0/208384012 conn(0x7fc10009a9f0 msgr2=0x7fc10015ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:40.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.769+0000 7fc107c65640 1 -- 172.21.15.117:0/208384012 shutdown_connections 2024-09-19T08:38:40.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.770+0000 7fc107c65640 1 -- 172.21.15.117:0/208384012 wait complete. 2024-09-19T08:38:40.783 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T08:38:40.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.891+0000 7f351ed3b640 1 Processor -- start 2024-09-19T08:38:40.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.892+0000 7f351ed3b640 1 -- start start 2024-09-19T08:38:40.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.892+0000 7f351ed3b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35180d4840 0x7f351815f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:40.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.892+0000 7f351ed3b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35180d1b10 con 0x7f351815f0d0 2024-09-19T08:38:40.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.892+0000 7f351ed3b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35180cf2b0 con 0x7f35180d0070 2024-09-19T08:38:40.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.892+0000 7f351ed3b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f35180cf590 con 0x7f35180d4840 2024-09-19T08:38:40.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f351cad7640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f351815f0d0 0x7f35180d1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:49878/0 (socket says 172.21.15.117:49878) 2024-09-19T08:38:40.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f351cad7640 1 -- 172.21.15.117:0/849837832 learned_addr learned my addr 172.21.15.117:0/849837832 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:40.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f351d2d8640 1 --2- 172.21.15.117:0/849837832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35180d4840 0x7f351815f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:40.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f35177fe640 1 -- 172.21.15.117:0/849837832 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1073708276 0 0) 0x7f35180d1b10 con 0x7f351815f0d0 2024-09-19T08:38:40.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f35177fe640 1 -- 172.21.15.117:0/849837832 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3500003520 con 0x7f351815f0d0 2024-09-19T08:38:40.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f35177fe640 1 -- 172.21.15.117:0/849837832 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 447112799 0 0) 0x7f3500003520 con 0x7f351815f0d0 2024-09-19T08:38:40.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f35177fe640 1 -- 172.21.15.117:0/849837832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35180d4840 msgr2=0x7f351815f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:40.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f35177fe640 1 --2- 172.21.15.117:0/849837832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35180d4840 0x7f351815f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:40.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f35177fe640 1 -- 172.21.15.117:0/849837832 >> v1:172.21.15.146:6789/0 conn(0x7f35180d0070 legacy=0x7f35180d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:40.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f35177fe640 1 -- 172.21.15.117:0/849837832 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35180cf870 con 0x7f351815f0d0 2024-09-19T08:38:40.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f35177fe640 1 -- 172.21.15.117:0/849837832 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f3508001670 con 0x7f351815f0d0 2024-09-19T08:38:40.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f35177fe640 1 -- 172.21.15.117:0/849837832 >> v1:172.21.15.117:6789/0 conn(0x7f351815f0d0 legacy=0x7f35180d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:40.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f35177fe640 1 --2- 172.21.15.117:0/849837832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35000039e0 0x7f3500003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:40.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f35177fe640 1 --2- 172.21.15.117:0/849837832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35180d4840 0x7f3500004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:40.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f35177fe640 1 --2- 172.21.15.117:0/849837832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3500004d40 0x7f35000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:40.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f35177fe640 1 -- 172.21.15.117:0/849837832 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f35180cf590 con 0x7f3500004d40 2024-09-19T08:38:40.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f35177fe640 1 -- 172.21.15.117:0/849837832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f350000baf0 con 0x7f35000039e0 2024-09-19T08:38:40.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f35177fe640 1 -- 172.21.15.117:0/849837832 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f350000bcf0 con 0x7f35180d4840 2024-09-19T08:38:40.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f351d2d8640 1 --2- 172.21.15.117:0/849837832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3500004d40 0x7f35000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:40.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f351cad7640 1 --2- 172.21.15.117:0/849837832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35000039e0 0x7f3500003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:40.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f3517fff640 1 --2- 172.21.15.117:0/849837832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35180d4840 0x7f3500004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:40.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f351d2d8640 1 -- 172.21.15.117:0/849837832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35180d4840 msgr2=0x7f3500004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:40.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.893+0000 7f351d2d8640 1 --2- 172.21.15.117:0/849837832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35180d4840 0x7f3500004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:40.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.894+0000 7f351d2d8640 1 -- 172.21.15.117:0/849837832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35000039e0 msgr2=0x7f3500003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:40.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.894+0000 7f351d2d8640 1 --2- 172.21.15.117:0/849837832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35000039e0 0x7f3500003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:40.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.894+0000 7f351d2d8640 1 -- 172.21.15.117:0/849837832 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3500003520 con 0x7f3500004d40 2024-09-19T08:38:40.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.894+0000 7f351d2d8640 1 --2- 172.21.15.117:0/849837832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3500004d40 0x7f35000051c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3510009a90 tx=0x7f3500005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d48e4b7c4282f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:40.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.894+0000 7f35177fe640 1 -- 172.21.15.117:0/849837832 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3510036070 con 0x7f3500004d40 2024-09-19T08:38:40.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.894+0000 7f35177fe640 1 -- 172.21.15.117:0/849837832 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3510031400 con 0x7f3500004d40 2024-09-19T08:38:40.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.894+0000 7f35177fe640 1 -- 172.21.15.117:0/849837832 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3510009690 con 0x7f3500004d40 2024-09-19T08:38:40.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.895+0000 7f351ed3b640 1 -- 172.21.15.117:0/849837832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3500004d40 msgr2=0x7f35000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:40.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.895+0000 7f351ed3b640 1 --2- 172.21.15.117:0/849837832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3500004d40 0x7f35000051c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3510009a90 tx=0x7f3500005830 comp rx=0 tx=0).stop 2024-09-19T08:38:40.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.895+0000 7f351d2d8640 1 -- 172.21.15.117:0/849837832 reap_dead start 2024-09-19T08:38:40.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.895+0000 7f351ed3b640 1 -- 172.21.15.117:0/849837832 shutdown_connections 2024-09-19T08:38:40.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.895+0000 7f351ed3b640 1 -- 172.21.15.117:0/849837832 >> 172.21.15.117:0/849837832 conn(0x7f351809d760 msgr2=0x7f351808bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:40.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.895+0000 7f351ed3b640 1 -- 172.21.15.117:0/849837832 shutdown_connections 2024-09-19T08:38:40.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.895+0000 7f351ed3b640 1 -- 172.21.15.117:0/849837832 wait complete. 2024-09-19T08:38:40.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.896+0000 7f351ed3b640 1 Processor -- start 2024-09-19T08:38:40.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.896+0000 7f351ed3b640 1 -- start start 2024-09-19T08:38:40.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.897+0000 7f351ed3b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3500004d40 0x7f35181547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:40.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.897+0000 7f351ed3b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3518155130 0x7f351815d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:40.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.897+0000 7f351ed3b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f351815da40 0x7f35181579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:40.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.897+0000 7f351ed3b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f351815f4b0 con 0x7f3518155130 2024-09-19T08:38:40.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.897+0000 7f351ed3b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f35180cef60 con 0x7f3500004d40 2024-09-19T08:38:40.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.897+0000 7f351ed3b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f351815f630 con 0x7f351815da40 2024-09-19T08:38:40.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.897+0000 7f3517fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3518155130 0x7f351815d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:40.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.897+0000 7f3517fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3518155130 0x7f351815d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50632/0 (socket says 172.21.15.117:50632) 2024-09-19T08:38:40.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.897+0000 7f3517fff640 1 -- 172.21.15.117:0/3316242731 learned_addr learned my addr 172.21.15.117:0/3316242731 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:40.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.897+0000 7f351cad7640 1 --2- 172.21.15.117:0/3316242731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3500004d40 0x7f35181547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:40.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.897+0000 7f351d2d8640 1 --2- 172.21.15.117:0/3316242731 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f351815da40 0x7f35181579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:40.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.897+0000 7f3517fff640 1 -- 172.21.15.117:0/3316242731 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f351815da40 msgr2=0x7f35181579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:40.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.897+0000 7f3517fff640 1 --2- 172.21.15.117:0/3316242731 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f351815da40 0x7f35181579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:40.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.897+0000 7f3517fff640 1 -- 172.21.15.117:0/3316242731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3500004d40 msgr2=0x7f35181547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:40.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.897+0000 7f3517fff640 1 --2- 172.21.15.117:0/3316242731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3500004d40 0x7f35181547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:40.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.897+0000 7f3517fff640 1 -- 172.21.15.117:0/3316242731 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35180cb650 con 0x7f3518155130 2024-09-19T08:38:40.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.897+0000 7f351cad7640 1 --2- 172.21.15.117:0/3316242731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3500004d40 0x7f35181547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:40.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.898+0000 7f3517fff640 1 --2- 172.21.15.117:0/3316242731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3518155130 0x7f351815d500 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f350c00fb90 tx=0x7f350c00d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:40.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.898+0000 7f35157fa640 1 -- 172.21.15.117:0/3316242731 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c00fe90 con 0x7f3518155130 2024-09-19T08:38:40.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.898+0000 7f35157fa640 1 -- 172.21.15.117:0/3316242731 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f350c018070 con 0x7f3518155130 2024-09-19T08:38:40.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.898+0000 7f351ed3b640 1 -- 172.21.15.117:0/3316242731 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35180cb930 con 0x7f3518155130 2024-09-19T08:38:40.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.898+0000 7f35157fa640 1 -- 172.21.15.117:0/3316242731 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c00de10 con 0x7f3518155130 2024-09-19T08:38:40.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.898+0000 7f351ed3b640 1 -- 172.21.15.117:0/3316242731 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35180cbef0 con 0x7f3518155130 2024-09-19T08:38:40.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.899+0000 7f351ed3b640 1 -- 172.21.15.117:0/3316242731 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35180d4130 con 0x7f3518155130 2024-09-19T08:38:40.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.899+0000 7f35157fa640 1 -- 172.21.15.117:0/3316242731 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f350c003970 con 0x7f3518155130 2024-09-19T08:38:40.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.900+0000 7f35157fa640 1 --2- 172.21.15.117:0/3316242731 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f350406c480 0x7f350406e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:40.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.900+0000 7f35157fa640 1 -- 172.21.15.117:0/3316242731 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7f350c08b8b0 con 0x7f3518155130 2024-09-19T08:38:40.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.900+0000 7f351cad7640 1 --2- 172.21.15.117:0/3316242731 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f350406c480 0x7f350406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:40.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.900+0000 7f351cad7640 1 --2- 172.21.15.117:0/3316242731 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f350406c480 0x7f350406e940 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3508001eb0 tx=0x7f3508009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:40.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:40.904+0000 7f35157fa640 1 -- 172.21.15.117:0/3316242731 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f350c059db0 con 0x7f3518155130 2024-09-19T08:38:41.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.070+0000 7f351ed3b640 1 -- 172.21.15.117:0/3316242731 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f35180b6de0 con 0x7f3518155130 2024-09-19T08:38:41.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.768+0000 7f35157fa640 1 -- 172.21.15.117:0/3316242731 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) ==== 181+0+0 (secure 0 0 0) 0x7f350c0596b0 con 0x7f3518155130 2024-09-19T08:38:41.768 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'cephfs_metadata' removed 2024-09-19T08:38:41.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.771+0000 7f351ed3b640 1 -- 172.21.15.117:0/3316242731 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f350406c480 msgr2=0x7f350406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:41.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.771+0000 7f351ed3b640 1 --2- 172.21.15.117:0/3316242731 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f350406c480 0x7f350406e940 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3508001eb0 tx=0x7f3508009040 comp rx=0 tx=0).stop 2024-09-19T08:38:41.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.771+0000 7f351ed3b640 1 -- 172.21.15.117:0/3316242731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3518155130 msgr2=0x7f351815d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:41.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.771+0000 7f351ed3b640 1 --2- 172.21.15.117:0/3316242731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3518155130 0x7f351815d500 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f350c00fb90 tx=0x7f350c00d520 comp rx=0 tx=0).stop 2024-09-19T08:38:41.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.772+0000 7f351ed3b640 1 -- 172.21.15.117:0/3316242731 shutdown_connections 2024-09-19T08:38:41.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.772+0000 7f351ed3b640 1 --2- 172.21.15.117:0/3316242731 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f350406c480 0x7f350406e940 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:41.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.772+0000 7f351ed3b640 1 --2- 172.21.15.117:0/3316242731 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f351815da40 0x7f35181579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:41.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.772+0000 7f351ed3b640 1 --2- 172.21.15.117:0/3316242731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3518155130 0x7f351815d500 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:41.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.772+0000 7f351ed3b640 1 --2- 172.21.15.117:0/3316242731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3500004d40 0x7f35181547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:41.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.772+0000 7f351ed3b640 1 -- 172.21.15.117:0/3316242731 >> 172.21.15.117:0/3316242731 conn(0x7f351809d760 msgr2=0x7f3518161530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:41.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.772+0000 7f351ed3b640 1 -- 172.21.15.117:0/3316242731 shutdown_connections 2024-09-19T08:38:41.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.772+0000 7f351ed3b640 1 -- 172.21.15.117:0/3316242731 wait complete. 2024-09-19T08:38:41.789 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T08:38:41.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.898+0000 7f2edc54b640 1 Processor -- start 2024-09-19T08:38:41.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.898+0000 7f2edc54b640 1 -- start start 2024-09-19T08:38:41.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.899+0000 7f2edc54b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ed40c5b00 0x7f2ed40cc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:41.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.899+0000 7f2edc54b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ed40b4540 con 0x7f2ed415a7b0 2024-09-19T08:38:41.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.899+0000 7f2edc54b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ed40cf9b0 con 0x7f2ed40cce70 2024-09-19T08:38:41.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.899+0000 7f2edc54b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f2ed40b4870 con 0x7f2ed40c5b00 2024-09-19T08:38:41.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.899+0000 7f2eda2e7640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f2ed415a7b0 0x7f2ed40cde40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:49882/0 (socket says 172.21.15.117:49882) 2024-09-19T08:38:41.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.899+0000 7f2eda2e7640 1 -- 172.21.15.117:0/379259540 learned_addr learned my addr 172.21.15.117:0/379259540 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:41.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.900+0000 7f2ed9ae6640 1 --2- 172.21.15.117:0/379259540 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ed40c5b00 0x7f2ed40cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:41.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.900+0000 7f2ed92e5640 1 -- 172.21.15.117:0/379259540 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3576198002 0 0) 0x7f2ed40b4540 con 0x7f2ed415a7b0 2024-09-19T08:38:41.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.900+0000 7f2ed92e5640 1 -- 172.21.15.117:0/379259540 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ec0003520 con 0x7f2ed415a7b0 2024-09-19T08:38:41.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.900+0000 7f2ed92e5640 1 -- 172.21.15.117:0/379259540 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 411957381 0 0) 0x7f2ec0003520 con 0x7f2ed415a7b0 2024-09-19T08:38:41.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.900+0000 7f2ed92e5640 1 -- 172.21.15.117:0/379259540 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ed40c5b00 msgr2=0x7f2ed40cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:41.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.900+0000 7f2ed92e5640 1 --2- 172.21.15.117:0/379259540 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ed40c5b00 0x7f2ed40cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:41.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.900+0000 7f2ed92e5640 1 -- 172.21.15.117:0/379259540 >> v1:172.21.15.146:6789/0 conn(0x7f2ed40cce70 legacy=0x7f2ed40b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:41.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.900+0000 7f2ed92e5640 1 -- 172.21.15.117:0/379259540 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed40cfc90 con 0x7f2ed415a7b0 2024-09-19T08:38:41.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.900+0000 7f2ed92e5640 1 -- 172.21.15.117:0/379259540 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f2ec4001670 con 0x7f2ed415a7b0 2024-09-19T08:38:41.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.900+0000 7f2ed92e5640 1 -- 172.21.15.117:0/379259540 >> v1:172.21.15.117:6789/0 conn(0x7f2ed415a7b0 legacy=0x7f2ed40cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:41.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.900+0000 7f2ed92e5640 1 --2- 172.21.15.117:0/379259540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ec00039e0 0x7f2ec0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:41.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.900+0000 7f2ed92e5640 1 --2- 172.21.15.117:0/379259540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ec0004800 0x7f2ec0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:41.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.900+0000 7f2ed92e5640 1 --2- 172.21.15.117:0/379259540 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ed40c5b00 0x7f2ec00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:41.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.900+0000 7f2ed92e5640 1 -- 172.21.15.117:0/379259540 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed40b4870 con 0x7f2ec0004800 2024-09-19T08:38:41.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.900+0000 7f2ed92e5640 1 -- 172.21.15.117:0/379259540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec000ba70 con 0x7f2ec00039e0 2024-09-19T08:38:41.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.900+0000 7f2ed92e5640 1 -- 172.21.15.117:0/379259540 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec000bc70 con 0x7f2ed40c5b00 2024-09-19T08:38:41.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.900+0000 7f2ed9ae6640 1 --2- 172.21.15.117:0/379259540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ec0004800 0x7f2ec0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:41.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.900+0000 7f2eda2e7640 1 --2- 172.21.15.117:0/379259540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ec00039e0 0x7f2ec0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:41.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.900+0000 7f2edaae8640 1 --2- 172.21.15.117:0/379259540 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ed40c5b00 0x7f2ec00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:41.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.901+0000 7f2ed9ae6640 1 -- 172.21.15.117:0/379259540 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ed40c5b00 msgr2=0x7f2ec00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:41.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.901+0000 7f2ed9ae6640 1 --2- 172.21.15.117:0/379259540 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ed40c5b00 0x7f2ec00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:41.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.901+0000 7f2ed9ae6640 1 -- 172.21.15.117:0/379259540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ec00039e0 msgr2=0x7f2ec0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:41.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.901+0000 7f2ed9ae6640 1 --2- 172.21.15.117:0/379259540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ec00039e0 0x7f2ec0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:41.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.901+0000 7f2ed9ae6640 1 -- 172.21.15.117:0/379259540 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec0003520 con 0x7f2ec0004800 2024-09-19T08:38:41.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.901+0000 7f2ed9ae6640 1 --2- 172.21.15.117:0/379259540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ec0004800 0x7f2ec0004c80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40cdbf0 tx=0x7f2ec0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3aa512276c3d723 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:41.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.901+0000 7f2ed92e5640 1 -- 172.21.15.117:0/379259540 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed003a070 con 0x7f2ec0004800 2024-09-19T08:38:41.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.901+0000 7f2ed92e5640 1 -- 172.21.15.117:0/379259540 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed0035410 con 0x7f2ec0004800 2024-09-19T08:38:41.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.901+0000 7f2ed92e5640 1 -- 172.21.15.117:0/379259540 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed000b990 con 0x7f2ec0004800 2024-09-19T08:38:41.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.902+0000 7f2edc54b640 1 -- 172.21.15.117:0/379259540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ec0004800 msgr2=0x7f2ec0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:41.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.902+0000 7f2edc54b640 1 --2- 172.21.15.117:0/379259540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ec0004800 0x7f2ec0004c80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40cdbf0 tx=0x7f2ec0005830 comp rx=0 tx=0).stop 2024-09-19T08:38:41.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.902+0000 7f2edaae8640 1 -- 172.21.15.117:0/379259540 reap_dead start 2024-09-19T08:38:41.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.902+0000 7f2edc54b640 1 -- 172.21.15.117:0/379259540 shutdown_connections 2024-09-19T08:38:41.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.902+0000 7f2edc54b640 1 -- 172.21.15.117:0/379259540 >> 172.21.15.117:0/379259540 conn(0x7f2ed406bdf0 msgr2=0x7f2ed406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:41.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.902+0000 7f2edc54b640 1 -- 172.21.15.117:0/379259540 shutdown_connections 2024-09-19T08:38:41.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.902+0000 7f2edc54b640 1 -- 172.21.15.117:0/379259540 wait complete. 2024-09-19T08:38:41.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.903+0000 7f2edc54b640 1 Processor -- start 2024-09-19T08:38:41.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.904+0000 7f2edc54b640 1 -- start start 2024-09-19T08:38:41.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.904+0000 7f2edc54b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ec0004800 0x7f2ed41583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:41.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.904+0000 7f2edc54b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ed40aeb00 0x7f2ed41588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:41.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.904+0000 7f2edc54b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ed40ca030 0x7f2ed415bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:41.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.904+0000 7f2edc54b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed415ab90 con 0x7f2ed40ca030 2024-09-19T08:38:41.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.904+0000 7f2edc54b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed40c5f40 con 0x7f2ed40aeb00 2024-09-19T08:38:41.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.904+0000 7f2edc54b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f2ed40ca8c0 con 0x7f2ec0004800 2024-09-19T08:38:41.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.904+0000 7f2edaae8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ed40ca030 0x7f2ed415bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:41.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.904+0000 7f2edaae8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ed40ca030 0x7f2ed415bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50644/0 (socket says 172.21.15.117:50644) 2024-09-19T08:38:41.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.904+0000 7f2edaae8640 1 -- 172.21.15.117:0/3421166848 learned_addr learned my addr 172.21.15.117:0/3421166848 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:41.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.904+0000 7f2eda2e7640 1 --2- 172.21.15.117:0/3421166848 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ec0004800 0x7f2ed41583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:41.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.904+0000 7f2ed9ae6640 1 --2- 172.21.15.117:0/3421166848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ed40aeb00 0x7f2ed41588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:41.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.905+0000 7f2edaae8640 1 -- 172.21.15.117:0/3421166848 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ec0004800 msgr2=0x7f2ed41583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:41.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.905+0000 7f2edaae8640 1 --2- 172.21.15.117:0/3421166848 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ec0004800 0x7f2ed41583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:41.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.905+0000 7f2edaae8640 1 -- 172.21.15.117:0/3421166848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ed40aeb00 msgr2=0x7f2ed41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:41.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.905+0000 7f2edaae8640 1 --2- 172.21.15.117:0/3421166848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ed40aeb00 0x7f2ed41588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:41.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.905+0000 7f2edaae8640 1 -- 172.21.15.117:0/3421166848 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed40b04a0 con 0x7f2ed40ca030 2024-09-19T08:38:41.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.905+0000 7f2edaae8640 1 --2- 172.21.15.117:0/3421166848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ed40ca030 0x7f2ed415bde0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40afca0 tx=0x7f2ecc00fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:41.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.905+0000 7f2ecaffd640 1 -- 172.21.15.117:0/3421166848 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc01a070 con 0x7f2ed40ca030 2024-09-19T08:38:41.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.905+0000 7f2ecaffd640 1 -- 172.21.15.117:0/3421166848 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ecc006d60 con 0x7f2ed40ca030 2024-09-19T08:38:41.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.905+0000 7f2ecaffd640 1 -- 172.21.15.117:0/3421166848 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc003b90 con 0x7f2ed40ca030 2024-09-19T08:38:41.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.905+0000 7f2edc54b640 1 -- 172.21.15.117:0/3421166848 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ed40afee0 con 0x7f2ed40ca030 2024-09-19T08:38:41.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.905+0000 7f2edc54b640 1 -- 172.21.15.117:0/3421166848 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ed415b8c0 con 0x7f2ed40ca030 2024-09-19T08:38:41.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.906+0000 7f2edc54b640 1 -- 172.21.15.117:0/3421166848 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ed415b6c0 con 0x7f2ed40ca030 2024-09-19T08:38:41.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.907+0000 7f2ecaffd640 1 -- 172.21.15.117:0/3421166848 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2ecc01d070 con 0x7f2ed40ca030 2024-09-19T08:38:41.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.907+0000 7f2ecaffd640 1 --2- 172.21.15.117:0/3421166848 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2eb806c2b0 0x7f2eb806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:41.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.908+0000 7f2ecaffd640 1 -- 172.21.15.117:0/3421166848 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5749+0+0 (secure 0 0 0) 0x7f2ecc08a9c0 con 0x7f2ed40ca030 2024-09-19T08:38:41.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.908+0000 7f2eda2e7640 1 --2- 172.21.15.117:0/3421166848 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2eb806c2b0 0x7f2eb806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:41.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.908+0000 7f2eda2e7640 1 --2- 172.21.15.117:0/3421166848 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2eb806c2b0 0x7f2eb806e770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4000c00 tx=0x7f2ec4001c30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:41.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:41.912+0000 7f2ecaffd640 1 -- 172.21.15.117:0/3421166848 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2ecc08ce20 con 0x7f2ed40ca030 2024-09-19T08:38:42.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.083+0000 7f2edc54b640 1 -- 172.21.15.117:0/3421166848 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2ed40cc930 con 0x7f2ed40ca030 2024-09-19T08:38:42.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.773+0000 7f2ecaffd640 1 -- 172.21.15.117:0/3421166848 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) ==== 169+0+0 (secure 0 0 0) 0x7f2ed40b04a0 con 0x7f2ed40ca030 2024-09-19T08:38:42.773 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'cephfs_data' removed 2024-09-19T08:38:42.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.776+0000 7f2edc54b640 1 -- 172.21.15.117:0/3421166848 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2eb806c2b0 msgr2=0x7f2eb806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:42.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.776+0000 7f2edc54b640 1 --2- 172.21.15.117:0/3421166848 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2eb806c2b0 0x7f2eb806e770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4000c00 tx=0x7f2ec4001c30 comp rx=0 tx=0).stop 2024-09-19T08:38:42.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.776+0000 7f2edc54b640 1 -- 172.21.15.117:0/3421166848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ed40ca030 msgr2=0x7f2ed415bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:42.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.776+0000 7f2edc54b640 1 --2- 172.21.15.117:0/3421166848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ed40ca030 0x7f2ed415bde0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40afca0 tx=0x7f2ecc00fd40 comp rx=0 tx=0).stop 2024-09-19T08:38:42.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.776+0000 7f2edc54b640 1 -- 172.21.15.117:0/3421166848 shutdown_connections 2024-09-19T08:38:42.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.776+0000 7f2edc54b640 1 --2- 172.21.15.117:0/3421166848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ed40ca030 0x7f2ed415bde0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:42.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.776+0000 7f2edc54b640 1 --2- 172.21.15.117:0/3421166848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ed40aeb00 0x7f2ed41588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:42.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.776+0000 7f2edc54b640 1 --2- 172.21.15.117:0/3421166848 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2eb806c2b0 0x7f2eb806e770 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:42.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.776+0000 7f2edc54b640 1 --2- 172.21.15.117:0/3421166848 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ec0004800 0x7f2ed41583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:42.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.776+0000 7f2edc54b640 1 -- 172.21.15.117:0/3421166848 >> 172.21.15.117:0/3421166848 conn(0x7f2ed406bdf0 msgr2=0x7f2ed40cb870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:42.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.777+0000 7f2edc54b640 1 -- 172.21.15.117:0/3421166848 shutdown_connections 2024-09-19T08:38:42.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.777+0000 7f2edc54b640 1 -- 172.21.15.117:0/3421166848 wait complete. 2024-09-19T08:38:42.791 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T08:38:42.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.891+0000 7fa5099c4640 1 Processor -- start 2024-09-19T08:38:42.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.891+0000 7fa5099c4640 1 -- start start 2024-09-19T08:38:42.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.892+0000 7fa5099c4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa5040ce260 0x7fa504166030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:42.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.892+0000 7fa5099c4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5040cd910 con 0x7fa50415b6e0 2024-09-19T08:38:42.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.892+0000 7fa5099c4640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5040ccda0 con 0x7fa50415b300 2024-09-19T08:38:42.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.892+0000 7fa5099c4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fa5040cd070 con 0x7fa5040ce260 2024-09-19T08:38:42.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.892+0000 7fa5027fc640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fa50415b6e0 0x7fa5040cdb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:49884/0 (socket says 172.21.15.117:49884) 2024-09-19T08:38:42.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.892+0000 7fa5027fc640 1 -- 172.21.15.117:0/2917100582 learned_addr learned my addr 172.21.15.117:0/2917100582 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:42.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.892+0000 7fa5037fe640 1 --2- 172.21.15.117:0/2917100582 >> v2:172.21.15.117:3300/0 conn(0x7fa5040ce260 0x7fa504166030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:42.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.892+0000 7fa501ffb640 1 -- 172.21.15.117:0/2917100582 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1422507820 0 0) 0x7fa5040cd910 con 0x7fa50415b6e0 2024-09-19T08:38:42.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.892+0000 7fa501ffb640 1 -- 172.21.15.117:0/2917100582 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4f0003520 con 0x7fa50415b6e0 2024-09-19T08:38:42.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.892+0000 7fa5037fe640 1 -- 172.21.15.117:0/2917100582 >> v1:172.21.15.146:6789/0 conn(0x7fa50415b300 legacy=0x7fa5040cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:42.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.892+0000 7fa5037fe640 1 -- 172.21.15.117:0/2917100582 >> v1:172.21.15.117:6789/0 conn(0x7fa50415b6e0 legacy=0x7fa5040cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:42.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.892+0000 7fa5037fe640 1 -- 172.21.15.117:0/2917100582 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5040cd350 con 0x7fa5040ce260 2024-09-19T08:38:42.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.893+0000 7fa5037fe640 1 --2- 172.21.15.117:0/2917100582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5040ce260 0x7fa504166030 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc009d90 tx=0x7fa4fc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8517789cfb838872 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:42.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.894+0000 7fa501ffb640 1 -- 172.21.15.117:0/2917100582 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc007740 con 0x7fa5040ce260 2024-09-19T08:38:42.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.894+0000 7fa501ffb640 1 -- 172.21.15.117:0/2917100582 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4fc0078e0 con 0x7fa5040ce260 2024-09-19T08:38:42.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.894+0000 7fa501ffb640 1 -- 172.21.15.117:0/2917100582 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc007cb0 con 0x7fa5040ce260 2024-09-19T08:38:42.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.894+0000 7fa5099c4640 1 -- 172.21.15.117:0/2917100582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5040ce260 msgr2=0x7fa504166030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:42.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.894+0000 7fa5099c4640 1 --2- 172.21.15.117:0/2917100582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5040ce260 0x7fa504166030 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc009d90 tx=0x7fa4fc02a6a0 comp rx=0 tx=0).stop 2024-09-19T08:38:42.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.894+0000 7fa5099c4640 1 -- 172.21.15.117:0/2917100582 shutdown_connections 2024-09-19T08:38:42.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.894+0000 7fa5099c4640 1 --2- 172.21.15.117:0/2917100582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5040ce260 0x7fa504166030 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:42.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.894+0000 7fa5099c4640 1 -- 172.21.15.117:0/2917100582 >> 172.21.15.117:0/2917100582 conn(0x7fa5040b2d10 msgr2=0x7fa5040b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:42.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.894+0000 7fa5099c4640 1 -- 172.21.15.117:0/2917100582 shutdown_connections 2024-09-19T08:38:42.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.894+0000 7fa5099c4640 1 -- 172.21.15.117:0/2917100582 wait complete. 2024-09-19T08:38:42.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.895+0000 7fa5099c4640 1 Processor -- start 2024-09-19T08:38:42.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.896+0000 7fa5099c4640 1 -- start start 2024-09-19T08:38:42.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.896+0000 7fa5099c4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5040ce260 0x7fa50406c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:42.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.896+0000 7fa5099c4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa50415b300 0x7fa5041f4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:42.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.896+0000 7fa5099c4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa50415b6e0 0x7fa5040b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:42.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.896+0000 7fa5099c4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa5040b39f0 con 0x7fa50415b300 2024-09-19T08:38:42.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.896+0000 7fa5099c4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa5040b0b50 con 0x7fa50415b6e0 2024-09-19T08:38:42.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.896+0000 7fa5099c4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fa5040b3b70 con 0x7fa5040ce260 2024-09-19T08:38:42.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.896+0000 7fa5027fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa50415b300 0x7fa5041f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:42.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.896+0000 7fa5027fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa50415b300 0x7fa5041f4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50668/0 (socket says 172.21.15.117:50668) 2024-09-19T08:38:42.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.896+0000 7fa5027fc640 1 -- 172.21.15.117:0/1344793561 learned_addr learned my addr 172.21.15.117:0/1344793561 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:42.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.897+0000 7fa502ffd640 1 --2- 172.21.15.117:0/1344793561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5040ce260 0x7fa50406c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:42.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.897+0000 7fa5037fe640 1 --2- 172.21.15.117:0/1344793561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa50415b6e0 0x7fa5040b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:42.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.897+0000 7fa5027fc640 1 -- 172.21.15.117:0/1344793561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5040ce260 msgr2=0x7fa50406c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:42.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.897+0000 7fa5027fc640 1 --2- 172.21.15.117:0/1344793561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5040ce260 0x7fa50406c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:42.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.897+0000 7fa5027fc640 1 -- 172.21.15.117:0/1344793561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa50415b6e0 msgr2=0x7fa5040b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:42.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.897+0000 7fa5027fc640 1 --2- 172.21.15.117:0/1344793561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa50415b6e0 0x7fa5040b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:42.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.897+0000 7fa5027fc640 1 -- 172.21.15.117:0/1344793561 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5041f5330 con 0x7fa50415b300 2024-09-19T08:38:42.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.897+0000 7fa5037fe640 1 --2- 172.21.15.117:0/1344793561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa50415b6e0 0x7fa5040b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:42.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.897+0000 7fa502ffd640 1 --2- 172.21.15.117:0/1344793561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5040ce260 0x7fa50406c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:42.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.897+0000 7fa5027fc640 1 --2- 172.21.15.117:0/1344793561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa50415b300 0x7fa5041f4770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400c390 tx=0x7fa4f400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:42.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.897+0000 7fa4fbfff640 1 -- 172.21.15.117:0/1344793561 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4017070 con 0x7fa50415b300 2024-09-19T08:38:42.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.897+0000 7fa4fbfff640 1 -- 172.21.15.117:0/1344793561 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f4005d00 con 0x7fa50415b300 2024-09-19T08:38:42.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.897+0000 7fa5099c4640 1 -- 172.21.15.117:0/1344793561 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5040c9f40 con 0x7fa50415b300 2024-09-19T08:38:42.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.897+0000 7fa4fbfff640 1 -- 172.21.15.117:0/1344793561 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4007310 con 0x7fa50415b300 2024-09-19T08:38:42.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.897+0000 7fa5099c4640 1 -- 172.21.15.117:0/1344793561 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5040ca500 con 0x7fa50415b300 2024-09-19T08:38:42.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.898+0000 7fa5099c4640 1 -- 172.21.15.117:0/1344793561 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa50406fc10 con 0x7fa50415b300 2024-09-19T08:38:42.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.899+0000 7fa4fbfff640 1 -- 172.21.15.117:0/1344793561 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa4f401a070 con 0x7fa50415b300 2024-09-19T08:38:42.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.899+0000 7fa4fbfff640 1 --2- 172.21.15.117:0/1344793561 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa4e406c2b0 0x7fa4e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:42.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.899+0000 7fa4fbfff640 1 -- 172.21.15.117:0/1344793561 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fa4f408a6d0 con 0x7fa50415b300 2024-09-19T08:38:42.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.900+0000 7fa502ffd640 1 --2- 172.21.15.117:0/1344793561 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa4e406c2b0 0x7fa4e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:42.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.900+0000 7fa502ffd640 1 --2- 172.21.15.117:0/1344793561 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa4e406c2b0 0x7fa4e406e770 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec003eb0 tx=0x7fa4ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:42.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:42.904+0000 7fa4fbfff640 1 -- 172.21.15.117:0/1344793561 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa50406fc10 con 0x7fa50415b300 2024-09-19T08:38:43.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.073+0000 7fa5099c4640 1 -- 172.21.15.117:0/1344793561 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fa5040cdd80 con 0x7fa50415b300 2024-09-19T08:38:43.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.077+0000 7fa4fbfff640 1 -- 172.21.15.117:0/1344793561 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fa5041f5330 con 0x7fa50415b300 2024-09-19T08:38:43.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.079+0000 7fa5099c4640 1 -- 172.21.15.117:0/1344793561 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa4e406c2b0 msgr2=0x7fa4e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:43.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.079+0000 7fa5099c4640 1 --2- 172.21.15.117:0/1344793561 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa4e406c2b0 0x7fa4e406e770 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec003eb0 tx=0x7fa4ec009040 comp rx=0 tx=0).stop 2024-09-19T08:38:43.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.079+0000 7fa5099c4640 1 -- 172.21.15.117:0/1344793561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa50415b300 msgr2=0x7fa5041f4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:43.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.079+0000 7fa5099c4640 1 --2- 172.21.15.117:0/1344793561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa50415b300 0x7fa5041f4770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400c390 tx=0x7fa4f400c850 comp rx=0 tx=0).stop 2024-09-19T08:38:43.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.079+0000 7fa5099c4640 1 -- 172.21.15.117:0/1344793561 shutdown_connections 2024-09-19T08:38:43.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.079+0000 7fa5099c4640 1 --2- 172.21.15.117:0/1344793561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa50415b6e0 0x7fa5040b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:43.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.079+0000 7fa5099c4640 1 --2- 172.21.15.117:0/1344793561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa50415b300 0x7fa5041f4770 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:43.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.079+0000 7fa5099c4640 1 --2- 172.21.15.117:0/1344793561 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fa4e406c2b0 0x7fa4e406e770 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:43.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.079+0000 7fa5099c4640 1 --2- 172.21.15.117:0/1344793561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5040ce260 0x7fa50406c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:43.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.079+0000 7fa5099c4640 1 -- 172.21.15.117:0/1344793561 >> 172.21.15.117:0/1344793561 conn(0x7fa5040b2d10 msgr2=0x7fa50406eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:43.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.079+0000 7fa5099c4640 1 -- 172.21.15.117:0/1344793561 shutdown_connections 2024-09-19T08:38:43.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.079+0000 7fa5099c4640 1 -- 172.21.15.117:0/1344793561 wait complete. 2024-09-19T08:38:43.090 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-09-19T08:38:43.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.188+0000 7f05e69e4640 1 Processor -- start 2024-09-19T08:38:43.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.188+0000 7f05e69e4640 1 -- start start 2024-09-19T08:38:43.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.189+0000 7f05e69e4640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f05e0070930 0x7f05e00b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:43.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.189+0000 7f05e69e4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e0070ea0 con 0x7f05e015e4f0 2024-09-19T08:38:43.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.189+0000 7f05e69e4640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e006e8c0 con 0x7f05e00add30 2024-09-19T08:38:43.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.189+0000 7f05e69e4640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f05e006eba0 con 0x7f05e0070930 2024-09-19T08:38:43.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.189+0000 7f05df7fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f05e015e4f0 0x7f05e00b5050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:49888/0 (socket says 172.21.15.117:49888) 2024-09-19T08:38:43.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.189+0000 7f05df7fe640 1 -- 172.21.15.117:0/2590197521 learned_addr learned my addr 172.21.15.117:0/2590197521 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:43.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.189+0000 7f05e4f81640 1 --2- 172.21.15.117:0/2590197521 >> v2:172.21.15.146:3300/0 conn(0x7f05e0070930 0x7f05e00b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:43.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.189+0000 7f05deffd640 1 -- 172.21.15.117:0/2590197521 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3550870157 0 0) 0x7f05e0070ea0 con 0x7f05e015e4f0 2024-09-19T08:38:43.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.189+0000 7f05deffd640 1 -- 172.21.15.117:0/2590197521 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05c8003520 con 0x7f05e015e4f0 2024-09-19T08:38:43.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.189+0000 7f05deffd640 1 -- 172.21.15.117:0/2590197521 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3856092770 0 0) 0x7f05c8003520 con 0x7f05e015e4f0 2024-09-19T08:38:43.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.189+0000 7f05deffd640 1 -- 172.21.15.117:0/2590197521 >> v2:172.21.15.146:3300/0 conn(0x7f05e0070930 msgr2=0x7f05e00b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:43.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.189+0000 7f05deffd640 1 --2- 172.21.15.117:0/2590197521 >> v2:172.21.15.146:3300/0 conn(0x7f05e0070930 0x7f05e00b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:43.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.189+0000 7f05deffd640 1 -- 172.21.15.117:0/2590197521 >> v1:172.21.15.146:6789/0 conn(0x7f05e00add30 legacy=0x7f05e00ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:43.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.189+0000 7f05deffd640 1 -- 172.21.15.117:0/2590197521 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e006ee80 con 0x7f05e015e4f0 2024-09-19T08:38:43.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.189+0000 7f05deffd640 1 -- 172.21.15.117:0/2590197521 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f05d4001670 con 0x7f05e015e4f0 2024-09-19T08:38:43.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.189+0000 7f05deffd640 1 -- 172.21.15.117:0/2590197521 >> v1:172.21.15.117:6789/0 conn(0x7f05e015e4f0 legacy=0x7f05e00b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:43.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.189+0000 7f05deffd640 1 --2- 172.21.15.117:0/2590197521 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05c80039b0 0x7f05c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:43.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.189+0000 7f05deffd640 1 --2- 172.21.15.117:0/2590197521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05c80043b0 0x7f05c8004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:43.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.190+0000 7f05deffd640 1 --2- 172.21.15.117:0/2590197521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05c8005080 0x7f05c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:43.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.190+0000 7f05deffd640 1 -- 172.21.15.117:0/2590197521 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f05e006eba0 con 0x7f05c80043b0 2024-09-19T08:38:43.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.190+0000 7f05deffd640 1 -- 172.21.15.117:0/2590197521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f05c800bfe0 con 0x7f05c8005080 2024-09-19T08:38:43.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.190+0000 7f05deffd640 1 -- 172.21.15.117:0/2590197521 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f05c800c1e0 con 0x7f05c80039b0 2024-09-19T08:38:43.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.190+0000 7f05df7fe640 1 --2- 172.21.15.117:0/2590197521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05c80043b0 0x7f05c8004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:43.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.190+0000 7f05dffff640 1 --2- 172.21.15.117:0/2590197521 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05c80039b0 0x7f05c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:43.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.190+0000 7f05e4f81640 1 --2- 172.21.15.117:0/2590197521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05c8005080 0x7f05c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:43.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.190+0000 7f05df7fe640 1 -- 172.21.15.117:0/2590197521 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05c80039b0 msgr2=0x7f05c8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:43.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.190+0000 7f05df7fe640 1 --2- 172.21.15.117:0/2590197521 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05c80039b0 0x7f05c8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:43.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.190+0000 7f05df7fe640 1 -- 172.21.15.117:0/2590197521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05c8005080 msgr2=0x7f05c800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:43.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.190+0000 7f05df7fe640 1 --2- 172.21.15.117:0/2590197521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05c8005080 0x7f05c800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:43.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.190+0000 7f05df7fe640 1 -- 172.21.15.117:0/2590197521 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c8003520 con 0x7f05c80043b0 2024-09-19T08:38:43.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.190+0000 7f05e4f81640 1 --2- 172.21.15.117:0/2590197521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05c8005080 0x7f05c800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:43.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.190+0000 7f05e4f81640 1 -- 172.21.15.117:0/2590197521 reap_dead start 2024-09-19T08:38:43.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.191+0000 7f05df7fe640 1 --2- 172.21.15.117:0/2590197521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05c80043b0 0x7f05c8004880 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f05d400c240 tx=0x7f05c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc339ef55171f9f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:43.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.191+0000 7f05deffd640 1 -- 172.21.15.117:0/2590197521 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4007d10 con 0x7f05c80043b0 2024-09-19T08:38:43.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.191+0000 7f05deffd640 1 -- 172.21.15.117:0/2590197521 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d4005ad0 con 0x7f05c80043b0 2024-09-19T08:38:43.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.191+0000 7f05deffd640 1 -- 172.21.15.117:0/2590197521 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4007070 con 0x7f05c80043b0 2024-09-19T08:38:43.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.191+0000 7f05e69e4640 1 -- 172.21.15.117:0/2590197521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05c80043b0 msgr2=0x7f05c8004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:43.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.191+0000 7f05e69e4640 1 --2- 172.21.15.117:0/2590197521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05c80043b0 0x7f05c8004880 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f05d400c240 tx=0x7f05c8005830 comp rx=0 tx=0).stop 2024-09-19T08:38:43.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.191+0000 7f05e69e4640 1 -- 172.21.15.117:0/2590197521 shutdown_connections 2024-09-19T08:38:43.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.191+0000 7f05e69e4640 1 --2- 172.21.15.117:0/2590197521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05c80043b0 0x7f05c8004880 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:43.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.191+0000 7f05e69e4640 1 -- 172.21.15.117:0/2590197521 >> 172.21.15.117:0/2590197521 conn(0x7f05e006bc10 msgr2=0x7f05e006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:43.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.191+0000 7f05e69e4640 1 -- 172.21.15.117:0/2590197521 shutdown_connections 2024-09-19T08:38:43.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.191+0000 7f05e69e4640 1 -- 172.21.15.117:0/2590197521 wait complete. 2024-09-19T08:38:43.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.192+0000 7f05e69e4640 1 Processor -- start 2024-09-19T08:38:43.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.193+0000 7f05e69e4640 1 -- start start 2024-09-19T08:38:43.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.193+0000 7f05e69e4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05c80043b0 0x7f05e015f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:43.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.193+0000 7f05e69e4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05e00b1d80 0x7f05e01f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:43.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.193+0000 7f05e69e4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05e00b2200 0x7f05e01f76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:43.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.193+0000 7f05e69e4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f05e00ae4a0 con 0x7f05e00b1d80 2024-09-19T08:38:43.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.193+0000 7f05e69e4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f05e00ae320 con 0x7f05e00b2200 2024-09-19T08:38:43.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.193+0000 7f05e69e4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f05e00ae620 con 0x7f05c80043b0 2024-09-19T08:38:43.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.193+0000 7f05df7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05e00b1d80 0x7f05e01f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:43.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.193+0000 7f05df7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05e00b1d80 0x7f05e01f71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50692/0 (socket says 172.21.15.117:50692) 2024-09-19T08:38:43.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.193+0000 7f05df7fe640 1 -- 172.21.15.117:0/2183384121 learned_addr learned my addr 172.21.15.117:0/2183384121 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:43.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.194+0000 7f05e4f81640 1 --2- 172.21.15.117:0/2183384121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05e00b2200 0x7f05e01f76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:43.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.194+0000 7f05dffff640 1 --2- 172.21.15.117:0/2183384121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05c80043b0 0x7f05e015f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:43.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.194+0000 7f05df7fe640 1 -- 172.21.15.117:0/2183384121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05c80043b0 msgr2=0x7f05e015f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:43.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.194+0000 7f05df7fe640 1 --2- 172.21.15.117:0/2183384121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05c80043b0 0x7f05e015f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:43.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.194+0000 7f05df7fe640 1 -- 172.21.15.117:0/2183384121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05e00b2200 msgr2=0x7f05e01f76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:43.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.194+0000 7f05df7fe640 1 --2- 172.21.15.117:0/2183384121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05e00b2200 0x7f05e01f76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:43.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.194+0000 7f05df7fe640 1 -- 172.21.15.117:0/2183384121 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e01f7d80 con 0x7f05e00b1d80 2024-09-19T08:38:43.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.194+0000 7f05dffff640 1 --2- 172.21.15.117:0/2183384121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05c80043b0 0x7f05e015f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:43.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.194+0000 7f05e4f81640 1 --2- 172.21.15.117:0/2183384121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05e00b2200 0x7f05e01f76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:43.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.194+0000 7f05df7fe640 1 --2- 172.21.15.117:0/2183384121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05e00b1d80 0x7f05e01f71a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f05d400c360 tx=0x7f05e006f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:43.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.194+0000 7f05dcff9640 1 -- 172.21.15.117:0/2183384121 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4041020 con 0x7f05e00b1d80 2024-09-19T08:38:43.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.194+0000 7f05dcff9640 1 -- 172.21.15.117:0/2183384121 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d4038040 con 0x7f05e00b1d80 2024-09-19T08:38:43.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.194+0000 7f05e69e4640 1 -- 172.21.15.117:0/2183384121 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e01f8060 con 0x7f05e00b1d80 2024-09-19T08:38:43.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.194+0000 7f05dcff9640 1 -- 172.21.15.117:0/2183384121 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4001670 con 0x7f05e00b1d80 2024-09-19T08:38:43.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.194+0000 7f05e69e4640 1 -- 172.21.15.117:0/2183384121 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e015ec50 con 0x7f05e00b1d80 2024-09-19T08:38:43.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.195+0000 7f05e69e4640 1 -- 172.21.15.117:0/2183384121 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e00b5050 con 0x7f05e00b1d80 2024-09-19T08:38:43.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.195+0000 7f05dcff9640 1 -- 172.21.15.117:0/2183384121 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f05d4044020 con 0x7f05e00b1d80 2024-09-19T08:38:43.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.196+0000 7f05dcff9640 1 --2- 172.21.15.117:0/2183384121 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f05cc06c2b0 0x7f05cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:43.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.196+0000 7f05dcff9640 1 -- 172.21.15.117:0/2183384121 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f05d40ab640 con 0x7f05e00b1d80 2024-09-19T08:38:43.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.196+0000 7f05dffff640 1 --2- 172.21.15.117:0/2183384121 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f05cc06c2b0 0x7f05cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:43.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.197+0000 7f05dffff640 1 --2- 172.21.15.117:0/2183384121 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f05cc06c2b0 0x7f05cc06e770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f05d0003700 tx=0x7f05d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:43.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.200+0000 7f05dcff9640 1 -- 172.21.15.117:0/2183384121 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f05d4005aa0 con 0x7f05e00b1d80 2024-09-19T08:38:43.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.440+0000 7f05e69e4640 1 -- 172.21.15.117:0/2183384121 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) -- 0x7f05e00adb10 con 0x7f05e00b1d80 2024-09-19T08:38:43.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.774+0000 7f05dcff9640 1 -- 172.21.15.117:0/2183384121 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v100) ==== 142+0+0 (secure 0 0 0) 0x7f05d4079f20 con 0x7f05e00b1d80 2024-09-19T08:38:43.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.776+0000 7f05e69e4640 1 -- 172.21.15.117:0/2183384121 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f05cc06c2b0 msgr2=0x7f05cc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:43.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.776+0000 7f05e69e4640 1 --2- 172.21.15.117:0/2183384121 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f05cc06c2b0 0x7f05cc06e770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f05d0003700 tx=0x7f05d0009040 comp rx=0 tx=0).stop 2024-09-19T08:38:43.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.776+0000 7f05e69e4640 1 -- 172.21.15.117:0/2183384121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05e00b1d80 msgr2=0x7f05e01f71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:43.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.776+0000 7f05e69e4640 1 --2- 172.21.15.117:0/2183384121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05e00b1d80 0x7f05e01f71a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f05d400c360 tx=0x7f05e006f050 comp rx=0 tx=0).stop 2024-09-19T08:38:43.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.776+0000 7f05e69e4640 1 -- 172.21.15.117:0/2183384121 shutdown_connections 2024-09-19T08:38:43.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.776+0000 7f05e69e4640 1 --2- 172.21.15.117:0/2183384121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05e00b2200 0x7f05e01f76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:43.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.776+0000 7f05e69e4640 1 --2- 172.21.15.117:0/2183384121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05e00b1d80 0x7f05e01f71a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:43.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.776+0000 7f05e69e4640 1 --2- 172.21.15.117:0/2183384121 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f05cc06c2b0 0x7f05cc06e770 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:43.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.776+0000 7f05e69e4640 1 --2- 172.21.15.117:0/2183384121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05c80043b0 0x7f05e015f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:43.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.776+0000 7f05e69e4640 1 -- 172.21.15.117:0/2183384121 >> 172.21.15.117:0/2183384121 conn(0x7f05e006bc10 msgr2=0x7f05e015c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:43.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.776+0000 7f05e69e4640 1 -- 172.21.15.117:0/2183384121 shutdown_connections 2024-09-19T08:38:43.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.776+0000 7f05e69e4640 1 -- 172.21.15.117:0/2183384121 wait complete. 2024-09-19T08:38:43.788 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-09-19T08:38:43.788 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2024-09-19T08:38:43.788 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-09-19T08:38:43.789 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:38:43.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.888+0000 7f9b7f4e4640 1 Processor -- start 2024-09-19T08:38:43.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.888+0000 7f9b7f4e4640 1 -- start start 2024-09-19T08:38:43.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.889+0000 7f9b7f4e4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9b7815b120 0x7f9b7806f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:43.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.889+0000 7f9b7f4e4640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9b780d0bc0 0x7f9b7806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:43.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.889+0000 7f9b7f4e4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b7815b500 con 0x7f9b7806dec0 2024-09-19T08:38:43.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.889+0000 7f9b7f4e4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9b7806e940 con 0x7f9b7815b120 2024-09-19T08:38:43.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.889+0000 7f9b7f4e4640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f9b7806ec20 con 0x7f9b780d0bc0 2024-09-19T08:38:43.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.889+0000 7f9b7d280640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9b7815b120 0x7f9b7806f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:43.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.889+0000 7f9b7ca7f640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f9b7806dec0 0x7f9b780d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:49904/0 (socket says 172.21.15.117:49904) 2024-09-19T08:38:43.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.889+0000 7f9b7ca7f640 1 -- 172.21.15.117:0/3437982458 learned_addr learned my addr 172.21.15.117:0/3437982458 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:43.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.889+0000 7f9b7da81640 1 --2- 172.21.15.117:0/3437982458 >> v2:172.21.15.146:3300/0 conn(0x7f9b780d0bc0 0x7f9b7806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:43.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.889+0000 7f9b7d280640 1 -- 172.21.15.117:0/3437982458 >> v2:172.21.15.146:3300/0 conn(0x7f9b780d0bc0 msgr2=0x7f9b7806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:43.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.889+0000 7f9b7d280640 1 --2- 172.21.15.117:0/3437982458 >> v2:172.21.15.146:3300/0 conn(0x7f9b780d0bc0 0x7f9b7806e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:43.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.889+0000 7f9b7d280640 1 -- 172.21.15.117:0/3437982458 >> v1:172.21.15.117:6789/0 conn(0x7f9b7806dec0 legacy=0x7f9b780d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:43.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.889+0000 7f9b6ffff640 1 -- 172.21.15.117:0/3437982458 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 11217724 0 0) 0x7f9b7815b500 con 0x7f9b7806dec0 2024-09-19T08:38:43.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.889+0000 7f9b7d280640 1 -- 172.21.15.117:0/3437982458 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7806ef00 con 0x7f9b7815b120 2024-09-19T08:38:43.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.890+0000 7f9b7d280640 1 --2- 172.21.15.117:0/3437982458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b7815b120 0x7f9b7806f9e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9b7815eb60 tx=0x7f9b7402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c190988871dd0659 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:43.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.890+0000 7f9b6ffff640 1 -- 172.21.15.117:0/3437982458 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b74037070 con 0x7f9b7815b120 2024-09-19T08:38:43.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.890+0000 7f9b6ffff640 1 -- 172.21.15.117:0/3437982458 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b74032440 con 0x7f9b7815b120 2024-09-19T08:38:43.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.890+0000 7f9b6ffff640 1 -- 172.21.15.117:0/3437982458 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b74032810 con 0x7f9b7815b120 2024-09-19T08:38:43.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.890+0000 7f9b7f4e4640 1 -- 172.21.15.117:0/3437982458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b7815b120 msgr2=0x7f9b7806f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:43.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.890+0000 7f9b7f4e4640 1 --2- 172.21.15.117:0/3437982458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b7815b120 0x7f9b7806f9e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9b7815eb60 tx=0x7f9b7402a1a0 comp rx=0 tx=0).stop 2024-09-19T08:38:43.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.890+0000 7f9b7f4e4640 1 -- 172.21.15.117:0/3437982458 shutdown_connections 2024-09-19T08:38:43.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.890+0000 7f9b7f4e4640 1 --2- 172.21.15.117:0/3437982458 >> v2:172.21.15.146:3300/0 conn(0x7f9b780d0bc0 0x7f9b7806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:43.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.890+0000 7f9b7f4e4640 1 --2- 172.21.15.117:0/3437982458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b7815b120 0x7f9b7806f9e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:43.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.890+0000 7f9b7f4e4640 1 -- 172.21.15.117:0/3437982458 >> 172.21.15.117:0/3437982458 conn(0x7f9b7806bdf0 msgr2=0x7f9b7806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:43.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.891+0000 7f9b7f4e4640 1 -- 172.21.15.117:0/3437982458 shutdown_connections 2024-09-19T08:38:43.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.891+0000 7f9b7f4e4640 1 -- 172.21.15.117:0/3437982458 wait complete. 2024-09-19T08:38:43.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.892+0000 7f9b7f4e4640 1 Processor -- start 2024-09-19T08:38:43.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.892+0000 7f9b7f4e4640 1 -- start start 2024-09-19T08:38:43.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.892+0000 7f9b7f4e4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b7806dec0 0x7f9b78145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:43.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.892+0000 7f9b7f4e4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b780d0bc0 0x7f9b780afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:43.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.892+0000 7f9b7f4e4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b7815b120 0x7f9b780b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:43.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.892+0000 7f9b7f4e4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9b780ce060 con 0x7f9b7806dec0 2024-09-19T08:38:43.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.892+0000 7f9b7f4e4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7806f4c0 con 0x7f9b780d0bc0 2024-09-19T08:38:43.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.892+0000 7f9b7f4e4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f9b780c5160 con 0x7f9b7815b120 2024-09-19T08:38:43.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.893+0000 7f9b7d280640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b7806dec0 0x7f9b78145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:43.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.893+0000 7f9b7d280640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b7806dec0 0x7f9b78145800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50724/0 (socket says 172.21.15.117:50724) 2024-09-19T08:38:43.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.893+0000 7f9b7d280640 1 -- 172.21.15.117:0/3888445258 learned_addr learned my addr 172.21.15.117:0/3888445258 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:43.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.893+0000 7f9b7ca7f640 1 --2- 172.21.15.117:0/3888445258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b780d0bc0 0x7f9b780afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:43.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.893+0000 7f9b7da81640 1 --2- 172.21.15.117:0/3888445258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b7815b120 0x7f9b780b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:43.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.893+0000 7f9b7d280640 1 -- 172.21.15.117:0/3888445258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b7815b120 msgr2=0x7f9b780b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:43.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.893+0000 7f9b7d280640 1 --2- 172.21.15.117:0/3888445258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b7815b120 0x7f9b780b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:43.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.893+0000 7f9b7d280640 1 -- 172.21.15.117:0/3888445258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b780d0bc0 msgr2=0x7f9b780afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:43.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.893+0000 7f9b7d280640 1 --2- 172.21.15.117:0/3888445258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b780d0bc0 0x7f9b780afdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:43.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.893+0000 7f9b7d280640 1 -- 172.21.15.117:0/3888445258 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b780adc10 con 0x7f9b7806dec0 2024-09-19T08:38:43.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.893+0000 7f9b7da81640 1 --2- 172.21.15.117:0/3888445258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b7815b120 0x7f9b780b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:43.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.893+0000 7f9b7ca7f640 1 --2- 172.21.15.117:0/3888445258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b780d0bc0 0x7f9b780afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:43.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.893+0000 7f9b7d280640 1 --2- 172.21.15.117:0/3888445258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b7806dec0 0x7f9b78145800 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9b74000c00 tx=0x7f9b740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:43.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.893+0000 7f9b6dffb640 1 -- 172.21.15.117:0/3888445258 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b74037050 con 0x7f9b7806dec0 2024-09-19T08:38:43.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.893+0000 7f9b6dffb640 1 -- 172.21.15.117:0/3888445258 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b74038040 con 0x7f9b7806dec0 2024-09-19T08:38:43.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.893+0000 7f9b6dffb640 1 -- 172.21.15.117:0/3888445258 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b74004450 con 0x7f9b7806dec0 2024-09-19T08:38:43.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.893+0000 7f9b7f4e4640 1 -- 172.21.15.117:0/3888445258 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b780adef0 con 0x7f9b7806dec0 2024-09-19T08:38:43.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.893+0000 7f9b7f4e4640 1 -- 172.21.15.117:0/3888445258 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b780ae4b0 con 0x7f9b7806dec0 2024-09-19T08:38:43.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.894+0000 7f9b7f4e4640 1 -- 172.21.15.117:0/3888445258 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b7806e330 con 0x7f9b7806dec0 2024-09-19T08:38:43.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.895+0000 7f9b6dffb640 1 -- 172.21.15.117:0/3888445258 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9b74030980 con 0x7f9b7806dec0 2024-09-19T08:38:43.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.895+0000 7f9b6dffb640 1 --2- 172.21.15.117:0/3888445258 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9b5c06c2b0 0x7f9b5c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:43.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.895+0000 7f9b6dffb640 1 -- 172.21.15.117:0/3888445258 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f9b740abe80 con 0x7f9b7806dec0 2024-09-19T08:38:43.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.896+0000 7f9b7ca7f640 1 --2- 172.21.15.117:0/3888445258 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9b5c06c2b0 0x7f9b5c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:43.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.896+0000 7f9b7ca7f640 1 --2- 172.21.15.117:0/3888445258 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9b5c06c2b0 0x7f9b5c06e770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9b78072670 tx=0x7f9b68007c30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:43.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:43.900+0000 7f9b6dffb640 1 -- 172.21.15.117:0/3888445258 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9b7407a880 con 0x7f9b7806dec0 2024-09-19T08:38:44.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.067+0000 7f9b7f4e4640 1 -- 172.21.15.117:0/3888445258 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b780723c0 con 0x7f9b7806dec0 2024-09-19T08:38:44.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.068+0000 7f9b6dffb640 1 -- 172.21.15.117:0/3888445258 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+13355 (secure 0 0 0) 0x7f9b7407a180 con 0x7f9b7806dec0 2024-09-19T08:38:44.068 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:44.068 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":43,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:38:42.769511+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6837/3614861409":"2024-09-20T08:38:39.760168+0000","172.21.15.146:6835/3614861409":"2024-09-20T08:38:39.760168+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:38:44.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.070+0000 7f9b7f4e4640 1 -- 172.21.15.117:0/3888445258 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9b5c06c2b0 msgr2=0x7f9b5c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:44.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.070+0000 7f9b7f4e4640 1 --2- 172.21.15.117:0/3888445258 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9b5c06c2b0 0x7f9b5c06e770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9b78072670 tx=0x7f9b68007c30 comp rx=0 tx=0).stop 2024-09-19T08:38:44.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.070+0000 7f9b7f4e4640 1 -- 172.21.15.117:0/3888445258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b7806dec0 msgr2=0x7f9b78145800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:44.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.070+0000 7f9b7f4e4640 1 --2- 172.21.15.117:0/3888445258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b7806dec0 0x7f9b78145800 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9b74000c00 tx=0x7f9b740046c0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.070+0000 7f9b7f4e4640 1 -- 172.21.15.117:0/3888445258 shutdown_connections 2024-09-19T08:38:44.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.070+0000 7f9b7f4e4640 1 --2- 172.21.15.117:0/3888445258 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9b5c06c2b0 0x7f9b5c06e770 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.070+0000 7f9b7f4e4640 1 --2- 172.21.15.117:0/3888445258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b7815b120 0x7f9b780b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.070+0000 7f9b7f4e4640 1 --2- 172.21.15.117:0/3888445258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b780d0bc0 0x7f9b780afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.070+0000 7f9b7f4e4640 1 --2- 172.21.15.117:0/3888445258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b7806dec0 0x7f9b78145800 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.070+0000 7f9b7f4e4640 1 -- 172.21.15.117:0/3888445258 >> 172.21.15.117:0/3888445258 conn(0x7f9b7806bdf0 msgr2=0x7f9b7806c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:44.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.070+0000 7f9b7f4e4640 1 -- 172.21.15.117:0/3888445258 shutdown_connections 2024-09-19T08:38:44.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.070+0000 7f9b7f4e4640 1 -- 172.21.15.117:0/3888445258 wait complete. 2024-09-19T08:38:44.081 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:37:01.875773+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T08:38:44.081 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T08:38:44.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.182+0000 7fcf701a1640 1 Processor -- start 2024-09-19T08:38:44.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.182+0000 7fcf701a1640 1 -- start start 2024-09-19T08:38:44.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.183+0000 7fcf701a1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf68147e70 0x7fcf680cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.183+0000 7fcf701a1640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcf6806cd20 0x7fcf6806d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.183+0000 7fcf701a1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf680cfb00 con 0x7fcf6815e870 2024-09-19T08:38:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.183+0000 7fcf701a1640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fcf68148250 con 0x7fcf6806cd20 2024-09-19T08:38:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.183+0000 7fcf701a1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fcf680cf130 con 0x7fcf68147e70 2024-09-19T08:38:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.183+0000 7fcf6e73e640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fcf6815e870 0x7fcf680cfe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:49920/0 (socket says 172.21.15.117:49920) 2024-09-19T08:38:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.183+0000 7fcf6e73e640 1 -- 172.21.15.117:0/3575970539 learned_addr learned my addr 172.21.15.117:0/3575970539 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.183+0000 7fcf6d73c640 1 --2- 172.21.15.117:0/3575970539 >> v2:172.21.15.146:3300/0 conn(0x7fcf6806cd20 0x7fcf6806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.183+0000 7fcf6df3d640 1 --2- 172.21.15.117:0/3575970539 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf68147e70 0x7fcf680cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.184+0000 7fcf6cf3b640 1 -- 172.21.15.117:0/3575970539 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3738680941 0 0) 0x7fcf680cfb00 con 0x7fcf6815e870 2024-09-19T08:38:44.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.184+0000 7fcf6cf3b640 1 -- 172.21.15.117:0/3575970539 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf50003520 con 0x7fcf6815e870 2024-09-19T08:38:44.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.184+0000 7fcf6df3d640 1 -- 172.21.15.117:0/3575970539 >> v2:172.21.15.146:3300/0 conn(0x7fcf6806cd20 msgr2=0x7fcf6806d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:44.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.184+0000 7fcf6df3d640 1 --2- 172.21.15.117:0/3575970539 >> v2:172.21.15.146:3300/0 conn(0x7fcf6806cd20 0x7fcf6806d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.184+0000 7fcf6df3d640 1 -- 172.21.15.117:0/3575970539 >> v1:172.21.15.117:6789/0 conn(0x7fcf6815e870 legacy=0x7fcf680cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:44.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.184+0000 7fcf6df3d640 1 -- 172.21.15.117:0/3575970539 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6815f450 con 0x7fcf68147e70 2024-09-19T08:38:44.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.184+0000 7fcf6d73c640 1 --2- 172.21.15.117:0/3575970539 >> v2:172.21.15.146:3300/0 conn(0x7fcf6806cd20 0x7fcf6806d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:38:44.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.185+0000 7fcf6df3d640 1 --2- 172.21.15.117:0/3575970539 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf68147e70 0x7fcf680cf5c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcf580097a0 tx=0x7fcf5802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6885d36231dbf3c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:44.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.185+0000 7fcf6cf3b640 1 -- 172.21.15.117:0/3575970539 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58037070 con 0x7fcf68147e70 2024-09-19T08:38:44.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.185+0000 7fcf6cf3b640 1 -- 172.21.15.117:0/3575970539 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf58032440 con 0x7fcf68147e70 2024-09-19T08:38:44.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.185+0000 7fcf6cf3b640 1 -- 172.21.15.117:0/3575970539 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf580327f0 con 0x7fcf68147e70 2024-09-19T08:38:44.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.185+0000 7fcf701a1640 1 -- 172.21.15.117:0/3575970539 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf68147e70 msgr2=0x7fcf680cf5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:44.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.185+0000 7fcf701a1640 1 --2- 172.21.15.117:0/3575970539 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf68147e70 0x7fcf680cf5c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcf580097a0 tx=0x7fcf5802a180 comp rx=0 tx=0).stop 2024-09-19T08:38:44.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.185+0000 7fcf701a1640 1 -- 172.21.15.117:0/3575970539 shutdown_connections 2024-09-19T08:38:44.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.185+0000 7fcf701a1640 1 --2- 172.21.15.117:0/3575970539 >> v2:172.21.15.146:3300/0 conn(0x7fcf6806cd20 0x7fcf6806d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.185+0000 7fcf701a1640 1 --2- 172.21.15.117:0/3575970539 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf68147e70 0x7fcf680cf5c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.185+0000 7fcf701a1640 1 -- 172.21.15.117:0/3575970539 >> 172.21.15.117:0/3575970539 conn(0x7fcf680b3ed0 msgr2=0x7fcf680b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:44.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.185+0000 7fcf701a1640 1 -- 172.21.15.117:0/3575970539 shutdown_connections 2024-09-19T08:38:44.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.185+0000 7fcf701a1640 1 -- 172.21.15.117:0/3575970539 wait complete. 2024-09-19T08:38:44.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.187+0000 7fcf701a1640 1 Processor -- start 2024-09-19T08:38:44.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.187+0000 7fcf701a1640 1 -- start start 2024-09-19T08:38:44.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.187+0000 7fcf701a1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf6806cd20 0x7fcf68159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:44.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.187+0000 7fcf701a1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf68147e70 0x7fcf68158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:44.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.187+0000 7fcf701a1640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf6815e870 0x7fcf6815a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.187+0000 7fcf701a1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcf680ceae0 con 0x7fcf6806cd20 2024-09-19T08:38:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.187+0000 7fcf701a1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6806d6a0 con 0x7fcf68147e70 2024-09-19T08:38:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.187+0000 7fcf701a1640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fcf680cedc0 con 0x7fcf6815e870 2024-09-19T08:38:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.187+0000 7fcf6df3d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf6806cd20 0x7fcf68159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.187+0000 7fcf6df3d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf6806cd20 0x7fcf68159fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50740/0 (socket says 172.21.15.117:50740) 2024-09-19T08:38:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.187+0000 7fcf6df3d640 1 -- 172.21.15.117:0/30549390 learned_addr learned my addr 172.21.15.117:0/30549390 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.188+0000 7fcf6e73e640 1 --2- 172.21.15.117:0/30549390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf6815e870 0x7fcf6815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.188+0000 7fcf6d73c640 1 --2- 172.21.15.117:0/30549390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf68147e70 0x7fcf68158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.188+0000 7fcf6df3d640 1 -- 172.21.15.117:0/30549390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf6815e870 msgr2=0x7fcf6815a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:44.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.188+0000 7fcf6df3d640 1 --2- 172.21.15.117:0/30549390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf6815e870 0x7fcf6815a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.188+0000 7fcf6df3d640 1 -- 172.21.15.117:0/30549390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf68147e70 msgr2=0x7fcf68158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:44.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.188+0000 7fcf6df3d640 1 --2- 172.21.15.117:0/30549390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf68147e70 0x7fcf68158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.188+0000 7fcf6df3d640 1 -- 172.21.15.117:0/30549390 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf68159470 con 0x7fcf6806cd20 2024-09-19T08:38:44.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.188+0000 7fcf6d73c640 1 --2- 172.21.15.117:0/30549390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf68147e70 0x7fcf68158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:44.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.188+0000 7fcf6df3d640 1 --2- 172.21.15.117:0/30549390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf6806cd20 0x7fcf68159fc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcf5802a1c0 tx=0x7fcf580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:44.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.188+0000 7fcf667fc640 1 -- 172.21.15.117:0/30549390 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58037040 con 0x7fcf6806cd20 2024-09-19T08:38:44.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.188+0000 7fcf667fc640 1 -- 172.21.15.117:0/30549390 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf58042070 con 0x7fcf6806cd20 2024-09-19T08:38:44.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.188+0000 7fcf701a1640 1 -- 172.21.15.117:0/30549390 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf681f41d0 con 0x7fcf6806cd20 2024-09-19T08:38:44.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.188+0000 7fcf667fc640 1 -- 172.21.15.117:0/30549390 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5803b930 con 0x7fcf6806cd20 2024-09-19T08:38:44.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.188+0000 7fcf701a1640 1 -- 172.21.15.117:0/30549390 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf681f4790 con 0x7fcf6806cd20 2024-09-19T08:38:44.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.189+0000 7fcf701a1640 1 -- 172.21.15.117:0/30549390 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf680722f0 con 0x7fcf6806cd20 2024-09-19T08:38:44.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.189+0000 7fcf667fc640 1 -- 172.21.15.117:0/30549390 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcf5803bad0 con 0x7fcf6806cd20 2024-09-19T08:38:44.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.190+0000 7fcf667fc640 1 --2- 172.21.15.117:0/30549390 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf5406c2b0 0x7fcf5406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:44.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.190+0000 7fcf667fc640 1 -- 172.21.15.117:0/30549390 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fcf580aba80 con 0x7fcf6806cd20 2024-09-19T08:38:44.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.190+0000 7fcf6d73c640 1 --2- 172.21.15.117:0/30549390 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf5406c2b0 0x7fcf5406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:44.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.191+0000 7fcf6d73c640 1 --2- 172.21.15.117:0/30549390 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf5406c2b0 0x7fcf5406e770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcf680b8410 tx=0x7fcf5c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:44.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.194+0000 7fcf667fc640 1 -- 172.21.15.117:0/30549390 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcf5807a510 con 0x7fcf6806cd20 2024-09-19T08:38:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.358+0000 7fcf701a1640 1 -- 172.21.15.117:0/30549390 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcf680690c0 con 0x7fcf6806cd20 2024-09-19T08:38:44.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.358+0000 7fcf667fc640 1 -- 172.21.15.117:0/30549390 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) ==== 93+0+10 (secure 0 0 0) 0x7fcf58079e10 con 0x7fcf6806cd20 2024-09-19T08:38:44.359 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 1 2024-09-19T08:38:44.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.360+0000 7fcf701a1640 1 -- 172.21.15.117:0/30549390 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf5406c2b0 msgr2=0x7fcf5406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:44.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.360+0000 7fcf701a1640 1 --2- 172.21.15.117:0/30549390 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf5406c2b0 0x7fcf5406e770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcf680b8410 tx=0x7fcf5c008040 comp rx=0 tx=0).stop 2024-09-19T08:38:44.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.360+0000 7fcf701a1640 1 -- 172.21.15.117:0/30549390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf6806cd20 msgr2=0x7fcf68159fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:44.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.360+0000 7fcf701a1640 1 --2- 172.21.15.117:0/30549390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf6806cd20 0x7fcf68159fc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcf5802a1c0 tx=0x7fcf580046c0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.360+0000 7fcf701a1640 1 -- 172.21.15.117:0/30549390 shutdown_connections 2024-09-19T08:38:44.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.360+0000 7fcf701a1640 1 --2- 172.21.15.117:0/30549390 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcf5406c2b0 0x7fcf5406e770 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.360+0000 7fcf701a1640 1 --2- 172.21.15.117:0/30549390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf6815e870 0x7fcf6815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.360+0000 7fcf701a1640 1 --2- 172.21.15.117:0/30549390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf68147e70 0x7fcf68158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.360+0000 7fcf701a1640 1 --2- 172.21.15.117:0/30549390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf6806cd20 0x7fcf68159fc0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.360+0000 7fcf701a1640 1 -- 172.21.15.117:0/30549390 >> 172.21.15.117:0/30549390 conn(0x7fcf680b3ed0 msgr2=0x7fcf68160020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:44.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.361+0000 7fcf701a1640 1 -- 172.21.15.117:0/30549390 shutdown_connections 2024-09-19T08:38:44.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.361+0000 7fcf701a1640 1 -- 172.21.15.117:0/30549390 wait complete. 2024-09-19T08:38:44.372 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-09-19T08:38:44.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.470+0000 7f3a4ec7b640 1 Processor -- start 2024-09-19T08:38:44.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.470+0000 7f3a4ec7b640 1 -- start start 2024-09-19T08:38:44.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.471+0000 7f3a4ec7b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a4815c270 0x7f3a4806c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:44.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.471+0000 7f3a4ec7b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3a480ae270 0x7f3a480cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:44.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.471+0000 7f3a4ec7b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a480cfda0 con 0x7f3a480b36a0 2024-09-19T08:38:44.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.471+0000 7f3a4ec7b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f3a480ccf80 con 0x7f3a480ae270 2024-09-19T08:38:44.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.471+0000 7f3a4ec7b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f3a480cd260 con 0x7f3a4815c270 2024-09-19T08:38:44.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.471+0000 7f3a3ffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3a480ae270 0x7f3a480cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:44.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.471+0000 7f3a3ffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3a480ae270 0x7f3a480cef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39462/0 (socket says 172.21.15.117:39462) 2024-09-19T08:38:44.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.471+0000 7f3a3ffff640 1 -- 172.21.15.117:0/4221042321 learned_addr learned my addr 172.21.15.117:0/4221042321 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:44.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.471+0000 7f3a4ca17640 1 --2- 172.21.15.117:0/4221042321 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a4815c270 0x7f3a4806c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:44.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.471+0000 7f3a3ffff640 1 -- 172.21.15.117:0/4221042321 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a4815c270 msgr2=0x7f3a4806c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:44.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.471+0000 7f3a3ffff640 1 --2- 172.21.15.117:0/4221042321 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a4815c270 0x7f3a4806c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.471+0000 7f3a3ffff640 1 -- 172.21.15.117:0/4221042321 >> v1:172.21.15.146:6789/0 conn(0x7f3a480b36a0 legacy=0x7f3a480d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:44.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.471+0000 7f3a3ffff640 1 -- 172.21.15.117:0/4221042321 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a480cd540 con 0x7f3a480ae270 2024-09-19T08:38:44.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.472+0000 7f3a3ffff640 1 --2- 172.21.15.117:0/4221042321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a480ae270 0x7f3a480cef70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009870 tx=0x7f3a3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76bb90cbcd520101 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:44.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.472+0000 7f3a3f7fe640 1 -- 172.21.15.117:0/4221042321 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a38037070 con 0x7f3a480ae270 2024-09-19T08:38:44.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.472+0000 7f3a3f7fe640 1 -- 172.21.15.117:0/4221042321 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a38032440 con 0x7f3a480ae270 2024-09-19T08:38:44.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.472+0000 7f3a3f7fe640 1 -- 172.21.15.117:0/4221042321 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a38032810 con 0x7f3a480ae270 2024-09-19T08:38:44.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.473+0000 7f3a4ec7b640 1 -- 172.21.15.117:0/4221042321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a480ae270 msgr2=0x7f3a480cef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:44.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.473+0000 7f3a4ec7b640 1 --2- 172.21.15.117:0/4221042321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a480ae270 0x7f3a480cef70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009870 tx=0x7f3a3802a270 comp rx=0 tx=0).stop 2024-09-19T08:38:44.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.473+0000 7f3a4ec7b640 1 -- 172.21.15.117:0/4221042321 shutdown_connections 2024-09-19T08:38:44.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.473+0000 7f3a4ec7b640 1 --2- 172.21.15.117:0/4221042321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a480ae270 0x7f3a480cef70 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.473+0000 7f3a4ec7b640 1 --2- 172.21.15.117:0/4221042321 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a4815c270 0x7f3a4806c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.473+0000 7f3a4ec7b640 1 -- 172.21.15.117:0/4221042321 >> 172.21.15.117:0/4221042321 conn(0x7f3a4809a9f0 msgr2=0x7f3a480b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:44.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.473+0000 7f3a4ec7b640 1 -- 172.21.15.117:0/4221042321 shutdown_connections 2024-09-19T08:38:44.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.473+0000 7f3a4ec7b640 1 -- 172.21.15.117:0/4221042321 wait complete. 2024-09-19T08:38:44.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.474+0000 7f3a4ec7b640 1 Processor -- start 2024-09-19T08:38:44.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.474+0000 7f3a4ec7b640 1 -- start start 2024-09-19T08:38:44.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.475+0000 7f3a4ec7b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a480ae270 0x7f3a481f4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:44.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.475+0000 7f3a4ec7b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a480b36a0 0x7f3a480c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:44.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.475+0000 7f3a4ec7b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a4815c270 0x7f3a480b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:44.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.475+0000 7f3a4ec7b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4815c7d0 con 0x7f3a480b36a0 2024-09-19T08:38:44.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.475+0000 7f3a4ec7b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4815c650 con 0x7f3a4815c270 2024-09-19T08:38:44.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.475+0000 7f3a4ec7b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f3a480ccba0 con 0x7f3a480ae270 2024-09-19T08:38:44.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.475+0000 7f3a3ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a480b36a0 0x7f3a480c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:44.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.475+0000 7f3a3ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a480b36a0 0x7f3a480c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39470/0 (socket says 172.21.15.117:39470) 2024-09-19T08:38:44.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.475+0000 7f3a3ffff640 1 -- 172.21.15.117:0/2936710175 learned_addr learned my addr 172.21.15.117:0/2936710175 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:44.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.475+0000 7f3a4ca17640 1 --2- 172.21.15.117:0/2936710175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a480ae270 0x7f3a481f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:44.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.475+0000 7f3a4d218640 1 --2- 172.21.15.117:0/2936710175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a4815c270 0x7f3a480b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:44.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.475+0000 7f3a3ffff640 1 -- 172.21.15.117:0/2936710175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a480ae270 msgr2=0x7f3a481f4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:44.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.475+0000 7f3a3ffff640 1 --2- 172.21.15.117:0/2936710175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a480ae270 0x7f3a481f4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.475+0000 7f3a3ffff640 1 -- 172.21.15.117:0/2936710175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a4815c270 msgr2=0x7f3a480b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:44.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.475+0000 7f3a3ffff640 1 --2- 172.21.15.117:0/2936710175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a4815c270 0x7f3a480b6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.475+0000 7f3a3ffff640 1 -- 172.21.15.117:0/2936710175 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a480ca480 con 0x7f3a480b36a0 2024-09-19T08:38:44.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.475+0000 7f3a4d218640 1 --2- 172.21.15.117:0/2936710175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a4815c270 0x7f3a480b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:44.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.476+0000 7f3a3ffff640 1 --2- 172.21.15.117:0/2936710175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a480b36a0 0x7f3a480c8e80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3a38000c00 tx=0x7f3a380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:44.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.476+0000 7f3a3d7fa640 1 -- 172.21.15.117:0/2936710175 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a38041020 con 0x7f3a480b36a0 2024-09-19T08:38:44.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.476+0000 7f3a3d7fa640 1 -- 172.21.15.117:0/2936710175 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a380306c0 con 0x7f3a480b36a0 2024-09-19T08:38:44.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.476+0000 7f3a4ec7b640 1 -- 172.21.15.117:0/2936710175 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a480ca760 con 0x7f3a480b36a0 2024-09-19T08:38:44.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.476+0000 7f3a3d7fa640 1 -- 172.21.15.117:0/2936710175 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a38037040 con 0x7f3a480b36a0 2024-09-19T08:38:44.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.476+0000 7f3a4ec7b640 1 -- 172.21.15.117:0/2936710175 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a480cad20 con 0x7f3a480b36a0 2024-09-19T08:38:44.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.477+0000 7f3a4ec7b640 1 -- 172.21.15.117:0/2936710175 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a4806c620 con 0x7f3a480b36a0 2024-09-19T08:38:44.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.477+0000 7f3a3d7fa640 1 -- 172.21.15.117:0/2936710175 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3a38044020 con 0x7f3a480b36a0 2024-09-19T08:38:44.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.478+0000 7f3a3d7fa640 1 --2- 172.21.15.117:0/2936710175 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3a3406c2b0 0x7f3a3406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:44.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.478+0000 7f3a3d7fa640 1 -- 172.21.15.117:0/2936710175 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f3a380ab9e0 con 0x7f3a480b36a0 2024-09-19T08:38:44.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.478+0000 7f3a4ca17640 1 --2- 172.21.15.117:0/2936710175 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3a3406c2b0 0x7f3a3406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:44.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.479+0000 7f3a4ca17640 1 --2- 172.21.15.117:0/2936710175 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3a3406c2b0 0x7f3a3406e770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3a44006fd0 tx=0x7f3a44008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:44.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.482+0000 7f3a3d7fa640 1 -- 172.21.15.117:0/2936710175 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3a3804b030 con 0x7f3a480b36a0 2024-09-19T08:38:44.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.712+0000 7f3a4ec7b640 1 -- 172.21.15.117:0/2936710175 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) -- 0x7f3a4806bef0 con 0x7f3a480b36a0 2024-09-19T08:38:44.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.778+0000 7f3a3d7fa640 1 -- 172.21.15.117:0/2936710175 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v101) ==== 152+0+0 (secure 0 0 0) 0x7f3a3807a350 con 0x7f3a480b36a0 2024-09-19T08:38:44.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.780+0000 7f3a4ec7b640 1 -- 172.21.15.117:0/2936710175 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3a3406c2b0 msgr2=0x7f3a3406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:44.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.780+0000 7f3a4ec7b640 1 --2- 172.21.15.117:0/2936710175 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3a3406c2b0 0x7f3a3406e770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3a44006fd0 tx=0x7f3a44008040 comp rx=0 tx=0).stop 2024-09-19T08:38:44.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.780+0000 7f3a4ec7b640 1 -- 172.21.15.117:0/2936710175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a480b36a0 msgr2=0x7f3a480c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:44.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.780+0000 7f3a4ec7b640 1 --2- 172.21.15.117:0/2936710175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a480b36a0 0x7f3a480c8e80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3a38000c00 tx=0x7f3a380046c0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.781+0000 7f3a4ec7b640 1 -- 172.21.15.117:0/2936710175 shutdown_connections 2024-09-19T08:38:44.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.781+0000 7f3a4ec7b640 1 --2- 172.21.15.117:0/2936710175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a4815c270 0x7f3a480b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.781+0000 7f3a4ec7b640 1 --2- 172.21.15.117:0/2936710175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a480b36a0 0x7f3a480c8e80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.781+0000 7f3a4ec7b640 1 --2- 172.21.15.117:0/2936710175 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3a3406c2b0 0x7f3a3406e770 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.781+0000 7f3a4ec7b640 1 --2- 172.21.15.117:0/2936710175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a480ae270 0x7f3a481f4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.781+0000 7f3a4ec7b640 1 -- 172.21.15.117:0/2936710175 >> 172.21.15.117:0/2936710175 conn(0x7f3a4809a9f0 msgr2=0x7f3a480b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:44.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.781+0000 7f3a4ec7b640 1 -- 172.21.15.117:0/2936710175 shutdown_connections 2024-09-19T08:38:44.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.781+0000 7f3a4ec7b640 1 -- 172.21.15.117:0/2936710175 wait complete. 2024-09-19T08:38:44.792 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T08:38:44.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.894+0000 7fe2d8d8d640 1 Processor -- start 2024-09-19T08:38:44.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.894+0000 7fe2d8d8d640 1 -- start start 2024-09-19T08:38:44.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.895+0000 7fe2d8d8d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2d40d0bc0 0x7fe2d40c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:44.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.895+0000 7fe2d8d8d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2d415b500 con 0x7fe2d406f9e0 2024-09-19T08:38:44.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.895+0000 7fe2d8d8d640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2d406e940 con 0x7fe2d415b120 2024-09-19T08:38:44.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.895+0000 7fe2d8d8d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fe2d406ec20 con 0x7fe2d40d0bc0 2024-09-19T08:38:44.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.895+0000 7fe2d1d9b640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe2d406f9e0 0x7fe2d40d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:37414/0 (socket says 172.21.15.117:37414) 2024-09-19T08:38:44.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.895+0000 7fe2d1d9b640 1 -- 172.21.15.117:0/1618210552 learned_addr learned my addr 172.21.15.117:0/1618210552 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:44.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.895+0000 7fe2d2d9d640 1 --2- 172.21.15.117:0/1618210552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2d40d0bc0 0x7fe2d40c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:44.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d159a640 1 -- 172.21.15.117:0/1618210552 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4189230349 0 0) 0x7fe2d415b500 con 0x7fe2d406f9e0 2024-09-19T08:38:44.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d159a640 1 -- 172.21.15.117:0/1618210552 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2bc003520 con 0x7fe2d406f9e0 2024-09-19T08:38:44.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d159a640 1 -- 172.21.15.117:0/1618210552 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 994058951 0 0) 0x7fe2bc003520 con 0x7fe2d406f9e0 2024-09-19T08:38:44.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d159a640 1 -- 172.21.15.117:0/1618210552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2d40d0bc0 msgr2=0x7fe2d40c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:44.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d159a640 1 --2- 172.21.15.117:0/1618210552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2d40d0bc0 0x7fe2d40c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d159a640 1 -- 172.21.15.117:0/1618210552 >> v1:172.21.15.146:6789/0 conn(0x7fe2d415b120 legacy=0x7fe2d406dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:44.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d159a640 1 -- 172.21.15.117:0/1618210552 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d406ef00 con 0x7fe2d406f9e0 2024-09-19T08:38:44.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d159a640 1 -- 172.21.15.117:0/1618210552 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7fe2c8001670 con 0x7fe2d406f9e0 2024-09-19T08:38:44.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d159a640 1 -- 172.21.15.117:0/1618210552 >> v1:172.21.15.117:6789/0 conn(0x7fe2d406f9e0 legacy=0x7fe2d40d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:44.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d159a640 1 --2- 172.21.15.117:0/1618210552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2bc0039e0 0x7fe2bc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:44.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d159a640 1 --2- 172.21.15.117:0/1618210552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2d40d0bc0 0x7fe2bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:44.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d159a640 1 --2- 172.21.15.117:0/1618210552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2bc004d40 0x7fe2bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:44.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d159a640 1 -- 172.21.15.117:0/1618210552 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d406ec20 con 0x7fe2bc004d40 2024-09-19T08:38:44.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d159a640 1 -- 172.21.15.117:0/1618210552 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc00b9f0 con 0x7fe2bc0039e0 2024-09-19T08:38:44.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d159a640 1 -- 172.21.15.117:0/1618210552 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fe2bc00bbf0 con 0x7fe2d40d0bc0 2024-09-19T08:38:44.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d2d9d640 1 --2- 172.21.15.117:0/1618210552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2bc004d40 0x7fe2bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:44.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d1d9b640 1 --2- 172.21.15.117:0/1618210552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2d40d0bc0 0x7fe2bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:44.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d259c640 1 --2- 172.21.15.117:0/1618210552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2bc0039e0 0x7fe2bc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:44.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d2d9d640 1 -- 172.21.15.117:0/1618210552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2d40d0bc0 msgr2=0x7fe2bc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:44.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d2d9d640 1 --2- 172.21.15.117:0/1618210552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2d40d0bc0 0x7fe2bc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d2d9d640 1 -- 172.21.15.117:0/1618210552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2bc0039e0 msgr2=0x7fe2bc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:44.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d2d9d640 1 --2- 172.21.15.117:0/1618210552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2bc0039e0 0x7fe2bc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.896+0000 7fe2d2d9d640 1 -- 172.21.15.117:0/1618210552 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2bc003520 con 0x7fe2bc004d40 2024-09-19T08:38:44.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.897+0000 7fe2d2d9d640 1 --2- 172.21.15.117:0/1618210552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2bc004d40 0x7fe2bc0051c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009f90 tx=0x7fe2bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d7b3e9af6b2b30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:44.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.897+0000 7fe2d159a640 1 -- 172.21.15.117:0/1618210552 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc009c10 con 0x7fe2bc004d40 2024-09-19T08:38:44.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.897+0000 7fe2d159a640 1 -- 172.21.15.117:0/1618210552 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2cc036070 con 0x7fe2bc004d40 2024-09-19T08:38:44.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.897+0000 7fe2d159a640 1 -- 172.21.15.117:0/1618210552 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc031850 con 0x7fe2bc004d40 2024-09-19T08:38:44.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.898+0000 7fe2d8d8d640 1 -- 172.21.15.117:0/1618210552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2bc004d40 msgr2=0x7fe2bc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:44.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.898+0000 7fe2d8d8d640 1 --2- 172.21.15.117:0/1618210552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2bc004d40 0x7fe2bc0051c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009f90 tx=0x7fe2bc005830 comp rx=0 tx=0).stop 2024-09-19T08:38:44.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.898+0000 7fe2d2d9d640 1 -- 172.21.15.117:0/1618210552 reap_dead start 2024-09-19T08:38:44.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.898+0000 7fe2d8d8d640 1 -- 172.21.15.117:0/1618210552 shutdown_connections 2024-09-19T08:38:44.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.898+0000 7fe2d8d8d640 1 -- 172.21.15.117:0/1618210552 >> 172.21.15.117:0/1618210552 conn(0x7fe2d406bdf0 msgr2=0x7fe2d406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:44.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.898+0000 7fe2d8d8d640 1 -- 172.21.15.117:0/1618210552 shutdown_connections 2024-09-19T08:38:44.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.898+0000 7fe2d8d8d640 1 -- 172.21.15.117:0/1618210552 wait complete. 2024-09-19T08:38:44.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.899+0000 7fe2d8d8d640 1 Processor -- start 2024-09-19T08:38:44.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.899+0000 7fe2d8d8d640 1 -- start start 2024-09-19T08:38:44.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.900+0000 7fe2d8d8d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2bc004d40 0x7fe2d40b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:44.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.900+0000 7fe2d8d8d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2d4071d60 0x7fe2d40cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:44.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.900+0000 7fe2d8d8d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2d4099530 0x7fe2d40999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:44.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.900+0000 7fe2d8d8d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d406e5d0 con 0x7fe2d4071d60 2024-09-19T08:38:44.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.900+0000 7fe2d8d8d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d406f4c0 con 0x7fe2d4099530 2024-09-19T08:38:44.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.900+0000 7fe2d8d8d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fe2d40ce060 con 0x7fe2bc004d40 2024-09-19T08:38:44.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.900+0000 7fe2d1d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2d4071d60 0x7fe2d40cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:44.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.900+0000 7fe2d1d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2d4071d60 0x7fe2d40cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39486/0 (socket says 172.21.15.117:39486) 2024-09-19T08:38:44.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.900+0000 7fe2d1d9b640 1 -- 172.21.15.117:0/2077281017 learned_addr learned my addr 172.21.15.117:0/2077281017 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:44.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.900+0000 7fe2d259c640 1 --2- 172.21.15.117:0/2077281017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2bc004d40 0x7fe2d40b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:44.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.900+0000 7fe2d2d9d640 1 --2- 172.21.15.117:0/2077281017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2d4099530 0x7fe2d40999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:44.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.900+0000 7fe2d1d9b640 1 -- 172.21.15.117:0/2077281017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2bc004d40 msgr2=0x7fe2d40b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:44.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.900+0000 7fe2d1d9b640 1 --2- 172.21.15.117:0/2077281017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2bc004d40 0x7fe2d40b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.900+0000 7fe2d1d9b640 1 -- 172.21.15.117:0/2077281017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2d4099530 msgr2=0x7fe2d40999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:44.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.900+0000 7fe2d1d9b640 1 --2- 172.21.15.117:0/2077281017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2d4099530 0x7fe2d40999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:44.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.900+0000 7fe2d1d9b640 1 -- 172.21.15.117:0/2077281017 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d4072240 con 0x7fe2d4071d60 2024-09-19T08:38:44.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.900+0000 7fe2d2d9d640 1 --2- 172.21.15.117:0/2077281017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2d4099530 0x7fe2d40999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:44.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.900+0000 7fe2d1d9b640 1 --2- 172.21.15.117:0/2077281017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2d4071d60 0x7fe2d40cb160 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8007370 tx=0x7fe2c8007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:44.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.901+0000 7fe2c2ffd640 1 -- 172.21.15.117:0/2077281017 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c800f940 con 0x7fe2d4071d60 2024-09-19T08:38:44.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.901+0000 7fe2c2ffd640 1 -- 172.21.15.117:0/2077281017 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c8018070 con 0x7fe2d4071d60 2024-09-19T08:38:44.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.901+0000 7fe2c2ffd640 1 -- 172.21.15.117:0/2077281017 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c800fd60 con 0x7fe2d4071d60 2024-09-19T08:38:44.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.901+0000 7fe2d8d8d640 1 -- 172.21.15.117:0/2077281017 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d4072520 con 0x7fe2d4071d60 2024-09-19T08:38:44.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.901+0000 7fe2d8d8d640 1 -- 172.21.15.117:0/2077281017 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d4072ae0 con 0x7fe2d4071d60 2024-09-19T08:38:44.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.902+0000 7fe2d8d8d640 1 -- 172.21.15.117:0/2077281017 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2d40d04b0 con 0x7fe2d4071d60 2024-09-19T08:38:44.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.902+0000 7fe2c2ffd640 1 -- 172.21.15.117:0/2077281017 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe2c801d460 con 0x7fe2d4071d60 2024-09-19T08:38:44.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.902+0000 7fe2c2ffd640 1 --2- 172.21.15.117:0/2077281017 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe2b406c2e0 0x7fe2b406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:44.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.902+0000 7fe2c2ffd640 1 -- 172.21.15.117:0/2077281017 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fe2c808b330 con 0x7fe2d4071d60 2024-09-19T08:38:44.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.903+0000 7fe2d259c640 1 --2- 172.21.15.117:0/2077281017 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe2b406c2e0 0x7fe2b406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:44.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.903+0000 7fe2d259c640 1 --2- 172.21.15.117:0/2077281017 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe2b406c2e0 0x7fe2b406e7a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4001910 tx=0x7fe2c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:44.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:44.907+0000 7fe2c2ffd640 1 -- 172.21.15.117:0/2077281017 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe2c8059c10 con 0x7fe2d4071d60 2024-09-19T08:38:45.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.071+0000 7fe2d8d8d640 1 -- 172.21.15.117:0/2077281017 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fe2d40cf040 con 0x7fe2d4071d60 2024-09-19T08:38:45.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.075+0000 7fe2c2ffd640 1 -- 172.21.15.117:0/2077281017 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7fe2c8059510 con 0x7fe2d4071d60 2024-09-19T08:38:45.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.077+0000 7fe2d8d8d640 1 -- 172.21.15.117:0/2077281017 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe2b406c2e0 msgr2=0x7fe2b406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:45.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.077+0000 7fe2d8d8d640 1 --2- 172.21.15.117:0/2077281017 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe2b406c2e0 0x7fe2b406e7a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4001910 tx=0x7fe2c4009040 comp rx=0 tx=0).stop 2024-09-19T08:38:45.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.077+0000 7fe2d8d8d640 1 -- 172.21.15.117:0/2077281017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2d4071d60 msgr2=0x7fe2d40cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:45.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.077+0000 7fe2d8d8d640 1 --2- 172.21.15.117:0/2077281017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2d4071d60 0x7fe2d40cb160 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8007370 tx=0x7fe2c8007830 comp rx=0 tx=0).stop 2024-09-19T08:38:45.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.077+0000 7fe2d8d8d640 1 -- 172.21.15.117:0/2077281017 shutdown_connections 2024-09-19T08:38:45.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.077+0000 7fe2d8d8d640 1 --2- 172.21.15.117:0/2077281017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2d4099530 0x7fe2d40999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:45.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.077+0000 7fe2d8d8d640 1 --2- 172.21.15.117:0/2077281017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2d4071d60 0x7fe2d40cb160 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:45.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.077+0000 7fe2d8d8d640 1 --2- 172.21.15.117:0/2077281017 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fe2b406c2e0 0x7fe2b406e7a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:45.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.077+0000 7fe2d8d8d640 1 --2- 172.21.15.117:0/2077281017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2bc004d40 0x7fe2d40b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:45.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.077+0000 7fe2d8d8d640 1 -- 172.21.15.117:0/2077281017 >> 172.21.15.117:0/2077281017 conn(0x7fe2d406bdf0 msgr2=0x7fe2d40aeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:45.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.077+0000 7fe2d8d8d640 1 -- 172.21.15.117:0/2077281017 shutdown_connections 2024-09-19T08:38:45.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.077+0000 7fe2d8d8d640 1 -- 172.21.15.117:0/2077281017 wait complete. 2024-09-19T08:38:45.087 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T08:38:45.088 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T08:38:45.145 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T08:38:45.189 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T08:38:45.190 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:38:45.190 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:38:45.206 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20491 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T08:38:45.206 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:38:45.206 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:38:45.248 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15971 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T08:38:45.248 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:38:45.248 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:38:45.263 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20491 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T08:38:45.264 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:38:45.264 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:38:45.306 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15971 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T08:38:45.307 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T08:38:45.307 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:38:45.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.404+0000 7fcc7faeb640 1 Processor -- start 2024-09-19T08:38:45.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.405+0000 7fcc7faeb640 1 -- start start 2024-09-19T08:38:45.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.405+0000 7fcc7faeb640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc781619b0 0x7fcc780d0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:45.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.405+0000 7fcc7faeb640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc780b0a80 0x7fcc780d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:45.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.405+0000 7fcc7faeb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc7806c990 con 0x7fcc78161d90 2024-09-19T08:38:45.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.405+0000 7fcc7faeb640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fcc780d0ec0 con 0x7fcc781619b0 2024-09-19T08:38:45.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.405+0000 7fcc7faeb640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fcc780cec10 con 0x7fcc780b0a80 2024-09-19T08:38:45.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7e088640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fcc78161d90 0x7fcc780cd880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:37416/0 (socket says 172.21.15.117:37416) 2024-09-19T08:38:45.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7e088640 1 -- 172.21.15.117:0/1358916567 learned_addr learned my addr 172.21.15.117:0/1358916567 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:45.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7d086640 1 --2- 172.21.15.117:0/1358916567 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc780b0a80 0x7fcc780d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:45.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7c885640 1 -- 172.21.15.117:0/1358916567 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2075245266 0 0) 0x7fcc7806c990 con 0x7fcc78161d90 2024-09-19T08:38:45.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7d887640 1 --2- 172.21.15.117:0/1358916567 >> v2:172.21.15.146:3300/0 conn(0x7fcc781619b0 0x7fcc780d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:45.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7c885640 1 -- 172.21.15.117:0/1358916567 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc60003520 con 0x7fcc78161d90 2024-09-19T08:38:45.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7c885640 1 -- 172.21.15.117:0/1358916567 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3864768856 0 0) 0x7fcc60003520 con 0x7fcc78161d90 2024-09-19T08:38:45.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7c885640 1 -- 172.21.15.117:0/1358916567 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc780b0a80 msgr2=0x7fcc780d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:45.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7c885640 1 --2- 172.21.15.117:0/1358916567 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc780b0a80 0x7fcc780d0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:45.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7c885640 1 -- 172.21.15.117:0/1358916567 >> v2:172.21.15.146:3300/0 conn(0x7fcc781619b0 msgr2=0x7fcc780d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:45.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7c885640 1 --2- 172.21.15.117:0/1358916567 >> v2:172.21.15.146:3300/0 conn(0x7fcc781619b0 0x7fcc780d0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:45.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7c885640 1 -- 172.21.15.117:0/1358916567 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc780ce930 con 0x7fcc78161d90 2024-09-19T08:38:45.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7c885640 1 -- 172.21.15.117:0/1358916567 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7fcc70001670 con 0x7fcc78161d90 2024-09-19T08:38:45.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7c885640 1 -- 172.21.15.117:0/1358916567 >> v1:172.21.15.117:6789/0 conn(0x7fcc78161d90 legacy=0x7fcc780cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:45.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7c885640 1 --2- 172.21.15.117:0/1358916567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc600039b0 0x7fcc60003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:45.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7c885640 1 --2- 172.21.15.117:0/1358916567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc60004800 0x7fcc60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:45.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7c885640 1 --2- 172.21.15.117:0/1358916567 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc780b0a80 0x7fcc600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:45.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7c885640 1 -- 172.21.15.117:0/1358916567 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcc780d0ec0 con 0x7fcc600039b0 2024-09-19T08:38:45.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7c885640 1 -- 172.21.15.117:0/1358916567 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcc780cec10 con 0x7fcc60004800 2024-09-19T08:38:45.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7c885640 1 -- 172.21.15.117:0/1358916567 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fcc6000b9c0 con 0x7fcc780b0a80 2024-09-19T08:38:45.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7d887640 1 --2- 172.21.15.117:0/1358916567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc600039b0 0x7fcc60003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:45.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7d086640 1 --2- 172.21.15.117:0/1358916567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc60004800 0x7fcc60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:45.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.406+0000 7fcc7e088640 1 --2- 172.21.15.117:0/1358916567 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc780b0a80 0x7fcc600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:45.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.407+0000 7fcc7d887640 1 -- 172.21.15.117:0/1358916567 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc780b0a80 msgr2=0x7fcc600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:45.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.407+0000 7fcc7d887640 1 --2- 172.21.15.117:0/1358916567 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc780b0a80 0x7fcc600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:45.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.407+0000 7fcc7d887640 1 -- 172.21.15.117:0/1358916567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc60004800 msgr2=0x7fcc60004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:45.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.407+0000 7fcc7d887640 1 --2- 172.21.15.117:0/1358916567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc60004800 0x7fcc60004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:45.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.407+0000 7fcc7d887640 1 -- 172.21.15.117:0/1358916567 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc60003520 con 0x7fcc600039b0 2024-09-19T08:38:45.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.407+0000 7fcc7e088640 1 --2- 172.21.15.117:0/1358916567 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc780b0a80 0x7fcc600051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:45.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.407+0000 7fcc7d887640 1 --2- 172.21.15.117:0/1358916567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc600039b0 0x7fcc60003dd0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009ac0 tx=0x7fcc60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1e50bdd0154fd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:45.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.407+0000 7fcc7c885640 1 -- 172.21.15.117:0/1358916567 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc68036070 con 0x7fcc600039b0 2024-09-19T08:38:45.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.407+0000 7fcc7c885640 1 -- 172.21.15.117:0/1358916567 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc68031400 con 0x7fcc600039b0 2024-09-19T08:38:45.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.407+0000 7fcc7c885640 1 -- 172.21.15.117:0/1358916567 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc68009690 con 0x7fcc600039b0 2024-09-19T08:38:45.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.408+0000 7fcc7faeb640 1 -- 172.21.15.117:0/1358916567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc600039b0 msgr2=0x7fcc60003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:45.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.408+0000 7fcc7faeb640 1 --2- 172.21.15.117:0/1358916567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc600039b0 0x7fcc60003dd0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009ac0 tx=0x7fcc60005830 comp rx=0 tx=0).stop 2024-09-19T08:38:45.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.408+0000 7fcc7e088640 1 -- 172.21.15.117:0/1358916567 reap_dead start 2024-09-19T08:38:45.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.408+0000 7fcc7faeb640 1 -- 172.21.15.117:0/1358916567 shutdown_connections 2024-09-19T08:38:45.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.408+0000 7fcc7faeb640 1 -- 172.21.15.117:0/1358916567 >> 172.21.15.117:0/1358916567 conn(0x7fcc7809a9f0 msgr2=0x7fcc780b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:45.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.408+0000 7fcc7faeb640 1 -- 172.21.15.117:0/1358916567 shutdown_connections 2024-09-19T08:38:45.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.408+0000 7fcc7faeb640 1 -- 172.21.15.117:0/1358916567 wait complete. 2024-09-19T08:38:45.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.409+0000 7fcc7faeb640 1 Processor -- start 2024-09-19T08:38:45.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.409+0000 7fcc7faeb640 1 -- start start 2024-09-19T08:38:45.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.410+0000 7fcc7faeb640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc600039b0 0x7fcc7815b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:45.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.410+0000 7fcc7faeb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc780c4e40 0x7fcc780c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:45.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.410+0000 7fcc7faeb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc780cc170 0x7fcc780cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:45.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.410+0000 7fcc7faeb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7806c620 con 0x7fcc780cc170 2024-09-19T08:38:45.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.410+0000 7fcc7faeb640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcc780b0820 con 0x7fcc780c4e40 2024-09-19T08:38:45.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.410+0000 7fcc7faeb640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fcc780ccce0 con 0x7fcc600039b0 2024-09-19T08:38:45.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.410+0000 7fcc7e088640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc780cc170 0x7fcc780cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:45.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.410+0000 7fcc7e088640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc780cc170 0x7fcc780cc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39504/0 (socket says 172.21.15.117:39504) 2024-09-19T08:38:45.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.410+0000 7fcc7e088640 1 -- 172.21.15.117:0/1451521253 learned_addr learned my addr 172.21.15.117:0/1451521253 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:45.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.410+0000 7fcc7d887640 1 --2- 172.21.15.117:0/1451521253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc600039b0 0x7fcc7815b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:45.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.410+0000 7fcc7d086640 1 --2- 172.21.15.117:0/1451521253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc780c4e40 0x7fcc780c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:45.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.410+0000 7fcc7e088640 1 -- 172.21.15.117:0/1451521253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc600039b0 msgr2=0x7fcc7815b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:45.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.410+0000 7fcc7e088640 1 --2- 172.21.15.117:0/1451521253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc600039b0 0x7fcc7815b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:45.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.410+0000 7fcc7e088640 1 -- 172.21.15.117:0/1451521253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc780c4e40 msgr2=0x7fcc780c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:45.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.410+0000 7fcc7e088640 1 --2- 172.21.15.117:0/1451521253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc780c4e40 0x7fcc780c52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:45.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.410+0000 7fcc7e088640 1 -- 172.21.15.117:0/1451521253 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc7815bf00 con 0x7fcc780cc170 2024-09-19T08:38:45.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.410+0000 7fcc7d887640 1 --2- 172.21.15.117:0/1451521253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc600039b0 0x7fcc7815b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:45.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.410+0000 7fcc7e088640 1 --2- 172.21.15.117:0/1451521253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc780cc170 0x7fcc780cc5f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcc70000c00 tx=0x7fcc7000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:45.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.411+0000 7fcc767fc640 1 -- 172.21.15.117:0/1451521253 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7000c610 con 0x7fcc780cc170 2024-09-19T08:38:45.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.411+0000 7fcc767fc640 1 -- 172.21.15.117:0/1451521253 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc70018070 con 0x7fcc780cc170 2024-09-19T08:38:45.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.411+0000 7fcc7faeb640 1 -- 172.21.15.117:0/1451521253 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc780c59b0 con 0x7fcc780cc170 2024-09-19T08:38:45.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.411+0000 7fcc767fc640 1 -- 172.21.15.117:0/1451521253 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7000c9b0 con 0x7fcc780cc170 2024-09-19T08:38:45.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.411+0000 7fcc7faeb640 1 -- 172.21.15.117:0/1451521253 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc780c5f70 con 0x7fcc780cc170 2024-09-19T08:38:45.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.412+0000 7fcc7faeb640 1 -- 172.21.15.117:0/1451521253 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc780cd330 con 0x7fcc780cc170 2024-09-19T08:38:45.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.412+0000 7fcc767fc640 1 -- 172.21.15.117:0/1451521253 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcc7000cb50 con 0x7fcc780cc170 2024-09-19T08:38:45.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.413+0000 7fcc767fc640 1 --2- 172.21.15.117:0/1451521253 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcc6406c2e0 0x7fcc6406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:45.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.413+0000 7fcc767fc640 1 -- 172.21.15.117:0/1451521253 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fcc7008ab00 con 0x7fcc780cc170 2024-09-19T08:38:45.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.413+0000 7fcc7d887640 1 --2- 172.21.15.117:0/1451521253 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcc6406c2e0 0x7fcc6406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:45.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.413+0000 7fcc7d887640 1 --2- 172.21.15.117:0/1451521253 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcc6406c2e0 0x7fcc6406e7a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcc68033000 tx=0x7fcc68008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:45.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.417+0000 7fcc767fc640 1 -- 172.21.15.117:0/1451521253 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcc700593e0 con 0x7fcc780cc170 2024-09-19T08:38:45.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.613+0000 7fcc7faeb640 1 -- 172.21.15.117:0/1451521253 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc780d0af0 con 0x7fcc780cc170 2024-09-19T08:38:45.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.614+0000 7fcc767fc640 1 -- 172.21.15.117:0/1451521253 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+3923 (secure 0 0 0) 0x7fcc70058ce0 con 0x7fcc780cc170 2024-09-19T08:38:45.614 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:45.614 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":18,"btime":"2024-09-19T08:38:40:763965+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4595,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2240250216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2240250216},{"type":"v1","addr":"172.21.15.146:6836","nonce":2240250216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/2165679820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":2165679820},{"type":"v1","addr":"172.21.15.117:6834","nonce":2165679820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4920,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2737032516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":2737032516},{"type":"v1","addr":"172.21.15.117:6835","nonce":2737032516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5074,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/2238407863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2238407863},{"type":"v1","addr":"172.21.15.146:6837","nonce":2238407863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[]} 2024-09-19T08:38:45.614 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 18 2024-09-19T08:38:45.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.616+0000 7fcc7faeb640 1 -- 172.21.15.117:0/1451521253 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcc6406c2e0 msgr2=0x7fcc6406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:45.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.616+0000 7fcc7faeb640 1 --2- 172.21.15.117:0/1451521253 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcc6406c2e0 0x7fcc6406e7a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcc68033000 tx=0x7fcc68008030 comp rx=0 tx=0).stop 2024-09-19T08:38:45.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.616+0000 7fcc7faeb640 1 -- 172.21.15.117:0/1451521253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc780cc170 msgr2=0x7fcc780cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:45.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.616+0000 7fcc7faeb640 1 --2- 172.21.15.117:0/1451521253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc780cc170 0x7fcc780cc5f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcc70000c00 tx=0x7fcc7000eb90 comp rx=0 tx=0).stop 2024-09-19T08:38:45.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.616+0000 7fcc7faeb640 1 -- 172.21.15.117:0/1451521253 shutdown_connections 2024-09-19T08:38:45.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.616+0000 7fcc7faeb640 1 --2- 172.21.15.117:0/1451521253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc780cc170 0x7fcc780cc5f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:45.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.616+0000 7fcc7faeb640 1 --2- 172.21.15.117:0/1451521253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc780c4e40 0x7fcc780c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:45.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.616+0000 7fcc7faeb640 1 --2- 172.21.15.117:0/1451521253 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcc6406c2e0 0x7fcc6406e7a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:45.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.616+0000 7fcc7faeb640 1 --2- 172.21.15.117:0/1451521253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc600039b0 0x7fcc7815b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:45.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.616+0000 7fcc7faeb640 1 -- 172.21.15.117:0/1451521253 >> 172.21.15.117:0/1451521253 conn(0x7fcc7809a9f0 msgr2=0x7fcc780704d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:45.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.616+0000 7fcc7faeb640 1 -- 172.21.15.117:0/1451521253 shutdown_connections 2024-09-19T08:38:45.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.616+0000 7fcc7faeb640 1 -- 172.21.15.117:0/1451521253 wait complete. 2024-09-19T08:38:45.627 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T08:38:45.627 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T08:38:45.627 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T08:38:45.627 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:38:45.627 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T08:38:45.628 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T08:38:45.628 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T08:38:45.628 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:38:45.628 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T08:38:45.628 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T08:38:45.628 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T08:38:45.629 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:38:45.629 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T08:38:45.629 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T08:38:45.629 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T08:38:45.629 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:38:45.637 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T08:38:45.637 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T08:38:45.638 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T08:38:45.638 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T08:38:45.641 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T08:38:45.641 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T08:38:45.642 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T08:38:45.642 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T08:38:45.680 INFO:tasks.ceph.mds.c:Started 2024-09-19T08:38:45.680 DEBUG:teuthology.parallel:result is None 2024-09-19T08:38:45.681 INFO:tasks.ceph.mds.a:Started 2024-09-19T08:38:45.681 DEBUG:teuthology.parallel:result is None 2024-09-19T08:38:45.684 INFO:tasks.ceph.mds.b:Started 2024-09-19T08:38:45.684 DEBUG:teuthology.parallel:result is None 2024-09-19T08:38:45.685 INFO:tasks.ceph.mds.d:Started 2024-09-19T08:38:45.685 DEBUG:teuthology.parallel:result is None 2024-09-19T08:38:45.685 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T08:38:45.755 INFO:tasks.ceph.mds.a.smithi117.stdout:starting mds.a at 2024-09-19T08:38:45.755 INFO:tasks.ceph.mds.c.smithi117.stdout:starting mds.c at 2024-09-19T08:38:45.768 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2024-09-19T08:38:45.769 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2024-09-19T08:38:45.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.789+0000 7f24a8796640 1 Processor -- start 2024-09-19T08:38:45.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.789+0000 7f24a8796640 1 -- start start 2024-09-19T08:38:45.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.790+0000 7f24a8796640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24a015b390 0x7f24a00b4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:45.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.790+0000 7f24a8796640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f24a00b6d50 0x7f24a00b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:45.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.790+0000 7f24a8796640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f24a00d1120 0x7f24a00d1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:45.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.790+0000 7f24a8796640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f24a00d1ad0 con 0x7f24a00b6d50 2024-09-19T08:38:45.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.790+0000 7f24a8796640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f24a00ae860 con 0x7f24a00d1120 2024-09-19T08:38:45.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.790+0000 7f24a8796640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f24a00aead0 con 0x7f24a015b390 2024-09-19T08:38:45.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.790+0000 7f24a5d31640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f24a00b6d50 0x7f24a00b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:45.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.790+0000 7f24a5d31640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f24a00b6d50 0x7f24a00b08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39540/0 (socket says 172.21.15.117:39540) 2024-09-19T08:38:45.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.790+0000 7f24a5d31640 1 -- 172.21.15.117:0/3361207648 learned_addr learned my addr 172.21.15.117:0/3361207648 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:45.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.790+0000 7f24a6532640 1 --2- 172.21.15.117:0/3361207648 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24a015b390 0x7f24a00b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:45.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.790+0000 7f24a6d33640 1 --2- 172.21.15.117:0/3361207648 >> v2:172.21.15.146:3300/0 conn(0x7f24a00d1120 0x7f24a00d1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:45.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.791+0000 7f24a5d31640 1 -- 172.21.15.117:0/3361207648 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24a015b390 msgr2=0x7f24a00b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:45.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.791+0000 7f24a5d31640 1 --2- 172.21.15.117:0/3361207648 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24a015b390 0x7f24a00b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:45.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.791+0000 7f24a5d31640 1 -- 172.21.15.117:0/3361207648 >> v2:172.21.15.146:3300/0 conn(0x7f24a00d1120 msgr2=0x7f24a00d1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:45.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.791+0000 7f24a5d31640 1 --2- 172.21.15.117:0/3361207648 >> v2:172.21.15.146:3300/0 conn(0x7f24a00d1120 0x7f24a00d1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:45.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.791+0000 7f24a5d31640 1 -- 172.21.15.117:0/3361207648 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a00aedb0 con 0x7f24a00b6d50 2024-09-19T08:38:45.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.791+0000 7f24a5d31640 1 --2- 172.21.15.117:0/3361207648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24a00b6d50 0x7f24a00b08a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f24a0072d90 tx=0x7f249002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c067a79528bb05eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:45.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.791+0000 7f24a5530640 1 -- 172.21.15.117:0/3361207648 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2490037070 con 0x7f24a00b6d50 2024-09-19T08:38:45.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.791+0000 7f24a5530640 1 -- 172.21.15.117:0/3361207648 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2490032440 con 0x7f24a00b6d50 2024-09-19T08:38:45.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.791+0000 7f24a5530640 1 -- 172.21.15.117:0/3361207648 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2490032810 con 0x7f24a00b6d50 2024-09-19T08:38:45.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.792+0000 7f24a8796640 1 -- 172.21.15.117:0/3361207648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24a00b6d50 msgr2=0x7f24a00b08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:45.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.792+0000 7f24a8796640 1 --2- 172.21.15.117:0/3361207648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24a00b6d50 0x7f24a00b08a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f24a0072d90 tx=0x7f249002a140 comp rx=0 tx=0).stop 2024-09-19T08:38:45.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.792+0000 7f24a8796640 1 -- 172.21.15.117:0/3361207648 shutdown_connections 2024-09-19T08:38:45.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.792+0000 7f24a8796640 1 --2- 172.21.15.117:0/3361207648 >> v2:172.21.15.146:3300/0 conn(0x7f24a00d1120 0x7f24a00d1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:45.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.792+0000 7f24a8796640 1 --2- 172.21.15.117:0/3361207648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24a00b6d50 0x7f24a00b08a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:45.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.792+0000 7f24a8796640 1 --2- 172.21.15.117:0/3361207648 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24a015b390 0x7f24a00b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:45.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.792+0000 7f24a8796640 1 -- 172.21.15.117:0/3361207648 >> 172.21.15.117:0/3361207648 conn(0x7f24a009a9f0 msgr2=0x7f24a00b6640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:45.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.792+0000 7f24a8796640 1 -- 172.21.15.117:0/3361207648 shutdown_connections 2024-09-19T08:38:45.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.792+0000 7f24a8796640 1 -- 172.21.15.117:0/3361207648 wait complete. 2024-09-19T08:38:45.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.793+0000 7f24a8796640 1 Processor -- start 2024-09-19T08:38:45.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.793+0000 7f24a8796640 1 -- start start 2024-09-19T08:38:45.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.794+0000 7f24a8796640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24a00b6d50 0x7f24a0151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:45.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.794+0000 7f24a8796640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a00d1120 0x7f24a009b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:45.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.794+0000 7f24a8796640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24a015b390 0x7f24a01599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:45.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.794+0000 7f24a8796640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f24a00b7190 con 0x7f24a00b6d50 2024-09-19T08:38:45.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.794+0000 7f24a8796640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f24a00b0de0 con 0x7f24a00d1120 2024-09-19T08:38:45.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.794+0000 7f24a8796640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f24a00b4790 con 0x7f24a015b390 2024-09-19T08:38:45.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.794+0000 7f24a6532640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24a00b6d50 0x7f24a0151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:45.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.794+0000 7f24a6532640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24a00b6d50 0x7f24a0151030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39550/0 (socket says 172.21.15.117:39550) 2024-09-19T08:38:45.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.794+0000 7f24a6532640 1 -- 172.21.15.117:0/3360025652 learned_addr learned my addr 172.21.15.117:0/3360025652 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:45.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.794+0000 7f24a5d31640 1 --2- 172.21.15.117:0/3360025652 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a00d1120 0x7f24a009b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:45.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.794+0000 7f24a6d33640 1 --2- 172.21.15.117:0/3360025652 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24a015b390 0x7f24a01599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:45.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.795+0000 7f24a6532640 1 -- 172.21.15.117:0/3360025652 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24a015b390 msgr2=0x7f24a01599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:45.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.795+0000 7f24a6532640 1 --2- 172.21.15.117:0/3360025652 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24a015b390 0x7f24a01599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:45.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.795+0000 7f24a6532640 1 -- 172.21.15.117:0/3360025652 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a00d1120 msgr2=0x7f24a009b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:45.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.795+0000 7f24a6532640 1 --2- 172.21.15.117:0/3360025652 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a00d1120 0x7f24a009b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:45.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.795+0000 7f24a6532640 1 -- 172.21.15.117:0/3360025652 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a009e2b0 con 0x7f24a00b6d50 2024-09-19T08:38:45.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.795+0000 7f24a6532640 1 --2- 172.21.15.117:0/3360025652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24a00b6d50 0x7f24a0151030 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f249c00e870 tx=0x7f249c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:45.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.795+0000 7f2496ffd640 1 -- 172.21.15.117:0/3360025652 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c017070 con 0x7f24a00b6d50 2024-09-19T08:38:45.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.795+0000 7f2496ffd640 1 -- 172.21.15.117:0/3360025652 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f249c00c940 con 0x7f24a00b6d50 2024-09-19T08:38:45.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.795+0000 7f24a8796640 1 -- 172.21.15.117:0/3360025652 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a009e590 con 0x7f24a00b6d50 2024-09-19T08:38:45.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.795+0000 7f2496ffd640 1 -- 172.21.15.117:0/3360025652 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c00cd30 con 0x7f24a00b6d50 2024-09-19T08:38:45.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.795+0000 7f24a8796640 1 -- 172.21.15.117:0/3360025652 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a0152580 con 0x7f24a00b6d50 2024-09-19T08:38:45.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.796+0000 7f24a8796640 1 -- 172.21.15.117:0/3360025652 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a00d1590 con 0x7f24a00b6d50 2024-09-19T08:38:45.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.796+0000 7f2496ffd640 1 -- 172.21.15.117:0/3360025652 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f249c01a070 con 0x7f24a00b6d50 2024-09-19T08:38:45.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.797+0000 7f2496ffd640 1 --2- 172.21.15.117:0/3360025652 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f248406c2b0 0x7f248406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:45.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.797+0000 7f2496ffd640 1 -- 172.21.15.117:0/3360025652 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f249c08b3f0 con 0x7f24a00b6d50 2024-09-19T08:38:45.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.797+0000 7f24a5d31640 1 --2- 172.21.15.117:0/3360025652 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f248406c2b0 0x7f248406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:45.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.797+0000 7f24a5d31640 1 --2- 172.21.15.117:0/3360025652 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f248406c2b0 0x7f248406e770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2490034000 tx=0x7f249002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:45.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.801+0000 7f2496ffd640 1 -- 172.21.15.117:0/3360025652 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f249c059710 con 0x7f24a00b6d50 2024-09-19T08:38:45.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:45.984+0000 7f24a8796640 1 -- 172.21.15.117:0/3360025652 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f24a00cd9b0 con 0x7f24a00b6d50 2024-09-19T08:38:46.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.813+0000 7f2496ffd640 1 -- 172.21.15.117:0/3360025652 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v48) ==== 97+0+0 (secure 0 0 0) 0x7f249c05da10 con 0x7f24a00b6d50 2024-09-19T08:38:46.813 INFO:teuthology.orchestra.run.smithi117.stderr: removed all blocklist entries 2024-09-19T08:38:46.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.816+0000 7f24a8796640 1 -- 172.21.15.117:0/3360025652 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f248406c2b0 msgr2=0x7f248406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:46.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.816+0000 7f24a8796640 1 --2- 172.21.15.117:0/3360025652 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f248406c2b0 0x7f248406e770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2490034000 tx=0x7f249002e000 comp rx=0 tx=0).stop 2024-09-19T08:38:46.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.816+0000 7f24a8796640 1 -- 172.21.15.117:0/3360025652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24a00b6d50 msgr2=0x7f24a0151030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:46.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.816+0000 7f24a8796640 1 --2- 172.21.15.117:0/3360025652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24a00b6d50 0x7f24a0151030 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f249c00e870 tx=0x7f249c00ed30 comp rx=0 tx=0).stop 2024-09-19T08:38:46.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.816+0000 7f24a8796640 1 -- 172.21.15.117:0/3360025652 shutdown_connections 2024-09-19T08:38:46.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.816+0000 7f24a8796640 1 --2- 172.21.15.117:0/3360025652 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f248406c2b0 0x7f248406e770 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:46.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.816+0000 7f24a8796640 1 --2- 172.21.15.117:0/3360025652 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24a015b390 0x7f24a01599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:46.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.816+0000 7f24a8796640 1 --2- 172.21.15.117:0/3360025652 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a00d1120 0x7f24a009b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:46.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.816+0000 7f24a8796640 1 --2- 172.21.15.117:0/3360025652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24a00b6d50 0x7f24a0151030 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:46.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.816+0000 7f24a8796640 1 -- 172.21.15.117:0/3360025652 >> 172.21.15.117:0/3360025652 conn(0x7f24a009a9f0 msgr2=0x7f24a00af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:46.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.817+0000 7f24a8796640 1 -- 172.21.15.117:0/3360025652 shutdown_connections 2024-09-19T08:38:46.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.817+0000 7f24a8796640 1 -- 172.21.15.117:0/3360025652 wait complete. 2024-09-19T08:38:46.830 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T08:38:46.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.933+0000 7f71d521e640 1 Processor -- start 2024-09-19T08:38:46.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.933+0000 7f71d521e640 1 -- start start 2024-09-19T08:38:46.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.934+0000 7f71d521e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f71d015f0d0 0x7f71d015f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:46.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.934+0000 7f71d521e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71d00d4130 0x7f71d00d4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:46.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.934+0000 7f71d521e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71d00d1b10 con 0x7f71d00d0070 2024-09-19T08:38:46.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.934+0000 7f71d521e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f71d00cf2b0 con 0x7f71d015f0d0 2024-09-19T08:38:46.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.934+0000 7f71d521e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f71d00cf590 con 0x7f71d00d4130 2024-09-19T08:38:46.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.934+0000 7f71ced9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f71d015f0d0 0x7f71d015f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:46.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.934+0000 7f71ce59c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f71d00d0070 0x7f71d00d1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:37434/0 (socket says 172.21.15.117:37434) 2024-09-19T08:38:46.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.934+0000 7f71ce59c640 1 -- 172.21.15.117:0/2143573759 learned_addr learned my addr 172.21.15.117:0/2143573759 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:46.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.935+0000 7f71cf59e640 1 --2- 172.21.15.117:0/2143573759 >> v2:172.21.15.146:3300/0 conn(0x7f71d00d4130 0x7f71d00d4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:46.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.935+0000 7f71ced9d640 1 -- 172.21.15.117:0/2143573759 >> v2:172.21.15.146:3300/0 conn(0x7f71d00d4130 msgr2=0x7f71d00d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:46.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.935+0000 7f71ced9d640 1 --2- 172.21.15.117:0/2143573759 >> v2:172.21.15.146:3300/0 conn(0x7f71d00d4130 0x7f71d00d4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:46.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.935+0000 7f71ced9d640 1 -- 172.21.15.117:0/2143573759 >> v1:172.21.15.117:6789/0 conn(0x7f71d00d0070 legacy=0x7f71d00d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:46.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.935+0000 7f71ced9d640 1 -- 172.21.15.117:0/2143573759 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d00cf870 con 0x7f71d015f0d0 2024-09-19T08:38:46.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.935+0000 7f71cdd9b640 1 -- 172.21.15.117:0/2143573759 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1679476887 0 0) 0x7f71d00d1b10 con 0x7f71d00d0070 2024-09-19T08:38:46.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.935+0000 7f71ced9d640 1 --2- 172.21.15.117:0/2143573759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71d015f0d0 0x7f71d015f4b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f71d00d04e0 tx=0x7f71b802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca670284b813e7e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:46.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.936+0000 7f71cdd9b640 1 -- 172.21.15.117:0/2143573759 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b8037070 con 0x7f71d015f0d0 2024-09-19T08:38:46.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.936+0000 7f71cdd9b640 1 -- 172.21.15.117:0/2143573759 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b8032440 con 0x7f71d015f0d0 2024-09-19T08:38:46.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.936+0000 7f71cdd9b640 1 -- 172.21.15.117:0/2143573759 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b802ae60 con 0x7f71d015f0d0 2024-09-19T08:38:46.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.936+0000 7f71d521e640 1 -- 172.21.15.117:0/2143573759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71d015f0d0 msgr2=0x7f71d015f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:46.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.936+0000 7f71d521e640 1 --2- 172.21.15.117:0/2143573759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71d015f0d0 0x7f71d015f4b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f71d00d04e0 tx=0x7f71b802a110 comp rx=0 tx=0).stop 2024-09-19T08:38:46.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.936+0000 7f71d521e640 1 -- 172.21.15.117:0/2143573759 shutdown_connections 2024-09-19T08:38:46.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.936+0000 7f71d521e640 1 --2- 172.21.15.117:0/2143573759 >> v2:172.21.15.146:3300/0 conn(0x7f71d00d4130 0x7f71d00d4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:46.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.936+0000 7f71d521e640 1 --2- 172.21.15.117:0/2143573759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71d015f0d0 0x7f71d015f4b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:46.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.936+0000 7f71d521e640 1 -- 172.21.15.117:0/2143573759 >> 172.21.15.117:0/2143573759 conn(0x7f71d009d760 msgr2=0x7f71d008bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:46.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.936+0000 7f71d521e640 1 -- 172.21.15.117:0/2143573759 shutdown_connections 2024-09-19T08:38:46.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.936+0000 7f71d521e640 1 -- 172.21.15.117:0/2143573759 wait complete. 2024-09-19T08:38:46.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.938+0000 7f71d521e640 1 Processor -- start 2024-09-19T08:38:46.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.938+0000 7f71d521e640 1 -- start start 2024-09-19T08:38:46.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.938+0000 7f71d521e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71d00d0070 0x7f71d01f7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:46.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.938+0000 7f71d521e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d00d4130 0x7f71d0157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:46.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.938+0000 7f71d521e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71d015f0d0 0x7f71d00b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:46.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.938+0000 7f71d521e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f71d00cef60 con 0x7f71d00d0070 2024-09-19T08:38:46.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.938+0000 7f71d521e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f71d00d4aa0 con 0x7f71d00d4130 2024-09-19T08:38:46.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.938+0000 7f71d521e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f71d00b2f70 con 0x7f71d015f0d0 2024-09-19T08:38:46.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.939+0000 7f71ced9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71d00d0070 0x7f71d01f7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:46.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.939+0000 7f71ced9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71d00d0070 0x7f71d01f7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39574/0 (socket says 172.21.15.117:39574) 2024-09-19T08:38:46.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.939+0000 7f71ced9d640 1 -- 172.21.15.117:0/2758188431 learned_addr learned my addr 172.21.15.117:0/2758188431 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:46.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.939+0000 7f71cf59e640 1 --2- 172.21.15.117:0/2758188431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71d015f0d0 0x7f71d00b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:46.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.939+0000 7f71ce59c640 1 --2- 172.21.15.117:0/2758188431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d00d4130 0x7f71d0157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:46.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.939+0000 7f71ced9d640 1 -- 172.21.15.117:0/2758188431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71d015f0d0 msgr2=0x7f71d00b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:46.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.939+0000 7f71ced9d640 1 --2- 172.21.15.117:0/2758188431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71d015f0d0 0x7f71d00b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:46.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.939+0000 7f71ced9d640 1 -- 172.21.15.117:0/2758188431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d00d4130 msgr2=0x7f71d0157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:46.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.939+0000 7f71ced9d640 1 --2- 172.21.15.117:0/2758188431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d00d4130 0x7f71d0157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:46.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.939+0000 7f71ced9d640 1 -- 172.21.15.117:0/2758188431 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d01f83b0 con 0x7f71d00d0070 2024-09-19T08:38:46.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.939+0000 7f71ced9d640 1 --2- 172.21.15.117:0/2758188431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71d00d0070 0x7f71d01f7e70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f71b8000c00 tx=0x7f71b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:46.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.939+0000 7f71c77fe640 1 -- 172.21.15.117:0/2758188431 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b8037050 con 0x7f71d00d0070 2024-09-19T08:38:46.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.939+0000 7f71c77fe640 1 -- 172.21.15.117:0/2758188431 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b8038040 con 0x7f71d00d0070 2024-09-19T08:38:46.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.939+0000 7f71c77fe640 1 -- 172.21.15.117:0/2758188431 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b8004470 con 0x7f71d00d0070 2024-09-19T08:38:46.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.939+0000 7f71d521e640 1 -- 172.21.15.117:0/2758188431 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d00cc450 con 0x7f71d00d0070 2024-09-19T08:38:46.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.939+0000 7f71d521e640 1 -- 172.21.15.117:0/2758188431 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d00b3bb0 con 0x7f71d00d0070 2024-09-19T08:38:46.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.940+0000 7f71d521e640 1 -- 172.21.15.117:0/2758188431 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71d00cc620 con 0x7f71d00d0070 2024-09-19T08:38:46.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.941+0000 7f71c77fe640 1 -- 172.21.15.117:0/2758188431 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f71b8030900 con 0x7f71d00d0070 2024-09-19T08:38:46.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.941+0000 7f71c77fe640 1 --2- 172.21.15.117:0/2758188431 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f71b006c2b0 0x7f71b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:46.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.941+0000 7f71c77fe640 1 -- 172.21.15.117:0/2758188431 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5249+0+0 (secure 0 0 0) 0x7f71b80abcf0 con 0x7f71d00d0070 2024-09-19T08:38:46.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.941+0000 7f71ce59c640 1 --2- 172.21.15.117:0/2758188431 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f71b006c2b0 0x7f71b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:46.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.942+0000 7f71ce59c640 1 --2- 172.21.15.117:0/2758188431 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f71b006c2b0 0x7f71b006e770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f71d015e3c0 tx=0x7f71c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:46.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:46.946+0000 7f71c77fe640 1 -- 172.21.15.117:0/2758188431 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f71b80b0070 con 0x7f71d00d0070 2024-09-19T08:38:47.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.173+0000 7f71d521e640 1 -- 172.21.15.117:0/2758188431 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f71d00d4560 con 0x7f71d00d0070 2024-09-19T08:38:47.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.173+0000 7f71c77fe640 1 -- 172.21.15.117:0/2758188431 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7f71d01f83b0 con 0x7f71d00d0070 2024-09-19T08:38:47.174 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:47.174 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T08:38:47.174 INFO:teuthology.orchestra.run.smithi117.stdout: "auth_dump": [ 2024-09-19T08:38:47.174 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:47.174 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "mds.a", 2024-09-19T08:38:47.174 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB44utmHw2nDRAAoIVTtJpfdniBkgt/n50nHg==", 2024-09-19T08:38:47.174 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:47.174 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow", 2024-09-19T08:38:47.174 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow *", 2024-09-19T08:38:47.174 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow *", 2024-09-19T08:38:47.174 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "mds.b", 2024-09-19T08:38:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB44utmifiDGRAA34GAUAJ4KhXW2WGLdHa9xQ==", 2024-09-19T08:38:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow", 2024-09-19T08:38:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow *", 2024-09-19T08:38:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow *", 2024-09-19T08:38:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:47.175 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "mds.c", 2024-09-19T08:38:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB44utme+LSFBAA/tadCvj4CzlxiMj1w/T6/A==", 2024-09-19T08:38:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow", 2024-09-19T08:38:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow *", 2024-09-19T08:38:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow *", 2024-09-19T08:38:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "mds.d", 2024-09-19T08:38:47.176 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB44utmS0KGIBAAsTEM5IiQpHXzO5J+j1wn3w==", 2024-09-19T08:38:47.177 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:47.177 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow", 2024-09-19T08:38:47.177 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow *", 2024-09-19T08:38:47.177 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow *", 2024-09-19T08:38:47.177 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:47.177 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:47.177 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:47.177 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:47.177 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.0", 2024-09-19T08:38:47.177 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB84utmxBpsEhAABdz/Goew538p9BNfIgRrsQ==", 2024-09-19T08:38:47.177 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:47.178 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2024-09-19T08:38:47.178 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2024-09-19T08:38:47.178 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:47.178 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:47.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:47.178 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:47.178 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.1", 2024-09-19T08:38:47.178 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB/4utmHUdUIxAAG09ixI0+EoBdrDIJcwIGnQ==", 2024-09-19T08:38:47.178 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:47.178 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2024-09-19T08:38:47.178 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2024-09-19T08:38:47.178 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:47.178 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:47.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:47.179 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:47.179 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.2", 2024-09-19T08:38:47.179 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQCC4utmGxKkNBAAZ7PRYmJzVPiO4MJKhDi4Dg==", 2024-09-19T08:38:47.179 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:47.179 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2024-09-19T08:38:47.179 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2024-09-19T08:38:47.179 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:47.179 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:47.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:47.180 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:47.180 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.3", 2024-09-19T08:38:47.180 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQCF4utmITrTNRAAx1Vb1imQtiwe7bmAubkpAw==", 2024-09-19T08:38:47.180 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:47.180 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2024-09-19T08:38:47.181 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2024-09-19T08:38:47.181 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:47.181 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:47.181 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:47.181 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:47.181 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.4", 2024-09-19T08:38:47.181 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQCM4utmhQxCFBAATgkv9JUObRF+tpU1GYcPDw==", 2024-09-19T08:38:47.181 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:47.181 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2024-09-19T08:38:47.181 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2024-09-19T08:38:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.5", 2024-09-19T08:38:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQCP4utmwQLhMxAAgaQDJyUNuUAorZcg3ujn1g==", 2024-09-19T08:38:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2024-09-19T08:38:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2024-09-19T08:38:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:47.182 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.6", 2024-09-19T08:38:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQCT4utm8hylFxAAZIkKmzbAkG47lxMgxAQXYg==", 2024-09-19T08:38:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2024-09-19T08:38:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2024-09-19T08:38:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "osd.7", 2024-09-19T08:38:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQCW4utm5q1yHBAA129yQst2D7WxXHl8n8H67A==", 2024-09-19T08:38:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow profile osd", 2024-09-19T08:38:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile osd", 2024-09-19T08:38:47.183 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.0", 2024-09-19T08:38:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB44utm6+SOJBAAd1SCpjEGh0tRc3cpmnVJDA==", 2024-09-19T08:38:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow", 2024-09-19T08:38:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow r", 2024-09-19T08:38:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T08:38:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.1", 2024-09-19T08:38:47.184 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB44utmwZhILRAA7XsdtUcwcRNMsBtD7b0oEg==", 2024-09-19T08:38:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow", 2024-09-19T08:38:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow r", 2024-09-19T08:38:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow rw", 2024-09-19T08:38:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow rwx" 2024-09-19T08:38:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.2", 2024-09-19T08:38:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB44utm+kIcKhAAChWsl4sULIR5oEpWzebQBw==", 2024-09-19T08:38:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow", 2024-09-19T08:38:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow r", 2024-09-19T08:38:47.185 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow rw", 2024-09-19T08:38:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow rwx" 2024-09-19T08:38:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.3", 2024-09-19T08:38:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB44utmovjYMhAAM8bTiJHlA0Cs8jOoDV5N2w==", 2024-09-19T08:38:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow", 2024-09-19T08:38:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow r", 2024-09-19T08:38:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow rw", 2024-09-19T08:38:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow rwx" 2024-09-19T08:38:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:47.186 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "client.admin", 2024-09-19T08:38:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB34utmAVe1LRAA02O+aGvuW08bs5cP5Ybx5g==", 2024-09-19T08:38:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow *", 2024-09-19T08:38:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": "allow *", 2024-09-19T08:38:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow *", 2024-09-19T08:38:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "mgr.x", 2024-09-19T08:38:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB44utmIExxChAAnLzpZuo2zLAlA3djNp6qhQ==", 2024-09-19T08:38:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:47.187 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow *", 2024-09-19T08:38:47.188 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile mgr", 2024-09-19T08:38:47.188 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:47.188 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:47.188 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:38:47.188 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:47.188 INFO:teuthology.orchestra.run.smithi117.stdout: "entity": "mgr.y", 2024-09-19T08:38:47.188 INFO:teuthology.orchestra.run.smithi117.stdout: "key": "AQB44utmU4TYBhAARfqD+WyAad5N6j/Dbg4azQ==", 2024-09-19T08:38:47.188 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": { 2024-09-19T08:38:47.188 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": "allow *", 2024-09-19T08:38:47.188 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": "allow profile mgr", 2024-09-19T08:38:47.188 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": "allow *" 2024-09-19T08:38:47.188 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:47.188 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:47.189 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2024-09-19T08:38:47.189 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T08:38:47.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.175+0000 7f71d521e640 1 -- 172.21.15.117:0/2758188431 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f71b006c2b0 msgr2=0x7f71b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:47.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.175+0000 7f71d521e640 1 --2- 172.21.15.117:0/2758188431 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f71b006c2b0 0x7f71b006e770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f71d015e3c0 tx=0x7f71c0009040 comp rx=0 tx=0).stop 2024-09-19T08:38:47.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.175+0000 7f71d521e640 1 -- 172.21.15.117:0/2758188431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71d00d0070 msgr2=0x7f71d01f7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:47.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.175+0000 7f71d521e640 1 --2- 172.21.15.117:0/2758188431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71d00d0070 0x7f71d01f7e70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f71b8000c00 tx=0x7f71b80046c0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.175+0000 7f71d521e640 1 -- 172.21.15.117:0/2758188431 shutdown_connections 2024-09-19T08:38:47.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.175+0000 7f71d521e640 1 --2- 172.21.15.117:0/2758188431 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f71b006c2b0 0x7f71b006e770 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.175+0000 7f71d521e640 1 --2- 172.21.15.117:0/2758188431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71d015f0d0 0x7f71d00b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.175+0000 7f71d521e640 1 --2- 172.21.15.117:0/2758188431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d00d4130 0x7f71d0157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.175+0000 7f71d521e640 1 --2- 172.21.15.117:0/2758188431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71d00d0070 0x7f71d01f7e70 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.175+0000 7f71d521e640 1 -- 172.21.15.117:0/2758188431 >> 172.21.15.117:0/2758188431 conn(0x7f71d009d760 msgr2=0x7f71d00d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:47.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.175+0000 7f71d521e640 1 -- 172.21.15.117:0/2758188431 shutdown_connections 2024-09-19T08:38:47.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.175+0000 7f71d521e640 1 -- 172.21.15.117:0/2758188431 wait complete. 2024-09-19T08:38:47.191 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T08:38:47.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.291+0000 7ff4be2ba640 1 Processor -- start 2024-09-19T08:38:47.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.291+0000 7ff4be2ba640 1 -- start start 2024-09-19T08:38:47.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.291+0000 7ff4be2ba640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff4b8141470 0x7ff4b8141b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:47.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.292+0000 7ff4be2ba640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4b8161f10 con 0x7ff4b806ce70 2024-09-19T08:38:47.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.292+0000 7ff4be2ba640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4b8141850 con 0x7ff4b80d2840 2024-09-19T08:38:47.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.292+0000 7ff4be2ba640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff4b81621b0 con 0x7ff4b8141470 2024-09-19T08:38:47.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.292+0000 7ff4b7fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff4b8141470 0x7ff4b8141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:47.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.292+0000 7ff4b77fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7ff4b806ce70 0x7ff4b80d2130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:37440/0 (socket says 172.21.15.117:37440) 2024-09-19T08:38:47.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.292+0000 7ff4b77fe640 1 -- 172.21.15.117:0/718915686 learned_addr learned my addr 172.21.15.117:0/718915686 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:47.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.292+0000 7ff4b7fff640 1 -- 172.21.15.117:0/718915686 >> v1:172.21.15.146:6789/0 conn(0x7ff4b80d2840 legacy=0x7ff4b815ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:47.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.292+0000 7ff4b7fff640 1 -- 172.21.15.117:0/718915686 >> v1:172.21.15.117:6789/0 conn(0x7ff4b806ce70 legacy=0x7ff4b80d2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:47.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.292+0000 7ff4b7fff640 1 -- 172.21.15.117:0/718915686 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b8162490 con 0x7ff4b8141470 2024-09-19T08:38:47.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.293+0000 7ff4b7fff640 1 --2- 172.21.15.117:0/718915686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b8141470 0x7ff4b8141b70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80097a0 tx=0x7ff4a802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2143513b1040c2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:47.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.293+0000 7ff4b6ffd640 1 -- 172.21.15.117:0/718915686 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8037070 con 0x7ff4b8141470 2024-09-19T08:38:47.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.293+0000 7ff4b6ffd640 1 -- 172.21.15.117:0/718915686 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a802ae50 con 0x7ff4b8141470 2024-09-19T08:38:47.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.293+0000 7ff4b6ffd640 1 -- 172.21.15.117:0/718915686 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8032660 con 0x7ff4b8141470 2024-09-19T08:38:47.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.293+0000 7ff4be2ba640 1 -- 172.21.15.117:0/718915686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b8141470 msgr2=0x7ff4b8141b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:47.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.293+0000 7ff4be2ba640 1 --2- 172.21.15.117:0/718915686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b8141470 0x7ff4b8141b70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80097a0 tx=0x7ff4a802a140 comp rx=0 tx=0).stop 2024-09-19T08:38:47.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.293+0000 7ff4be2ba640 1 -- 172.21.15.117:0/718915686 shutdown_connections 2024-09-19T08:38:47.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.293+0000 7ff4be2ba640 1 --2- 172.21.15.117:0/718915686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b8141470 0x7ff4b8141b70 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.293+0000 7ff4be2ba640 1 -- 172.21.15.117:0/718915686 >> 172.21.15.117:0/718915686 conn(0x7ff4b80b4040 msgr2=0x7ff4b80b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:47.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.293+0000 7ff4be2ba640 1 -- 172.21.15.117:0/718915686 shutdown_connections 2024-09-19T08:38:47.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.293+0000 7ff4be2ba640 1 -- 172.21.15.117:0/718915686 wait complete. 2024-09-19T08:38:47.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.294+0000 7ff4be2ba640 1 Processor -- start 2024-09-19T08:38:47.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.295+0000 7ff4be2ba640 1 -- start start 2024-09-19T08:38:47.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.295+0000 7ff4be2ba640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b806ce70 0x7ff4b8160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:47.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.295+0000 7ff4be2ba640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b80d2840 0x7ff4b813d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:47.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.295+0000 7ff4be2ba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b8141470 0x7ff4b813de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:47.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.295+0000 7ff4be2ba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b8162d30 con 0x7ff4b8141470 2024-09-19T08:38:47.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.295+0000 7ff4be2ba640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b8162a50 con 0x7ff4b80d2840 2024-09-19T08:38:47.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.295+0000 7ff4be2ba640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7ff4b806d300 con 0x7ff4b806ce70 2024-09-19T08:38:47.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.295+0000 7ff4bc857640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b8141470 0x7ff4b813de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:47.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.296+0000 7ff4bc857640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b8141470 0x7ff4b813de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39584/0 (socket says 172.21.15.117:39584) 2024-09-19T08:38:47.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.296+0000 7ff4bc857640 1 -- 172.21.15.117:0/514182316 learned_addr learned my addr 172.21.15.117:0/514182316 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:47.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.296+0000 7ff4b7fff640 1 --2- 172.21.15.117:0/514182316 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b806ce70 0x7ff4b8160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:47.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.296+0000 7ff4b77fe640 1 --2- 172.21.15.117:0/514182316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b80d2840 0x7ff4b813d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:47.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.296+0000 7ff4bc857640 1 -- 172.21.15.117:0/514182316 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b806ce70 msgr2=0x7ff4b8160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:47.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.296+0000 7ff4bc857640 1 --2- 172.21.15.117:0/514182316 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b806ce70 0x7ff4b8160ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.296+0000 7ff4bc857640 1 -- 172.21.15.117:0/514182316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b80d2840 msgr2=0x7ff4b813d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:47.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.296+0000 7ff4bc857640 1 --2- 172.21.15.117:0/514182316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b80d2840 0x7ff4b813d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.296+0000 7ff4bc857640 1 -- 172.21.15.117:0/514182316 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b8160130 con 0x7ff4b8141470 2024-09-19T08:38:47.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.296+0000 7ff4bc857640 1 --2- 172.21.15.117:0/514182316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b8141470 0x7ff4b813de00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000c7b0 tx=0x7ff4b000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:47.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.296+0000 7ff4b4ff9640 1 -- 172.21.15.117:0/514182316 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0004b60 con 0x7ff4b8141470 2024-09-19T08:38:47.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.296+0000 7ff4b4ff9640 1 -- 172.21.15.117:0/514182316 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4b0004d00 con 0x7ff4b8141470 2024-09-19T08:38:47.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.296+0000 7ff4be2ba640 1 -- 172.21.15.117:0/514182316 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4b8160410 con 0x7ff4b8141470 2024-09-19T08:38:47.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.296+0000 7ff4b4ff9640 1 -- 172.21.15.117:0/514182316 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b000aa90 con 0x7ff4b8141470 2024-09-19T08:38:47.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.296+0000 7ff4be2ba640 1 -- 172.21.15.117:0/514182316 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4b81609d0 con 0x7ff4b8141470 2024-09-19T08:38:47.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.297+0000 7ff4be2ba640 1 -- 172.21.15.117:0/514182316 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4b806d690 con 0x7ff4b8141470 2024-09-19T08:38:47.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.298+0000 7ff4b4ff9640 1 -- 172.21.15.117:0/514182316 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff4b000ac30 con 0x7ff4b8141470 2024-09-19T08:38:47.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.298+0000 7ff4b4ff9640 1 --2- 172.21.15.117:0/514182316 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff4a406c2b0 0x7ff4a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:47.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.298+0000 7ff4b4ff9640 1 -- 172.21.15.117:0/514182316 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5249+0+0 (secure 0 0 0) 0x7ff4b008b450 con 0x7ff4b8141470 2024-09-19T08:38:47.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.298+0000 7ff4b7fff640 1 --2- 172.21.15.117:0/514182316 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff4a406c2b0 0x7ff4a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:47.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.299+0000 7ff4b7fff640 1 --2- 172.21.15.117:0/514182316 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff4a406c2b0 0x7ff4a406e770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8034000 tx=0x7ff4a802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:47.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.302+0000 7ff4b4ff9640 1 -- 172.21.15.117:0/514182316 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff4b0020070 con 0x7ff4b8141470 2024-09-19T08:38:47.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.471+0000 7ff4be2ba640 1 -- 172.21.15.117:0/514182316 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff4b813d6a0 con 0x7ff4b8141470 2024-09-19T08:38:47.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.471+0000 7ff4b4ff9640 1 -- 172.21.15.117:0/514182316 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v48) ==== 84+0+65 (secure 0 0 0) 0x7ff4b00596a0 con 0x7ff4b8141470 2024-09-19T08:38:47.471 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:47.471 INFO:teuthology.orchestra.run.smithi117.stdout:[ 2024-09-19T08:38:47.471 INFO:teuthology.orchestra.run.smithi117.stdout: { 2024-09-19T08:38:47.471 INFO:teuthology.orchestra.run.smithi117.stdout: "poolnum": 1, 2024-09-19T08:38:47.471 INFO:teuthology.orchestra.run.smithi117.stdout: "poolname": ".mgr" 2024-09-19T08:38:47.471 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:38:47.471 INFO:teuthology.orchestra.run.smithi117.stdout:] 2024-09-19T08:38:47.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.473+0000 7ff4be2ba640 1 -- 172.21.15.117:0/514182316 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff4a406c2b0 msgr2=0x7ff4a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:47.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.473+0000 7ff4be2ba640 1 --2- 172.21.15.117:0/514182316 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff4a406c2b0 0x7ff4a406e770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8034000 tx=0x7ff4a802e000 comp rx=0 tx=0).stop 2024-09-19T08:38:47.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.473+0000 7ff4be2ba640 1 -- 172.21.15.117:0/514182316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b8141470 msgr2=0x7ff4b813de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:47.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.473+0000 7ff4be2ba640 1 --2- 172.21.15.117:0/514182316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b8141470 0x7ff4b813de00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000c7b0 tx=0x7ff4b000cc70 comp rx=0 tx=0).stop 2024-09-19T08:38:47.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.473+0000 7ff4be2ba640 1 -- 172.21.15.117:0/514182316 shutdown_connections 2024-09-19T08:38:47.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.473+0000 7ff4be2ba640 1 --2- 172.21.15.117:0/514182316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b8141470 0x7ff4b813de00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.473+0000 7ff4be2ba640 1 --2- 172.21.15.117:0/514182316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b80d2840 0x7ff4b813d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.473+0000 7ff4be2ba640 1 --2- 172.21.15.117:0/514182316 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff4a406c2b0 0x7ff4a406e770 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.473+0000 7ff4be2ba640 1 --2- 172.21.15.117:0/514182316 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b806ce70 0x7ff4b8160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.473+0000 7ff4be2ba640 1 -- 172.21.15.117:0/514182316 >> 172.21.15.117:0/514182316 conn(0x7ff4b80b4040 msgr2=0x7ff4b815caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:47.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.473+0000 7ff4be2ba640 1 -- 172.21.15.117:0/514182316 shutdown_connections 2024-09-19T08:38:47.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.473+0000 7ff4be2ba640 1 -- 172.21.15.117:0/514182316 wait complete. 2024-09-19T08:38:47.483 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T08:38:47.484 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T08:38:47.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.587+0000 7ffaf9d31640 1 Processor -- start 2024-09-19T08:38:47.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.587+0000 7ffaf9d31640 1 -- start start 2024-09-19T08:38:47.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.587+0000 7ffaf9d31640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffaf40d4840 0x7ffaf415f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:47.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.587+0000 7ffaf9d31640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaf40d1b10 con 0x7ffaf415f0d0 2024-09-19T08:38:47.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.587+0000 7ffaf9d31640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaf40cf2b0 con 0x7ffaf40d0070 2024-09-19T08:38:47.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.587+0000 7ffaf9d31640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ffaf40cf590 con 0x7ffaf40d4840 2024-09-19T08:38:47.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.588+0000 7ffaf3fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffaf40d4840 0x7ffaf415f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:47.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.588+0000 7ffaf37fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7ffaf415f0d0 0x7ffaf40d1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:37442/0 (socket says 172.21.15.117:37442) 2024-09-19T08:38:47.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.588+0000 7ffaf37fe640 1 -- 172.21.15.117:0/1267111358 learned_addr learned my addr 172.21.15.117:0/1267111358 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:47.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.588+0000 7ffaf3fff640 1 -- 172.21.15.117:0/1267111358 >> v1:172.21.15.146:6789/0 conn(0x7ffaf40d0070 legacy=0x7ffaf40d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:47.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.588+0000 7ffaf3fff640 1 -- 172.21.15.117:0/1267111358 >> v1:172.21.15.117:6789/0 conn(0x7ffaf415f0d0 legacy=0x7ffaf40d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:47.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.588+0000 7ffaf2ffd640 1 -- 172.21.15.117:0/1267111358 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1931338720 0 0) 0x7ffaf40d1b10 con 0x7ffaf415f0d0 2024-09-19T08:38:47.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.588+0000 7ffaf3fff640 1 -- 172.21.15.117:0/1267111358 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf40cf870 con 0x7ffaf40d4840 2024-09-19T08:38:47.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.589+0000 7ffaf3fff640 1 --2- 172.21.15.117:0/1267111358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf40d4840 0x7ffaf415f4b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009dc0 tx=0x7ffaec02a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed64ab2b22dafa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:47.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.589+0000 7ffaf2ffd640 1 -- 172.21.15.117:0/1267111358 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec007740 con 0x7ffaf40d4840 2024-09-19T08:38:47.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.589+0000 7ffaf2ffd640 1 -- 172.21.15.117:0/1267111358 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaec0078e0 con 0x7ffaf40d4840 2024-09-19T08:38:47.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.589+0000 7ffaf2ffd640 1 -- 172.21.15.117:0/1267111358 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec007cb0 con 0x7ffaf40d4840 2024-09-19T08:38:47.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.589+0000 7ffaf9d31640 1 -- 172.21.15.117:0/1267111358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf40d4840 msgr2=0x7ffaf415f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:47.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.589+0000 7ffaf9d31640 1 --2- 172.21.15.117:0/1267111358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf40d4840 0x7ffaf415f4b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009dc0 tx=0x7ffaec02a640 comp rx=0 tx=0).stop 2024-09-19T08:38:47.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.589+0000 7ffaf9d31640 1 -- 172.21.15.117:0/1267111358 shutdown_connections 2024-09-19T08:38:47.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.589+0000 7ffaf9d31640 1 --2- 172.21.15.117:0/1267111358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf40d4840 0x7ffaf415f4b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.589+0000 7ffaf9d31640 1 -- 172.21.15.117:0/1267111358 >> 172.21.15.117:0/1267111358 conn(0x7ffaf409d760 msgr2=0x7ffaf408bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:47.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.589+0000 7ffaf9d31640 1 -- 172.21.15.117:0/1267111358 shutdown_connections 2024-09-19T08:38:47.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.589+0000 7ffaf9d31640 1 -- 172.21.15.117:0/1267111358 wait complete. 2024-09-19T08:38:47.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.590+0000 7ffaf9d31640 1 Processor -- start 2024-09-19T08:38:47.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.591+0000 7ffaf9d31640 1 -- start start 2024-09-19T08:38:47.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.591+0000 7ffaf9d31640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaf40d0070 0x7ffaf41597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:47.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.591+0000 7ffaf9d31640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf40d4840 0x7ffaf40b4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:47.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.591+0000 7ffaf9d31640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaf415f0d0 0x7ffaf40b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:47.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.591+0000 7ffaf9d31640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf40b2f70 con 0x7ffaf40d4840 2024-09-19T08:38:47.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.591+0000 7ffaf9d31640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf40cef60 con 0x7ffaf415f0d0 2024-09-19T08:38:47.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.591+0000 7ffaf9d31640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7ffaf40b30f0 con 0x7ffaf40d0070 2024-09-19T08:38:47.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.591+0000 7ffaeaffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf40d4840 0x7ffaf40b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:47.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.591+0000 7ffaeaffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf40d4840 0x7ffaf40b4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39598/0 (socket says 172.21.15.117:39598) 2024-09-19T08:38:47.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.591+0000 7ffaeaffd640 1 -- 172.21.15.117:0/1255196176 learned_addr learned my addr 172.21.15.117:0/1255196176 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:47.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.592+0000 7ffaf37fe640 1 --2- 172.21.15.117:0/1255196176 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaf40d0070 0x7ffaf41597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:47.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.592+0000 7ffaf3fff640 1 --2- 172.21.15.117:0/1255196176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaf415f0d0 0x7ffaf40b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:47.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.592+0000 7ffaeaffd640 1 -- 172.21.15.117:0/1255196176 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaf40d0070 msgr2=0x7ffaf41597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:47.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.592+0000 7ffaeaffd640 1 --2- 172.21.15.117:0/1255196176 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaf40d0070 0x7ffaf41597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.592+0000 7ffaeaffd640 1 -- 172.21.15.117:0/1255196176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaf415f0d0 msgr2=0x7ffaf40b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:47.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.592+0000 7ffaeaffd640 1 --2- 172.21.15.117:0/1255196176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaf415f0d0 0x7ffaf40b4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.592+0000 7ffaeaffd640 1 -- 172.21.15.117:0/1255196176 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf4160ab0 con 0x7ffaf40d4840 2024-09-19T08:38:47.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.592+0000 7ffaf37fe640 1 --2- 172.21.15.117:0/1255196176 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaf40d0070 0x7ffaf41597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:47.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.592+0000 7ffaeaffd640 1 --2- 172.21.15.117:0/1255196176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf40d4840 0x7ffaf40b4500 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00c430 tx=0x7ffadc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:47.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.592+0000 7ffaf0ff9640 1 -- 172.21.15.117:0/1255196176 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffadc011790 con 0x7ffaf40d4840 2024-09-19T08:38:47.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.592+0000 7ffaf0ff9640 1 -- 172.21.15.117:0/1255196176 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffadc017070 con 0x7ffaf40d4840 2024-09-19T08:38:47.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.592+0000 7ffaf9d31640 1 -- 172.21.15.117:0/1255196176 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf4160d90 con 0x7ffaf40d4840 2024-09-19T08:38:47.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.592+0000 7ffaf0ff9640 1 -- 172.21.15.117:0/1255196176 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffadc011b70 con 0x7ffaf40d4840 2024-09-19T08:38:47.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.592+0000 7ffaf9d31640 1 -- 172.21.15.117:0/1255196176 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaf4161350 con 0x7ffaf40d4840 2024-09-19T08:38:47.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.593+0000 7ffaf9d31640 1 -- 172.21.15.117:0/1255196176 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaf406cf30 con 0x7ffaf40d4840 2024-09-19T08:38:47.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.594+0000 7ffaf0ff9640 1 -- 172.21.15.117:0/1255196176 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ffadc011d10 con 0x7ffaf40d4840 2024-09-19T08:38:47.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.594+0000 7ffaf0ff9640 1 --2- 172.21.15.117:0/1255196176 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ffad406c2b0 0x7ffad406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:47.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.594+0000 7ffaf0ff9640 1 -- 172.21.15.117:0/1255196176 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5249+0+0 (secure 0 0 0) 0x7ffadc08afa0 con 0x7ffaf40d4840 2024-09-19T08:38:47.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.594+0000 7ffaf37fe640 1 --2- 172.21.15.117:0/1255196176 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ffad406c2b0 0x7ffad406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:47.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.595+0000 7ffaf37fe640 1 --2- 172.21.15.117:0/1255196176 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ffad406c2b0 0x7ffad406e770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffae4000f60 tx=0x7ffae4007ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:47.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.598+0000 7ffaf0ff9640 1 -- 172.21.15.117:0/1255196176 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ffadc059960 con 0x7ffaf40d4840 2024-09-19T08:38:47.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.764+0000 7ffaf9d31640 1 -- 172.21.15.117:0/1255196176 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ffaf40b1b70 con 0x7ffaf40d4840 2024-09-19T08:38:47.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.818+0000 7ffaf0ff9640 1 -- 172.21.15.117:0/1255196176 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v49) ==== 138+0+0 (secure 0 0 0) 0x7ffadc059260 con 0x7ffaf40d4840 2024-09-19T08:38:47.818 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'cephfs_metadata' created 2024-09-19T08:38:47.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.821+0000 7ffaf9d31640 1 -- 172.21.15.117:0/1255196176 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ffad406c2b0 msgr2=0x7ffad406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:47.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.821+0000 7ffaf9d31640 1 --2- 172.21.15.117:0/1255196176 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ffad406c2b0 0x7ffad406e770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffae4000f60 tx=0x7ffae4007ca0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.821+0000 7ffaf9d31640 1 -- 172.21.15.117:0/1255196176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf40d4840 msgr2=0x7ffaf40b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:47.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.821+0000 7ffaf9d31640 1 --2- 172.21.15.117:0/1255196176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf40d4840 0x7ffaf40b4500 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00c430 tx=0x7ffadc00c8f0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.821+0000 7ffaf9d31640 1 -- 172.21.15.117:0/1255196176 shutdown_connections 2024-09-19T08:38:47.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.821+0000 7ffaf9d31640 1 --2- 172.21.15.117:0/1255196176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaf415f0d0 0x7ffaf40b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.821+0000 7ffaf9d31640 1 --2- 172.21.15.117:0/1255196176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf40d4840 0x7ffaf40b4500 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.821+0000 7ffaf9d31640 1 --2- 172.21.15.117:0/1255196176 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ffad406c2b0 0x7ffad406e770 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.821+0000 7ffaf9d31640 1 --2- 172.21.15.117:0/1255196176 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaf40d0070 0x7ffaf41597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.821+0000 7ffaf9d31640 1 -- 172.21.15.117:0/1255196176 >> 172.21.15.117:0/1255196176 conn(0x7ffaf409d760 msgr2=0x7ffaf40d1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:47.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.821+0000 7ffaf9d31640 1 -- 172.21.15.117:0/1255196176 shutdown_connections 2024-09-19T08:38:47.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.821+0000 7ffaf9d31640 1 -- 172.21.15.117:0/1255196176 wait complete. 2024-09-19T08:38:47.834 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T08:38:47.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.939+0000 7fd33274b640 1 Processor -- start 2024-09-19T08:38:47.939 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.939+0000 7fd33274b640 1 -- start start 2024-09-19T08:38:47.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.940+0000 7fd33274b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd32c0cbea0 0x7fd32c0cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:47.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.940+0000 7fd33274b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd32c0d2460 0x7fd32c0d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:47.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.940+0000 7fd33274b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd32c072050 con 0x7fd32c15e2e0 2024-09-19T08:38:47.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.940+0000 7fd33274b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd32c0d2e10 con 0x7fd32c0d2460 2024-09-19T08:38:47.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.940+0000 7fd33274b640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fd32c15e6c0 con 0x7fd32c0cbea0 2024-09-19T08:38:47.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.940+0000 7fd330ce8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd32c0d2460 0x7fd32c0d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:47.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.940+0000 7fd330ce8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd32c0d2460 0x7fd32c0d28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39602/0 (socket says 172.21.15.117:39602) 2024-09-19T08:38:47.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.940+0000 7fd330ce8640 1 -- 172.21.15.117:0/302566879 learned_addr learned my addr 172.21.15.117:0/302566879 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:47.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.940+0000 7fd32b7fe640 1 --2- 172.21.15.117:0/302566879 >> v2:172.21.15.146:3300/0 conn(0x7fd32c0cbea0 0x7fd32c0cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:47.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.940+0000 7fd330ce8640 1 -- 172.21.15.117:0/302566879 >> v2:172.21.15.146:3300/0 conn(0x7fd32c0cbea0 msgr2=0x7fd32c0cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:47.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.940+0000 7fd330ce8640 1 --2- 172.21.15.117:0/302566879 >> v2:172.21.15.146:3300/0 conn(0x7fd32c0cbea0 0x7fd32c0cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.940+0000 7fd330ce8640 1 -- 172.21.15.117:0/302566879 >> v1:172.21.15.146:6789/0 conn(0x7fd32c15e2e0 legacy=0x7fd32c071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:47.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.940+0000 7fd330ce8640 1 -- 172.21.15.117:0/302566879 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c072330 con 0x7fd32c0d2460 2024-09-19T08:38:47.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.941+0000 7fd330ce8640 1 --2- 172.21.15.117:0/302566879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd32c0d2460 0x7fd32c0d28d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd32c06eca0 tx=0x7fd32402a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12061f2457f3112 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:47.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.941+0000 7fd32affd640 1 -- 172.21.15.117:0/302566879 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324036070 con 0x7fd32c0d2460 2024-09-19T08:38:47.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.941+0000 7fd32affd640 1 -- 172.21.15.117:0/302566879 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd324031600 con 0x7fd32c0d2460 2024-09-19T08:38:47.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.941+0000 7fd32affd640 1 -- 172.21.15.117:0/302566879 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3240319d0 con 0x7fd32c0d2460 2024-09-19T08:38:47.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.942+0000 7fd33274b640 1 -- 172.21.15.117:0/302566879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd32c0d2460 msgr2=0x7fd32c0d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:47.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.942+0000 7fd33274b640 1 --2- 172.21.15.117:0/302566879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd32c0d2460 0x7fd32c0d28d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd32c06eca0 tx=0x7fd32402a760 comp rx=0 tx=0).stop 2024-09-19T08:38:47.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.942+0000 7fd33274b640 1 -- 172.21.15.117:0/302566879 shutdown_connections 2024-09-19T08:38:47.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.942+0000 7fd33274b640 1 --2- 172.21.15.117:0/302566879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd32c0d2460 0x7fd32c0d28d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.942+0000 7fd33274b640 1 --2- 172.21.15.117:0/302566879 >> v2:172.21.15.146:3300/0 conn(0x7fd32c0cbea0 0x7fd32c0cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.942+0000 7fd33274b640 1 -- 172.21.15.117:0/302566879 >> 172.21.15.117:0/302566879 conn(0x7fd32c0701d0 msgr2=0x7fd32c0705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:47.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.942+0000 7fd33274b640 1 -- 172.21.15.117:0/302566879 shutdown_connections 2024-09-19T08:38:47.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.942+0000 7fd33274b640 1 -- 172.21.15.117:0/302566879 wait complete. 2024-09-19T08:38:47.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.943+0000 7fd33274b640 1 Processor -- start 2024-09-19T08:38:47.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.943+0000 7fd33274b640 1 -- start start 2024-09-19T08:38:47.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.944+0000 7fd33274b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd32c0cbea0 0x7fd32c160c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:47.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.944+0000 7fd33274b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd32c0d2460 0x7fd32c0b7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:47.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.944+0000 7fd33274b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd32c15e2e0 0x7fd32c14e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:47.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.944+0000 7fd33274b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c0d0df0 con 0x7fd32c0cbea0 2024-09-19T08:38:47.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.944+0000 7fd33274b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c0d0b10 con 0x7fd32c15e2e0 2024-09-19T08:38:47.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.944+0000 7fd33274b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fd32c0ccdb0 con 0x7fd32c0d2460 2024-09-19T08:38:47.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.944+0000 7fd32bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd32c0cbea0 0x7fd32c160c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:47.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.944+0000 7fd32bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd32c0cbea0 0x7fd32c160c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39608/0 (socket says 172.21.15.117:39608) 2024-09-19T08:38:47.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.944+0000 7fd32bfff640 1 -- 172.21.15.117:0/3775836317 learned_addr learned my addr 172.21.15.117:0/3775836317 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:47.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.944+0000 7fd330ce8640 1 --2- 172.21.15.117:0/3775836317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd32c15e2e0 0x7fd32c14e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:47.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.944+0000 7fd32b7fe640 1 --2- 172.21.15.117:0/3775836317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd32c0d2460 0x7fd32c0b7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:47.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.944+0000 7fd32bfff640 1 -- 172.21.15.117:0/3775836317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd32c0d2460 msgr2=0x7fd32c0b7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:47.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.944+0000 7fd32bfff640 1 --2- 172.21.15.117:0/3775836317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd32c0d2460 0x7fd32c0b7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.944+0000 7fd32bfff640 1 -- 172.21.15.117:0/3775836317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd32c15e2e0 msgr2=0x7fd32c14e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:47.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.944+0000 7fd32bfff640 1 --2- 172.21.15.117:0/3775836317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd32c15e2e0 0x7fd32c14e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:47.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.944+0000 7fd32bfff640 1 -- 172.21.15.117:0/3775836317 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c161720 con 0x7fd32c0cbea0 2024-09-19T08:38:47.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.945+0000 7fd32bfff640 1 --2- 172.21.15.117:0/3775836317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd32c0cbea0 0x7fd32c160c60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00c3c0 tx=0x7fd31c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:47.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.945+0000 7fd328ff9640 1 -- 172.21.15.117:0/3775836317 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c0052d0 con 0x7fd32c0cbea0 2024-09-19T08:38:47.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.945+0000 7fd328ff9640 1 -- 172.21.15.117:0/3775836317 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd31c005490 con 0x7fd32c0cbea0 2024-09-19T08:38:47.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.945+0000 7fd328ff9640 1 -- 172.21.15.117:0/3775836317 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c007260 con 0x7fd32c0cbea0 2024-09-19T08:38:47.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.945+0000 7fd33274b640 1 -- 172.21.15.117:0/3775836317 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32c0b8280 con 0x7fd32c0cbea0 2024-09-19T08:38:47.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.945+0000 7fd33274b640 1 -- 172.21.15.117:0/3775836317 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd32c161440 con 0x7fd32c0cbea0 2024-09-19T08:38:47.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.946+0000 7fd33274b640 1 -- 172.21.15.117:0/3775836317 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd32c0cc870 con 0x7fd32c0cbea0 2024-09-19T08:38:47.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.946+0000 7fd328ff9640 1 -- 172.21.15.117:0/3775836317 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd31c007400 con 0x7fd32c0cbea0 2024-09-19T08:38:47.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.947+0000 7fd328ff9640 1 --2- 172.21.15.117:0/3775836317 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd31806c2b0 0x7fd31806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:47.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.947+0000 7fd328ff9640 1 -- 172.21.15.117:0/3775836317 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5619+0+0 (secure 0 0 0) 0x7fd31c08a830 con 0x7fd32c0cbea0 2024-09-19T08:38:47.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.947+0000 7fd32b7fe640 1 --2- 172.21.15.117:0/3775836317 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd31806c2b0 0x7fd31806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:47.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.947+0000 7fd32b7fe640 1 --2- 172.21.15.117:0/3775836317 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd31806c2b0 0x7fd31806e770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd32c1611a0 tx=0x7fd320008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:47.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:47.951+0000 7fd328ff9640 1 -- 172.21.15.117:0/3775836317 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd31c059080 con 0x7fd32c0cbea0 2024-09-19T08:38:48.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.116+0000 7fd33274b640 1 -- 172.21.15.117:0/3775836317 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd32c15d6e0 con 0x7fd32c0cbea0 2024-09-19T08:38:48.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.825+0000 7fd328ff9640 1 -- 172.21.15.117:0/3775836317 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v50) ==== 170+0+0 (secure 0 0 0) 0x7fd31c058980 con 0x7fd32c0cbea0 2024-09-19T08:38:48.825 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'cephfs_data' created 2024-09-19T08:38:48.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.827+0000 7fd33274b640 1 -- 172.21.15.117:0/3775836317 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd31806c2b0 msgr2=0x7fd31806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:48.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.827+0000 7fd33274b640 1 --2- 172.21.15.117:0/3775836317 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd31806c2b0 0x7fd31806e770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd32c1611a0 tx=0x7fd320008040 comp rx=0 tx=0).stop 2024-09-19T08:38:48.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.827+0000 7fd33274b640 1 -- 172.21.15.117:0/3775836317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd32c0cbea0 msgr2=0x7fd32c160c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:48.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.827+0000 7fd33274b640 1 --2- 172.21.15.117:0/3775836317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd32c0cbea0 0x7fd32c160c60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00c3c0 tx=0x7fd31c00c880 comp rx=0 tx=0).stop 2024-09-19T08:38:48.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.827+0000 7fd33274b640 1 -- 172.21.15.117:0/3775836317 shutdown_connections 2024-09-19T08:38:48.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.827+0000 7fd33274b640 1 --2- 172.21.15.117:0/3775836317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd32c15e2e0 0x7fd32c14e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:48.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.827+0000 7fd33274b640 1 --2- 172.21.15.117:0/3775836317 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd31806c2b0 0x7fd31806e770 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:48.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.827+0000 7fd33274b640 1 --2- 172.21.15.117:0/3775836317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd32c0d2460 0x7fd32c0b7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:48.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.828+0000 7fd33274b640 1 --2- 172.21.15.117:0/3775836317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd32c0cbea0 0x7fd32c160c60 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:48.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.828+0000 7fd33274b640 1 -- 172.21.15.117:0/3775836317 >> 172.21.15.117:0/3775836317 conn(0x7fd32c0701d0 msgr2=0x7fd32c15b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:48.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.828+0000 7fd33274b640 1 -- 172.21.15.117:0/3775836317 shutdown_connections 2024-09-19T08:38:48.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.828+0000 7fd33274b640 1 -- 172.21.15.117:0/3775836317 wait complete. 2024-09-19T08:38:48.852 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T08:38:48.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.957+0000 7fb08358d640 1 Processor -- start 2024-09-19T08:38:48.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.958+0000 7fb08358d640 1 -- start start 2024-09-19T08:38:48.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.958+0000 7fb08358d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb07c15f0d0 0x7fb07c15f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:48.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.958+0000 7fb08358d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb07c0d0070 0x7fb07c0d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:48.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.959+0000 7fb08358d640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb07c0cf2b0 con 0x7fb07c0d1940 2024-09-19T08:38:48.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.959+0000 7fb08358d640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fb07c0cf590 con 0x7fb07c0d0070 2024-09-19T08:38:48.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.959+0000 7fb08358d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fb07c0cf870 con 0x7fb07c15f0d0 2024-09-19T08:38:48.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.959+0000 7fb081329640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb07c15f0d0 0x7fb07c15f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:48.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.959+0000 7fb081b2a640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb07c0d1940 0x7fb07c0d4130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.117:57900/0 (socket says 172.21.15.117:57900) 2024-09-19T08:38:48.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.959+0000 7fb081b2a640 1 -- 172.21.15.117:0/1690306986 learned_addr learned my addr 172.21.15.117:0/1690306986 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:48.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.959+0000 7fb080b28640 1 --2- 172.21.15.117:0/1690306986 >> v2:172.21.15.146:3300/0 conn(0x7fb07c0d0070 0x7fb07c0d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:48.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.959+0000 7fb081329640 1 -- 172.21.15.117:0/1690306986 >> v2:172.21.15.146:3300/0 conn(0x7fb07c0d0070 msgr2=0x7fb07c0d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:48.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.959+0000 7fb081329640 1 --2- 172.21.15.117:0/1690306986 >> v2:172.21.15.146:3300/0 conn(0x7fb07c0d0070 0x7fb07c0d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:48.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.959+0000 7fb081329640 1 -- 172.21.15.117:0/1690306986 >> v1:172.21.15.146:6789/0 conn(0x7fb07c0d1940 legacy=0x7fb07c0d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:48.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.959+0000 7fb081329640 1 -- 172.21.15.117:0/1690306986 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb07c0cfb50 con 0x7fb07c15f0d0 2024-09-19T08:38:48.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.959+0000 7fb06ffff640 1 -- 172.21.15.117:0/1690306986 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2038471722 0 0) 0x7fb07c0cf2b0 con 0x7fb07c0d1940 2024-09-19T08:38:48.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.959+0000 7fb080b28640 1 --2- 172.21.15.117:0/1690306986 >> v2:172.21.15.146:3300/0 conn(0x7fb07c0d0070 0x7fb07c0d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:38:48.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.960+0000 7fb081329640 1 --2- 172.21.15.117:0/1690306986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb07c15f0d0 0x7fb07c15f4b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb0700097a0 tx=0x7fb07002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2e3daca4ed5a2b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:48.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.960+0000 7fb06ffff640 1 -- 172.21.15.117:0/1690306986 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb070037070 con 0x7fb07c15f0d0 2024-09-19T08:38:48.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.960+0000 7fb06ffff640 1 -- 172.21.15.117:0/1690306986 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb07002ae50 con 0x7fb07c15f0d0 2024-09-19T08:38:48.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.960+0000 7fb06ffff640 1 -- 172.21.15.117:0/1690306986 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb070032660 con 0x7fb07c15f0d0 2024-09-19T08:38:48.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.961+0000 7fb08358d640 1 -- 172.21.15.117:0/1690306986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb07c15f0d0 msgr2=0x7fb07c15f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:48.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.961+0000 7fb08358d640 1 --2- 172.21.15.117:0/1690306986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb07c15f0d0 0x7fb07c15f4b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb0700097a0 tx=0x7fb07002a100 comp rx=0 tx=0).stop 2024-09-19T08:38:48.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.961+0000 7fb08358d640 1 -- 172.21.15.117:0/1690306986 shutdown_connections 2024-09-19T08:38:48.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.961+0000 7fb08358d640 1 --2- 172.21.15.117:0/1690306986 >> v2:172.21.15.146:3300/0 conn(0x7fb07c0d0070 0x7fb07c0d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:48.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.961+0000 7fb08358d640 1 --2- 172.21.15.117:0/1690306986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb07c15f0d0 0x7fb07c15f4b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:48.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.961+0000 7fb08358d640 1 -- 172.21.15.117:0/1690306986 >> 172.21.15.117:0/1690306986 conn(0x7fb07c09d760 msgr2=0x7fb07c08bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:48.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.961+0000 7fb08358d640 1 -- 172.21.15.117:0/1690306986 shutdown_connections 2024-09-19T08:38:48.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.961+0000 7fb08358d640 1 -- 172.21.15.117:0/1690306986 wait complete. 2024-09-19T08:38:48.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.962+0000 7fb08358d640 1 Processor -- start 2024-09-19T08:38:48.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.962+0000 7fb08358d640 1 -- start start 2024-09-19T08:38:48.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb08358d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb07c0d0070 0x7fb07c0b9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:48.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb08358d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb07c0d1940 0x7fb07c15b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:48.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb08358d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb07c15f0d0 0x7fb07c1f4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:48.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb08358d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c0d49c0 con 0x7fb07c15f0d0 2024-09-19T08:38:48.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb08358d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c0d4840 con 0x7fb07c0d1940 2024-09-19T08:38:48.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb08358d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fb07c0d4b40 con 0x7fb07c0d0070 2024-09-19T08:38:48.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb081b2a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb07c15f0d0 0x7fb07c1f4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:48.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb080b28640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb07c0d1940 0x7fb07c15b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:48.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb081329640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb07c0d0070 0x7fb07c0b9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:48.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb081b2a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb07c15f0d0 0x7fb07c1f4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39612/0 (socket says 172.21.15.117:39612) 2024-09-19T08:38:48.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb080b28640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb07c0d1940 0x7fb07c15b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.117:42094/0 (socket says 172.21.15.117:42094) 2024-09-19T08:38:48.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb081b2a640 1 -- 172.21.15.117:0/400658197 learned_addr learned my addr 172.21.15.117:0/400658197 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:48.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb081b2a640 1 -- 172.21.15.117:0/400658197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb07c0d0070 msgr2=0x7fb07c0b9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:48.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb081b2a640 1 --2- 172.21.15.117:0/400658197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb07c0d0070 0x7fb07c0b9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:48.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb081b2a640 1 -- 172.21.15.117:0/400658197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb07c0d1940 msgr2=0x7fb07c15b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:48.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb081b2a640 1 --2- 172.21.15.117:0/400658197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb07c0d1940 0x7fb07c15b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:48.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb081b2a640 1 -- 172.21.15.117:0/400658197 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb07c15bce0 con 0x7fb07c15f0d0 2024-09-19T08:38:48.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb080b28640 1 --2- 172.21.15.117:0/400658197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb07c0d1940 0x7fb07c15b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:38:48.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb081b2a640 1 --2- 172.21.15.117:0/400658197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb07c15f0d0 0x7fb07c1f4010 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb07400c7b0 tx=0x7fb07400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:48.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb06dffb640 1 -- 172.21.15.117:0/400658197 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb074018070 con 0x7fb07c15f0d0 2024-09-19T08:38:48.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb06dffb640 1 -- 172.21.15.117:0/400658197 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb07400a640 con 0x7fb07c15f0d0 2024-09-19T08:38:48.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb06dffb640 1 -- 172.21.15.117:0/400658197 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07400aa70 con 0x7fb07c15f0d0 2024-09-19T08:38:48.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.963+0000 7fb08358d640 1 -- 172.21.15.117:0/400658197 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb07c1f4550 con 0x7fb07c15f0d0 2024-09-19T08:38:48.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.964+0000 7fb08358d640 1 -- 172.21.15.117:0/400658197 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb07c1f4b00 con 0x7fb07c15f0d0 2024-09-19T08:38:48.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.965+0000 7fb08358d640 1 -- 172.21.15.117:0/400658197 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb07c0d1400 con 0x7fb07c15f0d0 2024-09-19T08:38:48.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.965+0000 7fb06dffb640 1 -- 172.21.15.117:0/400658197 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb07401b070 con 0x7fb07c15f0d0 2024-09-19T08:38:48.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.965+0000 7fb06dffb640 1 --2- 172.21.15.117:0/400658197 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb06006c2b0 0x7fb06006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:48.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.966+0000 7fb06dffb640 1 -- 172.21.15.117:0/400658197 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6001+0+0 (secure 0 0 0) 0x7fb07408aab0 con 0x7fb07c15f0d0 2024-09-19T08:38:48.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.966+0000 7fb081329640 1 --2- 172.21.15.117:0/400658197 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb06006c2b0 0x7fb06006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:48.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.966+0000 7fb081329640 1 --2- 172.21.15.117:0/400658197 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb06006c2b0 0x7fb06006e770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb070034000 tx=0x7fb07002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:48.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:48.970+0000 7fb06dffb640 1 -- 172.21.15.117:0/400658197 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb074058aa0 con 0x7fb07c15f0d0 2024-09-19T08:38:49.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.168+0000 7fb08358d640 1 -- 172.21.15.117:0/400658197 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb07c06cf30 con 0x7fb07c15f0d0 2024-09-19T08:38:49.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.826+0000 7fb06dffb640 1 -- 172.21.15.117:0/400658197 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v20) ==== 172+0+0 (secure 0 0 0) 0x7fb07405cda0 con 0x7fb07c15f0d0 2024-09-19T08:38:49.826 INFO:teuthology.orchestra.run.smithi117.stderr:new fs with metadata pool 7 and data pool 8 2024-09-19T08:38:49.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.831+0000 7fb08358d640 1 -- 172.21.15.117:0/400658197 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb06006c2b0 msgr2=0x7fb06006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:49.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.831+0000 7fb08358d640 1 --2- 172.21.15.117:0/400658197 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb06006c2b0 0x7fb06006e770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb070034000 tx=0x7fb07002e000 comp rx=0 tx=0).stop 2024-09-19T08:38:49.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.831+0000 7fb08358d640 1 -- 172.21.15.117:0/400658197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb07c15f0d0 msgr2=0x7fb07c1f4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:49.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.831+0000 7fb08358d640 1 --2- 172.21.15.117:0/400658197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb07c15f0d0 0x7fb07c1f4010 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb07400c7b0 tx=0x7fb07400cc70 comp rx=0 tx=0).stop 2024-09-19T08:38:49.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.831+0000 7fb08358d640 1 -- 172.21.15.117:0/400658197 shutdown_connections 2024-09-19T08:38:49.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.831+0000 7fb08358d640 1 --2- 172.21.15.117:0/400658197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb07c15f0d0 0x7fb07c1f4010 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:49.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.831+0000 7fb08358d640 1 --2- 172.21.15.117:0/400658197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb07c0d1940 0x7fb07c15b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:49.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.831+0000 7fb08358d640 1 --2- 172.21.15.117:0/400658197 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb06006c2b0 0x7fb06006e770 secure :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb070034000 tx=0x7fb07002e000 comp rx=0 tx=0).stop 2024-09-19T08:38:49.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.831+0000 7fb08358d640 1 --2- 172.21.15.117:0/400658197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb07c0d0070 0x7fb07c0b9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:49.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.831+0000 7fb08358d640 1 -- 172.21.15.117:0/400658197 >> 172.21.15.117:0/400658197 conn(0x7fb07c09d760 msgr2=0x7fb07c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:49.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.832+0000 7fb08358d640 1 -- 172.21.15.117:0/400658197 shutdown_connections 2024-09-19T08:38:49.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.832+0000 7fb08358d640 1 -- 172.21.15.117:0/400658197 wait complete. 2024-09-19T08:38:49.863 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:38:49.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.966+0000 7f9092a77640 1 Processor -- start 2024-09-19T08:38:49.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.966+0000 7f9092a77640 1 -- start start 2024-09-19T08:38:49.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.967+0000 7f9092a77640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f908c06f9e0 0x7f908c0d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:49.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.967+0000 7f9092a77640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f908c0d0e00 con 0x7f908c0d09f0 2024-09-19T08:38:49.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.967+0000 7f9092a77640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f908c15b500 con 0x7f908c15b120 2024-09-19T08:38:49.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.967+0000 7f9092a77640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f908c06e940 con 0x7f908c06f9e0 2024-09-19T08:38:49.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.967+0000 7f9091014640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f908c0d09f0 0x7f908c0c5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:37458/0 (socket says 172.21.15.117:37458) 2024-09-19T08:38:49.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.967+0000 7f9091014640 1 -- 172.21.15.117:0/1114655413 learned_addr learned my addr 172.21.15.117:0/1114655413 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:49.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.967+0000 7f9083fff640 1 --2- 172.21.15.117:0/1114655413 >> v2:172.21.15.146:3300/0 conn(0x7f908c06f9e0 0x7f908c0d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:49.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.967+0000 7f90837fe640 1 -- 172.21.15.117:0/1114655413 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3923546191 0 0) 0x7f9084001490 con 0x7f908c0d09f0 2024-09-19T08:38:49.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.967+0000 7f90837fe640 1 -- 172.21.15.117:0/1114655413 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9074003520 con 0x7f908c0d09f0 2024-09-19T08:38:49.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f90837fe640 1 -- 172.21.15.117:0/1114655413 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3367885860 0 0) 0x7f9074003520 con 0x7f908c0d09f0 2024-09-19T08:38:49.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f90837fe640 1 -- 172.21.15.117:0/1114655413 >> v2:172.21.15.146:3300/0 conn(0x7f908c06f9e0 msgr2=0x7f908c0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:49.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f90837fe640 1 --2- 172.21.15.117:0/1114655413 >> v2:172.21.15.146:3300/0 conn(0x7f908c06f9e0 0x7f908c0d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:49.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f90837fe640 1 -- 172.21.15.117:0/1114655413 >> v1:172.21.15.146:6789/0 conn(0x7f908c15b120 legacy=0x7f908c06dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:49.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f90837fe640 1 -- 172.21.15.117:0/1114655413 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908c06ec20 con 0x7f908c0d09f0 2024-09-19T08:38:49.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f90837fe640 1 -- 172.21.15.117:0/1114655413 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f9084001bc0 con 0x7f908c0d09f0 2024-09-19T08:38:49.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f90837fe640 1 -- 172.21.15.117:0/1114655413 >> v1:172.21.15.117:6789/0 conn(0x7f908c0d09f0 legacy=0x7f908c0c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:49.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f90837fe640 1 --2- 172.21.15.117:0/1114655413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90740039b0 0x7f9074003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:49.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f90837fe640 1 --2- 172.21.15.117:0/1114655413 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9074004800 0x7f9074004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:49.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f90837fe640 1 --2- 172.21.15.117:0/1114655413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90740051c0 0x7f907400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:49.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f90837fe640 1 -- 172.21.15.117:0/1114655413 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f908c06e940 con 0x7f90740039b0 2024-09-19T08:38:49.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f90837fe640 1 -- 172.21.15.117:0/1114655413 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f907400c060 con 0x7f90740051c0 2024-09-19T08:38:49.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f90837fe640 1 -- 172.21.15.117:0/1114655413 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f907400c260 con 0x7f9074004800 2024-09-19T08:38:49.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f9090813640 1 --2- 172.21.15.117:0/1114655413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90740039b0 0x7f9074003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:49.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f9083fff640 1 --2- 172.21.15.117:0/1114655413 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9074004800 0x7f9074004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:49.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f9091014640 1 --2- 172.21.15.117:0/1114655413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90740051c0 0x7f907400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:49.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f9090813640 1 -- 172.21.15.117:0/1114655413 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9074004800 msgr2=0x7f9074004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:49.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f9090813640 1 --2- 172.21.15.117:0/1114655413 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9074004800 0x7f9074004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:49.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f9090813640 1 -- 172.21.15.117:0/1114655413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90740051c0 msgr2=0x7f907400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:49.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f9090813640 1 --2- 172.21.15.117:0/1114655413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90740051c0 0x7f907400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:49.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f9090813640 1 -- 172.21.15.117:0/1114655413 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9074003520 con 0x7f90740039b0 2024-09-19T08:38:49.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f9091014640 1 --2- 172.21.15.117:0/1114655413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90740051c0 0x7f907400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:49.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.968+0000 7f9091014640 1 -- 172.21.15.117:0/1114655413 reap_dead start 2024-09-19T08:38:49.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.969+0000 7f9090813640 1 --2- 172.21.15.117:0/1114655413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90740039b0 0x7f9074003dd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9088001750 tx=0x7f9074005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daedc8627649c507 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:49.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.969+0000 7f90837fe640 1 -- 172.21.15.117:0/1114655413 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088001370 con 0x7f90740039b0 2024-09-19T08:38:49.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.969+0000 7f90837fe640 1 -- 172.21.15.117:0/1114655413 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90880052d0 con 0x7f90740039b0 2024-09-19T08:38:49.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.969+0000 7f90837fe640 1 -- 172.21.15.117:0/1114655413 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908802abc0 con 0x7f90740039b0 2024-09-19T08:38:49.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.969+0000 7f9092a77640 1 -- 172.21.15.117:0/1114655413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90740039b0 msgr2=0x7f9074003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:49.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.969+0000 7f9092a77640 1 --2- 172.21.15.117:0/1114655413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90740039b0 0x7f9074003dd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9088001750 tx=0x7f9074005830 comp rx=0 tx=0).stop 2024-09-19T08:38:49.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.969+0000 7f9092a77640 1 -- 172.21.15.117:0/1114655413 shutdown_connections 2024-09-19T08:38:49.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.969+0000 7f9092a77640 1 --2- 172.21.15.117:0/1114655413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90740039b0 0x7f9074003dd0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:49.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.969+0000 7f9092a77640 1 -- 172.21.15.117:0/1114655413 >> 172.21.15.117:0/1114655413 conn(0x7f908c06bdf0 msgr2=0x7f908c06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:49.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.969+0000 7f9092a77640 1 -- 172.21.15.117:0/1114655413 shutdown_connections 2024-09-19T08:38:49.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.970+0000 7f9092a77640 1 -- 172.21.15.117:0/1114655413 wait complete. 2024-09-19T08:38:49.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.971+0000 7f9092a77640 1 Processor -- start 2024-09-19T08:38:49.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.971+0000 7f9092a77640 1 -- start start 2024-09-19T08:38:49.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.972+0000 7f9092a77640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90740039b0 0x7f908c14d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:49.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.972+0000 7f9092a77640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f908c159b50 0x7f908c159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:49.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.972+0000 7f9092a77640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f908c1e38c0 0x7f908c1e3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:49.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.972+0000 7f9092a77640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f908c06f4c0 con 0x7f90740039b0 2024-09-19T08:38:49.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.972+0000 7f9092a77640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f908c06f1e0 con 0x7f908c1e38c0 2024-09-19T08:38:49.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.972+0000 7f9092a77640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f908c0ce060 con 0x7f908c159b50 2024-09-19T08:38:49.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.972+0000 7f9090813640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90740039b0 0x7f908c14d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:49.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.972+0000 7f9090813640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90740039b0 0x7f908c14d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39630/0 (socket says 172.21.15.117:39630) 2024-09-19T08:38:49.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.972+0000 7f9090813640 1 -- 172.21.15.117:0/401720261 learned_addr learned my addr 172.21.15.117:0/401720261 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:49.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.972+0000 7f9091014640 1 --2- 172.21.15.117:0/401720261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f908c1e38c0 0x7f908c1e3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:49.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.972+0000 7f9090813640 1 -- 172.21.15.117:0/401720261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f908c159b50 msgr2=0x7f908c159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:49.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.972+0000 7f9090813640 1 --2- 172.21.15.117:0/401720261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f908c159b50 0x7f908c159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:49.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.972+0000 7f9090813640 1 -- 172.21.15.117:0/401720261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f908c1e38c0 msgr2=0x7f908c1e3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:49.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.972+0000 7f9090813640 1 --2- 172.21.15.117:0/401720261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f908c1e38c0 0x7f908c1e3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:49.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.972+0000 7f9090813640 1 -- 172.21.15.117:0/401720261 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908c158a90 con 0x7f90740039b0 2024-09-19T08:38:49.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.972+0000 7f9090813640 1 --2- 172.21.15.117:0/401720261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90740039b0 0x7f908c14d770 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9088000c00 tx=0x7f9088001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:49.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.972+0000 7f90817fa640 1 -- 172.21.15.117:0/401720261 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088037040 con 0x7f90740039b0 2024-09-19T08:38:49.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.972+0000 7f90817fa640 1 -- 172.21.15.117:0/401720261 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9088005480 con 0x7f90740039b0 2024-09-19T08:38:49.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.972+0000 7f9092a77640 1 -- 172.21.15.117:0/401720261 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f908c1e45d0 con 0x7f90740039b0 2024-09-19T08:38:49.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.972+0000 7f90817fa640 1 -- 172.21.15.117:0/401720261 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088007a30 con 0x7f90740039b0 2024-09-19T08:38:49.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.972+0000 7f9092a77640 1 -- 172.21.15.117:0/401720261 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f908c159010 con 0x7f90740039b0 2024-09-19T08:38:49.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.973+0000 7f9092a77640 1 -- 172.21.15.117:0/401720261 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f908c0d04b0 con 0x7f90740039b0 2024-09-19T08:38:49.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.974+0000 7f90817fa640 1 -- 172.21.15.117:0/401720261 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9088044020 con 0x7f90740039b0 2024-09-19T08:38:49.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.974+0000 7f90817fa640 1 --2- 172.21.15.117:0/401720261 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f907806c2e0 0x7f907806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:49.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.974+0000 7f90817fa640 1 -- 172.21.15.117:0/401720261 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f90880ab0e0 con 0x7f90740039b0 2024-09-19T08:38:49.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.974+0000 7f9083fff640 1 --2- 172.21.15.117:0/401720261 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f907806c2e0 0x7f907806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:49.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.975+0000 7f9083fff640 1 --2- 172.21.15.117:0/401720261 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f907806c2e0 0x7f907806e7a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f907c006e80 tx=0x7f907c006df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:49.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:49.979+0000 7f90817fa640 1 -- 172.21.15.117:0/401720261 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9088079750 con 0x7f90740039b0 2024-09-19T08:38:50.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.146+0000 7f9092a77640 1 -- 172.21.15.117:0/401720261 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f908c0caf90 con 0x7f90740039b0 2024-09-19T08:38:50.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.147+0000 7f90817fa640 1 -- 172.21.15.117:0/401720261 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+17003 (secure 0 0 0) 0x7f9088079050 con 0x7f90740039b0 2024-09-19T08:38:50.147 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:50.147 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":51,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:38:49.170193+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:38:47.782719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-19T08:38:48.135062+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:38:50.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.149+0000 7f9092a77640 1 -- 172.21.15.117:0/401720261 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f907806c2e0 msgr2=0x7f907806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:50.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.149+0000 7f9092a77640 1 --2- 172.21.15.117:0/401720261 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f907806c2e0 0x7f907806e7a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f907c006e80 tx=0x7f907c006df0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.149+0000 7f9092a77640 1 -- 172.21.15.117:0/401720261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90740039b0 msgr2=0x7f908c14d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:50.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.149+0000 7f9092a77640 1 --2- 172.21.15.117:0/401720261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90740039b0 0x7f908c14d770 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9088000c00 tx=0x7f9088001120 comp rx=0 tx=0).stop 2024-09-19T08:38:50.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.149+0000 7f9092a77640 1 -- 172.21.15.117:0/401720261 shutdown_connections 2024-09-19T08:38:50.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.149+0000 7f9092a77640 1 --2- 172.21.15.117:0/401720261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f908c1e38c0 0x7f908c1e3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.149+0000 7f9092a77640 1 --2- 172.21.15.117:0/401720261 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f907806c2e0 0x7f907806e7a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.149+0000 7f9092a77640 1 --2- 172.21.15.117:0/401720261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f908c159b50 0x7f908c159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.149+0000 7f9092a77640 1 --2- 172.21.15.117:0/401720261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90740039b0 0x7f908c14d770 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.149+0000 7f9092a77640 1 -- 172.21.15.117:0/401720261 >> 172.21.15.117:0/401720261 conn(0x7f908c06bdf0 msgr2=0x7f908c0cbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:50.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.149+0000 7f9092a77640 1 -- 172.21.15.117:0/401720261 shutdown_connections 2024-09-19T08:38:50.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.149+0000 7f9092a77640 1 -- 172.21.15.117:0/401720261 wait complete. 2024-09-19T08:38:50.161 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:38:50.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.260+0000 7fb80d01e640 1 Processor -- start 2024-09-19T08:38:50.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.260+0000 7fb80d01e640 1 -- start start 2024-09-19T08:38:50.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.260+0000 7fb80d01e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb8080d2750 0x7fb80813f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.260+0000 7fb80d01e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8080726c0 0x7fb808160010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.260+0000 7fb80d01e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb80813fda0 con 0x7fb808072250 2024-09-19T08:38:50.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.260+0000 7fb80d01e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb808145bd0 con 0x7fb8080d2750 2024-09-19T08:38:50.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.260+0000 7fb80d01e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fb8081427e0 con 0x7fb8080726c0 2024-09-19T08:38:50.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.260+0000 7fb806d9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb8080d2750 0x7fb80813f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:50.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.261+0000 7fb7fffff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fb808072250 0x7fb8080cfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:37474/0 (socket says 172.21.15.117:37474) 2024-09-19T08:38:50.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.261+0000 7fb7fffff640 1 -- 172.21.15.117:0/2372683210 learned_addr learned my addr 172.21.15.117:0/2372683210 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:50.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.261+0000 7fb806d9d640 1 -- 172.21.15.117:0/2372683210 >> v2:172.21.15.146:3300/0 conn(0x7fb8080726c0 msgr2=0x7fb808160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:50.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.261+0000 7fb80759e640 1 --2- 172.21.15.117:0/2372683210 >> v2:172.21.15.146:3300/0 conn(0x7fb8080726c0 0x7fb808160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:50.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.261+0000 7fb80659c640 1 -- 172.21.15.117:0/2372683210 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2385456778 0 0) 0x7fb80813fda0 con 0x7fb808072250 2024-09-19T08:38:50.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.261+0000 7fb806d9d640 1 --2- 172.21.15.117:0/2372683210 >> v2:172.21.15.146:3300/0 conn(0x7fb8080726c0 0x7fb808160010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.261+0000 7fb806d9d640 1 -- 172.21.15.117:0/2372683210 >> v1:172.21.15.117:6789/0 conn(0x7fb808072250 legacy=0x7fb8080cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:50.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.261+0000 7fb806d9d640 1 -- 172.21.15.117:0/2372683210 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8080d2b30 con 0x7fb8080d2750 2024-09-19T08:38:50.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.261+0000 7fb80759e640 1 --2- 172.21.15.117:0/2372683210 >> v2:172.21.15.146:3300/0 conn(0x7fb8080726c0 0x7fb808160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:50.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.262+0000 7fb806d9d640 1 --2- 172.21.15.117:0/2372683210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8080d2750 0x7fb80813f860 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb8080b1d60 tx=0x7fb7f802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c053e62a8abfac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:50.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.262+0000 7fb80659c640 1 -- 172.21.15.117:0/2372683210 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8037070 con 0x7fb8080d2750 2024-09-19T08:38:50.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.262+0000 7fb80659c640 1 -- 172.21.15.117:0/2372683210 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f8032440 con 0x7fb8080d2750 2024-09-19T08:38:50.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.262+0000 7fb80659c640 1 -- 172.21.15.117:0/2372683210 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f802ae60 con 0x7fb8080d2750 2024-09-19T08:38:50.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.262+0000 7fb80d01e640 1 -- 172.21.15.117:0/2372683210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8080d2750 msgr2=0x7fb80813f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:50.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.262+0000 7fb80d01e640 1 --2- 172.21.15.117:0/2372683210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8080d2750 0x7fb80813f860 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb8080b1d60 tx=0x7fb7f802a110 comp rx=0 tx=0).stop 2024-09-19T08:38:50.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.262+0000 7fb80d01e640 1 -- 172.21.15.117:0/2372683210 shutdown_connections 2024-09-19T08:38:50.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.262+0000 7fb80d01e640 1 --2- 172.21.15.117:0/2372683210 >> v2:172.21.15.146:3300/0 conn(0x7fb8080726c0 0x7fb808160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.262+0000 7fb80d01e640 1 --2- 172.21.15.117:0/2372683210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8080d2750 0x7fb80813f860 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.262+0000 7fb80d01e640 1 -- 172.21.15.117:0/2372683210 >> 172.21.15.117:0/2372683210 conn(0x7fb8080b4040 msgr2=0x7fb8080b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:50.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.262+0000 7fb80d01e640 1 -- 172.21.15.117:0/2372683210 shutdown_connections 2024-09-19T08:38:50.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.262+0000 7fb80d01e640 1 -- 172.21.15.117:0/2372683210 wait complete. 2024-09-19T08:38:50.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.264+0000 7fb80d01e640 1 Processor -- start 2024-09-19T08:38:50.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.264+0000 7fb80d01e640 1 -- start start 2024-09-19T08:38:50.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.264+0000 7fb80d01e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb808072250 0x7fb8080b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.264+0000 7fb80d01e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8080726c0 0x7fb8081f1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.264+0000 7fb80d01e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8080d2750 0x7fb80813f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.264+0000 7fb80d01e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb808142220 con 0x7fb808072250 2024-09-19T08:38:50.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.264+0000 7fb80d01e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb808141f40 con 0x7fb8080d2750 2024-09-19T08:38:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.264+0000 7fb80d01e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fb808142500 con 0x7fb8080726c0 2024-09-19T08:38:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.264+0000 7fb806d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb808072250 0x7fb8080b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.264+0000 7fb806d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb808072250 0x7fb8080b5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39652/0 (socket says 172.21.15.117:39652) 2024-09-19T08:38:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.264+0000 7fb806d9d640 1 -- 172.21.15.117:0/197524947 learned_addr learned my addr 172.21.15.117:0/197524947 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.265+0000 7fb806d9d640 1 -- 172.21.15.117:0/197524947 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8080726c0 msgr2=0x7fb8081f1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.265+0000 7fb806d9d640 1 --2- 172.21.15.117:0/197524947 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8080726c0 0x7fb8081f1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.265+0000 7fb80759e640 1 --2- 172.21.15.117:0/197524947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8080d2750 0x7fb80813f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.265+0000 7fb806d9d640 1 -- 172.21.15.117:0/197524947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8080d2750 msgr2=0x7fb80813f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.265+0000 7fb806d9d640 1 --2- 172.21.15.117:0/197524947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8080d2750 0x7fb80813f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.265+0000 7fb806d9d640 1 -- 172.21.15.117:0/197524947 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8080b6280 con 0x7fb808072250 2024-09-19T08:38:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.265+0000 7fb806d9d640 1 --2- 172.21.15.117:0/197524947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb808072250 0x7fb8080b5c80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8000c00 tx=0x7fb7f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.265+0000 7fb7ff7fe640 1 -- 172.21.15.117:0/197524947 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8037040 con 0x7fb808072250 2024-09-19T08:38:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.265+0000 7fb7ff7fe640 1 -- 172.21.15.117:0/197524947 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f8042070 con 0x7fb808072250 2024-09-19T08:38:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.265+0000 7fb80d01e640 1 -- 172.21.15.117:0/197524947 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8080b6560 con 0x7fb808072250 2024-09-19T08:38:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.265+0000 7fb7ff7fe640 1 -- 172.21.15.117:0/197524947 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8030a50 con 0x7fb808072250 2024-09-19T08:38:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.265+0000 7fb80d01e640 1 -- 172.21.15.117:0/197524947 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8080b6b20 con 0x7fb808072250 2024-09-19T08:38:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.266+0000 7fb80d01e640 1 -- 172.21.15.117:0/197524947 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8081418b0 con 0x7fb808072250 2024-09-19T08:38:50.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.266+0000 7fb7ff7fe640 1 -- 172.21.15.117:0/197524947 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb7f8030bf0 con 0x7fb808072250 2024-09-19T08:38:50.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.267+0000 7fb7ff7fe640 1 --2- 172.21.15.117:0/197524947 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb7e806c2b0 0x7fb7e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.267+0000 7fb7ff7fe640 1 -- 172.21.15.117:0/197524947 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fb7f80abfe0 con 0x7fb808072250 2024-09-19T08:38:50.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.267+0000 7fb7fffff640 1 --2- 172.21.15.117:0/197524947 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb7e806c2b0 0x7fb7e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:50.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.268+0000 7fb7fffff640 1 --2- 172.21.15.117:0/197524947 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb7e806c2b0 0x7fb7e806e770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0007fd0 tx=0x7fb7f0007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:50.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.271+0000 7fb7ff7fe640 1 -- 172.21.15.117:0/197524947 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb7f807a650 con 0x7fb808072250 2024-09-19T08:38:50.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.439+0000 7fb80d01e640 1 -- 172.21.15.117:0/197524947 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8080b2a10 con 0x7fb808072250 2024-09-19T08:38:50.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.440+0000 7fb7ff7fe640 1 -- 172.21.15.117:0/197524947 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+17003 (secure 0 0 0) 0x7fb7f8079f50 con 0x7fb808072250 2024-09-19T08:38:50.440 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:50.440 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":51,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:38:49.170193+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:38:47.782719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-19T08:38:48.135062+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:38:50.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.442+0000 7fb80d01e640 1 -- 172.21.15.117:0/197524947 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb7e806c2b0 msgr2=0x7fb7e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:50.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.442+0000 7fb80d01e640 1 --2- 172.21.15.117:0/197524947 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb7e806c2b0 0x7fb7e806e770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0007fd0 tx=0x7fb7f0007900 comp rx=0 tx=0).stop 2024-09-19T08:38:50.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.442+0000 7fb80d01e640 1 -- 172.21.15.117:0/197524947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb808072250 msgr2=0x7fb8080b5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:50.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.442+0000 7fb80d01e640 1 --2- 172.21.15.117:0/197524947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb808072250 0x7fb8080b5c80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8000c00 tx=0x7fb7f80046c0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.442+0000 7fb80d01e640 1 -- 172.21.15.117:0/197524947 shutdown_connections 2024-09-19T08:38:50.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.442+0000 7fb80d01e640 1 --2- 172.21.15.117:0/197524947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8080d2750 0x7fb80813f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.442+0000 7fb80d01e640 1 --2- 172.21.15.117:0/197524947 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb7e806c2b0 0x7fb7e806e770 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.442+0000 7fb80d01e640 1 --2- 172.21.15.117:0/197524947 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8080726c0 0x7fb8081f1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.442+0000 7fb80d01e640 1 --2- 172.21.15.117:0/197524947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb808072250 0x7fb8080b5c80 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.442+0000 7fb80d01e640 1 -- 172.21.15.117:0/197524947 >> 172.21.15.117:0/197524947 conn(0x7fb8080b4040 msgr2=0x7fb8080b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:50.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.442+0000 7fb80d01e640 1 -- 172.21.15.117:0/197524947 shutdown_connections 2024-09-19T08:38:50.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.442+0000 7fb80d01e640 1 -- 172.21.15.117:0/197524947 wait complete. 2024-09-19T08:38:50.453 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T08:38:50.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.558+0000 7f9c2cb86640 1 Processor -- start 2024-09-19T08:38:50.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.558+0000 7f9c2cb86640 1 -- start start 2024-09-19T08:38:50.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.559+0000 7f9c2cb86640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9c2815e2a0 0x7f9c2806d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.559+0000 7f9c2cb86640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9c2815e680 0x7f9c280cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.559+0000 7f9c2cb86640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c2806d960 0x7f9c280d0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.559+0000 7f9c2cb86640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9c280d1880 con 0x7f9c2815e2a0 2024-09-19T08:38:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.559+0000 7f9c2cb86640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f9c280d1b60 con 0x7f9c2815e680 2024-09-19T08:38:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.559+0000 7f9c2cb86640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f9c280cf2d0 con 0x7f9c2806d960 2024-09-19T08:38:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.559+0000 7f9c2659c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9c2815e2a0 0x7f9c2806d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.559+0000 7f9c2659c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9c2815e2a0 0x7f9c2806d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39660/0 (socket says 172.21.15.117:39660) 2024-09-19T08:38:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.559+0000 7f9c2659c640 1 -- 172.21.15.117:0/452001377 learned_addr learned my addr 172.21.15.117:0/452001377 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.560+0000 7f9c2659c640 1 -- 172.21.15.117:0/452001377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c2806d960 msgr2=0x7f9c280d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:50.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.560+0000 7f9c2659c640 1 --2- 172.21.15.117:0/452001377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c2806d960 0x7f9c280d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.560+0000 7f9c2659c640 1 -- 172.21.15.117:0/452001377 >> v2:172.21.15.146:3300/0 conn(0x7f9c2815e680 msgr2=0x7f9c280cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:50.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.560+0000 7f9c2659c640 1 --2- 172.21.15.117:0/452001377 >> v2:172.21.15.146:3300/0 conn(0x7f9c2815e680 0x7f9c280cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.560+0000 7f9c2659c640 1 -- 172.21.15.117:0/452001377 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c280cf5b0 con 0x7f9c2815e2a0 2024-09-19T08:38:50.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.560+0000 7f9c2659c640 1 --2- 172.21.15.117:0/452001377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c2815e2a0 0x7f9c2806d420 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9c280a22a0 tx=0x7f9c1802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f35b362e06bbb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:50.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.561+0000 7f9c2559a640 1 -- 172.21.15.117:0/452001377 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18037070 con 0x7f9c2815e2a0 2024-09-19T08:38:50.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.561+0000 7f9c2559a640 1 -- 172.21.15.117:0/452001377 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c18032440 con 0x7f9c2815e2a0 2024-09-19T08:38:50.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.561+0000 7f9c2559a640 1 -- 172.21.15.117:0/452001377 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18032810 con 0x7f9c2815e2a0 2024-09-19T08:38:50.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.561+0000 7f9c2cb86640 1 -- 172.21.15.117:0/452001377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c2815e2a0 msgr2=0x7f9c2806d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:50.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.561+0000 7f9c2cb86640 1 --2- 172.21.15.117:0/452001377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c2815e2a0 0x7f9c2806d420 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9c280a22a0 tx=0x7f9c1802a1e0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.561+0000 7f9c2cb86640 1 -- 172.21.15.117:0/452001377 shutdown_connections 2024-09-19T08:38:50.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.561+0000 7f9c2cb86640 1 --2- 172.21.15.117:0/452001377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c2806d960 0x7f9c280d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.561+0000 7f9c2cb86640 1 --2- 172.21.15.117:0/452001377 >> v2:172.21.15.146:3300/0 conn(0x7f9c2815e680 0x7f9c280cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.561+0000 7f9c2cb86640 1 --2- 172.21.15.117:0/452001377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c2815e2a0 0x7f9c2806d420 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.561+0000 7f9c2cb86640 1 -- 172.21.15.117:0/452001377 >> 172.21.15.117:0/452001377 conn(0x7f9c2809d760 msgr2=0x7f9c2808bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:50.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.561+0000 7f9c2cb86640 1 -- 172.21.15.117:0/452001377 shutdown_connections 2024-09-19T08:38:50.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.561+0000 7f9c2cb86640 1 -- 172.21.15.117:0/452001377 wait complete. 2024-09-19T08:38:50.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.562+0000 7f9c2cb86640 1 Processor -- start 2024-09-19T08:38:50.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.563+0000 7f9c2cb86640 1 -- start start 2024-09-19T08:38:50.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.563+0000 7f9c2cb86640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c2806d960 0x7f9c280cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.563+0000 7f9c2cb86640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c2815e2a0 0x7f9c2814e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.563+0000 7f9c2cb86640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2815e680 0x7f9c2814d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.563+0000 7f9c2cb86640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9c280d44f0 con 0x7f9c2806d960 2024-09-19T08:38:50.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.563+0000 7f9c2cb86640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9c280d4370 con 0x7f9c2815e680 2024-09-19T08:38:50.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.563+0000 7f9c2cb86640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f9c280d4670 con 0x7f9c2815e2a0 2024-09-19T08:38:50.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.563+0000 7f9c2659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c2806d960 0x7f9c280cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:50.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.563+0000 7f9c2659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c2806d960 0x7f9c280cdf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39664/0 (socket says 172.21.15.117:39664) 2024-09-19T08:38:50.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.563+0000 7f9c2659c640 1 -- 172.21.15.117:0/432537019 learned_addr learned my addr 172.21.15.117:0/432537019 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:50.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.564+0000 7f9c2659c640 1 -- 172.21.15.117:0/432537019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c2815e2a0 msgr2=0x7f9c2814e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:50.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.564+0000 7f9c2659c640 1 --2- 172.21.15.117:0/432537019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c2815e2a0 0x7f9c2814e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.564+0000 7f9c2659c640 1 -- 172.21.15.117:0/432537019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2815e680 msgr2=0x7f9c2814d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:50.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.564+0000 7f9c2659c640 1 --2- 172.21.15.117:0/432537019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2815e680 0x7f9c2814d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.564+0000 7f9c2659c640 1 -- 172.21.15.117:0/432537019 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2814d920 con 0x7f9c2806d960 2024-09-19T08:38:50.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.564+0000 7f9c2659c640 1 --2- 172.21.15.117:0/432537019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c2806d960 0x7f9c280cdf20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9c18000c00 tx=0x7f9c180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:50.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.564+0000 7f9c16ffd640 1 -- 172.21.15.117:0/432537019 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18041070 con 0x7f9c2806d960 2024-09-19T08:38:50.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.564+0000 7f9c16ffd640 1 -- 172.21.15.117:0/432537019 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c1803c870 con 0x7f9c2806d960 2024-09-19T08:38:50.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.564+0000 7f9c2cb86640 1 -- 172.21.15.117:0/432537019 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2814dc00 con 0x7f9c2806d960 2024-09-19T08:38:50.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.564+0000 7f9c16ffd640 1 -- 172.21.15.117:0/432537019 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18037040 con 0x7f9c2806d960 2024-09-19T08:38:50.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.564+0000 7f9c2cb86640 1 -- 172.21.15.117:0/432537019 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c2814e1c0 con 0x7f9c2806d960 2024-09-19T08:38:50.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.565+0000 7f9c2cb86640 1 -- 172.21.15.117:0/432537019 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c2806d420 con 0x7f9c2806d960 2024-09-19T08:38:50.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.566+0000 7f9c16ffd640 1 -- 172.21.15.117:0/432537019 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9c18044070 con 0x7f9c2806d960 2024-09-19T08:38:50.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.566+0000 7f9c16ffd640 1 --2- 172.21.15.117:0/432537019 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9c0806c2b0 0x7f9c0806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.566+0000 7f9c16ffd640 1 -- 172.21.15.117:0/432537019 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f9c180ac190 con 0x7f9c2806d960 2024-09-19T08:38:50.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.566+0000 7f9c25d9b640 1 --2- 172.21.15.117:0/432537019 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9c0806c2b0 0x7f9c0806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:50.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.567+0000 7f9c25d9b640 1 --2- 172.21.15.117:0/432537019 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9c0806c2b0 0x7f9c0806e770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9c28153730 tx=0x7f9c1c006bf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:50.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.570+0000 7f9c16ffd640 1 -- 172.21.15.117:0/432537019 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9c1807a800 con 0x7f9c2806d960 2024-09-19T08:38:50.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.771+0000 7f9c2cb86640 1 -- 172.21.15.117:0/432537019 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9c2806cf90 con 0x7f9c2806d960 2024-09-19T08:38:50.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.839+0000 7f9c16ffd640 1 -- 172.21.15.117:0/432537019 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v21) ==== 118+0+0 (secure 0 0 0) 0x7f9c1807a100 con 0x7f9c2806d960 2024-09-19T08:38:50.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.841+0000 7f9c2cb86640 1 -- 172.21.15.117:0/432537019 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9c0806c2b0 msgr2=0x7f9c0806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:50.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.841+0000 7f9c2cb86640 1 --2- 172.21.15.117:0/432537019 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9c0806c2b0 0x7f9c0806e770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9c28153730 tx=0x7f9c1c006bf0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.841+0000 7f9c2cb86640 1 -- 172.21.15.117:0/432537019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c2806d960 msgr2=0x7f9c280cdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:50.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.841+0000 7f9c2cb86640 1 --2- 172.21.15.117:0/432537019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c2806d960 0x7f9c280cdf20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9c18000c00 tx=0x7f9c180046c0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.842+0000 7f9c2cb86640 1 -- 172.21.15.117:0/432537019 shutdown_connections 2024-09-19T08:38:50.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.842+0000 7f9c2cb86640 1 --2- 172.21.15.117:0/432537019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2815e680 0x7f9c2814d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.842+0000 7f9c2cb86640 1 --2- 172.21.15.117:0/432537019 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9c0806c2b0 0x7f9c0806e770 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.842+0000 7f9c2cb86640 1 --2- 172.21.15.117:0/432537019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c2815e2a0 0x7f9c2814e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.842+0000 7f9c2cb86640 1 --2- 172.21.15.117:0/432537019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c2806d960 0x7f9c280cdf20 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.842+0000 7f9c2cb86640 1 -- 172.21.15.117:0/432537019 >> 172.21.15.117:0/432537019 conn(0x7f9c2809d760 msgr2=0x7f9c281627e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:50.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.842+0000 7f9c2cb86640 1 -- 172.21.15.117:0/432537019 shutdown_connections 2024-09-19T08:38:50.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.842+0000 7f9c2cb86640 1 -- 172.21.15.117:0/432537019 wait complete. 2024-09-19T08:38:50.853 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T08:38:50.853 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T08:38:50.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.954+0000 7f3db3f4b640 1 Processor -- start 2024-09-19T08:38:50.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.955+0000 7f3db3f4b640 1 -- start start 2024-09-19T08:38:50.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.955+0000 7f3db3f4b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3dac0c5b00 0x7f3dac0cc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.955+0000 7f3db3f4b640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3dac0cce70 0x7f3dac0b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.955+0000 7f3db3f4b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dac0b4540 con 0x7f3dac15a7b0 2024-09-19T08:38:50.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.955+0000 7f3db3f4b640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f3dac0b4870 con 0x7f3dac0cce70 2024-09-19T08:38:50.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.955+0000 7f3db3f4b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f3dac0c5f40 con 0x7f3dac0c5b00 2024-09-19T08:38:50.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db1ce7640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f3dac15a7b0 0x7f3dac0cde40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:37476/0 (socket says 172.21.15.117:37476) 2024-09-19T08:38:50.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db1ce7640 1 -- 172.21.15.117:0/1203725343 learned_addr learned my addr 172.21.15.117:0/1203725343 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:50.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db0ce5640 1 -- 172.21.15.117:0/1203725343 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 432768671 0 0) 0x7f3dac0b4540 con 0x7f3dac15a7b0 2024-09-19T08:38:50.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db0ce5640 1 -- 172.21.15.117:0/1203725343 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d94003520 con 0x7f3dac15a7b0 2024-09-19T08:38:50.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db14e6640 1 --2- 172.21.15.117:0/1203725343 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3dac0c5b00 0x7f3dac0cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:50.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db24e8640 1 --2- 172.21.15.117:0/1203725343 >> v2:172.21.15.146:3300/0 conn(0x7f3dac0cce70 0x7f3dac0b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:50.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db0ce5640 1 -- 172.21.15.117:0/1203725343 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3517760212 0 0) 0x7f3d94003520 con 0x7f3dac15a7b0 2024-09-19T08:38:50.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db0ce5640 1 -- 172.21.15.117:0/1203725343 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3dac0c5b00 msgr2=0x7f3dac0cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:50.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db0ce5640 1 --2- 172.21.15.117:0/1203725343 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3dac0c5b00 0x7f3dac0cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db0ce5640 1 -- 172.21.15.117:0/1203725343 >> v2:172.21.15.146:3300/0 conn(0x7f3dac0cce70 msgr2=0x7f3dac0b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:50.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db0ce5640 1 --2- 172.21.15.117:0/1203725343 >> v2:172.21.15.146:3300/0 conn(0x7f3dac0cce70 0x7f3dac0b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db0ce5640 1 -- 172.21.15.117:0/1203725343 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dac0cf9b0 con 0x7f3dac15a7b0 2024-09-19T08:38:50.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db0ce5640 1 -- 172.21.15.117:0/1203725343 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f3d9c001670 con 0x7f3dac15a7b0 2024-09-19T08:38:50.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db0ce5640 1 -- 172.21.15.117:0/1203725343 >> v1:172.21.15.117:6789/0 conn(0x7f3dac15a7b0 legacy=0x7f3dac0cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:50.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db0ce5640 1 --2- 172.21.15.117:0/1203725343 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3dac0c5b00 0x7f3d940039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db0ce5640 1 --2- 172.21.15.117:0/1203725343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d94003f30 0x7f3d94004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db0ce5640 1 --2- 172.21.15.117:0/1203725343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d94004d40 0x7f3d940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db0ce5640 1 -- 172.21.15.117:0/1203725343 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac0b4870 con 0x7f3d94003f30 2024-09-19T08:38:50.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db0ce5640 1 -- 172.21.15.117:0/1203725343 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac0c5f40 con 0x7f3d94004d40 2024-09-19T08:38:50.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db0ce5640 1 -- 172.21.15.117:0/1203725343 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f3d9400cad0 con 0x7f3dac0c5b00 2024-09-19T08:38:50.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db14e6640 1 --2- 172.21.15.117:0/1203725343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d94003f30 0x7f3d94004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:50.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db1ce7640 1 --2- 172.21.15.117:0/1203725343 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3dac0c5b00 0x7f3d940039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:50.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db24e8640 1 --2- 172.21.15.117:0/1203725343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d94004d40 0x7f3d940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:50.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db14e6640 1 -- 172.21.15.117:0/1203725343 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3dac0c5b00 msgr2=0x7f3d940039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:50.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db14e6640 1 --2- 172.21.15.117:0/1203725343 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3dac0c5b00 0x7f3d940039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db14e6640 1 -- 172.21.15.117:0/1203725343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d94004d40 msgr2=0x7f3d940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:50.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.956+0000 7f3db14e6640 1 --2- 172.21.15.117:0/1203725343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d94004d40 0x7f3d940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.957+0000 7f3db14e6640 1 -- 172.21.15.117:0/1203725343 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d94003520 con 0x7f3d94003f30 2024-09-19T08:38:50.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.957+0000 7f3db24e8640 1 --2- 172.21.15.117:0/1203725343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d94004d40 0x7f3d940051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:50.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.957+0000 7f3db14e6640 1 --2- 172.21.15.117:0/1203725343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d94003f30 0x7f3d94004800 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009a90 tx=0x7f3d94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227d933b3aa466bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:50.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.957+0000 7f3db0ce5640 1 -- 172.21.15.117:0/1203725343 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da0036070 con 0x7f3d94003f30 2024-09-19T08:38:50.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.957+0000 7f3db0ce5640 1 -- 172.21.15.117:0/1203725343 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3da0031400 con 0x7f3d94003f30 2024-09-19T08:38:50.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.957+0000 7f3db0ce5640 1 -- 172.21.15.117:0/1203725343 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da0009690 con 0x7f3d94003f30 2024-09-19T08:38:50.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.958+0000 7f3db3f4b640 1 -- 172.21.15.117:0/1203725343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d94003f30 msgr2=0x7f3d94004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:50.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.958+0000 7f3db3f4b640 1 --2- 172.21.15.117:0/1203725343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d94003f30 0x7f3d94004800 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009a90 tx=0x7f3d94005830 comp rx=0 tx=0).stop 2024-09-19T08:38:50.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.958+0000 7f3db24e8640 1 -- 172.21.15.117:0/1203725343 reap_dead start 2024-09-19T08:38:50.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.958+0000 7f3db3f4b640 1 -- 172.21.15.117:0/1203725343 shutdown_connections 2024-09-19T08:38:50.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.958+0000 7f3db3f4b640 1 -- 172.21.15.117:0/1203725343 >> 172.21.15.117:0/1203725343 conn(0x7f3dac06bdf0 msgr2=0x7f3dac06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:50.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.958+0000 7f3db3f4b640 1 -- 172.21.15.117:0/1203725343 shutdown_connections 2024-09-19T08:38:50.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.958+0000 7f3db3f4b640 1 -- 172.21.15.117:0/1203725343 wait complete. 2024-09-19T08:38:50.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.959+0000 7f3db3f4b640 1 Processor -- start 2024-09-19T08:38:50.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.959+0000 7f3db3f4b640 1 -- start start 2024-09-19T08:38:50.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.960+0000 7f3db3f4b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d94003f30 0x7f3dac15ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.960+0000 7f3db3f4b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dac073260 0x7f3dac1f16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.960+0000 7f3db3f4b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dac1512b0 0x7f3dac0aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.960+0000 7f3db3f4b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac15ab90 con 0x7f3dac1512b0 2024-09-19T08:38:50.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.960+0000 7f3db3f4b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac0cff70 con 0x7f3dac073260 2024-09-19T08:38:50.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.960+0000 7f3db3f4b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f3dac0ca8c0 con 0x7f3d94003f30 2024-09-19T08:38:50.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.960+0000 7f3db24e8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dac1512b0 0x7f3dac0aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:50.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.960+0000 7f3db24e8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dac1512b0 0x7f3dac0aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39686/0 (socket says 172.21.15.117:39686) 2024-09-19T08:38:50.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.960+0000 7f3db24e8640 1 -- 172.21.15.117:0/2717540611 learned_addr learned my addr 172.21.15.117:0/2717540611 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:50.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.960+0000 7f3db14e6640 1 --2- 172.21.15.117:0/2717540611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dac073260 0x7f3dac1f16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:50.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.960+0000 7f3db1ce7640 1 --2- 172.21.15.117:0/2717540611 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d94003f30 0x7f3dac15ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:50.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.960+0000 7f3db24e8640 1 -- 172.21.15.117:0/2717540611 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d94003f30 msgr2=0x7f3dac15ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:50.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.960+0000 7f3db24e8640 1 --2- 172.21.15.117:0/2717540611 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d94003f30 0x7f3dac15ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.960+0000 7f3db24e8640 1 -- 172.21.15.117:0/2717540611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dac073260 msgr2=0x7f3dac1f16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:50.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.960+0000 7f3db24e8640 1 --2- 172.21.15.117:0/2717540611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dac073260 0x7f3dac1f16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:50.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.960+0000 7f3db24e8640 1 -- 172.21.15.117:0/2717540611 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dac0736e0 con 0x7f3dac1512b0 2024-09-19T08:38:50.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.960+0000 7f3db1ce7640 1 --2- 172.21.15.117:0/2717540611 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d94003f30 0x7f3dac15ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:50.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.960+0000 7f3db24e8640 1 --2- 172.21.15.117:0/2717540611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dac1512b0 0x7f3dac0aed90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3dac06cb50 tx=0x7f3da4010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:50.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.961+0000 7f3daa7fc640 1 -- 172.21.15.117:0/2717540611 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da4010d80 con 0x7f3dac1512b0 2024-09-19T08:38:50.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.961+0000 7f3daa7fc640 1 -- 172.21.15.117:0/2717540611 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3da4003990 con 0x7f3dac1512b0 2024-09-19T08:38:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.961+0000 7f3daa7fc640 1 -- 172.21.15.117:0/2717540611 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da4003d80 con 0x7f3dac1512b0 2024-09-19T08:38:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.961+0000 7f3db3f4b640 1 -- 172.21.15.117:0/2717540611 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dac15b410 con 0x7f3dac1512b0 2024-09-19T08:38:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.961+0000 7f3db3f4b640 1 -- 172.21.15.117:0/2717540611 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dac15b9d0 con 0x7f3dac1512b0 2024-09-19T08:38:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.961+0000 7f3db3f4b640 1 -- 172.21.15.117:0/2717540611 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dac0cc930 con 0x7f3dac1512b0 2024-09-19T08:38:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.962+0000 7f3daa7fc640 1 -- 172.21.15.117:0/2717540611 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3da401e030 con 0x7f3dac1512b0 2024-09-19T08:38:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.962+0000 7f3daa7fc640 1 --2- 172.21.15.117:0/2717540611 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3d9806c2e0 0x7f3d9806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.963+0000 7f3daa7fc640 1 -- 172.21.15.117:0/2717540611 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f3da408bc80 con 0x7f3dac1512b0 2024-09-19T08:38:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.963+0000 7f3db1ce7640 1 --2- 172.21.15.117:0/2717540611 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3d9806c2e0 0x7f3d9806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:50.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.963+0000 7f3db1ce7640 1 --2- 172.21.15.117:0/2717540611 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3d9806c2e0 0x7f3d9806e7a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c007fd0 tx=0x7f3d9c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:50.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:50.967+0000 7f3daa7fc640 1 -- 172.21.15.117:0/2717540611 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3da4025020 con 0x7f3dac1512b0 2024-09-19T08:38:51.081 INFO:tasks.ceph.mds.b.smithi146.stderr:2024-09-19T08:38:51.081+0000 7f3b710d4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T08:38:51.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.164+0000 7f3db3f4b640 1 -- 172.21.15.117:0/2717540611 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3dac0b3600 con 0x7f3dac1512b0 2024-09-19T08:38:51.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.846+0000 7f3daa7fc640 1 -- 172.21.15.117:0/2717540611 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7f3da405a2f0 con 0x7f3dac1512b0 2024-09-19T08:38:51.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.848+0000 7f3db3f4b640 1 -- 172.21.15.117:0/2717540611 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3d9806c2e0 msgr2=0x7f3d9806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:51.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.848+0000 7f3db3f4b640 1 --2- 172.21.15.117:0/2717540611 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3d9806c2e0 0x7f3d9806e7a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c007fd0 tx=0x7f3d9c009040 comp rx=0 tx=0).stop 2024-09-19T08:38:51.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.848+0000 7f3db3f4b640 1 -- 172.21.15.117:0/2717540611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dac1512b0 msgr2=0x7f3dac0aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:51.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.848+0000 7f3db3f4b640 1 --2- 172.21.15.117:0/2717540611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dac1512b0 0x7f3dac0aed90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3dac06cb50 tx=0x7f3da4010590 comp rx=0 tx=0).stop 2024-09-19T08:38:51.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.848+0000 7f3db3f4b640 1 -- 172.21.15.117:0/2717540611 shutdown_connections 2024-09-19T08:38:51.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.848+0000 7f3db3f4b640 1 --2- 172.21.15.117:0/2717540611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dac1512b0 0x7f3dac0aed90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:51.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.848+0000 7f3db3f4b640 1 --2- 172.21.15.117:0/2717540611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dac073260 0x7f3dac1f16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:51.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.848+0000 7f3db3f4b640 1 --2- 172.21.15.117:0/2717540611 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3d9806c2e0 0x7f3d9806e7a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:51.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.848+0000 7f3db3f4b640 1 --2- 172.21.15.117:0/2717540611 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d94003f30 0x7f3dac15ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:51.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.848+0000 7f3db3f4b640 1 -- 172.21.15.117:0/2717540611 >> 172.21.15.117:0/2717540611 conn(0x7f3dac06bdf0 msgr2=0x7f3dac0b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:51.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.848+0000 7f3db3f4b640 1 -- 172.21.15.117:0/2717540611 shutdown_connections 2024-09-19T08:38:51.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.848+0000 7f3db3f4b640 1 -- 172.21.15.117:0/2717540611 wait complete. 2024-09-19T08:38:51.862 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T08:38:51.862 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:38:51.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.967+0000 7f756fcae640 1 Processor -- start 2024-09-19T08:38:51.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.968+0000 7f756fcae640 1 -- start start 2024-09-19T08:38:51.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.968+0000 7f756fcae640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f75680d29c0 0x7f75680d2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:51.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.968+0000 7f756fcae640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75680d2250 con 0x7f756815e4d0 2024-09-19T08:38:51.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.968+0000 7f756fcae640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f756815f520 con 0x7f756815e8b0 2024-09-19T08:38:51.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.968+0000 7f756fcae640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f75680d3370 con 0x7f75680d29c0 2024-09-19T08:38:51.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756da4a640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f756815e4d0 0x7f75680d1600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:37492/0 (socket says 172.21.15.117:37492) 2024-09-19T08:38:51.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756da4a640 1 -- 172.21.15.117:0/2932735272 learned_addr learned my addr 172.21.15.117:0/2932735272 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:51.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756ca48640 1 -- 172.21.15.117:0/2932735272 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1913873937 0 0) 0x7f75680d2250 con 0x7f756815e4d0 2024-09-19T08:38:51.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756ca48640 1 -- 172.21.15.117:0/2932735272 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7554003520 con 0x7f756815e4d0 2024-09-19T08:38:51.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756d249640 1 --2- 172.21.15.117:0/2932735272 >> v2:172.21.15.146:3300/0 conn(0x7f75680d29c0 0x7f75680d2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:51.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756ca48640 1 -- 172.21.15.117:0/2932735272 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1514562192 0 0) 0x7f7554003520 con 0x7f756815e4d0 2024-09-19T08:38:51.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756ca48640 1 -- 172.21.15.117:0/2932735272 >> v2:172.21.15.146:3300/0 conn(0x7f75680d29c0 msgr2=0x7f75680d2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:51.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756ca48640 1 --2- 172.21.15.117:0/2932735272 >> v2:172.21.15.146:3300/0 conn(0x7f75680d29c0 0x7f75680d2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:51.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756ca48640 1 -- 172.21.15.117:0/2932735272 >> v1:172.21.15.146:6789/0 conn(0x7f756815e8b0 legacy=0x7f756815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:51.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756ca48640 1 -- 172.21.15.117:0/2932735272 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756815f800 con 0x7f756815e4d0 2024-09-19T08:38:51.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756ca48640 1 -- 172.21.15.117:0/2932735272 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f7564001690 con 0x7f756815e4d0 2024-09-19T08:38:51.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756d249640 1 --2- 172.21.15.117:0/2932735272 >> v2:172.21.15.146:3300/0 conn(0x7f75680d29c0 0x7f75680d2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:51.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756ca48640 1 -- 172.21.15.117:0/2932735272 >> v1:172.21.15.117:6789/0 conn(0x7f756815e4d0 legacy=0x7f75680d1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:51.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756ca48640 1 --2- 172.21.15.117:0/2932735272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75540039b0 0x7f7554003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:51.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756ca48640 1 --2- 172.21.15.117:0/2932735272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7554004800 0x7f7554004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756ca48640 1 --2- 172.21.15.117:0/2932735272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75540051c0 0x7f755400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756ca48640 1 -- 172.21.15.117:0/2932735272 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f75680d3370 con 0x7f75540051c0 2024-09-19T08:38:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756ca48640 1 -- 172.21.15.117:0/2932735272 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f755400c110 con 0x7f75540039b0 2024-09-19T08:38:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756ca48640 1 -- 172.21.15.117:0/2932735272 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f755400c310 con 0x7f7554004800 2024-09-19T08:38:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756e24b640 1 --2- 172.21.15.117:0/2932735272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75540051c0 0x7f755400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756da4a640 1 --2- 172.21.15.117:0/2932735272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75540039b0 0x7f7554003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.969+0000 7f756d249640 1 --2- 172.21.15.117:0/2932735272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7554004800 0x7f7554004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.970+0000 7f756e24b640 1 -- 172.21.15.117:0/2932735272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7554004800 msgr2=0x7f7554004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.970+0000 7f756e24b640 1 --2- 172.21.15.117:0/2932735272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7554004800 0x7f7554004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.970+0000 7f756e24b640 1 -- 172.21.15.117:0/2932735272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75540039b0 msgr2=0x7f7554003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.970+0000 7f756e24b640 1 --2- 172.21.15.117:0/2932735272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75540039b0 0x7f7554003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.970+0000 7f756e24b640 1 -- 172.21.15.117:0/2932735272 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7554003520 con 0x7f75540051c0 2024-09-19T08:38:51.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.970+0000 7f756e24b640 1 -- 172.21.15.117:0/2932735272 reap_dead start 2024-09-19T08:38:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.970+0000 7f756e24b640 1 --2- 172.21.15.117:0/2932735272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75540051c0 0x7f755400b9c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7560001e20 tx=0x7f7554005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c54ec19c55dfca4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.970+0000 7f756ca48640 1 -- 172.21.15.117:0/2932735272 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560001a70 con 0x7f75540051c0 2024-09-19T08:38:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.970+0000 7f756ca48640 1 -- 172.21.15.117:0/2932735272 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f756002ae40 con 0x7f75540051c0 2024-09-19T08:38:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.970+0000 7f756ca48640 1 -- 172.21.15.117:0/2932735272 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560003b90 con 0x7f75540051c0 2024-09-19T08:38:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.971+0000 7f756fcae640 1 -- 172.21.15.117:0/2932735272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75540051c0 msgr2=0x7f755400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.971+0000 7f756fcae640 1 --2- 172.21.15.117:0/2932735272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75540051c0 0x7f755400b9c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7560001e20 tx=0x7f7554005830 comp rx=0 tx=0).stop 2024-09-19T08:38:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.971+0000 7f756fcae640 1 -- 172.21.15.117:0/2932735272 shutdown_connections 2024-09-19T08:38:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.971+0000 7f756fcae640 1 --2- 172.21.15.117:0/2932735272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75540051c0 0x7f755400b9c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.971+0000 7f756fcae640 1 -- 172.21.15.117:0/2932735272 >> 172.21.15.117:0/2932735272 conn(0x7f756809d770 msgr2=0x7f756808bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.971+0000 7f756fcae640 1 -- 172.21.15.117:0/2932735272 shutdown_connections 2024-09-19T08:38:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.971+0000 7f756fcae640 1 -- 172.21.15.117:0/2932735272 wait complete. 2024-09-19T08:38:51.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.972+0000 7f756fcae640 1 Processor -- start 2024-09-19T08:38:51.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.972+0000 7f756fcae640 1 -- start start 2024-09-19T08:38:51.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.973+0000 7f756fcae640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75540051c0 0x7f75680b9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:51.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.973+0000 7f756fcae640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75680b8a00 0x7f75680b7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:51.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.973+0000 7f756fcae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7568153740 0x7f75680ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:51.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.973+0000 7f756fcae640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f75680d0e00 con 0x7f75680b8a00 2024-09-19T08:38:51.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.973+0000 7f756fcae640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f75680d1170 con 0x7f7568153740 2024-09-19T08:38:51.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.973+0000 7f756fcae640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f75680d2e30 con 0x7f75540051c0 2024-09-19T08:38:51.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.973+0000 7f756d249640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75680b8a00 0x7f75680b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:51.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.973+0000 7f756d249640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75680b8a00 0x7f75680b7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39698/0 (socket says 172.21.15.117:39698) 2024-09-19T08:38:51.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.973+0000 7f756d249640 1 -- 172.21.15.117:0/3866844671 learned_addr learned my addr 172.21.15.117:0/3866844671 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:51.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.973+0000 7f756e24b640 1 --2- 172.21.15.117:0/3866844671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7568153740 0x7f75680ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:51.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.973+0000 7f756da4a640 1 --2- 172.21.15.117:0/3866844671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75540051c0 0x7f75680b9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:51.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.973+0000 7f756d249640 1 -- 172.21.15.117:0/3866844671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75540051c0 msgr2=0x7f75680b9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:51.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.973+0000 7f756d249640 1 --2- 172.21.15.117:0/3866844671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75540051c0 0x7f75680b9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:51.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.973+0000 7f756d249640 1 -- 172.21.15.117:0/3866844671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7568153740 msgr2=0x7f75680ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:51.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.973+0000 7f756d249640 1 --2- 172.21.15.117:0/3866844671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7568153740 0x7f75680ccb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:51.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.973+0000 7f756d249640 1 -- 172.21.15.117:0/3866844671 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75680b7960 con 0x7f75680b8a00 2024-09-19T08:38:51.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.973+0000 7f756e24b640 1 --2- 172.21.15.117:0/3866844671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7568153740 0x7f75680ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:51.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.974+0000 7f756d249640 1 --2- 172.21.15.117:0/3866844671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75680b8a00 0x7f75680b7210 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f75580115d0 tx=0x7f75580119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:51.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.974+0000 7f755e7fc640 1 -- 172.21.15.117:0/3866844671 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7558019070 con 0x7f75680b8a00 2024-09-19T08:38:51.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.974+0000 7f755e7fc640 1 -- 172.21.15.117:0/3866844671 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7558004220 con 0x7f75680b8a00 2024-09-19T08:38:51.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.974+0000 7f756fcae640 1 -- 172.21.15.117:0/3866844671 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75680b7c40 con 0x7f75680b8a00 2024-09-19T08:38:51.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.974+0000 7f755e7fc640 1 -- 172.21.15.117:0/3866844671 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755800f040 con 0x7f75680b8a00 2024-09-19T08:38:51.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.974+0000 7f756fcae640 1 -- 172.21.15.117:0/3866844671 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75680b8200 con 0x7f75680b8a00 2024-09-19T08:38:51.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.975+0000 7f756fcae640 1 -- 172.21.15.117:0/3866844671 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f756815ed40 con 0x7f75680b8a00 2024-09-19T08:38:51.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.975+0000 7f755e7fc640 1 -- 172.21.15.117:0/3866844671 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7558015670 con 0x7f75680b8a00 2024-09-19T08:38:51.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.976+0000 7f755e7fc640 1 --2- 172.21.15.117:0/3866844671 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f754c06c2e0 0x7f754c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:51.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.976+0000 7f755e7fc640 1 -- 172.21.15.117:0/3866844671 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f755808b660 con 0x7f75680b8a00 2024-09-19T08:38:51.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.976+0000 7f756da4a640 1 --2- 172.21.15.117:0/3866844671 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f754c06c2e0 0x7f754c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:51.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.977+0000 7f756da4a640 1 --2- 172.21.15.117:0/3866844671 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f754c06c2e0 0x7f754c06e7a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f75680d4310 tx=0x7f75640078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:51.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:51.980+0000 7f755e7fc640 1 -- 172.21.15.117:0/3866844671 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7558059c40 con 0x7f75680b8a00 2024-09-19T08:38:52.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.179+0000 7f756fcae640 1 -- 172.21.15.117:0/3866844671 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f756806cf90 con 0x7f75680b8a00 2024-09-19T08:38:52.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.180+0000 7f755e7fc640 1 -- 172.21.15.117:0/3866844671 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5232 (secure 0 0 0) 0x7f7558089e20 con 0x7f75680b8a00 2024-09-19T08:38:52.180 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:52.180 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"btime":"2024-09-19T08:38:51:840984+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1753143760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1753143760},{"type":"v1","addr":"172.21.15.146:6836","nonce":1753143760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/283458533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":283458533},{"type":"v1","addr":"172.21.15.117:6835","nonce":283458533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3844667733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3844667733},{"type":"v1","addr":"172.21.15.117:6834","nonce":3844667733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:38:49.170502+0000","modified":"2024-09-19T08:38:51.165807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5352":{"gid":5352,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/4230307932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4230307932},{"type":"v1","addr":"172.21.15.146:6837","nonce":4230307932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5352,"qdb_cluster":[5352]},"id":3}]} 2024-09-19T08:38:52.180 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 22 2024-09-19T08:38:52.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.181+0000 7f756fcae640 1 -- 172.21.15.117:0/3866844671 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f754c06c2e0 msgr2=0x7f754c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:52.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.181+0000 7f756fcae640 1 --2- 172.21.15.117:0/3866844671 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f754c06c2e0 0x7f754c06e7a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f75680d4310 tx=0x7f75640078f0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.181+0000 7f756fcae640 1 -- 172.21.15.117:0/3866844671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75680b8a00 msgr2=0x7f75680b7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:52.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.181+0000 7f756fcae640 1 --2- 172.21.15.117:0/3866844671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75680b8a00 0x7f75680b7210 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f75580115d0 tx=0x7f75580119d0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.182+0000 7f756fcae640 1 -- 172.21.15.117:0/3866844671 shutdown_connections 2024-09-19T08:38:52.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.182+0000 7f756fcae640 1 --2- 172.21.15.117:0/3866844671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7568153740 0x7f75680ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.182+0000 7f756fcae640 1 --2- 172.21.15.117:0/3866844671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75680b8a00 0x7f75680b7210 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.182+0000 7f756fcae640 1 --2- 172.21.15.117:0/3866844671 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f754c06c2e0 0x7f754c06e7a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.182+0000 7f756fcae640 1 --2- 172.21.15.117:0/3866844671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75540051c0 0x7f75680b9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.182+0000 7f756fcae640 1 -- 172.21.15.117:0/3866844671 >> 172.21.15.117:0/3866844671 conn(0x7f756809d770 msgr2=0x7f75680b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:52.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.182+0000 7f756fcae640 1 -- 172.21.15.117:0/3866844671 shutdown_connections 2024-09-19T08:38:52.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.182+0000 7f756fcae640 1 -- 172.21.15.117:0/3866844671 wait complete. 2024-09-19T08:38:52.193 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:38:52.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.291+0000 7faa57a82640 1 Processor -- start 2024-09-19T08:38:52.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.291+0000 7faa57a82640 1 -- start start 2024-09-19T08:38:52.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.292+0000 7faa57a82640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa500add30 0x7faa500ae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:52.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.292+0000 7faa57a82640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faa50070930 0x7faa500b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:52.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.292+0000 7faa57a82640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa500ae650 con 0x7faa5015e4f0 2024-09-19T08:38:52.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.292+0000 7faa57a82640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7faa50070ea0 con 0x7faa50070930 2024-09-19T08:38:52.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.292+0000 7faa57a82640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7faa5006e8c0 con 0x7faa500add30 2024-09-19T08:38:52.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.292+0000 7faa5581e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa500add30 0x7faa500ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:52.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.292+0000 7faa5601f640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faa50070930 0x7faa500b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:52.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.293+0000 7faa5581e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa500add30 0x7faa500ae110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.117:60018/0 (socket says 172.21.15.117:60018) 2024-09-19T08:38:52.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.293+0000 7faa5501d640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7faa5015e4f0 0x7faa500b5050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.117:57908/0 (socket says 172.21.15.117:57908) 2024-09-19T08:38:52.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.293+0000 7faa5581e640 1 -- 172.21.15.117:0/1168129698 learned_addr learned my addr 172.21.15.117:0/1168129698 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:52.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.293+0000 7faa5601f640 1 --2- 172.21.15.117:0/1168129698 >> v2:172.21.15.146:3300/0 conn(0x7faa50070930 0x7faa500b00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.117:42226/0 (socket says 172.21.15.117:42226) 2024-09-19T08:38:52.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.293+0000 7faa5581e640 1 -- 172.21.15.117:0/1168129698 >> v2:172.21.15.146:3300/0 conn(0x7faa50070930 msgr2=0x7faa500b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:52.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.293+0000 7faa5581e640 1 --2- 172.21.15.117:0/1168129698 >> v2:172.21.15.146:3300/0 conn(0x7faa50070930 0x7faa500b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.293+0000 7faa5581e640 1 -- 172.21.15.117:0/1168129698 >> v1:172.21.15.146:6789/0 conn(0x7faa5015e4f0 legacy=0x7faa500b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:52.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.293+0000 7faa5581e640 1 -- 172.21.15.117:0/1168129698 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa5006eba0 con 0x7faa500add30 2024-09-19T08:38:52.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.294+0000 7faa5581e640 1 --2- 172.21.15.117:0/1168129698 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa500add30 0x7faa500ae110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009870 tx=0x7faa4c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2673d4cee361d9ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:52.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.294+0000 7faa5481c640 1 -- 172.21.15.117:0/1168129698 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4c037070 con 0x7faa500add30 2024-09-19T08:38:52.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.294+0000 7faa5481c640 1 -- 172.21.15.117:0/1168129698 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa4c032440 con 0x7faa500add30 2024-09-19T08:38:52.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.294+0000 7faa5481c640 1 -- 172.21.15.117:0/1168129698 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4c032810 con 0x7faa500add30 2024-09-19T08:38:52.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.294+0000 7faa57a82640 1 -- 172.21.15.117:0/1168129698 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa500add30 msgr2=0x7faa500ae110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:52.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.294+0000 7faa57a82640 1 --2- 172.21.15.117:0/1168129698 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa500add30 0x7faa500ae110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009870 tx=0x7faa4c02a270 comp rx=0 tx=0).stop 2024-09-19T08:38:52.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.294+0000 7faa57a82640 1 -- 172.21.15.117:0/1168129698 shutdown_connections 2024-09-19T08:38:52.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.294+0000 7faa57a82640 1 --2- 172.21.15.117:0/1168129698 >> v2:172.21.15.146:3300/0 conn(0x7faa50070930 0x7faa500b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.294+0000 7faa57a82640 1 --2- 172.21.15.117:0/1168129698 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa500add30 0x7faa500ae110 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.294+0000 7faa57a82640 1 -- 172.21.15.117:0/1168129698 >> 172.21.15.117:0/1168129698 conn(0x7faa5006bc10 msgr2=0x7faa5006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:52.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.294+0000 7faa57a82640 1 -- 172.21.15.117:0/1168129698 shutdown_connections 2024-09-19T08:38:52.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.294+0000 7faa57a82640 1 -- 172.21.15.117:0/1168129698 wait complete. 2024-09-19T08:38:52.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.296+0000 7faa57a82640 1 Processor -- start 2024-09-19T08:38:52.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.296+0000 7faa57a82640 1 -- start start 2024-09-19T08:38:52.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.296+0000 7faa57a82640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa50070930 0x7faa50149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:52.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.296+0000 7faa57a82640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa500add30 0x7faa5014acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:52.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.296+0000 7faa57a82640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa5015e4f0 0x7faa50160c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:52.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.296+0000 7faa57a82640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faa5006f3a0 con 0x7faa50070930 2024-09-19T08:38:52.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.296+0000 7faa57a82640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faa500b0630 con 0x7faa500add30 2024-09-19T08:38:52.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.296+0000 7faa57a82640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7faa5006f520 con 0x7faa5015e4f0 2024-09-19T08:38:52.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.296+0000 7faa5581e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa50070930 0x7faa50149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:52.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.296+0000 7faa5581e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa50070930 0x7faa50149580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39708/0 (socket says 172.21.15.117:39708) 2024-09-19T08:38:52.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.296+0000 7faa5581e640 1 -- 172.21.15.117:0/2147500129 learned_addr learned my addr 172.21.15.117:0/2147500129 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.297+0000 7faa5501d640 1 --2- 172.21.15.117:0/2147500129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa500add30 0x7faa5014acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.297+0000 7faa5601f640 1 --2- 172.21.15.117:0/2147500129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa5015e4f0 0x7faa50160c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.297+0000 7faa5581e640 1 -- 172.21.15.117:0/2147500129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa5015e4f0 msgr2=0x7faa50160c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.297+0000 7faa5581e640 1 --2- 172.21.15.117:0/2147500129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa5015e4f0 0x7faa50160c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.297+0000 7faa5581e640 1 -- 172.21.15.117:0/2147500129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa500add30 msgr2=0x7faa5014acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.297+0000 7faa5581e640 1 --2- 172.21.15.117:0/2147500129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa500add30 0x7faa5014acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.297+0000 7faa5581e640 1 -- 172.21.15.117:0/2147500129 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa50149ac0 con 0x7faa50070930 2024-09-19T08:38:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.297+0000 7faa5581e640 1 --2- 172.21.15.117:0/2147500129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa50070930 0x7faa50149580 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009870 tx=0x7faa4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.297+0000 7faa467fc640 1 -- 172.21.15.117:0/2147500129 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4c041020 con 0x7faa50070930 2024-09-19T08:38:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.297+0000 7faa467fc640 1 -- 172.21.15.117:0/2147500129 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa4c030640 con 0x7faa50070930 2024-09-19T08:38:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.297+0000 7faa57a82640 1 -- 172.21.15.117:0/2147500129 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa5015f890 con 0x7faa50070930 2024-09-19T08:38:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.297+0000 7faa467fc640 1 -- 172.21.15.117:0/2147500129 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4c037040 con 0x7faa50070930 2024-09-19T08:38:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.297+0000 7faa57a82640 1 -- 172.21.15.117:0/2147500129 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa5015fe50 con 0x7faa50070930 2024-09-19T08:38:52.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.298+0000 7faa57a82640 1 -- 172.21.15.117:0/2147500129 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa500b00f0 con 0x7faa50070930 2024-09-19T08:38:52.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.299+0000 7faa467fc640 1 -- 172.21.15.117:0/2147500129 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faa4c044020 con 0x7faa50070930 2024-09-19T08:38:52.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.299+0000 7faa467fc640 1 --2- 172.21.15.117:0/2147500129 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faa3406c2b0 0x7faa3406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:52.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.299+0000 7faa467fc640 1 -- 172.21.15.117:0/2147500129 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7faa4c0abb60 con 0x7faa50070930 2024-09-19T08:38:52.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.299+0000 7faa5501d640 1 --2- 172.21.15.117:0/2147500129 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faa3406c2b0 0x7faa3406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:52.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.300+0000 7faa5501d640 1 --2- 172.21.15.117:0/2147500129 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faa3406c2b0 0x7faa3406e770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faa500d0710 tx=0x7faa40000ed0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:52.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.303+0000 7faa467fc640 1 -- 172.21.15.117:0/2147500129 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7faa4c04b030 con 0x7faa50070930 2024-09-19T08:38:52.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.469+0000 7faa57a82640 1 -- 172.21.15.117:0/2147500129 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa500adb10 con 0x7faa50070930 2024-09-19T08:38:52.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.470+0000 7faa467fc640 1 -- 172.21.15.117:0/2147500129 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) ==== 74+0+16990 (secure 0 0 0) 0x7faa4c079b80 con 0x7faa50070930 2024-09-19T08:38:52.471 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:52.471 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":52,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:38:50.833792+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:38:47.782719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-19T08:38:48.135062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:38:52.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.473+0000 7faa57a82640 1 -- 172.21.15.117:0/2147500129 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faa3406c2b0 msgr2=0x7faa3406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:52.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.473+0000 7faa57a82640 1 --2- 172.21.15.117:0/2147500129 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faa3406c2b0 0x7faa3406e770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faa500d0710 tx=0x7faa40000ed0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.473+0000 7faa57a82640 1 -- 172.21.15.117:0/2147500129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa50070930 msgr2=0x7faa50149580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:52.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.473+0000 7faa57a82640 1 --2- 172.21.15.117:0/2147500129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa50070930 0x7faa50149580 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009870 tx=0x7faa4c0046c0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.473+0000 7faa57a82640 1 -- 172.21.15.117:0/2147500129 shutdown_connections 2024-09-19T08:38:52.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.473+0000 7faa57a82640 1 --2- 172.21.15.117:0/2147500129 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7faa3406c2b0 0x7faa3406e770 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.473+0000 7faa57a82640 1 --2- 172.21.15.117:0/2147500129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa5015e4f0 0x7faa50160c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.473+0000 7faa57a82640 1 --2- 172.21.15.117:0/2147500129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa500add30 0x7faa5014acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.473+0000 7faa57a82640 1 --2- 172.21.15.117:0/2147500129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa50070930 0x7faa50149580 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.473+0000 7faa57a82640 1 -- 172.21.15.117:0/2147500129 >> 172.21.15.117:0/2147500129 conn(0x7faa5006bc10 msgr2=0x7faa5006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:52.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.473+0000 7faa57a82640 1 -- 172.21.15.117:0/2147500129 shutdown_connections 2024-09-19T08:38:52.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.473+0000 7faa57a82640 1 -- 172.21.15.117:0/2147500129 wait complete. 2024-09-19T08:38:52.484 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T08:38:52.484 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:38:52.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.585+0000 7f9bb07d8640 1 Processor -- start 2024-09-19T08:38:52.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.585+0000 7f9bb07d8640 1 -- start start 2024-09-19T08:38:52.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.586+0000 7f9bb07d8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ba80add30 0x7f9ba80ae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:52.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.586+0000 7f9bb07d8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9ba8070930 0x7f9ba80b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:52.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.586+0000 7f9bb07d8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba80ae650 con 0x7f9ba815e4f0 2024-09-19T08:38:52.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.586+0000 7f9bb07d8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9ba8070ea0 con 0x7f9ba8070930 2024-09-19T08:38:52.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.586+0000 7f9bb07d8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba806e8c0 con 0x7f9ba80add30 2024-09-19T08:38:52.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.586+0000 7f9baed75640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9ba8070930 0x7f9ba80b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:52.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.586+0000 7f9badd73640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f9ba815e4f0 0x7f9ba80b5050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:37496/0 (socket says 172.21.15.117:37496) 2024-09-19T08:38:52.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.586+0000 7f9badd73640 1 -- 172.21.15.117:0/1665377914 learned_addr learned my addr 172.21.15.117:0/1665377914 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:52.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.586+0000 7f9bae574640 1 --2- 172.21.15.117:0/1665377914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ba80add30 0x7f9ba80ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:52.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.586+0000 7f9baed75640 1 -- 172.21.15.117:0/1665377914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ba80add30 msgr2=0x7f9ba80ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:52.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.586+0000 7f9baed75640 1 --2- 172.21.15.117:0/1665377914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ba80add30 0x7f9ba80ae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.586+0000 7f9baed75640 1 -- 172.21.15.117:0/1665377914 >> v1:172.21.15.117:6789/0 conn(0x7f9ba815e4f0 legacy=0x7f9ba80b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:52.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.586+0000 7f9baed75640 1 -- 172.21.15.117:0/1665377914 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba806eba0 con 0x7f9ba8070930 2024-09-19T08:38:52.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.586+0000 7f9bad572640 1 -- 172.21.15.117:0/1665377914 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2556260806 0 0) 0x7f9ba80ae650 con 0x7f9ba815e4f0 2024-09-19T08:38:52.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.586+0000 7f9bae574640 1 --2- 172.21.15.117:0/1665377914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ba80add30 0x7f9ba80ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:52.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.587+0000 7f9baed75640 1 --2- 172.21.15.117:0/1665377914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ba8070930 0x7f9ba80b00f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9b98009d90 tx=0x7f9b9802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50cf901392baf9a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:52.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.587+0000 7f9bad572640 1 -- 172.21.15.117:0/1665377914 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b98007740 con 0x7f9ba8070930 2024-09-19T08:38:52.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.587+0000 7f9bad572640 1 -- 172.21.15.117:0/1665377914 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b980078e0 con 0x7f9ba8070930 2024-09-19T08:38:52.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.587+0000 7f9bad572640 1 -- 172.21.15.117:0/1665377914 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b98007cb0 con 0x7f9ba8070930 2024-09-19T08:38:52.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.588+0000 7f9bb07d8640 1 -- 172.21.15.117:0/1665377914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ba8070930 msgr2=0x7f9ba80b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:52.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.588+0000 7f9bb07d8640 1 --2- 172.21.15.117:0/1665377914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ba8070930 0x7f9ba80b00f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9b98009d90 tx=0x7f9b9802a680 comp rx=0 tx=0).stop 2024-09-19T08:38:52.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.588+0000 7f9bb07d8640 1 -- 172.21.15.117:0/1665377914 shutdown_connections 2024-09-19T08:38:52.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.588+0000 7f9bb07d8640 1 --2- 172.21.15.117:0/1665377914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ba8070930 0x7f9ba80b00f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.588+0000 7f9bb07d8640 1 --2- 172.21.15.117:0/1665377914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ba80add30 0x7f9ba80ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.588+0000 7f9bb07d8640 1 -- 172.21.15.117:0/1665377914 >> 172.21.15.117:0/1665377914 conn(0x7f9ba806bc10 msgr2=0x7f9ba806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:52.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.588+0000 7f9bb07d8640 1 -- 172.21.15.117:0/1665377914 shutdown_connections 2024-09-19T08:38:52.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.588+0000 7f9bb07d8640 1 -- 172.21.15.117:0/1665377914 wait complete. 2024-09-19T08:38:52.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.589+0000 7f9bb07d8640 1 Processor -- start 2024-09-19T08:38:52.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.589+0000 7f9bb07d8640 1 -- start start 2024-09-19T08:38:52.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.590+0000 7f9bb07d8640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ba8070930 0x7f9ba8150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:52.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.590+0000 7f9bb07d8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ba80add30 0x7f9ba8160d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:52.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.590+0000 7f9bb07d8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ba815e4f0 0x7f9ba8161290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:52.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.590+0000 7f9bb07d8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba806f3a0 con 0x7f9ba80add30 2024-09-19T08:38:52.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.590+0000 7f9bb07d8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba80b0630 con 0x7f9ba815e4f0 2024-09-19T08:38:52.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.590+0000 7f9bb07d8640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba806f520 con 0x7f9ba8070930 2024-09-19T08:38:52.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.590+0000 7f9badd73640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ba80add30 0x7f9ba8160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:52.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.590+0000 7f9badd73640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ba80add30 0x7f9ba8160d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39726/0 (socket says 172.21.15.117:39726) 2024-09-19T08:38:52.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.590+0000 7f9badd73640 1 -- 172.21.15.117:0/4188414544 learned_addr learned my addr 172.21.15.117:0/4188414544 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:52.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.590+0000 7f9badd73640 1 -- 172.21.15.117:0/4188414544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ba8070930 msgr2=0x7f9ba8150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:52.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.590+0000 7f9badd73640 1 --2- 172.21.15.117:0/4188414544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ba8070930 0x7f9ba8150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.590+0000 7f9badd73640 1 -- 172.21.15.117:0/4188414544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ba815e4f0 msgr2=0x7f9ba8161290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:52.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.590+0000 7f9badd73640 1 --2- 172.21.15.117:0/4188414544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ba815e4f0 0x7f9ba8161290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.590+0000 7f9badd73640 1 -- 172.21.15.117:0/4188414544 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba815f7c0 con 0x7f9ba80add30 2024-09-19T08:38:52.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.590+0000 7f9badd73640 1 --2- 172.21.15.117:0/4188414544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ba80add30 0x7f9ba8160d50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c00c390 tx=0x7f9b9c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:52.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.590+0000 7f9ba6ffd640 1 -- 172.21.15.117:0/4188414544 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c0074e0 con 0x7f9ba80add30 2024-09-19T08:38:52.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.590+0000 7f9ba6ffd640 1 -- 172.21.15.117:0/4188414544 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b9c007680 con 0x7f9ba80add30 2024-09-19T08:38:52.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.590+0000 7f9bb07d8640 1 -- 172.21.15.117:0/4188414544 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba80cd610 con 0x7f9ba80add30 2024-09-19T08:38:52.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.590+0000 7f9ba6ffd640 1 -- 172.21.15.117:0/4188414544 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c004a00 con 0x7f9ba80add30 2024-09-19T08:38:52.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.590+0000 7f9bb07d8640 1 -- 172.21.15.117:0/4188414544 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba815fd20 con 0x7f9ba80add30 2024-09-19T08:38:52.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.591+0000 7f9bb07d8640 1 -- 172.21.15.117:0/4188414544 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba80b00f0 con 0x7f9ba80add30 2024-09-19T08:38:52.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.592+0000 7f9ba6ffd640 1 -- 172.21.15.117:0/4188414544 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9b9c011070 con 0x7f9ba80add30 2024-09-19T08:38:52.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.592+0000 7f9ba6ffd640 1 --2- 172.21.15.117:0/4188414544 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9b9406c2e0 0x7f9b9406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:52.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.592+0000 7f9ba6ffd640 1 -- 172.21.15.117:0/4188414544 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f9b9c08b110 con 0x7f9ba80add30 2024-09-19T08:38:52.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.593+0000 7f9bae574640 1 --2- 172.21.15.117:0/4188414544 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9b9406c2e0 0x7f9b9406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:52.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.593+0000 7f9bae574640 1 --2- 172.21.15.117:0/4188414544 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9b9406c2e0 0x7f9b9406e7a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0006fd0 tx=0x7f9ba0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:52.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.596+0000 7f9ba6ffd640 1 -- 172.21.15.117:0/4188414544 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9ba815f7c0 con 0x7f9ba80add30 2024-09-19T08:38:52.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.758+0000 7f9bb07d8640 1 -- 172.21.15.117:0/4188414544 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9ba8150d50 con 0x7f9b9406c2e0 2024-09-19T08:38:52.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.764+0000 7f9ba6ffd640 1 -- 172.21.15.117:0/4188414544 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239405 (secure 0 0 0) 0x7f9ba000ae40 con 0x7f9b9406c2e0 2024-09-19T08:38:52.767 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:52.768 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-09-19T08:38:52.770 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.767+0000 7f9bb07d8640 1 -- 172.21.15.117:0/4188414544 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9b9406c2e0 msgr2=0x7f9b9406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:52.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.767+0000 7f9bb07d8640 1 --2- 172.21.15.117:0/4188414544 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9b9406c2e0 0x7f9b9406e7a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0006fd0 tx=0x7f9ba0008040 comp rx=0 tx=0).stop 2024-09-19T08:38:52.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.767+0000 7f9bb07d8640 1 -- 172.21.15.117:0/4188414544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ba80add30 msgr2=0x7f9ba8160d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:52.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.767+0000 7f9bb07d8640 1 --2- 172.21.15.117:0/4188414544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ba80add30 0x7f9ba8160d50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c00c390 tx=0x7f9b9c00c850 comp rx=0 tx=0).stop 2024-09-19T08:38:52.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.767+0000 7f9bb07d8640 1 -- 172.21.15.117:0/4188414544 shutdown_connections 2024-09-19T08:38:52.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.767+0000 7f9bb07d8640 1 --2- 172.21.15.117:0/4188414544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ba815e4f0 0x7f9ba8161290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.767+0000 7f9bb07d8640 1 --2- 172.21.15.117:0/4188414544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ba80add30 0x7f9ba8160d50 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.767+0000 7f9bb07d8640 1 --2- 172.21.15.117:0/4188414544 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9b9406c2e0 0x7f9b9406e7a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.767+0000 7f9bb07d8640 1 --2- 172.21.15.117:0/4188414544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9ba8070930 0x7f9ba8150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.767+0000 7f9bb07d8640 1 -- 172.21.15.117:0/4188414544 >> 172.21.15.117:0/4188414544 conn(0x7f9ba806bc10 msgr2=0x7f9ba80b5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:52.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.767+0000 7f9bb07d8640 1 -- 172.21.15.117:0/4188414544 shutdown_connections 2024-09-19T08:38:52.771 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.767+0000 7f9bb07d8640 1 -- 172.21.15.117:0/4188414544 wait complete. 2024-09-19T08:38:52.778 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-09-19T08:38:51.869593+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590424,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":178,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":221708,"kb_used_data":5456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753012,"statfs":{"total":773094113280,"available":772867084288,"internally_reserved":0,"allocated":5586944,"data_stored":3067950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.042768"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.860745+0000","last_change":"2024-09-19T08:38:49.851860+0000","last_active":"2024-09-19T08:38:49.860745+0000","last_peered":"2024-09-19T08:38:49.860745+0000","last_clean":"2024-09-19T08:38:49.860745+0000","last_became_active":"2024-09-19T08:38:49.851582+0000","last_became_peered":"2024-09-19T08:38:49.851582+0000","last_unstale":"2024-09-19T08:38:49.860745+0000","last_undegraded":"2024-09-19T08:38:49.860745+0000","last_fullsized":"2024-09-19T08:38:49.860745+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:04.915512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.860844+0000","last_change":"2024-09-19T08:38:49.853887+0000","last_active":"2024-09-19T08:38:49.860844+0000","last_peered":"2024-09-19T08:38:49.860844+0000","last_clean":"2024-09-19T08:38:49.860844+0000","last_became_active":"2024-09-19T08:38:49.853098+0000","last_became_peered":"2024-09-19T08:38:49.853098+0000","last_unstale":"2024-09-19T08:38:49.860844+0000","last_undegraded":"2024-09-19T08:38:49.860844+0000","last_fullsized":"2024-09-19T08:38:49.860844+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:38.052077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.861772+0000","last_change":"2024-09-19T08:38:49.856788+0000","last_active":"2024-09-19T08:38:49.861772+0000","last_peered":"2024-09-19T08:38:49.861772+0000","last_clean":"2024-09-19T08:38:49.861772+0000","last_became_active":"2024-09-19T08:38:49.856469+0000","last_became_peered":"2024-09-19T08:38:49.856469+0000","last_unstale":"2024-09-19T08:38:49.861772+0000","last_undegraded":"2024-09-19T08:38:49.861772+0000","last_fullsized":"2024-09-19T08:38:49.861772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:35.354565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.853574+0000","last_change":"2024-09-19T08:38:49.849968+0000","last_active":"2024-09-19T08:38:49.853574+0000","last_peered":"2024-09-19T08:38:49.853574+0000","last_clean":"2024-09-19T08:38:49.853574+0000","last_became_active":"2024-09-19T08:38:49.848196+0000","last_became_peered":"2024-09-19T08:38:49.848196+0000","last_unstale":"2024-09-19T08:38:49.853574+0000","last_undegraded":"2024-09-19T08:38:49.853574+0000","last_fullsized":"2024-09-19T08:38:49.853574+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:46.522548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.849997+0000","last_change":"2024-09-19T08:38:49.843417+0000","last_active":"2024-09-19T08:38:49.849997+0000","last_peered":"2024-09-19T08:38:49.849997+0000","last_clean":"2024-09-19T08:38:49.849997+0000","last_became_active":"2024-09-19T08:38:49.843112+0000","last_became_peered":"2024-09-19T08:38:49.843112+0000","last_unstale":"2024-09-19T08:38:49.849997+0000","last_undegraded":"2024-09-19T08:38:49.849997+0000","last_fullsized":"2024-09-19T08:38:49.849997+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:26.972954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.861683+0000","last_change":"2024-09-19T08:38:49.856508+0000","last_active":"2024-09-19T08:38:49.861683+0000","last_peered":"2024-09-19T08:38:49.861683+0000","last_clean":"2024-09-19T08:38:49.861683+0000","last_became_active":"2024-09-19T08:38:49.856233+0000","last_became_peered":"2024-09-19T08:38:49.856233+0000","last_unstale":"2024-09-19T08:38:49.861683+0000","last_undegraded":"2024-09-19T08:38:49.861683+0000","last_fullsized":"2024-09-19T08:38:49.861683+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:56.004415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.862475+0000","last_change":"2024-09-19T08:38:48.847545+0000","last_active":"2024-09-19T08:38:49.862475+0000","last_peered":"2024-09-19T08:38:49.862475+0000","last_clean":"2024-09-19T08:38:49.862475+0000","last_became_active":"2024-09-19T08:38:48.847225+0000","last_became_peered":"2024-09-19T08:38:48.847225+0000","last_unstale":"2024-09-19T08:38:49.862475+0000","last_undegraded":"2024-09-19T08:38:49.862475+0000","last_fullsized":"2024-09-19T08:38:49.862475+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:22.921438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.851635+0000","last_change":"2024-09-19T08:38:48.848241+0000","last_active":"2024-09-19T08:38:49.851635+0000","last_peered":"2024-09-19T08:38:49.851635+0000","last_clean":"2024-09-19T08:38:49.851635+0000","last_became_active":"2024-09-19T08:38:48.847988+0000","last_became_peered":"2024-09-19T08:38:48.847988+0000","last_unstale":"2024-09-19T08:38:49.851635+0000","last_undegraded":"2024-09-19T08:38:49.851635+0000","last_fullsized":"2024-09-19T08:38:49.851635+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:04.274074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.861096+0000","last_change":"2024-09-19T08:38:49.852949+0000","last_active":"2024-09-19T08:38:49.861096+0000","last_peered":"2024-09-19T08:38:49.861096+0000","last_clean":"2024-09-19T08:38:49.861096+0000","last_became_active":"2024-09-19T08:38:49.852266+0000","last_became_peered":"2024-09-19T08:38:49.852266+0000","last_unstale":"2024-09-19T08:38:49.861096+0000","last_undegraded":"2024-09-19T08:38:49.861096+0000","last_fullsized":"2024-09-19T08:38:49.861096+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:22:14.408979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"51'8","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.863152+0000","last_change":"2024-09-19T08:38:48.847054+0000","last_active":"2024-09-19T08:38:49.863152+0000","last_peered":"2024-09-19T08:38:49.863152+0000","last_clean":"2024-09-19T08:38:49.863152+0000","last_became_active":"2024-09-19T08:38:48.846733+0000","last_became_peered":"2024-09-19T08:38:48.846733+0000","last_unstale":"2024-09-19T08:38:49.863152+0000","last_undegraded":"2024-09-19T08:38:49.863152+0000","last_fullsized":"2024-09-19T08:38:49.863152+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:07.461886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.862524+0000","last_change":"2024-09-19T08:38:48.846146+0000","last_active":"2024-09-19T08:38:49.862524+0000","last_peered":"2024-09-19T08:38:49.862524+0000","last_clean":"2024-09-19T08:38:49.862524+0000","last_became_active":"2024-09-19T08:38:48.845885+0000","last_became_peered":"2024-09-19T08:38:48.845885+0000","last_unstale":"2024-09-19T08:38:49.862524+0000","last_undegraded":"2024-09-19T08:38:49.862524+0000","last_fullsized":"2024-09-19T08:38:49.862524+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:20:07.203808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.859699+0000","last_change":"2024-09-19T08:38:48.847801+0000","last_active":"2024-09-19T08:38:49.859699+0000","last_peered":"2024-09-19T08:38:49.859699+0000","last_clean":"2024-09-19T08:38:49.859699+0000","last_became_active":"2024-09-19T08:38:48.847514+0000","last_became_peered":"2024-09-19T08:38:48.847514+0000","last_unstale":"2024-09-19T08:38:49.859699+0000","last_undegraded":"2024-09-19T08:38:49.859699+0000","last_fullsized":"2024-09-19T08:38:49.859699+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:49.457995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.861791+0000","last_change":"2024-09-19T08:38:49.857362+0000","last_active":"2024-09-19T08:38:49.861791+0000","last_peered":"2024-09-19T08:38:49.861791+0000","last_clean":"2024-09-19T08:38:49.861791+0000","last_became_active":"2024-09-19T08:38:49.857115+0000","last_became_peered":"2024-09-19T08:38:49.857115+0000","last_unstale":"2024-09-19T08:38:49.861791+0000","last_undegraded":"2024-09-19T08:38:49.861791+0000","last_fullsized":"2024-09-19T08:38:49.861791+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:00:53.483613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.861957+0000","last_change":"2024-09-19T08:38:49.854179+0000","last_active":"2024-09-19T08:38:49.861957+0000","last_peered":"2024-09-19T08:38:49.861957+0000","last_clean":"2024-09-19T08:38:49.861957+0000","last_became_active":"2024-09-19T08:38:49.853888+0000","last_became_peered":"2024-09-19T08:38:49.853888+0000","last_unstale":"2024-09-19T08:38:49.861957+0000","last_undegraded":"2024-09-19T08:38:49.861957+0000","last_fullsized":"2024-09-19T08:38:49.861957+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:40.178360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.862071+0000","last_change":"2024-09-19T08:38:49.861491+0000","last_active":"2024-09-19T08:38:49.862071+0000","last_peered":"2024-09-19T08:38:49.862071+0000","last_clean":"2024-09-19T08:38:49.862071+0000","last_became_active":"2024-09-19T08:38:49.861043+0000","last_became_peered":"2024-09-19T08:38:49.861043+0000","last_unstale":"2024-09-19T08:38:49.862071+0000","last_undegraded":"2024-09-19T08:38:49.862071+0000","last_fullsized":"2024-09-19T08:38:49.862071+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:05.788337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":212,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-19T08:38:45.816128+0000","last_change":"2024-09-19T08:37:04.479071+0000","last_active":"2024-09-19T08:38:45.816128+0000","last_peered":"2024-09-19T08:38:45.816128+0000","last_clean":"2024-09-19T08:38:45.816128+0000","last_became_active":"2024-09-19T08:37:04.478199+0000","last_became_peered":"2024-09-19T08:37:04.478199+0000","last_unstale":"2024-09-19T08:38:45.816128+0000","last_undegraded":"2024-09-19T08:38:45.816128+0000","last_fullsized":"2024-09-19T08:38:45.816128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_clean_scrub_stamp":"2024-09-19T08:37:02.519738+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:32.963748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":10,"acting":10,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":524288,"data_stored":224397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1142784,"data_stored":825835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":536576,"data_stored":229932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":229932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27576,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":548864,"data_stored":235467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1142784,"data_stored":825835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27568,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":548864,"data_stored":235467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":606208,"data_stored":261085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:38:52.782 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:38:52.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.918+0000 7f4a0620e640 1 Processor -- start 2024-09-19T08:38:52.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.918+0000 7f4a0620e640 1 -- start start 2024-09-19T08:38:52.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.918+0000 7f4a0620e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a00072590 0x7f4a0006d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:52.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.918+0000 7f4a0620e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a001620b0 con 0x7f4a00141ad0 2024-09-19T08:38:52.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.918+0000 7f4a0620e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a00162370 con 0x7f4a000d21f0 2024-09-19T08:38:52.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.918+0000 7f4a0620e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f4a00141750 con 0x7f4a00072590 2024-09-19T08:38:52.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.919+0000 7f49fffff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f4a00141ad0 0x7f4a00141f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:37510/0 (socket says 172.21.15.117:37510) 2024-09-19T08:38:52.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.919+0000 7f49fffff640 1 -- 172.21.15.117:0/2598190223 learned_addr learned my addr 172.21.15.117:0/2598190223 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:52.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.919+0000 7f49feffd640 1 --2- 172.21.15.117:0/2598190223 >> v2:172.21.15.146:3300/0 conn(0x7f4a00072590 0x7f4a0006d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:52.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.919+0000 7f49fe7fc640 1 -- 172.21.15.117:0/2598190223 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1631906214 0 0) 0x7f4a001620b0 con 0x7f4a00141ad0 2024-09-19T08:38:52.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.919+0000 7f49fe7fc640 1 -- 172.21.15.117:0/2598190223 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49e8003520 con 0x7f4a00141ad0 2024-09-19T08:38:52.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.919+0000 7f49fe7fc640 1 -- 172.21.15.117:0/2598190223 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3486034671 0 0) 0x7f49e8003520 con 0x7f4a00141ad0 2024-09-19T08:38:52.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.919+0000 7f49fe7fc640 1 -- 172.21.15.117:0/2598190223 >> v2:172.21.15.146:3300/0 conn(0x7f4a00072590 msgr2=0x7f4a0006d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:52.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.919+0000 7f49fe7fc640 1 --2- 172.21.15.117:0/2598190223 >> v2:172.21.15.146:3300/0 conn(0x7f4a00072590 0x7f4a0006d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.919+0000 7f49fe7fc640 1 -- 172.21.15.117:0/2598190223 >> v1:172.21.15.146:6789/0 conn(0x7f4a000d21f0 legacy=0x7f4a000d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:52.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.919+0000 7f49fe7fc640 1 -- 172.21.15.117:0/2598190223 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a00162650 con 0x7f4a00141ad0 2024-09-19T08:38:52.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.919+0000 7f49fe7fc640 1 -- 172.21.15.117:0/2598190223 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f49f8001670 con 0x7f4a00141ad0 2024-09-19T08:38:52.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.919+0000 7f49fe7fc640 1 -- 172.21.15.117:0/2598190223 >> v1:172.21.15.117:6789/0 conn(0x7f4a00141ad0 legacy=0x7f4a00141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:52.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.919+0000 7f49fe7fc640 1 --2- 172.21.15.117:0/2598190223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e80039b0 0x7f49e8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:52.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.919+0000 7f49fe7fc640 1 --2- 172.21.15.117:0/2598190223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49e80043b0 0x7f49e8004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:52.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.919+0000 7f49fe7fc640 1 --2- 172.21.15.117:0/2598190223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e8005120 0x7f49e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:52.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.919+0000 7f49fe7fc640 1 -- 172.21.15.117:0/2598190223 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4a00141750 con 0x7f49e8005120 2024-09-19T08:38:52.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.919+0000 7f49fe7fc640 1 -- 172.21.15.117:0/2598190223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f49e800c060 con 0x7f49e80039b0 2024-09-19T08:38:52.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.919+0000 7f49fe7fc640 1 -- 172.21.15.117:0/2598190223 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f49e800c260 con 0x7f49e80043b0 2024-09-19T08:38:52.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.919+0000 7f49fffff640 1 --2- 172.21.15.117:0/2598190223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e8005120 0x7f49e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:52.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.919+0000 7f49ff7fe640 1 --2- 172.21.15.117:0/2598190223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e80039b0 0x7f49e8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:52.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.919+0000 7f49feffd640 1 --2- 172.21.15.117:0/2598190223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49e80043b0 0x7f49e8004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:52.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.920+0000 7f49fffff640 1 -- 172.21.15.117:0/2598190223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49e80043b0 msgr2=0x7f49e8004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:52.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.920+0000 7f49fffff640 1 --2- 172.21.15.117:0/2598190223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49e80043b0 0x7f49e8004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.920+0000 7f49fffff640 1 -- 172.21.15.117:0/2598190223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e80039b0 msgr2=0x7f49e8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:52.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.920+0000 7f49fffff640 1 --2- 172.21.15.117:0/2598190223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e80039b0 0x7f49e8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.920+0000 7f49fffff640 1 -- 172.21.15.117:0/2598190223 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e8003520 con 0x7f49e8005120 2024-09-19T08:38:52.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.920+0000 7f49fffff640 1 -- 172.21.15.117:0/2598190223 reap_dead start 2024-09-19T08:38:52.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.920+0000 7f49fffff640 1 --2- 172.21.15.117:0/2598190223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e8005120 0x7f49e800b9c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f49f800c290 tx=0x7f49e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c3cfe53dfd434a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:52.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.920+0000 7f49fe7fc640 1 -- 172.21.15.117:0/2598190223 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f8007d50 con 0x7f49e8005120 2024-09-19T08:38:52.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.920+0000 7f49fe7fc640 1 -- 172.21.15.117:0/2598190223 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f8005af0 con 0x7f49e8005120 2024-09-19T08:38:52.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.920+0000 7f49fe7fc640 1 -- 172.21.15.117:0/2598190223 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f8007070 con 0x7f49e8005120 2024-09-19T08:38:52.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.921+0000 7f4a0620e640 1 -- 172.21.15.117:0/2598190223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e8005120 msgr2=0x7f49e800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:52.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.921+0000 7f4a0620e640 1 --2- 172.21.15.117:0/2598190223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e8005120 0x7f49e800b9c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f49f800c290 tx=0x7f49e8005830 comp rx=0 tx=0).stop 2024-09-19T08:38:52.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.921+0000 7f4a0620e640 1 -- 172.21.15.117:0/2598190223 shutdown_connections 2024-09-19T08:38:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.921+0000 7f4a0620e640 1 --2- 172.21.15.117:0/2598190223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49e8005120 0x7f49e800b9c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.921+0000 7f4a0620e640 1 -- 172.21.15.117:0/2598190223 >> 172.21.15.117:0/2598190223 conn(0x7f4a000b3ed0 msgr2=0x7f4a000b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.921+0000 7f4a0620e640 1 -- 172.21.15.117:0/2598190223 shutdown_connections 2024-09-19T08:38:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.921+0000 7f4a0620e640 1 -- 172.21.15.117:0/2598190223 wait complete. 2024-09-19T08:38:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.922+0000 7f4a0620e640 1 Processor -- start 2024-09-19T08:38:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.922+0000 7f4a0620e640 1 -- start start 2024-09-19T08:38:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.923+0000 7f4a0620e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e8005120 0x7f4a000b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.923+0000 7f4a0620e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a0015fae0 0x7f4a0015ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.923+0000 7f4a0620e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a000b6650 0x7f4a000b6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.923+0000 7f4a0620e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4a00158c30 con 0x7f4a0015fae0 2024-09-19T08:38:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.923+0000 7f4a0620e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4a00162c10 con 0x7f49e8005120 2024-09-19T08:38:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.923+0000 7f4a0620e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f4a00158db0 con 0x7f4a000b6650 2024-09-19T08:38:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.923+0000 7f49feffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a0015fae0 0x7f4a0015ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:52.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.923+0000 7f49feffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a0015fae0 0x7f4a0015ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39748/0 (socket says 172.21.15.117:39748) 2024-09-19T08:38:52.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.923+0000 7f49feffd640 1 -- 172.21.15.117:0/2820684171 learned_addr learned my addr 172.21.15.117:0/2820684171 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:52.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.923+0000 7f49ff7fe640 1 --2- 172.21.15.117:0/2820684171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e8005120 0x7f4a000b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:52.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.923+0000 7f49fffff640 1 --2- 172.21.15.117:0/2820684171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a000b6650 0x7f4a000b6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:52.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.923+0000 7f49feffd640 1 -- 172.21.15.117:0/2820684171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a000b6650 msgr2=0x7f4a000b6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:52.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.923+0000 7f49feffd640 1 --2- 172.21.15.117:0/2820684171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a000b6650 0x7f4a000b6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.923+0000 7f49feffd640 1 -- 172.21.15.117:0/2820684171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e8005120 msgr2=0x7f4a000b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:52.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.923+0000 7f49feffd640 1 --2- 172.21.15.117:0/2820684171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e8005120 0x7f4a000b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:52.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.923+0000 7f49feffd640 1 -- 172.21.15.117:0/2820684171 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a001f4bd0 con 0x7f4a0015fae0 2024-09-19T08:38:52.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.923+0000 7f49fffff640 1 --2- 172.21.15.117:0/2820684171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a000b6650 0x7f4a000b6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:52.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.924+0000 7f49feffd640 1 --2- 172.21.15.117:0/2820684171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a0015fae0 0x7f4a0015ff60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f49f4009fc0 tx=0x7f49f400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:52.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.924+0000 7f49e7fff640 1 -- 172.21.15.117:0/2820684171 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f4015430 con 0x7f4a0015fae0 2024-09-19T08:38:52.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.924+0000 7f49e7fff640 1 -- 172.21.15.117:0/2820684171 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f40155d0 con 0x7f4a0015fae0 2024-09-19T08:38:52.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.924+0000 7f4a0620e640 1 -- 172.21.15.117:0/2820684171 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a000b5300 con 0x7f4a0015fae0 2024-09-19T08:38:52.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.924+0000 7f49e7fff640 1 -- 172.21.15.117:0/2820684171 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f40159c0 con 0x7f4a0015fae0 2024-09-19T08:38:52.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.924+0000 7f4a0620e640 1 -- 172.21.15.117:0/2820684171 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a000b7010 con 0x7f4a0015fae0 2024-09-19T08:38:52.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.925+0000 7f4a0620e640 1 -- 172.21.15.117:0/2820684171 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a00068ca0 con 0x7f4a0015fae0 2024-09-19T08:38:52.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.925+0000 7f49e7fff640 1 -- 172.21.15.117:0/2820684171 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f49f4015b60 con 0x7f4a0015fae0 2024-09-19T08:38:52.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.926+0000 7f49e7fff640 1 --2- 172.21.15.117:0/2820684171 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f49ec06c2b0 0x7f49ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:52.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.926+0000 7f49e7fff640 1 -- 172.21.15.117:0/2820684171 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f49f408c580 con 0x7f4a0015fae0 2024-09-19T08:38:52.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.926+0000 7f49ff7fe640 1 --2- 172.21.15.117:0/2820684171 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f49ec06c2b0 0x7f49ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:52.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.926+0000 7f49ff7fe640 1 --2- 172.21.15.117:0/2820684171 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f49ec06c2b0 0x7f49ec06e770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f49f0001890 tx=0x7f49f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:52.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:52.930+0000 7f49e7fff640 1 -- 172.21.15.117:0/2820684171 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f49f4019030 con 0x7f4a0015fae0 2024-09-19T08:38:53.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.094+0000 7f4a0620e640 1 -- 172.21.15.117:0/2820684171 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4a001f4eb0 con 0x7f49ec06c2b0 2024-09-19T08:38:53.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.100+0000 7f49e7fff640 1 -- 172.21.15.117:0/2820684171 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239405 (secure 0 0 0) 0x7f4a001f4eb0 con 0x7f49ec06c2b0 2024-09-19T08:38:53.102 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:53.103 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-09-19T08:38:53.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.103+0000 7f4a0620e640 1 -- 172.21.15.117:0/2820684171 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f49ec06c2b0 msgr2=0x7f49ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:53.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.103+0000 7f4a0620e640 1 --2- 172.21.15.117:0/2820684171 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f49ec06c2b0 0x7f49ec06e770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f49f0001890 tx=0x7f49f0009040 comp rx=0 tx=0).stop 2024-09-19T08:38:53.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.103+0000 7f4a0620e640 1 -- 172.21.15.117:0/2820684171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a0015fae0 msgr2=0x7f4a0015ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:53.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.103+0000 7f4a0620e640 1 --2- 172.21.15.117:0/2820684171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a0015fae0 0x7f4a0015ff60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f49f4009fc0 tx=0x7f49f400f580 comp rx=0 tx=0).stop 2024-09-19T08:38:53.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.103+0000 7f4a0620e640 1 -- 172.21.15.117:0/2820684171 shutdown_connections 2024-09-19T08:38:53.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.103+0000 7f4a0620e640 1 --2- 172.21.15.117:0/2820684171 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f49ec06c2b0 0x7f49ec06e770 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.103+0000 7f4a0620e640 1 --2- 172.21.15.117:0/2820684171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a000b6650 0x7f4a000b6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.103+0000 7f4a0620e640 1 --2- 172.21.15.117:0/2820684171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a0015fae0 0x7f4a0015ff60 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.103+0000 7f4a0620e640 1 --2- 172.21.15.117:0/2820684171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e8005120 0x7f4a000b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.103+0000 7f4a0620e640 1 -- 172.21.15.117:0/2820684171 >> 172.21.15.117:0/2820684171 conn(0x7f4a000b3ed0 msgr2=0x7f4a000c7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:53.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.103+0000 7f4a0620e640 1 -- 172.21.15.117:0/2820684171 shutdown_connections 2024-09-19T08:38:53.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.103+0000 7f4a0620e640 1 -- 172.21.15.117:0/2820684171 wait complete. 2024-09-19T08:38:53.116 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-09-19T08:38:51.869593+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590424,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":178,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":221708,"kb_used_data":5456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753012,"statfs":{"total":773094113280,"available":772867084288,"internally_reserved":0,"allocated":5586944,"data_stored":3067950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.042768"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.860745+0000","last_change":"2024-09-19T08:38:49.851860+0000","last_active":"2024-09-19T08:38:49.860745+0000","last_peered":"2024-09-19T08:38:49.860745+0000","last_clean":"2024-09-19T08:38:49.860745+0000","last_became_active":"2024-09-19T08:38:49.851582+0000","last_became_peered":"2024-09-19T08:38:49.851582+0000","last_unstale":"2024-09-19T08:38:49.860745+0000","last_undegraded":"2024-09-19T08:38:49.860745+0000","last_fullsized":"2024-09-19T08:38:49.860745+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:04.915512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.860844+0000","last_change":"2024-09-19T08:38:49.853887+0000","last_active":"2024-09-19T08:38:49.860844+0000","last_peered":"2024-09-19T08:38:49.860844+0000","last_clean":"2024-09-19T08:38:49.860844+0000","last_became_active":"2024-09-19T08:38:49.853098+0000","last_became_peered":"2024-09-19T08:38:49.853098+0000","last_unstale":"2024-09-19T08:38:49.860844+0000","last_undegraded":"2024-09-19T08:38:49.860844+0000","last_fullsized":"2024-09-19T08:38:49.860844+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:38.052077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.861772+0000","last_change":"2024-09-19T08:38:49.856788+0000","last_active":"2024-09-19T08:38:49.861772+0000","last_peered":"2024-09-19T08:38:49.861772+0000","last_clean":"2024-09-19T08:38:49.861772+0000","last_became_active":"2024-09-19T08:38:49.856469+0000","last_became_peered":"2024-09-19T08:38:49.856469+0000","last_unstale":"2024-09-19T08:38:49.861772+0000","last_undegraded":"2024-09-19T08:38:49.861772+0000","last_fullsized":"2024-09-19T08:38:49.861772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:35.354565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.853574+0000","last_change":"2024-09-19T08:38:49.849968+0000","last_active":"2024-09-19T08:38:49.853574+0000","last_peered":"2024-09-19T08:38:49.853574+0000","last_clean":"2024-09-19T08:38:49.853574+0000","last_became_active":"2024-09-19T08:38:49.848196+0000","last_became_peered":"2024-09-19T08:38:49.848196+0000","last_unstale":"2024-09-19T08:38:49.853574+0000","last_undegraded":"2024-09-19T08:38:49.853574+0000","last_fullsized":"2024-09-19T08:38:49.853574+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:46.522548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.849997+0000","last_change":"2024-09-19T08:38:49.843417+0000","last_active":"2024-09-19T08:38:49.849997+0000","last_peered":"2024-09-19T08:38:49.849997+0000","last_clean":"2024-09-19T08:38:49.849997+0000","last_became_active":"2024-09-19T08:38:49.843112+0000","last_became_peered":"2024-09-19T08:38:49.843112+0000","last_unstale":"2024-09-19T08:38:49.849997+0000","last_undegraded":"2024-09-19T08:38:49.849997+0000","last_fullsized":"2024-09-19T08:38:49.849997+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:26.972954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.861683+0000","last_change":"2024-09-19T08:38:49.856508+0000","last_active":"2024-09-19T08:38:49.861683+0000","last_peered":"2024-09-19T08:38:49.861683+0000","last_clean":"2024-09-19T08:38:49.861683+0000","last_became_active":"2024-09-19T08:38:49.856233+0000","last_became_peered":"2024-09-19T08:38:49.856233+0000","last_unstale":"2024-09-19T08:38:49.861683+0000","last_undegraded":"2024-09-19T08:38:49.861683+0000","last_fullsized":"2024-09-19T08:38:49.861683+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:56.004415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.862475+0000","last_change":"2024-09-19T08:38:48.847545+0000","last_active":"2024-09-19T08:38:49.862475+0000","last_peered":"2024-09-19T08:38:49.862475+0000","last_clean":"2024-09-19T08:38:49.862475+0000","last_became_active":"2024-09-19T08:38:48.847225+0000","last_became_peered":"2024-09-19T08:38:48.847225+0000","last_unstale":"2024-09-19T08:38:49.862475+0000","last_undegraded":"2024-09-19T08:38:49.862475+0000","last_fullsized":"2024-09-19T08:38:49.862475+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:22.921438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.851635+0000","last_change":"2024-09-19T08:38:48.848241+0000","last_active":"2024-09-19T08:38:49.851635+0000","last_peered":"2024-09-19T08:38:49.851635+0000","last_clean":"2024-09-19T08:38:49.851635+0000","last_became_active":"2024-09-19T08:38:48.847988+0000","last_became_peered":"2024-09-19T08:38:48.847988+0000","last_unstale":"2024-09-19T08:38:49.851635+0000","last_undegraded":"2024-09-19T08:38:49.851635+0000","last_fullsized":"2024-09-19T08:38:49.851635+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:04.274074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.861096+0000","last_change":"2024-09-19T08:38:49.852949+0000","last_active":"2024-09-19T08:38:49.861096+0000","last_peered":"2024-09-19T08:38:49.861096+0000","last_clean":"2024-09-19T08:38:49.861096+0000","last_became_active":"2024-09-19T08:38:49.852266+0000","last_became_peered":"2024-09-19T08:38:49.852266+0000","last_unstale":"2024-09-19T08:38:49.861096+0000","last_undegraded":"2024-09-19T08:38:49.861096+0000","last_fullsized":"2024-09-19T08:38:49.861096+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:22:14.408979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"51'8","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.863152+0000","last_change":"2024-09-19T08:38:48.847054+0000","last_active":"2024-09-19T08:38:49.863152+0000","last_peered":"2024-09-19T08:38:49.863152+0000","last_clean":"2024-09-19T08:38:49.863152+0000","last_became_active":"2024-09-19T08:38:48.846733+0000","last_became_peered":"2024-09-19T08:38:48.846733+0000","last_unstale":"2024-09-19T08:38:49.863152+0000","last_undegraded":"2024-09-19T08:38:49.863152+0000","last_fullsized":"2024-09-19T08:38:49.863152+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:07.461886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.862524+0000","last_change":"2024-09-19T08:38:48.846146+0000","last_active":"2024-09-19T08:38:49.862524+0000","last_peered":"2024-09-19T08:38:49.862524+0000","last_clean":"2024-09-19T08:38:49.862524+0000","last_became_active":"2024-09-19T08:38:48.845885+0000","last_became_peered":"2024-09-19T08:38:48.845885+0000","last_unstale":"2024-09-19T08:38:49.862524+0000","last_undegraded":"2024-09-19T08:38:49.862524+0000","last_fullsized":"2024-09-19T08:38:49.862524+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:20:07.203808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.859699+0000","last_change":"2024-09-19T08:38:48.847801+0000","last_active":"2024-09-19T08:38:49.859699+0000","last_peered":"2024-09-19T08:38:49.859699+0000","last_clean":"2024-09-19T08:38:49.859699+0000","last_became_active":"2024-09-19T08:38:48.847514+0000","last_became_peered":"2024-09-19T08:38:48.847514+0000","last_unstale":"2024-09-19T08:38:49.859699+0000","last_undegraded":"2024-09-19T08:38:49.859699+0000","last_fullsized":"2024-09-19T08:38:49.859699+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:49.457995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.861791+0000","last_change":"2024-09-19T08:38:49.857362+0000","last_active":"2024-09-19T08:38:49.861791+0000","last_peered":"2024-09-19T08:38:49.861791+0000","last_clean":"2024-09-19T08:38:49.861791+0000","last_became_active":"2024-09-19T08:38:49.857115+0000","last_became_peered":"2024-09-19T08:38:49.857115+0000","last_unstale":"2024-09-19T08:38:49.861791+0000","last_undegraded":"2024-09-19T08:38:49.861791+0000","last_fullsized":"2024-09-19T08:38:49.861791+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:00:53.483613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.861957+0000","last_change":"2024-09-19T08:38:49.854179+0000","last_active":"2024-09-19T08:38:49.861957+0000","last_peered":"2024-09-19T08:38:49.861957+0000","last_clean":"2024-09-19T08:38:49.861957+0000","last_became_active":"2024-09-19T08:38:49.853888+0000","last_became_peered":"2024-09-19T08:38:49.853888+0000","last_unstale":"2024-09-19T08:38:49.861957+0000","last_undegraded":"2024-09-19T08:38:49.861957+0000","last_fullsized":"2024-09-19T08:38:49.861957+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:40.178360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.862071+0000","last_change":"2024-09-19T08:38:49.861491+0000","last_active":"2024-09-19T08:38:49.862071+0000","last_peered":"2024-09-19T08:38:49.862071+0000","last_clean":"2024-09-19T08:38:49.862071+0000","last_became_active":"2024-09-19T08:38:49.861043+0000","last_became_peered":"2024-09-19T08:38:49.861043+0000","last_unstale":"2024-09-19T08:38:49.862071+0000","last_undegraded":"2024-09-19T08:38:49.862071+0000","last_fullsized":"2024-09-19T08:38:49.862071+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:05.788337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":212,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-19T08:38:45.816128+0000","last_change":"2024-09-19T08:37:04.479071+0000","last_active":"2024-09-19T08:38:45.816128+0000","last_peered":"2024-09-19T08:38:45.816128+0000","last_clean":"2024-09-19T08:38:45.816128+0000","last_became_active":"2024-09-19T08:37:04.478199+0000","last_became_peered":"2024-09-19T08:37:04.478199+0000","last_unstale":"2024-09-19T08:38:45.816128+0000","last_undegraded":"2024-09-19T08:38:45.816128+0000","last_fullsized":"2024-09-19T08:38:45.816128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_clean_scrub_stamp":"2024-09-19T08:37:02.519738+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:32.963748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":10,"acting":10,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":524288,"data_stored":224397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1142784,"data_stored":825835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":536576,"data_stored":229932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":229932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27576,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":548864,"data_stored":235467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1142784,"data_stored":825835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27568,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":548864,"data_stored":235467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":606208,"data_stored":261085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:38:53.121 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:38:53.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.255+0000 7f82d5dc4640 1 Processor -- start 2024-09-19T08:38:53.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.255+0000 7f82d5dc4640 1 -- start start 2024-09-19T08:38:53.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.255+0000 7f82d5dc4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82d00d0bc0 0x7f82d00c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.255+0000 7f82d5dc4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82d015b500 con 0x7f82d006f9e0 2024-09-19T08:38:53.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.255+0000 7f82d5dc4640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82d006e940 con 0x7f82d015b120 2024-09-19T08:38:53.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.255+0000 7f82d5dc4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f82d006ec20 con 0x7f82d00d0bc0 2024-09-19T08:38:53.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.256+0000 7f82ceffd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f82d006f9e0 0x7f82d00d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:37520/0 (socket says 172.21.15.117:37520) 2024-09-19T08:38:53.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.256+0000 7f82ceffd640 1 -- 172.21.15.117:0/1873975329 learned_addr learned my addr 172.21.15.117:0/1873975329 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:53.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.256+0000 7f82ce7fc640 1 -- 172.21.15.117:0/1873975329 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2929535627 0 0) 0x7f82d015b500 con 0x7f82d006f9e0 2024-09-19T08:38:53.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.256+0000 7f82ce7fc640 1 -- 172.21.15.117:0/1873975329 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82b8003520 con 0x7f82d006f9e0 2024-09-19T08:38:53.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.256+0000 7f82cffff640 1 --2- 172.21.15.117:0/1873975329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82d00d0bc0 0x7f82d00c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:53.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.256+0000 7f82ce7fc640 1 -- 172.21.15.117:0/1873975329 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2329119007 0 0) 0x7f82b8003520 con 0x7f82d006f9e0 2024-09-19T08:38:53.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.256+0000 7f82ce7fc640 1 -- 172.21.15.117:0/1873975329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82d00d0bc0 msgr2=0x7f82d00c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:53.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.256+0000 7f82ce7fc640 1 --2- 172.21.15.117:0/1873975329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82d00d0bc0 0x7f82d00c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.256+0000 7f82ce7fc640 1 -- 172.21.15.117:0/1873975329 >> v1:172.21.15.146:6789/0 conn(0x7f82d015b120 legacy=0x7f82d006dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:53.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.256+0000 7f82ce7fc640 1 -- 172.21.15.117:0/1873975329 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d006ef00 con 0x7f82d006f9e0 2024-09-19T08:38:53.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.256+0000 7f82ce7fc640 1 -- 172.21.15.117:0/1873975329 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f82c4001670 con 0x7f82d006f9e0 2024-09-19T08:38:53.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.256+0000 7f82ce7fc640 1 -- 172.21.15.117:0/1873975329 >> v1:172.21.15.117:6789/0 conn(0x7f82d006f9e0 legacy=0x7f82d00d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:53.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.256+0000 7f82ce7fc640 1 --2- 172.21.15.117:0/1873975329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82b80039e0 0x7f82b8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.256+0000 7f82ce7fc640 1 --2- 172.21.15.117:0/1873975329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82b8004800 0x7f82b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.256+0000 7f82ce7fc640 1 --2- 172.21.15.117:0/1873975329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82d00d0bc0 0x7f82b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.256+0000 7f82ce7fc640 1 -- 172.21.15.117:0/1873975329 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f82d006ec20 con 0x7f82b80039e0 2024-09-19T08:38:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.256+0000 7f82ce7fc640 1 -- 172.21.15.117:0/1873975329 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f82b800baa0 con 0x7f82b8004800 2024-09-19T08:38:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.256+0000 7f82ce7fc640 1 -- 172.21.15.117:0/1873975329 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f82b800bca0 con 0x7f82d00d0bc0 2024-09-19T08:38:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.256+0000 7f82cf7fe640 1 --2- 172.21.15.117:0/1873975329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82b80039e0 0x7f82b8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.256+0000 7f82ceffd640 1 --2- 172.21.15.117:0/1873975329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82b8004800 0x7f82b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.256+0000 7f82cffff640 1 --2- 172.21.15.117:0/1873975329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82d00d0bc0 0x7f82b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.257+0000 7f82cf7fe640 1 -- 172.21.15.117:0/1873975329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82d00d0bc0 msgr2=0x7f82b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.257+0000 7f82cf7fe640 1 --2- 172.21.15.117:0/1873975329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82d00d0bc0 0x7f82b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.257+0000 7f82cf7fe640 1 -- 172.21.15.117:0/1873975329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82b8004800 msgr2=0x7f82b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.257+0000 7f82cf7fe640 1 --2- 172.21.15.117:0/1873975329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82b8004800 0x7f82b8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.257+0000 7f82cf7fe640 1 -- 172.21.15.117:0/1873975329 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b8003520 con 0x7f82b80039e0 2024-09-19T08:38:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.257+0000 7f82ceffd640 1 --2- 172.21.15.117:0/1873975329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82b8004800 0x7f82b8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.257+0000 7f82cf7fe640 1 --2- 172.21.15.117:0/1873975329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82b80039e0 0x7f82b8003e00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f82c0001720 tx=0x7f82b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca2a3ac00c5b956 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:53.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.257+0000 7f82ce7fc640 1 -- 172.21.15.117:0/1873975329 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0001370 con 0x7f82b80039e0 2024-09-19T08:38:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.257+0000 7f82ce7fc640 1 -- 172.21.15.117:0/1873975329 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c00052d0 con 0x7f82b80039e0 2024-09-19T08:38:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.257+0000 7f82ce7fc640 1 -- 172.21.15.117:0/1873975329 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c002ab90 con 0x7f82b80039e0 2024-09-19T08:38:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.258+0000 7f82d5dc4640 1 -- 172.21.15.117:0/1873975329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82b80039e0 msgr2=0x7f82b8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.258+0000 7f82d5dc4640 1 --2- 172.21.15.117:0/1873975329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82b80039e0 0x7f82b8003e00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f82c0001720 tx=0x7f82b8005830 comp rx=0 tx=0).stop 2024-09-19T08:38:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.258+0000 7f82cffff640 1 -- 172.21.15.117:0/1873975329 reap_dead start 2024-09-19T08:38:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.258+0000 7f82d5dc4640 1 -- 172.21.15.117:0/1873975329 shutdown_connections 2024-09-19T08:38:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.258+0000 7f82d5dc4640 1 -- 172.21.15.117:0/1873975329 >> 172.21.15.117:0/1873975329 conn(0x7f82d006bdf0 msgr2=0x7f82d006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.258+0000 7f82d5dc4640 1 -- 172.21.15.117:0/1873975329 shutdown_connections 2024-09-19T08:38:53.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.258+0000 7f82d5dc4640 1 -- 172.21.15.117:0/1873975329 wait complete. 2024-09-19T08:38:53.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.259+0000 7f82d5dc4640 1 Processor -- start 2024-09-19T08:38:53.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.259+0000 7f82d5dc4640 1 -- start start 2024-09-19T08:38:53.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.260+0000 7f82d5dc4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82b80039e0 0x7f82d014bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.260+0000 7f82d5dc4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82d0142840 0x7f82d0148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.260+0000 7f82d5dc4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82d0072e90 0x7f82d0073310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.260+0000 7f82d5dc4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f82d006e5d0 con 0x7f82d0072e90 2024-09-19T08:38:53.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.260+0000 7f82d5dc4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f82d006f4c0 con 0x7f82b80039e0 2024-09-19T08:38:53.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.260+0000 7f82d5dc4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f82d00ce060 con 0x7f82d0142840 2024-09-19T08:38:53.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.260+0000 7f82cffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82d0072e90 0x7f82d0073310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:53.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.260+0000 7f82cffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82d0072e90 0x7f82d0073310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39760/0 (socket says 172.21.15.117:39760) 2024-09-19T08:38:53.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.260+0000 7f82cffff640 1 -- 172.21.15.117:0/4124260741 learned_addr learned my addr 172.21.15.117:0/4124260741 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:53.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.260+0000 7f82cf7fe640 1 --2- 172.21.15.117:0/4124260741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82b80039e0 0x7f82d014bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:53.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.260+0000 7f82ceffd640 1 --2- 172.21.15.117:0/4124260741 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82d0142840 0x7f82d0148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:53.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.260+0000 7f82cffff640 1 -- 172.21.15.117:0/4124260741 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82d0142840 msgr2=0x7f82d0148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:53.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.260+0000 7f82cffff640 1 --2- 172.21.15.117:0/4124260741 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82d0142840 0x7f82d0148a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.260+0000 7f82cffff640 1 -- 172.21.15.117:0/4124260741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82b80039e0 msgr2=0x7f82d014bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:53.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.260+0000 7f82cffff640 1 --2- 172.21.15.117:0/4124260741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82b80039e0 0x7f82d014bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.260+0000 7f82cffff640 1 -- 172.21.15.117:0/4124260741 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d0142cc0 con 0x7f82d0072e90 2024-09-19T08:38:53.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.260+0000 7f82cf7fe640 1 --2- 172.21.15.117:0/4124260741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82b80039e0 0x7f82d014bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:53.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.260+0000 7f82ceffd640 1 --2- 172.21.15.117:0/4124260741 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82d0142840 0x7f82d0148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:53.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.261+0000 7f82cffff640 1 --2- 172.21.15.117:0/4124260741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82d0072e90 0x7f82d0073310 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f82c8011c80 tx=0x7f82c800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:53.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.261+0000 7f82b7fff640 1 -- 172.21.15.117:0/4124260741 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c8015430 con 0x7f82d0072e90 2024-09-19T08:38:53.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.261+0000 7f82b7fff640 1 -- 172.21.15.117:0/4124260741 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c80155d0 con 0x7f82d0072e90 2024-09-19T08:38:53.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.261+0000 7f82d5dc4640 1 -- 172.21.15.117:0/4124260741 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d0142f70 con 0x7f82d0072e90 2024-09-19T08:38:53.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.261+0000 7f82b7fff640 1 -- 172.21.15.117:0/4124260741 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c80159c0 con 0x7f82d0072e90 2024-09-19T08:38:53.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.261+0000 7f82d5dc4640 1 -- 172.21.15.117:0/4124260741 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d0143530 con 0x7f82d0072e90 2024-09-19T08:38:53.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.262+0000 7f82d5dc4640 1 -- 172.21.15.117:0/4124260741 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d00cc320 con 0x7f82d0072e90 2024-09-19T08:38:53.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.262+0000 7f82b7fff640 1 -- 172.21.15.117:0/4124260741 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f82c8015b60 con 0x7f82d0072e90 2024-09-19T08:38:53.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.263+0000 7f82b7fff640 1 --2- 172.21.15.117:0/4124260741 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f82bc06c2e0 0x7f82bc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.263+0000 7f82b7fff640 1 -- 172.21.15.117:0/4124260741 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f82c808c350 con 0x7f82d0072e90 2024-09-19T08:38:53.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.263+0000 7f82cf7fe640 1 --2- 172.21.15.117:0/4124260741 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f82bc06c2e0 0x7f82bc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:53.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.263+0000 7f82cf7fe640 1 --2- 172.21.15.117:0/4124260741 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f82bc06c2e0 0x7f82bc06e7a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f82c0032000 tx=0x7f82c002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:53.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.267+0000 7f82b7fff640 1 -- 172.21.15.117:0/4124260741 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f82d00cc320 con 0x7f82d0072e90 2024-09-19T08:38:53.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.430+0000 7f82d5dc4640 1 -- 172.21.15.117:0/4124260741 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f82d00d04b0 con 0x7f82bc06c2e0 2024-09-19T08:38:53.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.436+0000 7f82b7fff640 1 -- 172.21.15.117:0/4124260741 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239405 (secure 0 0 0) 0x7f82d00d04b0 con 0x7f82bc06c2e0 2024-09-19T08:38:53.438 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:53.439 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-09-19T08:38:53.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.438+0000 7f82d5dc4640 1 -- 172.21.15.117:0/4124260741 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f82bc06c2e0 msgr2=0x7f82bc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:53.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.438+0000 7f82d5dc4640 1 --2- 172.21.15.117:0/4124260741 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f82bc06c2e0 0x7f82bc06e7a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f82c0032000 tx=0x7f82c002e000 comp rx=0 tx=0).stop 2024-09-19T08:38:53.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.438+0000 7f82d5dc4640 1 -- 172.21.15.117:0/4124260741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82d0072e90 msgr2=0x7f82d0073310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:53.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.438+0000 7f82d5dc4640 1 --2- 172.21.15.117:0/4124260741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82d0072e90 0x7f82d0073310 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f82c8011c80 tx=0x7f82c800f580 comp rx=0 tx=0).stop 2024-09-19T08:38:53.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.438+0000 7f82d5dc4640 1 -- 172.21.15.117:0/4124260741 shutdown_connections 2024-09-19T08:38:53.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.438+0000 7f82d5dc4640 1 --2- 172.21.15.117:0/4124260741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82d0072e90 0x7f82d0073310 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.438+0000 7f82d5dc4640 1 --2- 172.21.15.117:0/4124260741 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f82bc06c2e0 0x7f82bc06e7a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.438+0000 7f82d5dc4640 1 --2- 172.21.15.117:0/4124260741 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82d0142840 0x7f82d0148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.438+0000 7f82d5dc4640 1 --2- 172.21.15.117:0/4124260741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82b80039e0 0x7f82d014bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.438+0000 7f82d5dc4640 1 -- 172.21.15.117:0/4124260741 >> 172.21.15.117:0/4124260741 conn(0x7f82d006bdf0 msgr2=0x7f82d00c5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:53.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.438+0000 7f82d5dc4640 1 -- 172.21.15.117:0/4124260741 shutdown_connections 2024-09-19T08:38:53.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.438+0000 7f82d5dc4640 1 -- 172.21.15.117:0/4124260741 wait complete. 2024-09-19T08:38:53.449 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-09-19T08:38:51.869593+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590424,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":178,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":221708,"kb_used_data":5456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753012,"statfs":{"total":773094113280,"available":772867084288,"internally_reserved":0,"allocated":5586944,"data_stored":3067950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.042768"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.860745+0000","last_change":"2024-09-19T08:38:49.851860+0000","last_active":"2024-09-19T08:38:49.860745+0000","last_peered":"2024-09-19T08:38:49.860745+0000","last_clean":"2024-09-19T08:38:49.860745+0000","last_became_active":"2024-09-19T08:38:49.851582+0000","last_became_peered":"2024-09-19T08:38:49.851582+0000","last_unstale":"2024-09-19T08:38:49.860745+0000","last_undegraded":"2024-09-19T08:38:49.860745+0000","last_fullsized":"2024-09-19T08:38:49.860745+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:04.915512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.860844+0000","last_change":"2024-09-19T08:38:49.853887+0000","last_active":"2024-09-19T08:38:49.860844+0000","last_peered":"2024-09-19T08:38:49.860844+0000","last_clean":"2024-09-19T08:38:49.860844+0000","last_became_active":"2024-09-19T08:38:49.853098+0000","last_became_peered":"2024-09-19T08:38:49.853098+0000","last_unstale":"2024-09-19T08:38:49.860844+0000","last_undegraded":"2024-09-19T08:38:49.860844+0000","last_fullsized":"2024-09-19T08:38:49.860844+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:38.052077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.861772+0000","last_change":"2024-09-19T08:38:49.856788+0000","last_active":"2024-09-19T08:38:49.861772+0000","last_peered":"2024-09-19T08:38:49.861772+0000","last_clean":"2024-09-19T08:38:49.861772+0000","last_became_active":"2024-09-19T08:38:49.856469+0000","last_became_peered":"2024-09-19T08:38:49.856469+0000","last_unstale":"2024-09-19T08:38:49.861772+0000","last_undegraded":"2024-09-19T08:38:49.861772+0000","last_fullsized":"2024-09-19T08:38:49.861772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:35.354565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.853574+0000","last_change":"2024-09-19T08:38:49.849968+0000","last_active":"2024-09-19T08:38:49.853574+0000","last_peered":"2024-09-19T08:38:49.853574+0000","last_clean":"2024-09-19T08:38:49.853574+0000","last_became_active":"2024-09-19T08:38:49.848196+0000","last_became_peered":"2024-09-19T08:38:49.848196+0000","last_unstale":"2024-09-19T08:38:49.853574+0000","last_undegraded":"2024-09-19T08:38:49.853574+0000","last_fullsized":"2024-09-19T08:38:49.853574+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:46.522548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.849997+0000","last_change":"2024-09-19T08:38:49.843417+0000","last_active":"2024-09-19T08:38:49.849997+0000","last_peered":"2024-09-19T08:38:49.849997+0000","last_clean":"2024-09-19T08:38:49.849997+0000","last_became_active":"2024-09-19T08:38:49.843112+0000","last_became_peered":"2024-09-19T08:38:49.843112+0000","last_unstale":"2024-09-19T08:38:49.849997+0000","last_undegraded":"2024-09-19T08:38:49.849997+0000","last_fullsized":"2024-09-19T08:38:49.849997+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:26.972954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.861683+0000","last_change":"2024-09-19T08:38:49.856508+0000","last_active":"2024-09-19T08:38:49.861683+0000","last_peered":"2024-09-19T08:38:49.861683+0000","last_clean":"2024-09-19T08:38:49.861683+0000","last_became_active":"2024-09-19T08:38:49.856233+0000","last_became_peered":"2024-09-19T08:38:49.856233+0000","last_unstale":"2024-09-19T08:38:49.861683+0000","last_undegraded":"2024-09-19T08:38:49.861683+0000","last_fullsized":"2024-09-19T08:38:49.861683+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:56.004415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.862475+0000","last_change":"2024-09-19T08:38:48.847545+0000","last_active":"2024-09-19T08:38:49.862475+0000","last_peered":"2024-09-19T08:38:49.862475+0000","last_clean":"2024-09-19T08:38:49.862475+0000","last_became_active":"2024-09-19T08:38:48.847225+0000","last_became_peered":"2024-09-19T08:38:48.847225+0000","last_unstale":"2024-09-19T08:38:49.862475+0000","last_undegraded":"2024-09-19T08:38:49.862475+0000","last_fullsized":"2024-09-19T08:38:49.862475+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:22.921438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.851635+0000","last_change":"2024-09-19T08:38:48.848241+0000","last_active":"2024-09-19T08:38:49.851635+0000","last_peered":"2024-09-19T08:38:49.851635+0000","last_clean":"2024-09-19T08:38:49.851635+0000","last_became_active":"2024-09-19T08:38:48.847988+0000","last_became_peered":"2024-09-19T08:38:48.847988+0000","last_unstale":"2024-09-19T08:38:49.851635+0000","last_undegraded":"2024-09-19T08:38:49.851635+0000","last_fullsized":"2024-09-19T08:38:49.851635+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:04.274074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.861096+0000","last_change":"2024-09-19T08:38:49.852949+0000","last_active":"2024-09-19T08:38:49.861096+0000","last_peered":"2024-09-19T08:38:49.861096+0000","last_clean":"2024-09-19T08:38:49.861096+0000","last_became_active":"2024-09-19T08:38:49.852266+0000","last_became_peered":"2024-09-19T08:38:49.852266+0000","last_unstale":"2024-09-19T08:38:49.861096+0000","last_undegraded":"2024-09-19T08:38:49.861096+0000","last_fullsized":"2024-09-19T08:38:49.861096+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:22:14.408979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"51'8","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.863152+0000","last_change":"2024-09-19T08:38:48.847054+0000","last_active":"2024-09-19T08:38:49.863152+0000","last_peered":"2024-09-19T08:38:49.863152+0000","last_clean":"2024-09-19T08:38:49.863152+0000","last_became_active":"2024-09-19T08:38:48.846733+0000","last_became_peered":"2024-09-19T08:38:48.846733+0000","last_unstale":"2024-09-19T08:38:49.863152+0000","last_undegraded":"2024-09-19T08:38:49.863152+0000","last_fullsized":"2024-09-19T08:38:49.863152+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:07.461886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.862524+0000","last_change":"2024-09-19T08:38:48.846146+0000","last_active":"2024-09-19T08:38:49.862524+0000","last_peered":"2024-09-19T08:38:49.862524+0000","last_clean":"2024-09-19T08:38:49.862524+0000","last_became_active":"2024-09-19T08:38:48.845885+0000","last_became_peered":"2024-09-19T08:38:48.845885+0000","last_unstale":"2024-09-19T08:38:49.862524+0000","last_undegraded":"2024-09-19T08:38:49.862524+0000","last_fullsized":"2024-09-19T08:38:49.862524+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:20:07.203808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.859699+0000","last_change":"2024-09-19T08:38:48.847801+0000","last_active":"2024-09-19T08:38:49.859699+0000","last_peered":"2024-09-19T08:38:49.859699+0000","last_clean":"2024-09-19T08:38:49.859699+0000","last_became_active":"2024-09-19T08:38:48.847514+0000","last_became_peered":"2024-09-19T08:38:48.847514+0000","last_unstale":"2024-09-19T08:38:49.859699+0000","last_undegraded":"2024-09-19T08:38:49.859699+0000","last_fullsized":"2024-09-19T08:38:49.859699+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:49.457995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.861791+0000","last_change":"2024-09-19T08:38:49.857362+0000","last_active":"2024-09-19T08:38:49.861791+0000","last_peered":"2024-09-19T08:38:49.861791+0000","last_clean":"2024-09-19T08:38:49.861791+0000","last_became_active":"2024-09-19T08:38:49.857115+0000","last_became_peered":"2024-09-19T08:38:49.857115+0000","last_unstale":"2024-09-19T08:38:49.861791+0000","last_undegraded":"2024-09-19T08:38:49.861791+0000","last_fullsized":"2024-09-19T08:38:49.861791+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:00:53.483613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.861957+0000","last_change":"2024-09-19T08:38:49.854179+0000","last_active":"2024-09-19T08:38:49.861957+0000","last_peered":"2024-09-19T08:38:49.861957+0000","last_clean":"2024-09-19T08:38:49.861957+0000","last_became_active":"2024-09-19T08:38:49.853888+0000","last_became_peered":"2024-09-19T08:38:49.853888+0000","last_unstale":"2024-09-19T08:38:49.861957+0000","last_undegraded":"2024-09-19T08:38:49.861957+0000","last_fullsized":"2024-09-19T08:38:49.861957+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:40.178360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.862071+0000","last_change":"2024-09-19T08:38:49.861491+0000","last_active":"2024-09-19T08:38:49.862071+0000","last_peered":"2024-09-19T08:38:49.862071+0000","last_clean":"2024-09-19T08:38:49.862071+0000","last_became_active":"2024-09-19T08:38:49.861043+0000","last_became_peered":"2024-09-19T08:38:49.861043+0000","last_unstale":"2024-09-19T08:38:49.862071+0000","last_undegraded":"2024-09-19T08:38:49.862071+0000","last_fullsized":"2024-09-19T08:38:49.862071+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:05.788337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:48.819487+0000","last_change":"2024-09-19T08:38:48.819487+0000","last_active":"2024-09-19T08:38:48.819487+0000","last_peered":"2024-09-19T08:38:48.819487+0000","last_clean":"2024-09-19T08:38:48.819487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:48.819487+0000","last_undegraded":"2024-09-19T08:38:48.819487+0000","last_fullsized":"2024-09-19T08:38:48.819487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T08:38:47.814416+0000","last_change":"2024-09-19T08:38:47.814416+0000","last_active":"2024-09-19T08:38:47.814416+0000","last_peered":"2024-09-19T08:38:47.814416+0000","last_clean":"2024-09-19T08:38:47.814416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T08:38:47.814416+0000","last_undegraded":"2024-09-19T08:38:47.814416+0000","last_fullsized":"2024-09-19T08:38:47.814416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":212,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-19T08:38:45.816128+0000","last_change":"2024-09-19T08:37:04.479071+0000","last_active":"2024-09-19T08:38:45.816128+0000","last_peered":"2024-09-19T08:38:45.816128+0000","last_clean":"2024-09-19T08:38:45.816128+0000","last_became_active":"2024-09-19T08:37:04.478199+0000","last_became_peered":"2024-09-19T08:37:04.478199+0000","last_unstale":"2024-09-19T08:38:45.816128+0000","last_undegraded":"2024-09-19T08:38:45.816128+0000","last_fullsized":"2024-09-19T08:38:45.816128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_clean_scrub_stamp":"2024-09-19T08:37:02.519738+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:32.963748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":10,"acting":10,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27540,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":524288,"data_stored":224397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1142784,"data_stored":825835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":536576,"data_stored":229932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":229932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27576,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":548864,"data_stored":235467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1142784,"data_stored":825835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27568,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":548864,"data_stored":235467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":606208,"data_stored":261085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:38:53.453 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3f is not active+clean 2024-09-19T08:38:53.454 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.454 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3e is not active+clean 2024-09-19T08:38:53.454 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.454 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3d is not active+clean 2024-09-19T08:38:53.454 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.454 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3c is not active+clean 2024-09-19T08:38:53.454 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.454 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3b is not active+clean 2024-09-19T08:38:53.454 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.454 INFO:tasks.ceph.ceph_manager.ceph:PG 8.39 is not active+clean 2024-09-19T08:38:53.455 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.455 INFO:tasks.ceph.ceph_manager.ceph:PG 8.37 is not active+clean 2024-09-19T08:38:53.455 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.455 INFO:tasks.ceph.ceph_manager.ceph:PG 8.36 is not active+clean 2024-09-19T08:38:53.455 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.455 INFO:tasks.ceph.ceph_manager.ceph:PG 8.35 is not active+clean 2024-09-19T08:38:53.455 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.455 INFO:tasks.ceph.ceph_manager.ceph:PG 8.32 is not active+clean 2024-09-19T08:38:53.455 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.455 INFO:tasks.ceph.ceph_manager.ceph:PG 8.31 is not active+clean 2024-09-19T08:38:53.455 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.456 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2f is not active+clean 2024-09-19T08:38:53.456 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.456 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2e is not active+clean 2024-09-19T08:38:53.456 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.456 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2d is not active+clean 2024-09-19T08:38:53.456 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.456 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2c is not active+clean 2024-09-19T08:38:53.456 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.456 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2b is not active+clean 2024-09-19T08:38:53.456 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.456 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2a is not active+clean 2024-09-19T08:38:53.456 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.457 INFO:tasks.ceph.ceph_manager.ceph:PG 8.29 is not active+clean 2024-09-19T08:38:53.457 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.457 INFO:tasks.ceph.ceph_manager.ceph:PG 8.28 is not active+clean 2024-09-19T08:38:53.457 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.457 INFO:tasks.ceph.ceph_manager.ceph:PG 8.27 is not active+clean 2024-09-19T08:38:53.457 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.457 INFO:tasks.ceph.ceph_manager.ceph:PG 8.26 is not active+clean 2024-09-19T08:38:53.457 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.457 INFO:tasks.ceph.ceph_manager.ceph:PG 8.24 is not active+clean 2024-09-19T08:38:53.457 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.458 INFO:tasks.ceph.ceph_manager.ceph:PG 8.23 is not active+clean 2024-09-19T08:38:53.458 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.458 INFO:tasks.ceph.ceph_manager.ceph:PG 8.22 is not active+clean 2024-09-19T08:38:53.458 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.458 INFO:tasks.ceph.ceph_manager.ceph:PG 8.21 is not active+clean 2024-09-19T08:38:53.458 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.458 INFO:tasks.ceph.ceph_manager.ceph:PG 8.20 is not active+clean 2024-09-19T08:38:53.458 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.458 INFO:tasks.ceph.ceph_manager.ceph:PG 8.10 is not active+clean 2024-09-19T08:38:53.458 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.458 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1f is not active+clean 2024-09-19T08:38:53.458 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.459 INFO:tasks.ceph.ceph_manager.ceph:PG 8.11 is not active+clean 2024-09-19T08:38:53.459 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.459 INFO:tasks.ceph.ceph_manager.ceph:PG 8.12 is not active+clean 2024-09-19T08:38:53.459 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.459 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1d is not active+clean 2024-09-19T08:38:53.459 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.459 INFO:tasks.ceph.ceph_manager.ceph:PG 8.13 is not active+clean 2024-09-19T08:38:53.459 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.459 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1c is not active+clean 2024-09-19T08:38:53.459 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.459 INFO:tasks.ceph.ceph_manager.ceph:PG 8.14 is not active+clean 2024-09-19T08:38:53.460 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.460 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1b is not active+clean 2024-09-19T08:38:53.460 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.460 INFO:tasks.ceph.ceph_manager.ceph:PG 8.15 is not active+clean 2024-09-19T08:38:53.460 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.460 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1a is not active+clean 2024-09-19T08:38:53.460 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.460 INFO:tasks.ceph.ceph_manager.ceph:PG 8.16 is not active+clean 2024-09-19T08:38:53.460 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.460 INFO:tasks.ceph.ceph_manager.ceph:PG 7.19 is not active+clean 2024-09-19T08:38:53.460 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.461 INFO:tasks.ceph.ceph_manager.ceph:PG 8.17 is not active+clean 2024-09-19T08:38:53.461 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.461 INFO:tasks.ceph.ceph_manager.ceph:PG 7.18 is not active+clean 2024-09-19T08:38:53.461 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.461 INFO:tasks.ceph.ceph_manager.ceph:PG 8.18 is not active+clean 2024-09-19T08:38:53.461 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.461 INFO:tasks.ceph.ceph_manager.ceph:PG 7.17 is not active+clean 2024-09-19T08:38:53.461 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.462 INFO:tasks.ceph.ceph_manager.ceph:PG 8.19 is not active+clean 2024-09-19T08:38:53.462 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.462 INFO:tasks.ceph.ceph_manager.ceph:PG 7.16 is not active+clean 2024-09-19T08:38:53.462 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.462 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1a is not active+clean 2024-09-19T08:38:53.462 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.463 INFO:tasks.ceph.ceph_manager.ceph:PG 7.15 is not active+clean 2024-09-19T08:38:53.463 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.463 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1b is not active+clean 2024-09-19T08:38:53.464 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.464 INFO:tasks.ceph.ceph_manager.ceph:PG 7.14 is not active+clean 2024-09-19T08:38:53.464 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.464 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1c is not active+clean 2024-09-19T08:38:53.464 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.464 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1d is not active+clean 2024-09-19T08:38:53.464 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.464 INFO:tasks.ceph.ceph_manager.ceph:PG 7.12 is not active+clean 2024-09-19T08:38:53.464 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.465 INFO:tasks.ceph.ceph_manager.ceph:PG 7.11 is not active+clean 2024-09-19T08:38:53.465 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.465 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1f is not active+clean 2024-09-19T08:38:53.465 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.465 INFO:tasks.ceph.ceph_manager.ceph:PG 8.0 is not active+clean 2024-09-19T08:38:53.465 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.465 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1 is not active+clean 2024-09-19T08:38:53.465 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.465 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2 is not active+clean 2024-09-19T08:38:53.465 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.465 INFO:tasks.ceph.ceph_manager.ceph:PG 7.d is not active+clean 2024-09-19T08:38:53.466 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.466 INFO:tasks.ceph.ceph_manager.ceph:PG 7.c is not active+clean 2024-09-19T08:38:53.466 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.466 INFO:tasks.ceph.ceph_manager.ceph:PG 8.4 is not active+clean 2024-09-19T08:38:53.466 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.466 INFO:tasks.ceph.ceph_manager.ceph:PG 7.b is not active+clean 2024-09-19T08:38:53.466 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.466 INFO:tasks.ceph.ceph_manager.ceph:PG 8.5 is not active+clean 2024-09-19T08:38:53.466 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.466 INFO:tasks.ceph.ceph_manager.ceph:PG 7.a is not active+clean 2024-09-19T08:38:53.466 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.467 INFO:tasks.ceph.ceph_manager.ceph:PG 8.6 is not active+clean 2024-09-19T08:38:53.467 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.467 INFO:tasks.ceph.ceph_manager.ceph:PG 7.9 is not active+clean 2024-09-19T08:38:53.467 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.467 INFO:tasks.ceph.ceph_manager.ceph:PG 7.8 is not active+clean 2024-09-19T08:38:53.467 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.467 INFO:tasks.ceph.ceph_manager.ceph:PG 8.8 is not active+clean 2024-09-19T08:38:53.467 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.467 INFO:tasks.ceph.ceph_manager.ceph:PG 7.7 is not active+clean 2024-09-19T08:38:53.467 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.467 INFO:tasks.ceph.ceph_manager.ceph:PG 8.a is not active+clean 2024-09-19T08:38:53.468 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.468 INFO:tasks.ceph.ceph_manager.ceph:PG 7.5 is not active+clean 2024-09-19T08:38:53.468 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.468 INFO:tasks.ceph.ceph_manager.ceph:PG 8.b is not active+clean 2024-09-19T08:38:53.468 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.468 INFO:tasks.ceph.ceph_manager.ceph:PG 7.4 is not active+clean 2024-09-19T08:38:53.468 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.468 INFO:tasks.ceph.ceph_manager.ceph:PG 8.c is not active+clean 2024-09-19T08:38:53.468 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.468 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3 is not active+clean 2024-09-19T08:38:53.468 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.469 INFO:tasks.ceph.ceph_manager.ceph:PG 8.d is not active+clean 2024-09-19T08:38:53.469 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.469 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2 is not active+clean 2024-09-19T08:38:53.469 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.469 INFO:tasks.ceph.ceph_manager.ceph:PG 8.e is not active+clean 2024-09-19T08:38:53.469 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.469 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1 is not active+clean 2024-09-19T08:38:53.469 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.469 INFO:tasks.ceph.ceph_manager.ceph:PG 7.0 is not active+clean 2024-09-19T08:38:53.469 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.470 INFO:tasks.ceph.ceph_manager.ceph:PG 8.9 is not active+clean 2024-09-19T08:38:53.470 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:48.819487+0000', 'last_change': '2024-09-19T08:38:48.819487+0000', 'last_active': '2024-09-19T08:38:48.819487+0000', 'last_peered': '2024-09-19T08:38:48.819487+0000', 'last_clean': '2024-09-19T08:38:48.819487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:48.819487+0000', 'last_undegraded': '2024-09-19T08:38:48.819487+0000', 'last_fullsized': '2024-09-19T08:38:48.819487+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:48.819487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.471 INFO:tasks.ceph.ceph_manager.ceph:PG 7.6 is not active+clean 2024-09-19T08:38:53.471 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T08:38:47.814416+0000', 'last_change': '2024-09-19T08:38:47.814416+0000', 'last_active': '2024-09-19T08:38:47.814416+0000', 'last_peered': '2024-09-19T08:38:47.814416+0000', 'last_clean': '2024-09-19T08:38:47.814416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T08:38:47.814416+0000', 'last_undegraded': '2024-09-19T08:38:47.814416+0000', 'last_fullsized': '2024-09-19T08:38:47.814416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'last_clean_scrub_stamp': '2024-09-19T08:38:47.814416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T08:38:53.472 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T08:38:53.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.587+0000 7fb6344b7640 1 Processor -- start 2024-09-19T08:38:53.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.587+0000 7fb6344b7640 1 -- start start 2024-09-19T08:38:53.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.588+0000 7fb6344b7640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb62c15c270 0x7fb62c06c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.588+0000 7fb6344b7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb62c0ae270 0x7fb62c0cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.588+0000 7fb6344b7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb62c0b36a0 0x7fb62c0cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.588+0000 7fb6344b7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fb62c0cfda0 con 0x7fb62c0b36a0 2024-09-19T08:38:53.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.588+0000 7fb6344b7640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fb62c0ccf80 con 0x7fb62c15c270 2024-09-19T08:38:53.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.588+0000 7fb6344b7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fb62c0cd260 con 0x7fb62c0ae270 2024-09-19T08:38:53.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.588+0000 7fb632a54640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb62c0b36a0 0x7fb62c0cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:53.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.588+0000 7fb632a54640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb62c0b36a0 0x7fb62c0cf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39766/0 (socket says 172.21.15.117:39766) 2024-09-19T08:38:53.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.588+0000 7fb632a54640 1 -- 172.21.15.117:0/1910584522 learned_addr learned my addr 172.21.15.117:0/1910584522 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:53.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.588+0000 7fb631a52640 1 --2- 172.21.15.117:0/1910584522 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb62c0ae270 0x7fb62c0cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:53.589 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.588+0000 7fb632253640 1 --2- 172.21.15.117:0/1910584522 >> v2:172.21.15.146:3300/0 conn(0x7fb62c15c270 0x7fb62c06c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:53.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.588+0000 7fb632a54640 1 -- 172.21.15.117:0/1910584522 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb62c0ae270 msgr2=0x7fb62c0cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:53.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.588+0000 7fb632a54640 1 --2- 172.21.15.117:0/1910584522 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb62c0ae270 0x7fb62c0cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.588+0000 7fb632a54640 1 -- 172.21.15.117:0/1910584522 >> v2:172.21.15.146:3300/0 conn(0x7fb62c15c270 msgr2=0x7fb62c06c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:53.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.588+0000 7fb632a54640 1 --2- 172.21.15.117:0/1910584522 >> v2:172.21.15.146:3300/0 conn(0x7fb62c15c270 0x7fb62c06c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.588+0000 7fb632a54640 1 -- 172.21.15.117:0/1910584522 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62c0cd540 con 0x7fb62c0b36a0 2024-09-19T08:38:53.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.589+0000 7fb632a54640 1 --2- 172.21.15.117:0/1910584522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb62c0b36a0 0x7fb62c0cf4b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb62c071220 tx=0x7fb62402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36993fc733f04179 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:53.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.589+0000 7fb631251640 1 -- 172.21.15.117:0/1910584522 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb624036070 con 0x7fb62c0b36a0 2024-09-19T08:38:53.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.589+0000 7fb631251640 1 -- 172.21.15.117:0/1910584522 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb624031600 con 0x7fb62c0b36a0 2024-09-19T08:38:53.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.589+0000 7fb631251640 1 -- 172.21.15.117:0/1910584522 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6240319d0 con 0x7fb62c0b36a0 2024-09-19T08:38:53.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.590+0000 7fb6344b7640 1 -- 172.21.15.117:0/1910584522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb62c0b36a0 msgr2=0x7fb62c0cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:53.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.590+0000 7fb6344b7640 1 --2- 172.21.15.117:0/1910584522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb62c0b36a0 0x7fb62c0cf4b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb62c071220 tx=0x7fb62402a6a0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.590+0000 7fb6344b7640 1 -- 172.21.15.117:0/1910584522 shutdown_connections 2024-09-19T08:38:53.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.590+0000 7fb6344b7640 1 --2- 172.21.15.117:0/1910584522 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb62c0ae270 0x7fb62c0cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.590+0000 7fb6344b7640 1 --2- 172.21.15.117:0/1910584522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb62c0b36a0 0x7fb62c0cf4b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.590+0000 7fb6344b7640 1 --2- 172.21.15.117:0/1910584522 >> v2:172.21.15.146:3300/0 conn(0x7fb62c15c270 0x7fb62c06c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.590+0000 7fb6344b7640 1 -- 172.21.15.117:0/1910584522 >> 172.21.15.117:0/1910584522 conn(0x7fb62c09a9f0 msgr2=0x7fb62c0b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:53.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.590+0000 7fb6344b7640 1 -- 172.21.15.117:0/1910584522 shutdown_connections 2024-09-19T08:38:53.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.590+0000 7fb6344b7640 1 -- 172.21.15.117:0/1910584522 wait complete. 2024-09-19T08:38:53.593 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.591+0000 7fb6344b7640 1 Processor -- start 2024-09-19T08:38:53.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.591+0000 7fb6344b7640 1 -- start start 2024-09-19T08:38:53.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb6344b7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb62c0ae270 0x7fb62c09b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb6344b7640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb62c0b36a0 0x7fb62c14f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb6344b7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb62c15c270 0x7fb62c15ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb6344b7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb62c15c7d0 con 0x7fb62c0ae270 2024-09-19T08:38:53.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb6344b7640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb62c15c650 con 0x7fb62c15c270 2024-09-19T08:38:53.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb6344b7640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fb62c0ccba0 con 0x7fb62c0b36a0 2024-09-19T08:38:53.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb632253640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb62c0ae270 0x7fb62c09b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:53.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb632253640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb62c0ae270 0x7fb62c09b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39772/0 (socket says 172.21.15.117:39772) 2024-09-19T08:38:53.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb632253640 1 -- 172.21.15.117:0/128500232 learned_addr learned my addr 172.21.15.117:0/128500232 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:53.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb631a52640 1 --2- 172.21.15.117:0/128500232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb62c0b36a0 0x7fb62c14f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:53.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb632a54640 1 --2- 172.21.15.117:0/128500232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb62c15c270 0x7fb62c15ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:53.594 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb632253640 1 -- 172.21.15.117:0/128500232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb62c0b36a0 msgr2=0x7fb62c14f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb632253640 1 --2- 172.21.15.117:0/128500232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb62c0b36a0 0x7fb62c14f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb632253640 1 -- 172.21.15.117:0/128500232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb62c15c270 msgr2=0x7fb62c15ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb632253640 1 --2- 172.21.15.117:0/128500232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb62c15c270 0x7fb62c15ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb632253640 1 -- 172.21.15.117:0/128500232 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62c1f5690 con 0x7fb62c0ae270 2024-09-19T08:38:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb631a52640 1 --2- 172.21.15.117:0/128500232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb62c0b36a0 0x7fb62c14f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb632a54640 1 --2- 172.21.15.117:0/128500232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb62c15c270 0x7fb62c15ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb632253640 1 --2- 172.21.15.117:0/128500232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb62c0ae270 0x7fb62c09b3f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb62800d5f0 tx=0x7fb62800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb622ffd640 1 -- 172.21.15.117:0/128500232 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6280125f0 con 0x7fb62c0ae270 2024-09-19T08:38:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb622ffd640 1 -- 172.21.15.117:0/128500232 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb628019070 con 0x7fb62c0ae270 2024-09-19T08:38:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb6344b7640 1 -- 172.21.15.117:0/128500232 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb62c1f5970 con 0x7fb62c0ae270 2024-09-19T08:38:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb622ffd640 1 -- 172.21.15.117:0/128500232 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6280129d0 con 0x7fb62c0ae270 2024-09-19T08:38:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.592+0000 7fb6344b7640 1 -- 172.21.15.117:0/128500232 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb62c1f5f30 con 0x7fb62c0ae270 2024-09-19T08:38:53.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.593+0000 7fb6344b7640 1 -- 172.21.15.117:0/128500232 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb62c06c620 con 0x7fb62c0ae270 2024-09-19T08:38:53.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.594+0000 7fb622ffd640 1 -- 172.21.15.117:0/128500232 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb628012b70 con 0x7fb62c0ae270 2024-09-19T08:38:53.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.594+0000 7fb622ffd640 1 --2- 172.21.15.117:0/128500232 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb61006c2b0 0x7fb61006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.594+0000 7fb622ffd640 1 -- 172.21.15.117:0/128500232 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7fb62808b9d0 con 0x7fb62c0ae270 2024-09-19T08:38:53.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.594+0000 7fb631a52640 1 --2- 172.21.15.117:0/128500232 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb61006c2b0 0x7fb61006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:53.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.595+0000 7fb631a52640 1 --2- 172.21.15.117:0/128500232 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb61006c2b0 0x7fb61006e770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0cbdf0 tx=0x7fb61c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:53.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.598+0000 7fb622ffd640 1 -- 172.21.15.117:0/128500232 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb628059fb0 con 0x7fb62c0ae270 2024-09-19T08:38:53.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.828+0000 7fb6344b7640 1 -- 172.21.15.117:0/128500232 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb62c0d2050 con 0x7fb62c0ae270 2024-09-19T08:38:53.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.829+0000 7fb622ffd640 1 -- 172.21.15.117:0/128500232 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1550 (secure 0 0 0) 0x7fb6280598b0 con 0x7fb62c0ae270 2024-09-19T08:38:53.829 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:53.829 INFO:teuthology.orchestra.run.smithi117.stdout:{"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":124,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":52,"num_osds":8,"num_up_osds":8,"osd_up_since":1726735021,"num_in_osds":8,"osd_in_since":1726735011,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":81},{"state_name":"active+clean","count":16}],"num_pgs":97,"num_pools":3,"num_objects":10,"data_bytes":590424,"bytes_used":227028992,"bytes_avail":772867084288,"bytes_total":773094113280,"unknown_pgs_ratio":0.83505153656005859,"write_bytes_sec":2026,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":22,"btime":"2024-09-19T08:38:51:840984+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"b","status":"up:active","gid":5352}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-19T08:38:39.867429+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T08:38:53.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.830+0000 7fb6344b7640 1 -- 172.21.15.117:0/128500232 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb61006c2b0 msgr2=0x7fb61006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:53.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.830+0000 7fb6344b7640 1 --2- 172.21.15.117:0/128500232 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb61006c2b0 0x7fb61006e770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0cbdf0 tx=0x7fb61c008040 comp rx=0 tx=0).stop 2024-09-19T08:38:53.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.831+0000 7fb6344b7640 1 -- 172.21.15.117:0/128500232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb62c0ae270 msgr2=0x7fb62c09b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:53.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.831+0000 7fb6344b7640 1 --2- 172.21.15.117:0/128500232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb62c0ae270 0x7fb62c09b3f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb62800d5f0 tx=0x7fb62800dab0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.831+0000 7fb6344b7640 1 -- 172.21.15.117:0/128500232 shutdown_connections 2024-09-19T08:38:53.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.831+0000 7fb6344b7640 1 --2- 172.21.15.117:0/128500232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb62c15c270 0x7fb62c15ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.831+0000 7fb6344b7640 1 --2- 172.21.15.117:0/128500232 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fb61006c2b0 0x7fb61006e770 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.831+0000 7fb6344b7640 1 --2- 172.21.15.117:0/128500232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb62c0b36a0 0x7fb62c14f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.831+0000 7fb6344b7640 1 --2- 172.21.15.117:0/128500232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb62c0ae270 0x7fb62c09b3f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.831+0000 7fb6344b7640 1 -- 172.21.15.117:0/128500232 >> 172.21.15.117:0/128500232 conn(0x7fb62c09a9f0 msgr2=0x7fb62c0af880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:53.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.831+0000 7fb6344b7640 1 -- 172.21.15.117:0/128500232 shutdown_connections 2024-09-19T08:38:53.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.831+0000 7fb6344b7640 1 -- 172.21.15.117:0/128500232 wait complete. 2024-09-19T08:38:53.842 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-19T08:38:53.842 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:38:53.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.940+0000 7fd3efdc4640 1 Processor -- start 2024-09-19T08:38:53.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.940+0000 7fd3efdc4640 1 -- start start 2024-09-19T08:38:53.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.941+0000 7fd3efdc4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd3e80add30 0x7fd3e80ae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.941+0000 7fd3efdc4640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd3e815e4f0 0x7fd3e80b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.941+0000 7fd3efdc4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e8070930 0x7fd3e80b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.941+0000 7fd3efdc4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd3e80ae650 con 0x7fd3e80add30 2024-09-19T08:38:53.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.941+0000 7fd3efdc4640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fd3e80b5590 con 0x7fd3e815e4f0 2024-09-19T08:38:53.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.941+0000 7fd3efdc4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e8070ea0 con 0x7fd3e8070930 2024-09-19T08:38:53.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.941+0000 7fd3edb60640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd3e80add30 0x7fd3e80ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:53.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.941+0000 7fd3edb60640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd3e80add30 0x7fd3e80ae110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39780/0 (socket says 172.21.15.117:39780) 2024-09-19T08:38:53.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.941+0000 7fd3edb60640 1 -- 172.21.15.117:0/2000457655 learned_addr learned my addr 172.21.15.117:0/2000457655 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:53.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.941+0000 7fd3edb60640 1 -- 172.21.15.117:0/2000457655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e8070930 msgr2=0x7fd3e80b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:53.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.941+0000 7fd3edb60640 1 --2- 172.21.15.117:0/2000457655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e8070930 0x7fd3e80b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.941+0000 7fd3edb60640 1 -- 172.21.15.117:0/2000457655 >> v2:172.21.15.146:3300/0 conn(0x7fd3e815e4f0 msgr2=0x7fd3e80b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:53.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.941+0000 7fd3edb60640 1 --2- 172.21.15.117:0/2000457655 >> v2:172.21.15.146:3300/0 conn(0x7fd3e815e4f0 0x7fd3e80b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.941+0000 7fd3edb60640 1 -- 172.21.15.117:0/2000457655 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e806e8c0 con 0x7fd3e80add30 2024-09-19T08:38:53.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.942+0000 7fd3edb60640 1 --2- 172.21.15.117:0/2000457655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e80add30 0x7fd3e80ae110 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd3e80b4ae0 tx=0x7fd3e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274453a8d09013c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:53.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.942+0000 7fd3ecb5e640 1 -- 172.21.15.117:0/2000457655 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4037070 con 0x7fd3e80add30 2024-09-19T08:38:53.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.942+0000 7fd3ecb5e640 1 -- 172.21.15.117:0/2000457655 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3e4032440 con 0x7fd3e80add30 2024-09-19T08:38:53.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.942+0000 7fd3ecb5e640 1 -- 172.21.15.117:0/2000457655 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4032810 con 0x7fd3e80add30 2024-09-19T08:38:53.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.943+0000 7fd3efdc4640 1 -- 172.21.15.117:0/2000457655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e80add30 msgr2=0x7fd3e80ae110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:53.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.943+0000 7fd3efdc4640 1 --2- 172.21.15.117:0/2000457655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e80add30 0x7fd3e80ae110 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd3e80b4ae0 tx=0x7fd3e402a1e0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.943+0000 7fd3efdc4640 1 -- 172.21.15.117:0/2000457655 shutdown_connections 2024-09-19T08:38:53.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.943+0000 7fd3efdc4640 1 --2- 172.21.15.117:0/2000457655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e8070930 0x7fd3e80b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.943+0000 7fd3efdc4640 1 --2- 172.21.15.117:0/2000457655 >> v2:172.21.15.146:3300/0 conn(0x7fd3e815e4f0 0x7fd3e80b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.943+0000 7fd3efdc4640 1 --2- 172.21.15.117:0/2000457655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e80add30 0x7fd3e80ae110 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.943+0000 7fd3efdc4640 1 -- 172.21.15.117:0/2000457655 >> 172.21.15.117:0/2000457655 conn(0x7fd3e806bc10 msgr2=0x7fd3e806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:53.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.943+0000 7fd3efdc4640 1 -- 172.21.15.117:0/2000457655 shutdown_connections 2024-09-19T08:38:53.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.943+0000 7fd3efdc4640 1 -- 172.21.15.117:0/2000457655 wait complete. 2024-09-19T08:38:53.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.944+0000 7fd3efdc4640 1 Processor -- start 2024-09-19T08:38:53.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.944+0000 7fd3efdc4640 1 -- start start 2024-09-19T08:38:53.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3efdc4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e8070930 0x7fd3e8148470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3efdc4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e80add30 0x7fd3e80ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3efdc4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3e815e4f0 0x7fd3e815c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3efdc4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e80b0630 con 0x7fd3e8070930 2024-09-19T08:38:53.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3efdc4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e806ee80 con 0x7fd3e815e4f0 2024-09-19T08:38:53.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3efdc4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e806f3a0 con 0x7fd3e80add30 2024-09-19T08:38:53.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3edb60640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e8070930 0x7fd3e8148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:53.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3edb60640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e8070930 0x7fd3e8148470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39790/0 (socket says 172.21.15.117:39790) 2024-09-19T08:38:53.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3edb60640 1 -- 172.21.15.117:0/3899990510 learned_addr learned my addr 172.21.15.117:0/3899990510 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:53.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3ed35f640 1 --2- 172.21.15.117:0/3899990510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e80add30 0x7fd3e80ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:53.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3ee361640 1 --2- 172.21.15.117:0/3899990510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3e815e4f0 0x7fd3e815c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:53.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3edb60640 1 -- 172.21.15.117:0/3899990510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e80add30 msgr2=0x7fd3e80ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3edb60640 1 --2- 172.21.15.117:0/3899990510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e80add30 0x7fd3e80ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3edb60640 1 -- 172.21.15.117:0/3899990510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3e815e4f0 msgr2=0x7fd3e815c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3edb60640 1 --2- 172.21.15.117:0/3899990510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3e815e4f0 0x7fd3e815c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3edb60640 1 -- 172.21.15.117:0/3899990510 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e80ceb20 con 0x7fd3e8070930 2024-09-19T08:38:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3edb60640 1 --2- 172.21.15.117:0/3899990510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e8070930 0x7fd3e8148470 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4000c00 tx=0x7fd3e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3de7fc640 1 -- 172.21.15.117:0/3899990510 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4041070 con 0x7fd3e8070930 2024-09-19T08:38:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3de7fc640 1 -- 172.21.15.117:0/3899990510 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3e403c870 con 0x7fd3e8070930 2024-09-19T08:38:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3efdc4640 1 -- 172.21.15.117:0/3899990510 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e80cee00 con 0x7fd3e8070930 2024-09-19T08:38:53.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3de7fc640 1 -- 172.21.15.117:0/3899990510 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4037040 con 0x7fd3e8070930 2024-09-19T08:38:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.945+0000 7fd3efdc4640 1 -- 172.21.15.117:0/3899990510 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e815a900 con 0x7fd3e8070930 2024-09-19T08:38:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.946+0000 7fd3efdc4640 1 -- 172.21.15.117:0/3899990510 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3e80ae110 con 0x7fd3e8070930 2024-09-19T08:38:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.947+0000 7fd3de7fc640 1 -- 172.21.15.117:0/3899990510 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd3e4044070 con 0x7fd3e8070930 2024-09-19T08:38:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.947+0000 7fd3de7fc640 1 --2- 172.21.15.117:0/3899990510 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd3cc06c2e0 0x7fd3cc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.947+0000 7fd3de7fc640 1 -- 172.21.15.117:0/3899990510 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7fd3e40ac250 con 0x7fd3e8070930 2024-09-19T08:38:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.947+0000 7fd3ed35f640 1 --2- 172.21.15.117:0/3899990510 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd3cc06c2e0 0x7fd3cc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:53.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.948+0000 7fd3ed35f640 1 --2- 172.21.15.117:0/3899990510 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd3cc06c2e0 0x7fd3cc06e7a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd3e815a360 tx=0x7fd3d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:53.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:53.951+0000 7fd3de7fc640 1 -- 172.21.15.117:0/3899990510 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd3e407a950 con 0x7fd3e8070930 2024-09-19T08:38:54.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:54.114+0000 7fd3efdc4640 1 -- 172.21.15.117:0/3899990510 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd3e80adb10 con 0x7fd3cc06c2e0 2024-09-19T08:38:54.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:54.120+0000 7fd3de7fc640 1 -- 172.21.15.117:0/3899990510 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7fd3e80adb10 con 0x7fd3cc06c2e0 2024-09-19T08:38:54.123 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:54.124 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-09-19T08:38:54.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:54.123+0000 7fd3efdc4640 1 -- 172.21.15.117:0/3899990510 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd3cc06c2e0 msgr2=0x7fd3cc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:54.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:54.123+0000 7fd3efdc4640 1 --2- 172.21.15.117:0/3899990510 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd3cc06c2e0 0x7fd3cc06e7a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd3e815a360 tx=0x7fd3d8008040 comp rx=0 tx=0).stop 2024-09-19T08:38:54.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:54.123+0000 7fd3efdc4640 1 -- 172.21.15.117:0/3899990510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e8070930 msgr2=0x7fd3e8148470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:54.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:54.123+0000 7fd3efdc4640 1 --2- 172.21.15.117:0/3899990510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e8070930 0x7fd3e8148470 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4000c00 tx=0x7fd3e40046c0 comp rx=0 tx=0).stop 2024-09-19T08:38:54.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:54.123+0000 7fd3efdc4640 1 -- 172.21.15.117:0/3899990510 shutdown_connections 2024-09-19T08:38:54.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:54.123+0000 7fd3efdc4640 1 --2- 172.21.15.117:0/3899990510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3e815e4f0 0x7fd3e815c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:54.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:54.123+0000 7fd3efdc4640 1 --2- 172.21.15.117:0/3899990510 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd3cc06c2e0 0x7fd3cc06e7a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:54.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:54.123+0000 7fd3efdc4640 1 --2- 172.21.15.117:0/3899990510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e80add30 0x7fd3e80ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:54.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:54.123+0000 7fd3efdc4640 1 --2- 172.21.15.117:0/3899990510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3e8070930 0x7fd3e8148470 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:54.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:54.123+0000 7fd3efdc4640 1 -- 172.21.15.117:0/3899990510 >> 172.21.15.117:0/3899990510 conn(0x7fd3e806bc10 msgr2=0x7fd3e80b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:54.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:54.123+0000 7fd3efdc4640 1 -- 172.21.15.117:0/3899990510 shutdown_connections 2024-09-19T08:38:54.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:54.123+0000 7fd3efdc4640 1 -- 172.21.15.117:0/3899990510 wait complete. 2024-09-19T08:38:54.135 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-09-19T08:38:53.869937+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222248,"kb_used_data":5968,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752472,"statfs":{"total":773094113280,"available":772866531328,"internally_reserved":0,"allocated":6111232,"data_stored":3313940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001043"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251831+0000","last_change":"2024-09-19T08:38:49.849078+0000","last_active":"2024-09-19T08:38:51.251831+0000","last_peered":"2024-09-19T08:38:51.251831+0000","last_clean":"2024-09-19T08:38:51.251831+0000","last_became_active":"2024-09-19T08:38:49.848505+0000","last_became_peered":"2024-09-19T08:38:49.848505+0000","last_unstale":"2024-09-19T08:38:51.251831+0000","last_undegraded":"2024-09-19T08:38:51.251831+0000","last_fullsized":"2024-09-19T08:38:51.251831+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:05.899941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.843369+0000","last_change":"2024-09-19T08:38:49.849349+0000","last_active":"2024-09-19T08:38:50.843369+0000","last_peered":"2024-09-19T08:38:50.843369+0000","last_clean":"2024-09-19T08:38:50.843369+0000","last_became_active":"2024-09-19T08:38:49.849070+0000","last_became_peered":"2024-09-19T08:38:49.849070+0000","last_unstale":"2024-09-19T08:38:50.843369+0000","last_undegraded":"2024-09-19T08:38:50.843369+0000","last_fullsized":"2024-09-19T08:38:50.843369+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:07.738397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844505+0000","last_change":"2024-09-19T08:38:49.851951+0000","last_active":"2024-09-19T08:38:50.844505+0000","last_peered":"2024-09-19T08:38:50.844505+0000","last_clean":"2024-09-19T08:38:50.844505+0000","last_became_active":"2024-09-19T08:38:49.851661+0000","last_became_peered":"2024-09-19T08:38:49.851661+0000","last_unstale":"2024-09-19T08:38:50.844505+0000","last_undegraded":"2024-09-19T08:38:50.844505+0000","last_fullsized":"2024-09-19T08:38:50.844505+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:17.136107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250081+0000","last_change":"2024-09-19T08:38:49.844381+0000","last_active":"2024-09-19T08:38:51.250081+0000","last_peered":"2024-09-19T08:38:51.250081+0000","last_clean":"2024-09-19T08:38:51.250081+0000","last_became_active":"2024-09-19T08:38:49.844118+0000","last_became_peered":"2024-09-19T08:38:49.844118+0000","last_unstale":"2024-09-19T08:38:51.250081+0000","last_undegraded":"2024-09-19T08:38:51.250081+0000","last_fullsized":"2024-09-19T08:38:51.250081+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:49.078216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.842456+0000","last_change":"2024-09-19T08:38:49.847052+0000","last_active":"2024-09-19T08:38:50.842456+0000","last_peered":"2024-09-19T08:38:50.842456+0000","last_clean":"2024-09-19T08:38:50.842456+0000","last_became_active":"2024-09-19T08:38:49.846658+0000","last_became_peered":"2024-09-19T08:38:49.846658+0000","last_unstale":"2024-09-19T08:38:50.842456+0000","last_undegraded":"2024-09-19T08:38:50.842456+0000","last_fullsized":"2024-09-19T08:38:50.842456+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:13.746673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.860745+0000","last_change":"2024-09-19T08:38:49.851860+0000","last_active":"2024-09-19T08:38:49.860745+0000","last_peered":"2024-09-19T08:38:49.860745+0000","last_clean":"2024-09-19T08:38:49.860745+0000","last_became_active":"2024-09-19T08:38:49.851582+0000","last_became_peered":"2024-09-19T08:38:49.851582+0000","last_unstale":"2024-09-19T08:38:49.860745+0000","last_undegraded":"2024-09-19T08:38:49.860745+0000","last_fullsized":"2024-09-19T08:38:49.860745+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:04.915512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250334+0000","last_change":"2024-09-19T08:38:49.854982+0000","last_active":"2024-09-19T08:38:51.250334+0000","last_peered":"2024-09-19T08:38:51.250334+0000","last_clean":"2024-09-19T08:38:51.250334+0000","last_became_active":"2024-09-19T08:38:49.854713+0000","last_became_peered":"2024-09-19T08:38:49.854713+0000","last_unstale":"2024-09-19T08:38:51.250334+0000","last_undegraded":"2024-09-19T08:38:51.250334+0000","last_fullsized":"2024-09-19T08:38:51.250334+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:05.899941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.860844+0000","last_change":"2024-09-19T08:38:49.853887+0000","last_active":"2024-09-19T08:38:49.860844+0000","last_peered":"2024-09-19T08:38:49.860844+0000","last_clean":"2024-09-19T08:38:49.860844+0000","last_became_active":"2024-09-19T08:38:49.853098+0000","last_became_peered":"2024-09-19T08:38:49.853098+0000","last_unstale":"2024-09-19T08:38:49.860844+0000","last_undegraded":"2024-09-19T08:38:49.860844+0000","last_fullsized":"2024-09-19T08:38:49.860844+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:38.052077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844381+0000","last_change":"2024-09-19T08:38:49.851272+0000","last_active":"2024-09-19T08:38:50.844381+0000","last_peered":"2024-09-19T08:38:50.844381+0000","last_clean":"2024-09-19T08:38:50.844381+0000","last_became_active":"2024-09-19T08:38:49.851024+0000","last_became_peered":"2024-09-19T08:38:49.851024+0000","last_unstale":"2024-09-19T08:38:50.844381+0000","last_undegraded":"2024-09-19T08:38:50.844381+0000","last_fullsized":"2024-09-19T08:38:50.844381+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:45:55.986170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251036+0000","last_change":"2024-09-19T08:38:49.852048+0000","last_active":"2024-09-19T08:38:51.251036+0000","last_peered":"2024-09-19T08:38:51.251036+0000","last_clean":"2024-09-19T08:38:51.251036+0000","last_became_active":"2024-09-19T08:38:49.851720+0000","last_became_peered":"2024-09-19T08:38:49.851720+0000","last_unstale":"2024-09-19T08:38:51.251036+0000","last_undegraded":"2024-09-19T08:38:51.251036+0000","last_fullsized":"2024-09-19T08:38:51.251036+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:48.341866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251643+0000","last_change":"2024-09-19T08:38:49.848707+0000","last_active":"2024-09-19T08:38:51.251643+0000","last_peered":"2024-09-19T08:38:51.251643+0000","last_clean":"2024-09-19T08:38:51.251643+0000","last_became_active":"2024-09-19T08:38:49.848338+0000","last_became_peered":"2024-09-19T08:38:49.848338+0000","last_unstale":"2024-09-19T08:38:51.251643+0000","last_undegraded":"2024-09-19T08:38:51.251643+0000","last_fullsized":"2024-09-19T08:38:51.251643+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:40.008691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.861772+0000","last_change":"2024-09-19T08:38:49.856788+0000","last_active":"2024-09-19T08:38:49.861772+0000","last_peered":"2024-09-19T08:38:49.861772+0000","last_clean":"2024-09-19T08:38:49.861772+0000","last_became_active":"2024-09-19T08:38:49.856469+0000","last_became_peered":"2024-09-19T08:38:49.856469+0000","last_unstale":"2024-09-19T08:38:49.861772+0000","last_undegraded":"2024-09-19T08:38:49.861772+0000","last_fullsized":"2024-09-19T08:38:49.861772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:35.354565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.853574+0000","last_change":"2024-09-19T08:38:49.849968+0000","last_active":"2024-09-19T08:38:49.853574+0000","last_peered":"2024-09-19T08:38:49.853574+0000","last_clean":"2024-09-19T08:38:49.853574+0000","last_became_active":"2024-09-19T08:38:49.848196+0000","last_became_peered":"2024-09-19T08:38:49.848196+0000","last_unstale":"2024-09-19T08:38:49.853574+0000","last_undegraded":"2024-09-19T08:38:49.853574+0000","last_fullsized":"2024-09-19T08:38:49.853574+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:46.522548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250411+0000","last_change":"2024-09-19T08:38:49.848022+0000","last_active":"2024-09-19T08:38:51.250411+0000","last_peered":"2024-09-19T08:38:51.250411+0000","last_clean":"2024-09-19T08:38:51.250411+0000","last_became_active":"2024-09-19T08:38:49.847620+0000","last_became_peered":"2024-09-19T08:38:49.847620+0000","last_unstale":"2024-09-19T08:38:51.250411+0000","last_undegraded":"2024-09-19T08:38:51.250411+0000","last_fullsized":"2024-09-19T08:38:51.250411+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:12.682829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.249955+0000","last_change":"2024-09-19T08:38:49.850608+0000","last_active":"2024-09-19T08:38:51.249955+0000","last_peered":"2024-09-19T08:38:51.249955+0000","last_clean":"2024-09-19T08:38:51.249955+0000","last_became_active":"2024-09-19T08:38:49.850366+0000","last_became_peered":"2024-09-19T08:38:49.850366+0000","last_unstale":"2024-09-19T08:38:51.249955+0000","last_undegraded":"2024-09-19T08:38:51.249955+0000","last_fullsized":"2024-09-19T08:38:51.249955+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:04.924645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.849997+0000","last_change":"2024-09-19T08:38:49.843417+0000","last_active":"2024-09-19T08:38:49.849997+0000","last_peered":"2024-09-19T08:38:49.849997+0000","last_clean":"2024-09-19T08:38:49.849997+0000","last_became_active":"2024-09-19T08:38:49.843112+0000","last_became_peered":"2024-09-19T08:38:49.843112+0000","last_unstale":"2024-09-19T08:38:49.849997+0000","last_undegraded":"2024-09-19T08:38:49.849997+0000","last_fullsized":"2024-09-19T08:38:49.849997+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:26.972954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251998+0000","last_change":"2024-09-19T08:38:49.848811+0000","last_active":"2024-09-19T08:38:51.251998+0000","last_peered":"2024-09-19T08:38:51.251998+0000","last_clean":"2024-09-19T08:38:51.251998+0000","last_became_active":"2024-09-19T08:38:49.848090+0000","last_became_peered":"2024-09-19T08:38:49.848090+0000","last_unstale":"2024-09-19T08:38:51.251998+0000","last_undegraded":"2024-09-19T08:38:51.251998+0000","last_fullsized":"2024-09-19T08:38:51.251998+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:52.093472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250411+0000","last_change":"2024-09-19T08:38:49.847934+0000","last_active":"2024-09-19T08:38:51.250411+0000","last_peered":"2024-09-19T08:38:51.250411+0000","last_clean":"2024-09-19T08:38:51.250411+0000","last_became_active":"2024-09-19T08:38:49.847661+0000","last_became_peered":"2024-09-19T08:38:49.847661+0000","last_unstale":"2024-09-19T08:38:51.250411+0000","last_undegraded":"2024-09-19T08:38:51.250411+0000","last_fullsized":"2024-09-19T08:38:51.250411+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:58.785393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844487+0000","last_change":"2024-09-19T08:38:49.849020+0000","last_active":"2024-09-19T08:38:50.844487+0000","last_peered":"2024-09-19T08:38:50.844487+0000","last_clean":"2024-09-19T08:38:50.844487+0000","last_became_active":"2024-09-19T08:38:49.848734+0000","last_became_peered":"2024-09-19T08:38:49.848734+0000","last_unstale":"2024-09-19T08:38:50.844487+0000","last_undegraded":"2024-09-19T08:38:50.844487+0000","last_fullsized":"2024-09-19T08:38:50.844487+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:47.175375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.842501+0000","last_change":"2024-09-19T08:38:49.850034+0000","last_active":"2024-09-19T08:38:50.842501+0000","last_peered":"2024-09-19T08:38:50.842501+0000","last_clean":"2024-09-19T08:38:50.842501+0000","last_became_active":"2024-09-19T08:38:49.849778+0000","last_became_peered":"2024-09-19T08:38:49.849778+0000","last_unstale":"2024-09-19T08:38:50.842501+0000","last_undegraded":"2024-09-19T08:38:50.842501+0000","last_fullsized":"2024-09-19T08:38:50.842501+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:20.386199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.249836+0000","last_change":"2024-09-19T08:38:49.845636+0000","last_active":"2024-09-19T08:38:51.249836+0000","last_peered":"2024-09-19T08:38:51.249836+0000","last_clean":"2024-09-19T08:38:51.249836+0000","last_became_active":"2024-09-19T08:38:49.845361+0000","last_became_peered":"2024-09-19T08:38:49.845361+0000","last_unstale":"2024-09-19T08:38:51.249836+0000","last_undegraded":"2024-09-19T08:38:51.249836+0000","last_fullsized":"2024-09-19T08:38:51.249836+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:59.863536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844107+0000","last_change":"2024-09-19T08:38:49.851645+0000","last_active":"2024-09-19T08:38:50.844107+0000","last_peered":"2024-09-19T08:38:50.844107+0000","last_clean":"2024-09-19T08:38:50.844107+0000","last_became_active":"2024-09-19T08:38:49.851362+0000","last_became_peered":"2024-09-19T08:38:49.851362+0000","last_unstale":"2024-09-19T08:38:50.844107+0000","last_undegraded":"2024-09-19T08:38:50.844107+0000","last_fullsized":"2024-09-19T08:38:50.844107+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:39.212985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.843801+0000","last_change":"2024-09-19T08:38:49.846913+0000","last_active":"2024-09-19T08:38:50.843801+0000","last_peered":"2024-09-19T08:38:50.843801+0000","last_clean":"2024-09-19T08:38:50.843801+0000","last_became_active":"2024-09-19T08:38:49.846445+0000","last_became_peered":"2024-09-19T08:38:49.846445+0000","last_unstale":"2024-09-19T08:38:50.843801+0000","last_undegraded":"2024-09-19T08:38:50.843801+0000","last_fullsized":"2024-09-19T08:38:50.843801+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:30.167215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.843708+0000","last_change":"2024-09-19T08:38:49.849625+0000","last_active":"2024-09-19T08:38:50.843708+0000","last_peered":"2024-09-19T08:38:50.843708+0000","last_clean":"2024-09-19T08:38:50.843708+0000","last_became_active":"2024-09-19T08:38:49.849205+0000","last_became_peered":"2024-09-19T08:38:49.849205+0000","last_unstale":"2024-09-19T08:38:50.843708+0000","last_undegraded":"2024-09-19T08:38:50.843708+0000","last_fullsized":"2024-09-19T08:38:50.843708+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:07.646294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251836+0000","last_change":"2024-09-19T08:38:49.856513+0000","last_active":"2024-09-19T08:38:51.251836+0000","last_peered":"2024-09-19T08:38:51.251836+0000","last_clean":"2024-09-19T08:38:51.251836+0000","last_became_active":"2024-09-19T08:38:49.856235+0000","last_became_peered":"2024-09-19T08:38:49.856235+0000","last_unstale":"2024-09-19T08:38:51.251836+0000","last_undegraded":"2024-09-19T08:38:51.251836+0000","last_fullsized":"2024-09-19T08:38:51.251836+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:34.315363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844396+0000","last_change":"2024-09-19T08:38:49.848128+0000","last_active":"2024-09-19T08:38:50.844396+0000","last_peered":"2024-09-19T08:38:50.844396+0000","last_clean":"2024-09-19T08:38:50.844396+0000","last_became_active":"2024-09-19T08:38:49.847867+0000","last_became_peered":"2024-09-19T08:38:49.847867+0000","last_unstale":"2024-09-19T08:38:50.844396+0000","last_undegraded":"2024-09-19T08:38:50.844396+0000","last_fullsized":"2024-09-19T08:38:50.844396+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:08:41.622370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.861683+0000","last_change":"2024-09-19T08:38:49.856508+0000","last_active":"2024-09-19T08:38:49.861683+0000","last_peered":"2024-09-19T08:38:49.861683+0000","last_clean":"2024-09-19T08:38:49.861683+0000","last_became_active":"2024-09-19T08:38:49.856233+0000","last_became_peered":"2024-09-19T08:38:49.856233+0000","last_unstale":"2024-09-19T08:38:49.861683+0000","last_undegraded":"2024-09-19T08:38:49.861683+0000","last_fullsized":"2024-09-19T08:38:49.861683+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:56.004415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.843334+0000","last_change":"2024-09-19T08:38:49.856249+0000","last_active":"2024-09-19T08:38:50.843334+0000","last_peered":"2024-09-19T08:38:50.843334+0000","last_clean":"2024-09-19T08:38:50.843334+0000","last_became_active":"2024-09-19T08:38:49.856018+0000","last_became_peered":"2024-09-19T08:38:49.856018+0000","last_unstale":"2024-09-19T08:38:50.843334+0000","last_undegraded":"2024-09-19T08:38:50.843334+0000","last_fullsized":"2024-09-19T08:38:50.843334+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:12.682829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251040+0000","last_change":"2024-09-19T08:38:49.851367+0000","last_active":"2024-09-19T08:38:51.251040+0000","last_peered":"2024-09-19T08:38:51.251040+0000","last_clean":"2024-09-19T08:38:51.251040+0000","last_became_active":"2024-09-19T08:38:49.850848+0000","last_became_peered":"2024-09-19T08:38:49.850848+0000","last_unstale":"2024-09-19T08:38:51.251040+0000","last_undegraded":"2024-09-19T08:38:51.251040+0000","last_fullsized":"2024-09-19T08:38:51.251040+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:27.775301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.249806+0000","last_change":"2024-09-19T08:38:49.853646+0000","last_active":"2024-09-19T08:38:51.249806+0000","last_peered":"2024-09-19T08:38:51.249806+0000","last_clean":"2024-09-19T08:38:51.249806+0000","last_became_active":"2024-09-19T08:38:49.853392+0000","last_became_peered":"2024-09-19T08:38:49.853392+0000","last_unstale":"2024-09-19T08:38:51.249806+0000","last_undegraded":"2024-09-19T08:38:51.249806+0000","last_fullsized":"2024-09-19T08:38:51.249806+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:17.136107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.843843+0000","last_change":"2024-09-19T08:38:49.854202+0000","last_active":"2024-09-19T08:38:50.843843+0000","last_peered":"2024-09-19T08:38:50.843843+0000","last_clean":"2024-09-19T08:38:50.843843+0000","last_became_active":"2024-09-19T08:38:49.853917+0000","last_became_peered":"2024-09-19T08:38:49.853917+0000","last_unstale":"2024-09-19T08:38:50.843843+0000","last_undegraded":"2024-09-19T08:38:50.843843+0000","last_fullsized":"2024-09-19T08:38:50.843843+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:37.067279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.842240+0000","last_change":"2024-09-19T08:38:49.853698+0000","last_active":"2024-09-19T08:38:50.842240+0000","last_peered":"2024-09-19T08:38:50.842240+0000","last_clean":"2024-09-19T08:38:50.842240+0000","last_became_active":"2024-09-19T08:38:49.853414+0000","last_became_peered":"2024-09-19T08:38:49.853414+0000","last_unstale":"2024-09-19T08:38:50.842240+0000","last_undegraded":"2024-09-19T08:38:50.842240+0000","last_fullsized":"2024-09-19T08:38:50.842240+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:56.505664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.249673+0000","last_change":"2024-09-19T08:38:49.846799+0000","last_active":"2024-09-19T08:38:51.249673+0000","last_peered":"2024-09-19T08:38:51.249673+0000","last_clean":"2024-09-19T08:38:51.249673+0000","last_became_active":"2024-09-19T08:38:49.846520+0000","last_became_peered":"2024-09-19T08:38:49.846520+0000","last_unstale":"2024-09-19T08:38:51.249673+0000","last_undegraded":"2024-09-19T08:38:51.249673+0000","last_fullsized":"2024-09-19T08:38:51.249673+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:08:41.622370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"51'4","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.176865+0000","last_change":"2024-09-19T08:38:48.842598+0000","last_active":"2024-09-19T08:38:51.176865+0000","last_peered":"2024-09-19T08:38:51.176865+0000","last_clean":"2024-09-19T08:38:51.176865+0000","last_became_active":"2024-09-19T08:38:48.842317+0000","last_became_peered":"2024-09-19T08:38:48.842317+0000","last_unstale":"2024-09-19T08:38:51.176865+0000","last_undegraded":"2024-09-19T08:38:51.176865+0000","last_fullsized":"2024-09-19T08:38:51.176865+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:24.848238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.249682+0000","last_change":"2024-09-19T08:38:49.846455+0000","last_active":"2024-09-19T08:38:51.249682+0000","last_peered":"2024-09-19T08:38:51.249682+0000","last_clean":"2024-09-19T08:38:51.249682+0000","last_became_active":"2024-09-19T08:38:49.846165+0000","last_became_peered":"2024-09-19T08:38:49.846165+0000","last_unstale":"2024-09-19T08:38:51.249682+0000","last_undegraded":"2024-09-19T08:38:51.249682+0000","last_fullsized":"2024-09-19T08:38:51.249682+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:32.986371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.862475+0000","last_change":"2024-09-19T08:38:48.847545+0000","last_active":"2024-09-19T08:38:49.862475+0000","last_peered":"2024-09-19T08:38:49.862475+0000","last_clean":"2024-09-19T08:38:49.862475+0000","last_became_active":"2024-09-19T08:38:48.847225+0000","last_became_peered":"2024-09-19T08:38:48.847225+0000","last_unstale":"2024-09-19T08:38:49.862475+0000","last_undegraded":"2024-09-19T08:38:49.862475+0000","last_fullsized":"2024-09-19T08:38:49.862475+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:22.921438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.249700+0000","last_change":"2024-09-19T08:38:49.845946+0000","last_active":"2024-09-19T08:38:51.249700+0000","last_peered":"2024-09-19T08:38:51.249700+0000","last_clean":"2024-09-19T08:38:51.249700+0000","last_became_active":"2024-09-19T08:38:49.845680+0000","last_became_peered":"2024-09-19T08:38:49.845680+0000","last_unstale":"2024-09-19T08:38:51.249700+0000","last_undegraded":"2024-09-19T08:38:51.249700+0000","last_fullsized":"2024-09-19T08:38:51.249700+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:47.175375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251256+0000","last_change":"2024-09-19T08:38:48.847398+0000","last_active":"2024-09-19T08:38:51.251256+0000","last_peered":"2024-09-19T08:38:51.251256+0000","last_clean":"2024-09-19T08:38:51.251256+0000","last_became_active":"2024-09-19T08:38:48.847082+0000","last_became_peered":"2024-09-19T08:38:48.847082+0000","last_unstale":"2024-09-19T08:38:51.251256+0000","last_undegraded":"2024-09-19T08:38:51.251256+0000","last_fullsized":"2024-09-19T08:38:51.251256+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:48.073145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250855+0000","last_change":"2024-09-19T08:38:49.857498+0000","last_active":"2024-09-19T08:38:51.250855+0000","last_peered":"2024-09-19T08:38:51.250855+0000","last_clean":"2024-09-19T08:38:51.250855+0000","last_became_active":"2024-09-19T08:38:49.857221+0000","last_became_peered":"2024-09-19T08:38:49.857221+0000","last_unstale":"2024-09-19T08:38:51.250855+0000","last_undegraded":"2024-09-19T08:38:51.250855+0000","last_fullsized":"2024-09-19T08:38:51.250855+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:12.840510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.843466+0000","last_change":"2024-09-19T08:38:48.850119+0000","last_active":"2024-09-19T08:38:50.843466+0000","last_peered":"2024-09-19T08:38:50.843466+0000","last_clean":"2024-09-19T08:38:50.843466+0000","last_became_active":"2024-09-19T08:38:48.849626+0000","last_became_peered":"2024-09-19T08:38:48.849626+0000","last_unstale":"2024-09-19T08:38:50.843466+0000","last_undegraded":"2024-09-19T08:38:50.843466+0000","last_fullsized":"2024-09-19T08:38:50.843466+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:21.743233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.176837+0000","last_change":"2024-09-19T08:38:49.845576+0000","last_active":"2024-09-19T08:38:51.176837+0000","last_peered":"2024-09-19T08:38:51.176837+0000","last_clean":"2024-09-19T08:38:51.176837+0000","last_became_active":"2024-09-19T08:38:49.845246+0000","last_became_peered":"2024-09-19T08:38:49.845246+0000","last_unstale":"2024-09-19T08:38:51.176837+0000","last_undegraded":"2024-09-19T08:38:51.176837+0000","last_fullsized":"2024-09-19T08:38:51.176837+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:07.738397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844300+0000","last_change":"2024-09-19T08:38:48.839975+0000","last_active":"2024-09-19T08:38:50.844300+0000","last_peered":"2024-09-19T08:38:50.844300+0000","last_clean":"2024-09-19T08:38:50.844300+0000","last_became_active":"2024-09-19T08:38:48.839677+0000","last_became_peered":"2024-09-19T08:38:48.839677+0000","last_unstale":"2024-09-19T08:38:50.844300+0000","last_undegraded":"2024-09-19T08:38:50.844300+0000","last_fullsized":"2024-09-19T08:38:50.844300+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:07.736206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250034+0000","last_change":"2024-09-19T08:38:49.840716+0000","last_active":"2024-09-19T08:38:51.250034+0000","last_peered":"2024-09-19T08:38:51.250034+0000","last_clean":"2024-09-19T08:38:51.250034+0000","last_became_active":"2024-09-19T08:38:49.840423+0000","last_became_peered":"2024-09-19T08:38:49.840423+0000","last_unstale":"2024-09-19T08:38:51.250034+0000","last_undegraded":"2024-09-19T08:38:51.250034+0000","last_fullsized":"2024-09-19T08:38:51.250034+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:32.671231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.249808+0000","last_change":"2024-09-19T08:38:48.847808+0000","last_active":"2024-09-19T08:38:51.249808+0000","last_peered":"2024-09-19T08:38:51.249808+0000","last_clean":"2024-09-19T08:38:51.249808+0000","last_became_active":"2024-09-19T08:38:48.847455+0000","last_became_peered":"2024-09-19T08:38:48.847455+0000","last_unstale":"2024-09-19T08:38:51.249808+0000","last_undegraded":"2024-09-19T08:38:51.249808+0000","last_fullsized":"2024-09-19T08:38:51.249808+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:18.763286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251391+0000","last_change":"2024-09-19T08:38:49.858480+0000","last_active":"2024-09-19T08:38:51.251391+0000","last_peered":"2024-09-19T08:38:51.251391+0000","last_clean":"2024-09-19T08:38:51.251391+0000","last_became_active":"2024-09-19T08:38:49.857704+0000","last_became_peered":"2024-09-19T08:38:49.857704+0000","last_unstale":"2024-09-19T08:38:51.251391+0000","last_undegraded":"2024-09-19T08:38:51.251391+0000","last_fullsized":"2024-09-19T08:38:51.251391+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:55.928839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.249629+0000","last_change":"2024-09-19T08:38:48.842933+0000","last_active":"2024-09-19T08:38:51.249629+0000","last_peered":"2024-09-19T08:38:51.249629+0000","last_clean":"2024-09-19T08:38:51.249629+0000","last_became_active":"2024-09-19T08:38:48.842671+0000","last_became_peered":"2024-09-19T08:38:48.842671+0000","last_unstale":"2024-09-19T08:38:51.249629+0000","last_undegraded":"2024-09-19T08:38:51.249629+0000","last_fullsized":"2024-09-19T08:38:51.249629+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:41.729463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250284+0000","last_change":"2024-09-19T08:38:49.843672+0000","last_active":"2024-09-19T08:38:51.250284+0000","last_peered":"2024-09-19T08:38:51.250284+0000","last_clean":"2024-09-19T08:38:51.250284+0000","last_became_active":"2024-09-19T08:38:49.843388+0000","last_became_peered":"2024-09-19T08:38:49.843388+0000","last_unstale":"2024-09-19T08:38:51.250284+0000","last_undegraded":"2024-09-19T08:38:51.250284+0000","last_fullsized":"2024-09-19T08:38:51.250284+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:25.853309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.843647+0000","last_change":"2024-09-19T08:38:48.845356+0000","last_active":"2024-09-19T08:38:50.843647+0000","last_peered":"2024-09-19T08:38:50.843647+0000","last_clean":"2024-09-19T08:38:50.843647+0000","last_became_active":"2024-09-19T08:38:48.843061+0000","last_became_peered":"2024-09-19T08:38:48.843061+0000","last_unstale":"2024-09-19T08:38:50.843647+0000","last_undegraded":"2024-09-19T08:38:50.843647+0000","last_fullsized":"2024-09-19T08:38:50.843647+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:21.265592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.176642+0000","last_change":"2024-09-19T08:38:49.854386+0000","last_active":"2024-09-19T08:38:51.176642+0000","last_peered":"2024-09-19T08:38:51.176642+0000","last_clean":"2024-09-19T08:38:51.176642+0000","last_became_active":"2024-09-19T08:38:49.854108+0000","last_became_peered":"2024-09-19T08:38:49.854108+0000","last_unstale":"2024-09-19T08:38:51.176642+0000","last_undegraded":"2024-09-19T08:38:51.176642+0000","last_fullsized":"2024-09-19T08:38:51.176642+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:20.386199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250412+0000","last_change":"2024-09-19T08:38:48.839622+0000","last_active":"2024-09-19T08:38:51.250412+0000","last_peered":"2024-09-19T08:38:51.250412+0000","last_clean":"2024-09-19T08:38:51.250412+0000","last_became_active":"2024-09-19T08:38:48.839155+0000","last_became_peered":"2024-09-19T08:38:48.839155+0000","last_unstale":"2024-09-19T08:38:51.250412+0000","last_undegraded":"2024-09-19T08:38:51.250412+0000","last_fullsized":"2024-09-19T08:38:51.250412+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:26.339583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250078+0000","last_change":"2024-09-19T08:38:49.844484+0000","last_active":"2024-09-19T08:38:51.250078+0000","last_peered":"2024-09-19T08:38:51.250078+0000","last_clean":"2024-09-19T08:38:51.250078+0000","last_became_active":"2024-09-19T08:38:49.844206+0000","last_became_peered":"2024-09-19T08:38:49.844206+0000","last_unstale":"2024-09-19T08:38:51.250078+0000","last_undegraded":"2024-09-19T08:38:51.250078+0000","last_fullsized":"2024-09-19T08:38:51.250078+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:38.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250376+0000","last_change":"2024-09-19T08:38:48.846227+0000","last_active":"2024-09-19T08:38:51.250376+0000","last_peered":"2024-09-19T08:38:51.250376+0000","last_clean":"2024-09-19T08:38:51.250376+0000","last_became_active":"2024-09-19T08:38:48.845992+0000","last_became_peered":"2024-09-19T08:38:48.845992+0000","last_unstale":"2024-09-19T08:38:51.250376+0000","last_undegraded":"2024-09-19T08:38:51.250376+0000","last_fullsized":"2024-09-19T08:38:51.250376+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:22.886551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250633+0000","last_change":"2024-09-19T08:38:49.847892+0000","last_active":"2024-09-19T08:38:51.250633+0000","last_peered":"2024-09-19T08:38:51.250633+0000","last_clean":"2024-09-19T08:38:51.250633+0000","last_became_active":"2024-09-19T08:38:49.847328+0000","last_became_peered":"2024-09-19T08:38:49.847328+0000","last_unstale":"2024-09-19T08:38:51.250633+0000","last_undegraded":"2024-09-19T08:38:51.250633+0000","last_fullsized":"2024-09-19T08:38:51.250633+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:51.228891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"51'3","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250119+0000","last_change":"2024-09-19T08:38:48.845062+0000","last_active":"2024-09-19T08:38:51.250119+0000","last_peered":"2024-09-19T08:38:51.250119+0000","last_clean":"2024-09-19T08:38:51.250119+0000","last_became_active":"2024-09-19T08:38:48.844728+0000","last_became_peered":"2024-09-19T08:38:48.844728+0000","last_unstale":"2024-09-19T08:38:51.250119+0000","last_undegraded":"2024-09-19T08:38:51.250119+0000","last_fullsized":"2024-09-19T08:38:51.250119+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:56.675316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.842358+0000","last_change":"2024-09-19T08:38:49.851121+0000","last_active":"2024-09-19T08:38:50.842358+0000","last_peered":"2024-09-19T08:38:50.842358+0000","last_clean":"2024-09-19T08:38:50.842358+0000","last_became_active":"2024-09-19T08:38:49.850869+0000","last_became_peered":"2024-09-19T08:38:49.850869+0000","last_unstale":"2024-09-19T08:38:50.842358+0000","last_undegraded":"2024-09-19T08:38:50.842358+0000","last_fullsized":"2024-09-19T08:38:50.842358+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:59.218345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"51'6","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251831+0000","last_change":"2024-09-19T08:38:48.845625+0000","last_active":"2024-09-19T08:38:51.251831+0000","last_peered":"2024-09-19T08:38:51.251831+0000","last_clean":"2024-09-19T08:38:51.251831+0000","last_became_active":"2024-09-19T08:38:48.845309+0000","last_became_peered":"2024-09-19T08:38:48.845309+0000","last_unstale":"2024-09-19T08:38:51.251831+0000","last_undegraded":"2024-09-19T08:38:51.251831+0000","last_fullsized":"2024-09-19T08:38:51.251831+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:55.500593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.249980+0000","last_change":"2024-09-19T08:38:49.841719+0000","last_active":"2024-09-19T08:38:51.249980+0000","last_peered":"2024-09-19T08:38:51.249980+0000","last_clean":"2024-09-19T08:38:51.249980+0000","last_became_active":"2024-09-19T08:38:49.841454+0000","last_became_peered":"2024-09-19T08:38:49.841454+0000","last_unstale":"2024-09-19T08:38:51.249980+0000","last_undegraded":"2024-09-19T08:38:51.249980+0000","last_fullsized":"2024-09-19T08:38:51.249980+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:01.188222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.851635+0000","last_change":"2024-09-19T08:38:48.848241+0000","last_active":"2024-09-19T08:38:49.851635+0000","last_peered":"2024-09-19T08:38:49.851635+0000","last_clean":"2024-09-19T08:38:49.851635+0000","last_became_active":"2024-09-19T08:38:48.847988+0000","last_became_peered":"2024-09-19T08:38:48.847988+0000","last_unstale":"2024-09-19T08:38:49.851635+0000","last_undegraded":"2024-09-19T08:38:49.851635+0000","last_fullsized":"2024-09-19T08:38:49.851635+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:04.274074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251757+0000","last_change":"2024-09-19T08:38:49.858822+0000","last_active":"2024-09-19T08:38:51.251757+0000","last_peered":"2024-09-19T08:38:51.251757+0000","last_clean":"2024-09-19T08:38:51.251757+0000","last_became_active":"2024-09-19T08:38:49.858381+0000","last_became_peered":"2024-09-19T08:38:49.858381+0000","last_unstale":"2024-09-19T08:38:51.251757+0000","last_undegraded":"2024-09-19T08:38:51.251757+0000","last_fullsized":"2024-09-19T08:38:51.251757+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:17.021357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250245+0000","last_change":"2024-09-19T08:38:48.840466+0000","last_active":"2024-09-19T08:38:51.250245+0000","last_peered":"2024-09-19T08:38:51.250245+0000","last_clean":"2024-09-19T08:38:51.250245+0000","last_became_active":"2024-09-19T08:38:48.840150+0000","last_became_peered":"2024-09-19T08:38:48.840150+0000","last_unstale":"2024-09-19T08:38:51.250245+0000","last_undegraded":"2024-09-19T08:38:51.250245+0000","last_fullsized":"2024-09-19T08:38:51.250245+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:42.121107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.861096+0000","last_change":"2024-09-19T08:38:49.852949+0000","last_active":"2024-09-19T08:38:49.861096+0000","last_peered":"2024-09-19T08:38:49.861096+0000","last_clean":"2024-09-19T08:38:49.861096+0000","last_became_active":"2024-09-19T08:38:49.852266+0000","last_became_peered":"2024-09-19T08:38:49.852266+0000","last_unstale":"2024-09-19T08:38:49.861096+0000","last_undegraded":"2024-09-19T08:38:49.861096+0000","last_fullsized":"2024-09-19T08:38:49.861096+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:22:14.408979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.842207+0000","last_change":"2024-09-19T08:38:48.848111+0000","last_active":"2024-09-19T08:38:50.842207+0000","last_peered":"2024-09-19T08:38:50.842207+0000","last_clean":"2024-09-19T08:38:50.842207+0000","last_became_active":"2024-09-19T08:38:48.847803+0000","last_became_peered":"2024-09-19T08:38:48.847803+0000","last_unstale":"2024-09-19T08:38:50.842207+0000","last_undegraded":"2024-09-19T08:38:50.842207+0000","last_fullsized":"2024-09-19T08:38:50.842207+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:51.649802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844426+0000","last_change":"2024-09-19T08:38:49.845868+0000","last_active":"2024-09-19T08:38:50.844426+0000","last_peered":"2024-09-19T08:38:50.844426+0000","last_clean":"2024-09-19T08:38:50.844426+0000","last_became_active":"2024-09-19T08:38:49.845600+0000","last_became_peered":"2024-09-19T08:38:49.845600+0000","last_unstale":"2024-09-19T08:38:50.844426+0000","last_undegraded":"2024-09-19T08:38:50.844426+0000","last_fullsized":"2024-09-19T08:38:50.844426+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:32.986371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"51'8","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.863152+0000","last_change":"2024-09-19T08:38:48.847054+0000","last_active":"2024-09-19T08:38:49.863152+0000","last_peered":"2024-09-19T08:38:49.863152+0000","last_clean":"2024-09-19T08:38:49.863152+0000","last_became_active":"2024-09-19T08:38:48.846733+0000","last_became_peered":"2024-09-19T08:38:48.846733+0000","last_unstale":"2024-09-19T08:38:49.863152+0000","last_undegraded":"2024-09-19T08:38:49.863152+0000","last_fullsized":"2024-09-19T08:38:49.863152+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:07.461886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250111+0000","last_change":"2024-09-19T08:38:49.846486+0000","last_active":"2024-09-19T08:38:51.250111+0000","last_peered":"2024-09-19T08:38:51.250111+0000","last_clean":"2024-09-19T08:38:51.250111+0000","last_became_active":"2024-09-19T08:38:49.846220+0000","last_became_peered":"2024-09-19T08:38:49.846220+0000","last_unstale":"2024-09-19T08:38:51.250111+0000","last_undegraded":"2024-09-19T08:38:51.250111+0000","last_fullsized":"2024-09-19T08:38:51.250111+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:34.315363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.862524+0000","last_change":"2024-09-19T08:38:48.846146+0000","last_active":"2024-09-19T08:38:49.862524+0000","last_peered":"2024-09-19T08:38:49.862524+0000","last_clean":"2024-09-19T08:38:49.862524+0000","last_became_active":"2024-09-19T08:38:48.845885+0000","last_became_peered":"2024-09-19T08:38:48.845885+0000","last_unstale":"2024-09-19T08:38:49.862524+0000","last_undegraded":"2024-09-19T08:38:49.862524+0000","last_fullsized":"2024-09-19T08:38:49.862524+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:20:07.203808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250460+0000","last_change":"2024-09-19T08:38:49.851345+0000","last_active":"2024-09-19T08:38:51.250460+0000","last_peered":"2024-09-19T08:38:51.250460+0000","last_clean":"2024-09-19T08:38:51.250460+0000","last_became_active":"2024-09-19T08:38:49.851071+0000","last_became_peered":"2024-09-19T08:38:49.851071+0000","last_unstale":"2024-09-19T08:38:51.250460+0000","last_undegraded":"2024-09-19T08:38:51.250460+0000","last_fullsized":"2024-09-19T08:38:51.250460+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:07.738397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.859699+0000","last_change":"2024-09-19T08:38:48.847801+0000","last_active":"2024-09-19T08:38:49.859699+0000","last_peered":"2024-09-19T08:38:49.859699+0000","last_clean":"2024-09-19T08:38:49.859699+0000","last_became_active":"2024-09-19T08:38:48.847514+0000","last_became_peered":"2024-09-19T08:38:48.847514+0000","last_unstale":"2024-09-19T08:38:49.859699+0000","last_undegraded":"2024-09-19T08:38:49.859699+0000","last_fullsized":"2024-09-19T08:38:49.859699+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:49.457995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.842260+0000","last_change":"2024-09-19T08:38:49.842699+0000","last_active":"2024-09-19T08:38:50.842260+0000","last_peered":"2024-09-19T08:38:50.842260+0000","last_clean":"2024-09-19T08:38:50.842260+0000","last_became_active":"2024-09-19T08:38:49.842436+0000","last_became_peered":"2024-09-19T08:38:49.842436+0000","last_unstale":"2024-09-19T08:38:50.842260+0000","last_undegraded":"2024-09-19T08:38:50.842260+0000","last_fullsized":"2024-09-19T08:38:50.842260+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:58.785393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250162+0000","last_change":"2024-09-19T08:38:48.841198+0000","last_active":"2024-09-19T08:38:51.250162+0000","last_peered":"2024-09-19T08:38:51.250162+0000","last_clean":"2024-09-19T08:38:51.250162+0000","last_became_active":"2024-09-19T08:38:48.840886+0000","last_became_peered":"2024-09-19T08:38:48.840886+0000","last_unstale":"2024-09-19T08:38:51.250162+0000","last_undegraded":"2024-09-19T08:38:51.250162+0000","last_fullsized":"2024-09-19T08:38:51.250162+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:30.256341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.861791+0000","last_change":"2024-09-19T08:38:49.857362+0000","last_active":"2024-09-19T08:38:49.861791+0000","last_peered":"2024-09-19T08:38:49.861791+0000","last_clean":"2024-09-19T08:38:49.861791+0000","last_became_active":"2024-09-19T08:38:49.857115+0000","last_became_peered":"2024-09-19T08:38:49.857115+0000","last_unstale":"2024-09-19T08:38:49.861791+0000","last_undegraded":"2024-09-19T08:38:49.861791+0000","last_fullsized":"2024-09-19T08:38:49.861791+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:00:53.483613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.843523+0000","last_change":"2024-09-19T08:38:48.848664+0000","last_active":"2024-09-19T08:38:50.843523+0000","last_peered":"2024-09-19T08:38:50.843523+0000","last_clean":"2024-09-19T08:38:50.843523+0000","last_became_active":"2024-09-19T08:38:48.848356+0000","last_became_peered":"2024-09-19T08:38:48.848356+0000","last_unstale":"2024-09-19T08:38:50.843523+0000","last_undegraded":"2024-09-19T08:38:50.843523+0000","last_fullsized":"2024-09-19T08:38:50.843523+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:47.648762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.843487+0000","last_change":"2024-09-19T08:38:49.846920+0000","last_active":"2024-09-19T08:38:50.843487+0000","last_peered":"2024-09-19T08:38:50.843487+0000","last_clean":"2024-09-19T08:38:50.843487+0000","last_became_active":"2024-09-19T08:38:49.846640+0000","last_became_peered":"2024-09-19T08:38:49.846640+0000","last_unstale":"2024-09-19T08:38:50.843487+0000","last_undegraded":"2024-09-19T08:38:50.843487+0000","last_fullsized":"2024-09-19T08:38:50.843487+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:27.775301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251526+0000","last_change":"2024-09-19T08:38:48.848609+0000","last_active":"2024-09-19T08:38:51.251526+0000","last_peered":"2024-09-19T08:38:51.251526+0000","last_clean":"2024-09-19T08:38:51.251526+0000","last_became_active":"2024-09-19T08:38:48.848279+0000","last_became_peered":"2024-09-19T08:38:48.848279+0000","last_unstale":"2024-09-19T08:38:51.251526+0000","last_undegraded":"2024-09-19T08:38:51.251526+0000","last_fullsized":"2024-09-19T08:38:51.251526+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:58.858465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250067+0000","last_change":"2024-09-19T08:38:49.844866+0000","last_active":"2024-09-19T08:38:51.250067+0000","last_peered":"2024-09-19T08:38:51.250067+0000","last_clean":"2024-09-19T08:38:51.250067+0000","last_became_active":"2024-09-19T08:38:49.844604+0000","last_became_peered":"2024-09-19T08:38:49.844604+0000","last_unstale":"2024-09-19T08:38:51.250067+0000","last_undegraded":"2024-09-19T08:38:51.250067+0000","last_fullsized":"2024-09-19T08:38:51.250067+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:06.598613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844078+0000","last_change":"2024-09-19T08:38:48.843340+0000","last_active":"2024-09-19T08:38:50.844078+0000","last_peered":"2024-09-19T08:38:50.844078+0000","last_clean":"2024-09-19T08:38:50.844078+0000","last_became_active":"2024-09-19T08:38:48.843021+0000","last_became_peered":"2024-09-19T08:38:48.843021+0000","last_unstale":"2024-09-19T08:38:50.844078+0000","last_undegraded":"2024-09-19T08:38:50.844078+0000","last_fullsized":"2024-09-19T08:38:50.844078+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:54.758114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251597+0000","last_change":"2024-09-19T08:38:49.848805+0000","last_active":"2024-09-19T08:38:51.251597+0000","last_peered":"2024-09-19T08:38:51.251597+0000","last_clean":"2024-09-19T08:38:51.251597+0000","last_became_active":"2024-09-19T08:38:49.848521+0000","last_became_peered":"2024-09-19T08:38:49.848521+0000","last_unstale":"2024-09-19T08:38:51.251597+0000","last_undegraded":"2024-09-19T08:38:51.251597+0000","last_fullsized":"2024-09-19T08:38:51.251597+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:24.333204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250631+0000","last_change":"2024-09-19T08:38:48.845655+0000","last_active":"2024-09-19T08:38:51.250631+0000","last_peered":"2024-09-19T08:38:51.250631+0000","last_clean":"2024-09-19T08:38:51.250631+0000","last_became_active":"2024-09-19T08:38:48.845350+0000","last_became_peered":"2024-09-19T08:38:48.845350+0000","last_unstale":"2024-09-19T08:38:51.250631+0000","last_undegraded":"2024-09-19T08:38:51.250631+0000","last_fullsized":"2024-09-19T08:38:51.250631+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:12.741602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.861957+0000","last_change":"2024-09-19T08:38:49.854179+0000","last_active":"2024-09-19T08:38:49.861957+0000","last_peered":"2024-09-19T08:38:49.861957+0000","last_clean":"2024-09-19T08:38:49.861957+0000","last_became_active":"2024-09-19T08:38:49.853888+0000","last_became_peered":"2024-09-19T08:38:49.853888+0000","last_unstale":"2024-09-19T08:38:49.861957+0000","last_undegraded":"2024-09-19T08:38:49.861957+0000","last_fullsized":"2024-09-19T08:38:49.861957+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:40.178360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250085+0000","last_change":"2024-09-19T08:38:48.839135+0000","last_active":"2024-09-19T08:38:51.250085+0000","last_peered":"2024-09-19T08:38:51.250085+0000","last_clean":"2024-09-19T08:38:51.250085+0000","last_became_active":"2024-09-19T08:38:48.838831+0000","last_became_peered":"2024-09-19T08:38:48.838831+0000","last_unstale":"2024-09-19T08:38:51.250085+0000","last_undegraded":"2024-09-19T08:38:51.250085+0000","last_fullsized":"2024-09-19T08:38:51.250085+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:24.848238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250386+0000","last_change":"2024-09-19T08:38:49.851797+0000","last_active":"2024-09-19T08:38:51.250386+0000","last_peered":"2024-09-19T08:38:51.250386+0000","last_clean":"2024-09-19T08:38:51.250386+0000","last_became_active":"2024-09-19T08:38:49.851511+0000","last_became_peered":"2024-09-19T08:38:49.851511+0000","last_unstale":"2024-09-19T08:38:51.250386+0000","last_undegraded":"2024-09-19T08:38:51.250386+0000","last_fullsized":"2024-09-19T08:38:51.250386+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:56.505664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.249826+0000","last_change":"2024-09-19T08:38:48.843087+0000","last_active":"2024-09-19T08:38:51.249826+0000","last_peered":"2024-09-19T08:38:51.249826+0000","last_clean":"2024-09-19T08:38:51.249826+0000","last_became_active":"2024-09-19T08:38:48.842831+0000","last_became_peered":"2024-09-19T08:38:48.842831+0000","last_unstale":"2024-09-19T08:38:51.249826+0000","last_undegraded":"2024-09-19T08:38:51.249826+0000","last_fullsized":"2024-09-19T08:38:51.249826+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:03.448865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250837+0000","last_change":"2024-09-19T08:38:49.858565+0000","last_active":"2024-09-19T08:38:51.250837+0000","last_peered":"2024-09-19T08:38:51.250837+0000","last_clean":"2024-09-19T08:38:51.250837+0000","last_became_active":"2024-09-19T08:38:49.857824+0000","last_became_peered":"2024-09-19T08:38:49.857824+0000","last_unstale":"2024-09-19T08:38:51.250837+0000","last_undegraded":"2024-09-19T08:38:51.250837+0000","last_fullsized":"2024-09-19T08:38:51.250837+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:52.093472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250161+0000","last_change":"2024-09-19T08:38:48.845188+0000","last_active":"2024-09-19T08:38:51.250161+0000","last_peered":"2024-09-19T08:38:51.250161+0000","last_clean":"2024-09-19T08:38:51.250161+0000","last_became_active":"2024-09-19T08:38:48.844772+0000","last_became_peered":"2024-09-19T08:38:48.844772+0000","last_unstale":"2024-09-19T08:38:51.250161+0000","last_undegraded":"2024-09-19T08:38:51.250161+0000","last_fullsized":"2024-09-19T08:38:51.250161+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:25:11.135022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844212+0000","last_change":"2024-09-19T08:38:49.846125+0000","last_active":"2024-09-19T08:38:50.844212+0000","last_peered":"2024-09-19T08:38:50.844212+0000","last_clean":"2024-09-19T08:38:50.844212+0000","last_became_active":"2024-09-19T08:38:49.845703+0000","last_became_peered":"2024-09-19T08:38:49.845703+0000","last_unstale":"2024-09-19T08:38:50.844212+0000","last_undegraded":"2024-09-19T08:38:50.844212+0000","last_fullsized":"2024-09-19T08:38:50.844212+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:54.030557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844482+0000","last_change":"2024-09-19T08:38:48.846578+0000","last_active":"2024-09-19T08:38:50.844482+0000","last_peered":"2024-09-19T08:38:50.844482+0000","last_clean":"2024-09-19T08:38:50.844482+0000","last_became_active":"2024-09-19T08:38:48.846308+0000","last_became_peered":"2024-09-19T08:38:48.846308+0000","last_unstale":"2024-09-19T08:38:50.844482+0000","last_undegraded":"2024-09-19T08:38:50.844482+0000","last_fullsized":"2024-09-19T08:38:50.844482+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:54.923768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251714+0000","last_change":"2024-09-19T08:38:49.855479+0000","last_active":"2024-09-19T08:38:51.251714+0000","last_peered":"2024-09-19T08:38:51.251714+0000","last_clean":"2024-09-19T08:38:51.251714+0000","last_became_active":"2024-09-19T08:38:49.855150+0000","last_became_peered":"2024-09-19T08:38:49.855150+0000","last_unstale":"2024-09-19T08:38:51.251714+0000","last_undegraded":"2024-09-19T08:38:51.251714+0000","last_fullsized":"2024-09-19T08:38:51.251714+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:22.270663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251963+0000","last_change":"2024-09-19T08:38:48.846502+0000","last_active":"2024-09-19T08:38:51.251963+0000","last_peered":"2024-09-19T08:38:51.251963+0000","last_clean":"2024-09-19T08:38:51.251963+0000","last_became_active":"2024-09-19T08:38:48.846138+0000","last_became_peered":"2024-09-19T08:38:48.846138+0000","last_unstale":"2024-09-19T08:38:51.251963+0000","last_undegraded":"2024-09-19T08:38:51.251963+0000","last_fullsized":"2024-09-19T08:38:51.251963+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:58.213274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.843396+0000","last_change":"2024-09-19T08:38:49.845503+0000","last_active":"2024-09-19T08:38:50.843396+0000","last_peered":"2024-09-19T08:38:50.843396+0000","last_clean":"2024-09-19T08:38:50.843396+0000","last_became_active":"2024-09-19T08:38:49.845247+0000","last_became_peered":"2024-09-19T08:38:49.845247+0000","last_unstale":"2024-09-19T08:38:50.843396+0000","last_undegraded":"2024-09-19T08:38:50.843396+0000","last_fullsized":"2024-09-19T08:38:50.843396+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:51.228891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844231+0000","last_change":"2024-09-19T08:38:48.840200+0000","last_active":"2024-09-19T08:38:50.844231+0000","last_peered":"2024-09-19T08:38:50.844231+0000","last_clean":"2024-09-19T08:38:50.844231+0000","last_became_active":"2024-09-19T08:38:48.839660+0000","last_became_peered":"2024-09-19T08:38:48.839660+0000","last_unstale":"2024-09-19T08:38:50.844231+0000","last_undegraded":"2024-09-19T08:38:50.844231+0000","last_fullsized":"2024-09-19T08:38:50.844231+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:05.366264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251550+0000","last_change":"2024-09-19T08:38:49.858328+0000","last_active":"2024-09-19T08:38:51.251550+0000","last_peered":"2024-09-19T08:38:51.251550+0000","last_clean":"2024-09-19T08:38:51.251550+0000","last_became_active":"2024-09-19T08:38:49.857699+0000","last_became_peered":"2024-09-19T08:38:49.857699+0000","last_unstale":"2024-09-19T08:38:51.251550+0000","last_undegraded":"2024-09-19T08:38:51.251550+0000","last_fullsized":"2024-09-19T08:38:51.251550+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:08.741277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.842271+0000","last_change":"2024-09-19T08:38:48.849977+0000","last_active":"2024-09-19T08:38:50.842271+0000","last_peered":"2024-09-19T08:38:50.842271+0000","last_clean":"2024-09-19T08:38:50.842271+0000","last_became_active":"2024-09-19T08:38:48.849707+0000","last_became_peered":"2024-09-19T08:38:48.849707+0000","last_unstale":"2024-09-19T08:38:50.842271+0000","last_undegraded":"2024-09-19T08:38:50.842271+0000","last_fullsized":"2024-09-19T08:38:50.842271+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:43.715182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-19T08:38:49.862071+0000","last_change":"2024-09-19T08:38:49.861491+0000","last_active":"2024-09-19T08:38:49.862071+0000","last_peered":"2024-09-19T08:38:49.862071+0000","last_clean":"2024-09-19T08:38:49.862071+0000","last_became_active":"2024-09-19T08:38:49.861043+0000","last_became_peered":"2024-09-19T08:38:49.861043+0000","last_unstale":"2024-09-19T08:38:49.862071+0000","last_undegraded":"2024-09-19T08:38:49.862071+0000","last_fullsized":"2024-09-19T08:38:49.862071+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:05.788337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250157+0000","last_change":"2024-09-19T08:38:48.839797+0000","last_active":"2024-09-19T08:38:51.250157+0000","last_peered":"2024-09-19T08:38:51.250157+0000","last_clean":"2024-09-19T08:38:51.250157+0000","last_became_active":"2024-09-19T08:38:48.839284+0000","last_became_peered":"2024-09-19T08:38:48.839284+0000","last_unstale":"2024-09-19T08:38:51.250157+0000","last_undegraded":"2024-09-19T08:38:51.250157+0000","last_fullsized":"2024-09-19T08:38:51.250157+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:29.381132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.176673+0000","last_change":"2024-09-19T08:38:49.844787+0000","last_active":"2024-09-19T08:38:51.176673+0000","last_peered":"2024-09-19T08:38:51.176673+0000","last_clean":"2024-09-19T08:38:51.176673+0000","last_became_active":"2024-09-19T08:38:49.844516+0000","last_became_peered":"2024-09-19T08:38:49.844516+0000","last_unstale":"2024-09-19T08:38:51.176673+0000","last_undegraded":"2024-09-19T08:38:51.176673+0000","last_fullsized":"2024-09-19T08:38:51.176673+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:12.682829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"52'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.833624+0000","last_change":"2024-09-19T08:38:48.843795+0000","last_active":"2024-09-19T08:38:51.833624+0000","last_peered":"2024-09-19T08:38:51.833624+0000","last_clean":"2024-09-19T08:38:51.833624+0000","last_became_active":"2024-09-19T08:38:48.843481+0000","last_became_peered":"2024-09-19T08:38:48.843481+0000","last_unstale":"2024-09-19T08:38:51.833624+0000","last_undegraded":"2024-09-19T08:38:51.833624+0000","last_fullsized":"2024-09-19T08:38:51.833624+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:57.780322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":222,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250210+0000","last_change":"2024-09-19T08:37:04.479071+0000","last_active":"2024-09-19T08:38:51.250210+0000","last_peered":"2024-09-19T08:38:51.250210+0000","last_clean":"2024-09-19T08:38:51.250210+0000","last_became_active":"2024-09-19T08:37:04.478199+0000","last_became_peered":"2024-09-19T08:37:04.478199+0000","last_unstale":"2024-09-19T08:38:51.250210+0000","last_undegraded":"2024-09-19T08:38:51.250210+0000","last_fullsized":"2024-09-19T08:38:51.250210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_clean_scrub_stamp":"2024-09-19T08:37:02.519738+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:32.963748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":602112,"data_stored":261611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509466,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1220608,"data_stored":859791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509466,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":630784,"data_stored":269425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":267811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":614400,"data_stored":267755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509467,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28216,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343624,"statfs":{"total":96636764160,"available":96607870976,"internally_reserved":0,"allocated":1208320,"data_stored":858159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":614400,"data_stored":268303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":606208,"data_stored":261085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:38:57.143 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:38:57.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.254+0000 7f57ee853640 1 Processor -- start 2024-09-19T08:38:57.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.254+0000 7f57ee853640 1 -- start start 2024-09-19T08:38:57.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.254+0000 7f57ee853640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f57e806d580 0x7f57e8141b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:57.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.254+0000 7f57ee853640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57e80d2130 0x7f57e80d2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:57.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.254+0000 7f57ee853640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57e8161f10 con 0x7f57e8141470 2024-09-19T08:38:57.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.254+0000 7f57ee853640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f57e8141850 con 0x7f57e806d580 2024-09-19T08:38:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.254+0000 7f57ee853640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f57e80d2a80 con 0x7f57e80d2130 2024-09-19T08:38:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.255+0000 7f57e77fe640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f57e806d580 0x7f57e8141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.255+0000 7f57ecdf0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57e80d2130 0x7f57e80d2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.255+0000 7f57e7fff640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f57e8141470 0x7f57e806ce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.117:44516/0 (socket says 172.21.15.117:44516) 2024-09-19T08:38:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.255+0000 7f57e7fff640 1 -- 172.21.15.117:0/2536013621 learned_addr learned my addr 172.21.15.117:0/2536013621 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.255+0000 7f57ecdf0640 1 -- 172.21.15.117:0/2536013621 >> v2:172.21.15.146:3300/0 conn(0x7f57e806d580 msgr2=0x7f57e8141b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.255+0000 7f57ecdf0640 1 --2- 172.21.15.117:0/2536013621 >> v2:172.21.15.146:3300/0 conn(0x7f57e806d580 0x7f57e8141b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.255+0000 7f57ecdf0640 1 -- 172.21.15.117:0/2536013621 >> v1:172.21.15.146:6789/0 conn(0x7f57e8141470 legacy=0x7f57e806ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.255+0000 7f57ecdf0640 1 -- 172.21.15.117:0/2536013621 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e81621b0 con 0x7f57e80d2130 2024-09-19T08:38:57.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.255+0000 7f57e77fe640 1 --2- 172.21.15.117:0/2536013621 >> v2:172.21.15.146:3300/0 conn(0x7f57e806d580 0x7f57e8141b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:38:57.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.256+0000 7f57ecdf0640 1 --2- 172.21.15.117:0/2536013621 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57e80d2130 0x7f57e80d2540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009d90 tx=0x7f57e002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa44c4aa8887eba2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:57.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.256+0000 7f57e6ffd640 1 -- 172.21.15.117:0/2536013621 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e0007740 con 0x7f57e80d2130 2024-09-19T08:38:57.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.256+0000 7f57e6ffd640 1 -- 172.21.15.117:0/2536013621 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57e00078e0 con 0x7f57e80d2130 2024-09-19T08:38:57.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.256+0000 7f57e6ffd640 1 -- 172.21.15.117:0/2536013621 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e0007cb0 con 0x7f57e80d2130 2024-09-19T08:38:57.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.257+0000 7f57ee853640 1 -- 172.21.15.117:0/2536013621 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57e80d2130 msgr2=0x7f57e80d2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:57.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.257+0000 7f57ee853640 1 --2- 172.21.15.117:0/2536013621 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57e80d2130 0x7f57e80d2540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009d90 tx=0x7f57e002a660 comp rx=0 tx=0).stop 2024-09-19T08:38:57.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.257+0000 7f57ee853640 1 -- 172.21.15.117:0/2536013621 shutdown_connections 2024-09-19T08:38:57.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.257+0000 7f57ee853640 1 --2- 172.21.15.117:0/2536013621 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57e80d2130 0x7f57e80d2540 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.257+0000 7f57ee853640 1 --2- 172.21.15.117:0/2536013621 >> v2:172.21.15.146:3300/0 conn(0x7f57e806d580 0x7f57e8141b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.257+0000 7f57ee853640 1 -- 172.21.15.117:0/2536013621 >> 172.21.15.117:0/2536013621 conn(0x7f57e80b4040 msgr2=0x7f57e80b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:57.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.257+0000 7f57ee853640 1 -- 172.21.15.117:0/2536013621 shutdown_connections 2024-09-19T08:38:57.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.257+0000 7f57ee853640 1 -- 172.21.15.117:0/2536013621 wait complete. 2024-09-19T08:38:57.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.258+0000 7f57ee853640 1 Processor -- start 2024-09-19T08:38:57.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.258+0000 7f57ee853640 1 -- start start 2024-09-19T08:38:57.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.259+0000 7f57ee853640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57e806d580 0x7f57e80d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:57.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.259+0000 7f57ee853640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57e80d2130 0x7f57e81f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:57.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.259+0000 7f57ee853640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57e8141470 0x7f57e813ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:57.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.259+0000 7f57ee853640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f57e8162a50 con 0x7f57e8141470 2024-09-19T08:38:57.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.259+0000 7f57ee853640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f57e8162770 con 0x7f57e806d580 2024-09-19T08:38:57.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.259+0000 7f57ee853640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f57e8162d30 con 0x7f57e80d2130 2024-09-19T08:38:57.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.259+0000 7f57ecdf0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57e8141470 0x7f57e813ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:57.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.259+0000 7f57e7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57e806d580 0x7f57e80d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:57.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.259+0000 7f57ecdf0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57e8141470 0x7f57e813ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58116/0 (socket says 172.21.15.117:58116) 2024-09-19T08:38:57.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.259+0000 7f57ecdf0640 1 -- 172.21.15.117:0/2232013603 learned_addr learned my addr 172.21.15.117:0/2232013603 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:57.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.259+0000 7f57e77fe640 1 --2- 172.21.15.117:0/2232013603 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57e80d2130 0x7f57e81f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:57.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.260+0000 7f57ecdf0640 1 -- 172.21.15.117:0/2232013603 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57e80d2130 msgr2=0x7f57e81f3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:57.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.260+0000 7f57ecdf0640 1 --2- 172.21.15.117:0/2232013603 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57e80d2130 0x7f57e81f3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.260+0000 7f57ecdf0640 1 -- 172.21.15.117:0/2232013603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57e806d580 msgr2=0x7f57e80d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:57.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.260+0000 7f57ecdf0640 1 --2- 172.21.15.117:0/2232013603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57e806d580 0x7f57e80d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.260+0000 7f57ecdf0640 1 -- 172.21.15.117:0/2232013603 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e813c800 con 0x7f57e8141470 2024-09-19T08:38:57.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.260+0000 7f57ecdf0640 1 --2- 172.21.15.117:0/2232013603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57e8141470 0x7f57e813ba10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009eb0 tx=0x7f57e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:57.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.260+0000 7f57e4ff9640 1 -- 172.21.15.117:0/2232013603 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e0040070 con 0x7f57e8141470 2024-09-19T08:38:57.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.260+0000 7f57e4ff9640 1 -- 172.21.15.117:0/2232013603 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57e0031bc0 con 0x7f57e8141470 2024-09-19T08:38:57.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.260+0000 7f57ee853640 1 -- 172.21.15.117:0/2232013603 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57e80d0eb0 con 0x7f57e8141470 2024-09-19T08:38:57.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.260+0000 7f57e4ff9640 1 -- 172.21.15.117:0/2232013603 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e0009450 con 0x7f57e8141470 2024-09-19T08:38:57.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.260+0000 7f57ee853640 1 -- 172.21.15.117:0/2232013603 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57e80d1470 con 0x7f57e8141470 2024-09-19T08:38:57.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.261+0000 7f57ee853640 1 -- 172.21.15.117:0/2232013603 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57e8141b70 con 0x7f57e8141470 2024-09-19T08:38:57.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.262+0000 7f57e4ff9640 1 -- 172.21.15.117:0/2232013603 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f57e0039040 con 0x7f57e8141470 2024-09-19T08:38:57.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.262+0000 7f57e4ff9640 1 --2- 172.21.15.117:0/2232013603 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f57d406c2b0 0x7f57d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:57.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.262+0000 7f57e4ff9640 1 -- 172.21.15.117:0/2232013603 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6130+0+0 (secure 0 0 0) 0x7f57e00accc0 con 0x7f57e8141470 2024-09-19T08:38:57.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.262+0000 7f57e7fff640 1 --2- 172.21.15.117:0/2232013603 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f57d406c2b0 0x7f57d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:57.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.263+0000 7f57e7fff640 1 --2- 172.21.15.117:0/2232013603 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f57d406c2b0 0x7f57d406e770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f57d8000f60 tx=0x7f57d8007e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:57.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.267+0000 7f57e4ff9640 1 -- 172.21.15.117:0/2232013603 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f57e007ac30 con 0x7f57e8141470 2024-09-19T08:38:57.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.428+0000 7f57ee853640 1 -- 172.21.15.117:0/2232013603 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f57e8142f30 con 0x7f57d406c2b0 2024-09-19T08:38:57.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.435+0000 7f57e4ff9640 1 -- 172.21.15.117:0/2232013603 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251945 (secure 0 0 0) 0x7f57e8142f30 con 0x7f57d406c2b0 2024-09-19T08:38:57.437 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:57.439 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-09-19T08:38:57.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.438+0000 7f57ee853640 1 -- 172.21.15.117:0/2232013603 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f57d406c2b0 msgr2=0x7f57d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:57.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.438+0000 7f57ee853640 1 --2- 172.21.15.117:0/2232013603 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f57d406c2b0 0x7f57d406e770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f57d8000f60 tx=0x7f57d8007e80 comp rx=0 tx=0).stop 2024-09-19T08:38:57.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.438+0000 7f57ee853640 1 -- 172.21.15.117:0/2232013603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57e8141470 msgr2=0x7f57e813ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:57.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.438+0000 7f57ee853640 1 --2- 172.21.15.117:0/2232013603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57e8141470 0x7f57e813ba10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009eb0 tx=0x7f57e0004a40 comp rx=0 tx=0).stop 2024-09-19T08:38:57.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.438+0000 7f57ee853640 1 -- 172.21.15.117:0/2232013603 shutdown_connections 2024-09-19T08:38:57.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.438+0000 7f57ee853640 1 --2- 172.21.15.117:0/2232013603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57e8141470 0x7f57e813ba10 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.438+0000 7f57ee853640 1 --2- 172.21.15.117:0/2232013603 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f57d406c2b0 0x7f57d406e770 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.441 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.438+0000 7f57ee853640 1 --2- 172.21.15.117:0/2232013603 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57e80d2130 0x7f57e81f3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.438+0000 7f57ee853640 1 --2- 172.21.15.117:0/2232013603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57e806d580 0x7f57e80d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.438+0000 7f57ee853640 1 -- 172.21.15.117:0/2232013603 >> 172.21.15.117:0/2232013603 conn(0x7f57e80b4040 msgr2=0x7f57e80b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:57.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.438+0000 7f57ee853640 1 -- 172.21.15.117:0/2232013603 shutdown_connections 2024-09-19T08:38:57.442 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.438+0000 7f57ee853640 1 -- 172.21.15.117:0/2232013603 wait complete. 2024-09-19T08:38:57.449 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2024-09-19T08:38:55.874349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222252,"kb_used_data":5980,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752468,"statfs":{"total":773094113280,"available":772866527232,"internally_reserved":0,"allocated":6123520,"data_stored":3320632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.005067"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251831+0000","last_change":"2024-09-19T08:38:49.849078+0000","last_active":"2024-09-19T08:38:51.251831+0000","last_peered":"2024-09-19T08:38:51.251831+0000","last_clean":"2024-09-19T08:38:51.251831+0000","last_became_active":"2024-09-19T08:38:49.848505+0000","last_became_peered":"2024-09-19T08:38:49.848505+0000","last_unstale":"2024-09-19T08:38:51.251831+0000","last_undegraded":"2024-09-19T08:38:51.251831+0000","last_fullsized":"2024-09-19T08:38:51.251831+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:05.899941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.843369+0000","last_change":"2024-09-19T08:38:49.849349+0000","last_active":"2024-09-19T08:38:50.843369+0000","last_peered":"2024-09-19T08:38:50.843369+0000","last_clean":"2024-09-19T08:38:50.843369+0000","last_became_active":"2024-09-19T08:38:49.849070+0000","last_became_peered":"2024-09-19T08:38:49.849070+0000","last_unstale":"2024-09-19T08:38:50.843369+0000","last_undegraded":"2024-09-19T08:38:50.843369+0000","last_fullsized":"2024-09-19T08:38:50.843369+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:07.738397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844505+0000","last_change":"2024-09-19T08:38:49.851951+0000","last_active":"2024-09-19T08:38:50.844505+0000","last_peered":"2024-09-19T08:38:50.844505+0000","last_clean":"2024-09-19T08:38:50.844505+0000","last_became_active":"2024-09-19T08:38:49.851661+0000","last_became_peered":"2024-09-19T08:38:49.851661+0000","last_unstale":"2024-09-19T08:38:50.844505+0000","last_undegraded":"2024-09-19T08:38:50.844505+0000","last_fullsized":"2024-09-19T08:38:50.844505+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:17.136107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250081+0000","last_change":"2024-09-19T08:38:49.844381+0000","last_active":"2024-09-19T08:38:51.250081+0000","last_peered":"2024-09-19T08:38:51.250081+0000","last_clean":"2024-09-19T08:38:51.250081+0000","last_became_active":"2024-09-19T08:38:49.844118+0000","last_became_peered":"2024-09-19T08:38:49.844118+0000","last_unstale":"2024-09-19T08:38:51.250081+0000","last_undegraded":"2024-09-19T08:38:51.250081+0000","last_fullsized":"2024-09-19T08:38:51.250081+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:49.078216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.842456+0000","last_change":"2024-09-19T08:38:49.847052+0000","last_active":"2024-09-19T08:38:50.842456+0000","last_peered":"2024-09-19T08:38:50.842456+0000","last_clean":"2024-09-19T08:38:50.842456+0000","last_became_active":"2024-09-19T08:38:49.846658+0000","last_became_peered":"2024-09-19T08:38:49.846658+0000","last_unstale":"2024-09-19T08:38:50.842456+0000","last_undegraded":"2024-09-19T08:38:50.842456+0000","last_fullsized":"2024-09-19T08:38:50.842456+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:13.746673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251028+0000","last_change":"2024-09-19T08:38:49.851860+0000","last_active":"2024-09-19T08:38:51.251028+0000","last_peered":"2024-09-19T08:38:51.251028+0000","last_clean":"2024-09-19T08:38:51.251028+0000","last_became_active":"2024-09-19T08:38:49.851582+0000","last_became_peered":"2024-09-19T08:38:49.851582+0000","last_unstale":"2024-09-19T08:38:51.251028+0000","last_undegraded":"2024-09-19T08:38:51.251028+0000","last_fullsized":"2024-09-19T08:38:51.251028+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:30.146998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250334+0000","last_change":"2024-09-19T08:38:49.854982+0000","last_active":"2024-09-19T08:38:51.250334+0000","last_peered":"2024-09-19T08:38:51.250334+0000","last_clean":"2024-09-19T08:38:51.250334+0000","last_became_active":"2024-09-19T08:38:49.854713+0000","last_became_peered":"2024-09-19T08:38:49.854713+0000","last_unstale":"2024-09-19T08:38:51.250334+0000","last_undegraded":"2024-09-19T08:38:51.250334+0000","last_fullsized":"2024-09-19T08:38:51.250334+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:05.899941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250010+0000","last_change":"2024-09-19T08:38:49.853887+0000","last_active":"2024-09-19T08:38:51.250010+0000","last_peered":"2024-09-19T08:38:51.250010+0000","last_clean":"2024-09-19T08:38:51.250010+0000","last_became_active":"2024-09-19T08:38:49.853098+0000","last_became_peered":"2024-09-19T08:38:49.853098+0000","last_unstale":"2024-09-19T08:38:51.250010+0000","last_undegraded":"2024-09-19T08:38:51.250010+0000","last_fullsized":"2024-09-19T08:38:51.250010+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:12.560215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844381+0000","last_change":"2024-09-19T08:38:49.851272+0000","last_active":"2024-09-19T08:38:50.844381+0000","last_peered":"2024-09-19T08:38:50.844381+0000","last_clean":"2024-09-19T08:38:50.844381+0000","last_became_active":"2024-09-19T08:38:49.851024+0000","last_became_peered":"2024-09-19T08:38:49.851024+0000","last_unstale":"2024-09-19T08:38:50.844381+0000","last_undegraded":"2024-09-19T08:38:50.844381+0000","last_fullsized":"2024-09-19T08:38:50.844381+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:45:55.986170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251036+0000","last_change":"2024-09-19T08:38:49.852048+0000","last_active":"2024-09-19T08:38:51.251036+0000","last_peered":"2024-09-19T08:38:51.251036+0000","last_clean":"2024-09-19T08:38:51.251036+0000","last_became_active":"2024-09-19T08:38:49.851720+0000","last_became_peered":"2024-09-19T08:38:49.851720+0000","last_unstale":"2024-09-19T08:38:51.251036+0000","last_undegraded":"2024-09-19T08:38:51.251036+0000","last_fullsized":"2024-09-19T08:38:51.251036+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:48.341866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251643+0000","last_change":"2024-09-19T08:38:49.848707+0000","last_active":"2024-09-19T08:38:51.251643+0000","last_peered":"2024-09-19T08:38:51.251643+0000","last_clean":"2024-09-19T08:38:51.251643+0000","last_became_active":"2024-09-19T08:38:49.848338+0000","last_became_peered":"2024-09-19T08:38:49.848338+0000","last_unstale":"2024-09-19T08:38:51.251643+0000","last_undegraded":"2024-09-19T08:38:51.251643+0000","last_fullsized":"2024-09-19T08:38:51.251643+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:40.008691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250409+0000","last_change":"2024-09-19T08:38:49.856788+0000","last_active":"2024-09-19T08:38:51.250409+0000","last_peered":"2024-09-19T08:38:51.250409+0000","last_clean":"2024-09-19T08:38:51.250409+0000","last_became_active":"2024-09-19T08:38:49.856469+0000","last_became_peered":"2024-09-19T08:38:49.856469+0000","last_unstale":"2024-09-19T08:38:51.250409+0000","last_undegraded":"2024-09-19T08:38:51.250409+0000","last_fullsized":"2024-09-19T08:38:51.250409+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:35.845632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250927+0000","last_change":"2024-09-19T08:38:49.849968+0000","last_active":"2024-09-19T08:38:51.250927+0000","last_peered":"2024-09-19T08:38:51.250927+0000","last_clean":"2024-09-19T08:38:51.250927+0000","last_became_active":"2024-09-19T08:38:49.848196+0000","last_became_peered":"2024-09-19T08:38:49.848196+0000","last_unstale":"2024-09-19T08:38:51.250927+0000","last_undegraded":"2024-09-19T08:38:51.250927+0000","last_fullsized":"2024-09-19T08:38:51.250927+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:11.813346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250411+0000","last_change":"2024-09-19T08:38:49.848022+0000","last_active":"2024-09-19T08:38:51.250411+0000","last_peered":"2024-09-19T08:38:51.250411+0000","last_clean":"2024-09-19T08:38:51.250411+0000","last_became_active":"2024-09-19T08:38:49.847620+0000","last_became_peered":"2024-09-19T08:38:49.847620+0000","last_unstale":"2024-09-19T08:38:51.250411+0000","last_undegraded":"2024-09-19T08:38:51.250411+0000","last_fullsized":"2024-09-19T08:38:51.250411+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:12.682829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.249955+0000","last_change":"2024-09-19T08:38:49.850608+0000","last_active":"2024-09-19T08:38:51.249955+0000","last_peered":"2024-09-19T08:38:51.249955+0000","last_clean":"2024-09-19T08:38:51.249955+0000","last_became_active":"2024-09-19T08:38:49.850366+0000","last_became_peered":"2024-09-19T08:38:49.850366+0000","last_unstale":"2024-09-19T08:38:51.249955+0000","last_undegraded":"2024-09-19T08:38:51.249955+0000","last_fullsized":"2024-09-19T08:38:51.249955+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:04.924645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250157+0000","last_change":"2024-09-19T08:38:49.843417+0000","last_active":"2024-09-19T08:38:51.250157+0000","last_peered":"2024-09-19T08:38:51.250157+0000","last_clean":"2024-09-19T08:38:51.250157+0000","last_became_active":"2024-09-19T08:38:49.843112+0000","last_became_peered":"2024-09-19T08:38:49.843112+0000","last_unstale":"2024-09-19T08:38:51.250157+0000","last_undegraded":"2024-09-19T08:38:51.250157+0000","last_fullsized":"2024-09-19T08:38:51.250157+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:17.686524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251998+0000","last_change":"2024-09-19T08:38:49.848811+0000","last_active":"2024-09-19T08:38:51.251998+0000","last_peered":"2024-09-19T08:38:51.251998+0000","last_clean":"2024-09-19T08:38:51.251998+0000","last_became_active":"2024-09-19T08:38:49.848090+0000","last_became_peered":"2024-09-19T08:38:49.848090+0000","last_unstale":"2024-09-19T08:38:51.251998+0000","last_undegraded":"2024-09-19T08:38:51.251998+0000","last_fullsized":"2024-09-19T08:38:51.251998+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:52.093472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250411+0000","last_change":"2024-09-19T08:38:49.847934+0000","last_active":"2024-09-19T08:38:51.250411+0000","last_peered":"2024-09-19T08:38:51.250411+0000","last_clean":"2024-09-19T08:38:51.250411+0000","last_became_active":"2024-09-19T08:38:49.847661+0000","last_became_peered":"2024-09-19T08:38:49.847661+0000","last_unstale":"2024-09-19T08:38:51.250411+0000","last_undegraded":"2024-09-19T08:38:51.250411+0000","last_fullsized":"2024-09-19T08:38:51.250411+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:58.785393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844487+0000","last_change":"2024-09-19T08:38:49.849020+0000","last_active":"2024-09-19T08:38:50.844487+0000","last_peered":"2024-09-19T08:38:50.844487+0000","last_clean":"2024-09-19T08:38:50.844487+0000","last_became_active":"2024-09-19T08:38:49.848734+0000","last_became_peered":"2024-09-19T08:38:49.848734+0000","last_unstale":"2024-09-19T08:38:50.844487+0000","last_undegraded":"2024-09-19T08:38:50.844487+0000","last_fullsized":"2024-09-19T08:38:50.844487+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:47.175375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.842501+0000","last_change":"2024-09-19T08:38:49.850034+0000","last_active":"2024-09-19T08:38:50.842501+0000","last_peered":"2024-09-19T08:38:50.842501+0000","last_clean":"2024-09-19T08:38:50.842501+0000","last_became_active":"2024-09-19T08:38:49.849778+0000","last_became_peered":"2024-09-19T08:38:49.849778+0000","last_unstale":"2024-09-19T08:38:50.842501+0000","last_undegraded":"2024-09-19T08:38:50.842501+0000","last_fullsized":"2024-09-19T08:38:50.842501+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:20.386199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.249836+0000","last_change":"2024-09-19T08:38:49.845636+0000","last_active":"2024-09-19T08:38:51.249836+0000","last_peered":"2024-09-19T08:38:51.249836+0000","last_clean":"2024-09-19T08:38:51.249836+0000","last_became_active":"2024-09-19T08:38:49.845361+0000","last_became_peered":"2024-09-19T08:38:49.845361+0000","last_unstale":"2024-09-19T08:38:51.249836+0000","last_undegraded":"2024-09-19T08:38:51.249836+0000","last_fullsized":"2024-09-19T08:38:51.249836+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:59.863536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844107+0000","last_change":"2024-09-19T08:38:49.851645+0000","last_active":"2024-09-19T08:38:50.844107+0000","last_peered":"2024-09-19T08:38:50.844107+0000","last_clean":"2024-09-19T08:38:50.844107+0000","last_became_active":"2024-09-19T08:38:49.851362+0000","last_became_peered":"2024-09-19T08:38:49.851362+0000","last_unstale":"2024-09-19T08:38:50.844107+0000","last_undegraded":"2024-09-19T08:38:50.844107+0000","last_fullsized":"2024-09-19T08:38:50.844107+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:39.212985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.843801+0000","last_change":"2024-09-19T08:38:49.846913+0000","last_active":"2024-09-19T08:38:50.843801+0000","last_peered":"2024-09-19T08:38:50.843801+0000","last_clean":"2024-09-19T08:38:50.843801+0000","last_became_active":"2024-09-19T08:38:49.846445+0000","last_became_peered":"2024-09-19T08:38:49.846445+0000","last_unstale":"2024-09-19T08:38:50.843801+0000","last_undegraded":"2024-09-19T08:38:50.843801+0000","last_fullsized":"2024-09-19T08:38:50.843801+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:30.167215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.843708+0000","last_change":"2024-09-19T08:38:49.849625+0000","last_active":"2024-09-19T08:38:50.843708+0000","last_peered":"2024-09-19T08:38:50.843708+0000","last_clean":"2024-09-19T08:38:50.843708+0000","last_became_active":"2024-09-19T08:38:49.849205+0000","last_became_peered":"2024-09-19T08:38:49.849205+0000","last_unstale":"2024-09-19T08:38:50.843708+0000","last_undegraded":"2024-09-19T08:38:50.843708+0000","last_fullsized":"2024-09-19T08:38:50.843708+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:07.646294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251836+0000","last_change":"2024-09-19T08:38:49.856513+0000","last_active":"2024-09-19T08:38:51.251836+0000","last_peered":"2024-09-19T08:38:51.251836+0000","last_clean":"2024-09-19T08:38:51.251836+0000","last_became_active":"2024-09-19T08:38:49.856235+0000","last_became_peered":"2024-09-19T08:38:49.856235+0000","last_unstale":"2024-09-19T08:38:51.251836+0000","last_undegraded":"2024-09-19T08:38:51.251836+0000","last_fullsized":"2024-09-19T08:38:51.251836+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:34.315363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844396+0000","last_change":"2024-09-19T08:38:49.848128+0000","last_active":"2024-09-19T08:38:50.844396+0000","last_peered":"2024-09-19T08:38:50.844396+0000","last_clean":"2024-09-19T08:38:50.844396+0000","last_became_active":"2024-09-19T08:38:49.847867+0000","last_became_peered":"2024-09-19T08:38:49.847867+0000","last_unstale":"2024-09-19T08:38:50.844396+0000","last_undegraded":"2024-09-19T08:38:50.844396+0000","last_fullsized":"2024-09-19T08:38:50.844396+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:08:41.622370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250405+0000","last_change":"2024-09-19T08:38:49.856508+0000","last_active":"2024-09-19T08:38:51.250405+0000","last_peered":"2024-09-19T08:38:51.250405+0000","last_clean":"2024-09-19T08:38:51.250405+0000","last_became_active":"2024-09-19T08:38:49.856233+0000","last_became_peered":"2024-09-19T08:38:49.856233+0000","last_unstale":"2024-09-19T08:38:51.250405+0000","last_undegraded":"2024-09-19T08:38:51.250405+0000","last_fullsized":"2024-09-19T08:38:51.250405+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:24.123436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.843334+0000","last_change":"2024-09-19T08:38:49.856249+0000","last_active":"2024-09-19T08:38:50.843334+0000","last_peered":"2024-09-19T08:38:50.843334+0000","last_clean":"2024-09-19T08:38:50.843334+0000","last_became_active":"2024-09-19T08:38:49.856018+0000","last_became_peered":"2024-09-19T08:38:49.856018+0000","last_unstale":"2024-09-19T08:38:50.843334+0000","last_undegraded":"2024-09-19T08:38:50.843334+0000","last_fullsized":"2024-09-19T08:38:50.843334+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:12.682829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251040+0000","last_change":"2024-09-19T08:38:49.851367+0000","last_active":"2024-09-19T08:38:51.251040+0000","last_peered":"2024-09-19T08:38:51.251040+0000","last_clean":"2024-09-19T08:38:51.251040+0000","last_became_active":"2024-09-19T08:38:49.850848+0000","last_became_peered":"2024-09-19T08:38:49.850848+0000","last_unstale":"2024-09-19T08:38:51.251040+0000","last_undegraded":"2024-09-19T08:38:51.251040+0000","last_fullsized":"2024-09-19T08:38:51.251040+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:27.775301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.249806+0000","last_change":"2024-09-19T08:38:49.853646+0000","last_active":"2024-09-19T08:38:51.249806+0000","last_peered":"2024-09-19T08:38:51.249806+0000","last_clean":"2024-09-19T08:38:51.249806+0000","last_became_active":"2024-09-19T08:38:49.853392+0000","last_became_peered":"2024-09-19T08:38:49.853392+0000","last_unstale":"2024-09-19T08:38:51.249806+0000","last_undegraded":"2024-09-19T08:38:51.249806+0000","last_fullsized":"2024-09-19T08:38:51.249806+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:17.136107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.843843+0000","last_change":"2024-09-19T08:38:49.854202+0000","last_active":"2024-09-19T08:38:50.843843+0000","last_peered":"2024-09-19T08:38:50.843843+0000","last_clean":"2024-09-19T08:38:50.843843+0000","last_became_active":"2024-09-19T08:38:49.853917+0000","last_became_peered":"2024-09-19T08:38:49.853917+0000","last_unstale":"2024-09-19T08:38:50.843843+0000","last_undegraded":"2024-09-19T08:38:50.843843+0000","last_fullsized":"2024-09-19T08:38:50.843843+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:37.067279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.842240+0000","last_change":"2024-09-19T08:38:49.853698+0000","last_active":"2024-09-19T08:38:50.842240+0000","last_peered":"2024-09-19T08:38:50.842240+0000","last_clean":"2024-09-19T08:38:50.842240+0000","last_became_active":"2024-09-19T08:38:49.853414+0000","last_became_peered":"2024-09-19T08:38:49.853414+0000","last_unstale":"2024-09-19T08:38:50.842240+0000","last_undegraded":"2024-09-19T08:38:50.842240+0000","last_fullsized":"2024-09-19T08:38:50.842240+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:56.505664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.249673+0000","last_change":"2024-09-19T08:38:49.846799+0000","last_active":"2024-09-19T08:38:51.249673+0000","last_peered":"2024-09-19T08:38:51.249673+0000","last_clean":"2024-09-19T08:38:51.249673+0000","last_became_active":"2024-09-19T08:38:49.846520+0000","last_became_peered":"2024-09-19T08:38:49.846520+0000","last_unstale":"2024-09-19T08:38:51.249673+0000","last_undegraded":"2024-09-19T08:38:51.249673+0000","last_fullsized":"2024-09-19T08:38:51.249673+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:08:41.622370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"51'4","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.176865+0000","last_change":"2024-09-19T08:38:48.842598+0000","last_active":"2024-09-19T08:38:51.176865+0000","last_peered":"2024-09-19T08:38:51.176865+0000","last_clean":"2024-09-19T08:38:51.176865+0000","last_became_active":"2024-09-19T08:38:48.842317+0000","last_became_peered":"2024-09-19T08:38:48.842317+0000","last_unstale":"2024-09-19T08:38:51.176865+0000","last_undegraded":"2024-09-19T08:38:51.176865+0000","last_fullsized":"2024-09-19T08:38:51.176865+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:24.848238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.249682+0000","last_change":"2024-09-19T08:38:49.846455+0000","last_active":"2024-09-19T08:38:51.249682+0000","last_peered":"2024-09-19T08:38:51.249682+0000","last_clean":"2024-09-19T08:38:51.249682+0000","last_became_active":"2024-09-19T08:38:49.846165+0000","last_became_peered":"2024-09-19T08:38:49.846165+0000","last_unstale":"2024-09-19T08:38:51.249682+0000","last_undegraded":"2024-09-19T08:38:51.249682+0000","last_fullsized":"2024-09-19T08:38:51.249682+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:32.986371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251164+0000","last_change":"2024-09-19T08:38:48.847545+0000","last_active":"2024-09-19T08:38:51.251164+0000","last_peered":"2024-09-19T08:38:51.251164+0000","last_clean":"2024-09-19T08:38:51.251164+0000","last_became_active":"2024-09-19T08:38:48.847225+0000","last_became_peered":"2024-09-19T08:38:48.847225+0000","last_unstale":"2024-09-19T08:38:51.251164+0000","last_undegraded":"2024-09-19T08:38:51.251164+0000","last_fullsized":"2024-09-19T08:38:51.251164+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:22.921438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.249700+0000","last_change":"2024-09-19T08:38:49.845946+0000","last_active":"2024-09-19T08:38:51.249700+0000","last_peered":"2024-09-19T08:38:51.249700+0000","last_clean":"2024-09-19T08:38:51.249700+0000","last_became_active":"2024-09-19T08:38:49.845680+0000","last_became_peered":"2024-09-19T08:38:49.845680+0000","last_unstale":"2024-09-19T08:38:51.249700+0000","last_undegraded":"2024-09-19T08:38:51.249700+0000","last_fullsized":"2024-09-19T08:38:51.249700+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:47.175375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251256+0000","last_change":"2024-09-19T08:38:48.847398+0000","last_active":"2024-09-19T08:38:51.251256+0000","last_peered":"2024-09-19T08:38:51.251256+0000","last_clean":"2024-09-19T08:38:51.251256+0000","last_became_active":"2024-09-19T08:38:48.847082+0000","last_became_peered":"2024-09-19T08:38:48.847082+0000","last_unstale":"2024-09-19T08:38:51.251256+0000","last_undegraded":"2024-09-19T08:38:51.251256+0000","last_fullsized":"2024-09-19T08:38:51.251256+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:48.073145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250855+0000","last_change":"2024-09-19T08:38:49.857498+0000","last_active":"2024-09-19T08:38:51.250855+0000","last_peered":"2024-09-19T08:38:51.250855+0000","last_clean":"2024-09-19T08:38:51.250855+0000","last_became_active":"2024-09-19T08:38:49.857221+0000","last_became_peered":"2024-09-19T08:38:49.857221+0000","last_unstale":"2024-09-19T08:38:51.250855+0000","last_undegraded":"2024-09-19T08:38:51.250855+0000","last_fullsized":"2024-09-19T08:38:51.250855+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:12.840510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.843466+0000","last_change":"2024-09-19T08:38:48.850119+0000","last_active":"2024-09-19T08:38:50.843466+0000","last_peered":"2024-09-19T08:38:50.843466+0000","last_clean":"2024-09-19T08:38:50.843466+0000","last_became_active":"2024-09-19T08:38:48.849626+0000","last_became_peered":"2024-09-19T08:38:48.849626+0000","last_unstale":"2024-09-19T08:38:50.843466+0000","last_undegraded":"2024-09-19T08:38:50.843466+0000","last_fullsized":"2024-09-19T08:38:50.843466+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:21.743233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.176837+0000","last_change":"2024-09-19T08:38:49.845576+0000","last_active":"2024-09-19T08:38:51.176837+0000","last_peered":"2024-09-19T08:38:51.176837+0000","last_clean":"2024-09-19T08:38:51.176837+0000","last_became_active":"2024-09-19T08:38:49.845246+0000","last_became_peered":"2024-09-19T08:38:49.845246+0000","last_unstale":"2024-09-19T08:38:51.176837+0000","last_undegraded":"2024-09-19T08:38:51.176837+0000","last_fullsized":"2024-09-19T08:38:51.176837+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:07.738397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844300+0000","last_change":"2024-09-19T08:38:48.839975+0000","last_active":"2024-09-19T08:38:50.844300+0000","last_peered":"2024-09-19T08:38:50.844300+0000","last_clean":"2024-09-19T08:38:50.844300+0000","last_became_active":"2024-09-19T08:38:48.839677+0000","last_became_peered":"2024-09-19T08:38:48.839677+0000","last_unstale":"2024-09-19T08:38:50.844300+0000","last_undegraded":"2024-09-19T08:38:50.844300+0000","last_fullsized":"2024-09-19T08:38:50.844300+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:07.736206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250034+0000","last_change":"2024-09-19T08:38:49.840716+0000","last_active":"2024-09-19T08:38:51.250034+0000","last_peered":"2024-09-19T08:38:51.250034+0000","last_clean":"2024-09-19T08:38:51.250034+0000","last_became_active":"2024-09-19T08:38:49.840423+0000","last_became_peered":"2024-09-19T08:38:49.840423+0000","last_unstale":"2024-09-19T08:38:51.250034+0000","last_undegraded":"2024-09-19T08:38:51.250034+0000","last_fullsized":"2024-09-19T08:38:51.250034+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:32.671231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.249808+0000","last_change":"2024-09-19T08:38:48.847808+0000","last_active":"2024-09-19T08:38:51.249808+0000","last_peered":"2024-09-19T08:38:51.249808+0000","last_clean":"2024-09-19T08:38:51.249808+0000","last_became_active":"2024-09-19T08:38:48.847455+0000","last_became_peered":"2024-09-19T08:38:48.847455+0000","last_unstale":"2024-09-19T08:38:51.249808+0000","last_undegraded":"2024-09-19T08:38:51.249808+0000","last_fullsized":"2024-09-19T08:38:51.249808+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:18.763286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251391+0000","last_change":"2024-09-19T08:38:49.858480+0000","last_active":"2024-09-19T08:38:51.251391+0000","last_peered":"2024-09-19T08:38:51.251391+0000","last_clean":"2024-09-19T08:38:51.251391+0000","last_became_active":"2024-09-19T08:38:49.857704+0000","last_became_peered":"2024-09-19T08:38:49.857704+0000","last_unstale":"2024-09-19T08:38:51.251391+0000","last_undegraded":"2024-09-19T08:38:51.251391+0000","last_fullsized":"2024-09-19T08:38:51.251391+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:55.928839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.249629+0000","last_change":"2024-09-19T08:38:48.842933+0000","last_active":"2024-09-19T08:38:51.249629+0000","last_peered":"2024-09-19T08:38:51.249629+0000","last_clean":"2024-09-19T08:38:51.249629+0000","last_became_active":"2024-09-19T08:38:48.842671+0000","last_became_peered":"2024-09-19T08:38:48.842671+0000","last_unstale":"2024-09-19T08:38:51.249629+0000","last_undegraded":"2024-09-19T08:38:51.249629+0000","last_fullsized":"2024-09-19T08:38:51.249629+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:41.729463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250284+0000","last_change":"2024-09-19T08:38:49.843672+0000","last_active":"2024-09-19T08:38:51.250284+0000","last_peered":"2024-09-19T08:38:51.250284+0000","last_clean":"2024-09-19T08:38:51.250284+0000","last_became_active":"2024-09-19T08:38:49.843388+0000","last_became_peered":"2024-09-19T08:38:49.843388+0000","last_unstale":"2024-09-19T08:38:51.250284+0000","last_undegraded":"2024-09-19T08:38:51.250284+0000","last_fullsized":"2024-09-19T08:38:51.250284+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:25.853309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.843647+0000","last_change":"2024-09-19T08:38:48.845356+0000","last_active":"2024-09-19T08:38:50.843647+0000","last_peered":"2024-09-19T08:38:50.843647+0000","last_clean":"2024-09-19T08:38:50.843647+0000","last_became_active":"2024-09-19T08:38:48.843061+0000","last_became_peered":"2024-09-19T08:38:48.843061+0000","last_unstale":"2024-09-19T08:38:50.843647+0000","last_undegraded":"2024-09-19T08:38:50.843647+0000","last_fullsized":"2024-09-19T08:38:50.843647+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:21.265592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.176642+0000","last_change":"2024-09-19T08:38:49.854386+0000","last_active":"2024-09-19T08:38:51.176642+0000","last_peered":"2024-09-19T08:38:51.176642+0000","last_clean":"2024-09-19T08:38:51.176642+0000","last_became_active":"2024-09-19T08:38:49.854108+0000","last_became_peered":"2024-09-19T08:38:49.854108+0000","last_unstale":"2024-09-19T08:38:51.176642+0000","last_undegraded":"2024-09-19T08:38:51.176642+0000","last_fullsized":"2024-09-19T08:38:51.176642+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:20.386199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250412+0000","last_change":"2024-09-19T08:38:48.839622+0000","last_active":"2024-09-19T08:38:51.250412+0000","last_peered":"2024-09-19T08:38:51.250412+0000","last_clean":"2024-09-19T08:38:51.250412+0000","last_became_active":"2024-09-19T08:38:48.839155+0000","last_became_peered":"2024-09-19T08:38:48.839155+0000","last_unstale":"2024-09-19T08:38:51.250412+0000","last_undegraded":"2024-09-19T08:38:51.250412+0000","last_fullsized":"2024-09-19T08:38:51.250412+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:26.339583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250078+0000","last_change":"2024-09-19T08:38:49.844484+0000","last_active":"2024-09-19T08:38:51.250078+0000","last_peered":"2024-09-19T08:38:51.250078+0000","last_clean":"2024-09-19T08:38:51.250078+0000","last_became_active":"2024-09-19T08:38:49.844206+0000","last_became_peered":"2024-09-19T08:38:49.844206+0000","last_unstale":"2024-09-19T08:38:51.250078+0000","last_undegraded":"2024-09-19T08:38:51.250078+0000","last_fullsized":"2024-09-19T08:38:51.250078+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:38.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250376+0000","last_change":"2024-09-19T08:38:48.846227+0000","last_active":"2024-09-19T08:38:51.250376+0000","last_peered":"2024-09-19T08:38:51.250376+0000","last_clean":"2024-09-19T08:38:51.250376+0000","last_became_active":"2024-09-19T08:38:48.845992+0000","last_became_peered":"2024-09-19T08:38:48.845992+0000","last_unstale":"2024-09-19T08:38:51.250376+0000","last_undegraded":"2024-09-19T08:38:51.250376+0000","last_fullsized":"2024-09-19T08:38:51.250376+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:22.886551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250633+0000","last_change":"2024-09-19T08:38:49.847892+0000","last_active":"2024-09-19T08:38:51.250633+0000","last_peered":"2024-09-19T08:38:51.250633+0000","last_clean":"2024-09-19T08:38:51.250633+0000","last_became_active":"2024-09-19T08:38:49.847328+0000","last_became_peered":"2024-09-19T08:38:49.847328+0000","last_unstale":"2024-09-19T08:38:51.250633+0000","last_undegraded":"2024-09-19T08:38:51.250633+0000","last_fullsized":"2024-09-19T08:38:51.250633+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:51.228891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"51'3","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250119+0000","last_change":"2024-09-19T08:38:48.845062+0000","last_active":"2024-09-19T08:38:51.250119+0000","last_peered":"2024-09-19T08:38:51.250119+0000","last_clean":"2024-09-19T08:38:51.250119+0000","last_became_active":"2024-09-19T08:38:48.844728+0000","last_became_peered":"2024-09-19T08:38:48.844728+0000","last_unstale":"2024-09-19T08:38:51.250119+0000","last_undegraded":"2024-09-19T08:38:51.250119+0000","last_fullsized":"2024-09-19T08:38:51.250119+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:56.675316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.842358+0000","last_change":"2024-09-19T08:38:49.851121+0000","last_active":"2024-09-19T08:38:50.842358+0000","last_peered":"2024-09-19T08:38:50.842358+0000","last_clean":"2024-09-19T08:38:50.842358+0000","last_became_active":"2024-09-19T08:38:49.850869+0000","last_became_peered":"2024-09-19T08:38:49.850869+0000","last_unstale":"2024-09-19T08:38:50.842358+0000","last_undegraded":"2024-09-19T08:38:50.842358+0000","last_fullsized":"2024-09-19T08:38:50.842358+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:59.218345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"51'6","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251831+0000","last_change":"2024-09-19T08:38:48.845625+0000","last_active":"2024-09-19T08:38:51.251831+0000","last_peered":"2024-09-19T08:38:51.251831+0000","last_clean":"2024-09-19T08:38:51.251831+0000","last_became_active":"2024-09-19T08:38:48.845309+0000","last_became_peered":"2024-09-19T08:38:48.845309+0000","last_unstale":"2024-09-19T08:38:51.251831+0000","last_undegraded":"2024-09-19T08:38:51.251831+0000","last_fullsized":"2024-09-19T08:38:51.251831+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:55.500593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.249980+0000","last_change":"2024-09-19T08:38:49.841719+0000","last_active":"2024-09-19T08:38:51.249980+0000","last_peered":"2024-09-19T08:38:51.249980+0000","last_clean":"2024-09-19T08:38:51.249980+0000","last_became_active":"2024-09-19T08:38:49.841454+0000","last_became_peered":"2024-09-19T08:38:49.841454+0000","last_unstale":"2024-09-19T08:38:51.249980+0000","last_undegraded":"2024-09-19T08:38:51.249980+0000","last_fullsized":"2024-09-19T08:38:51.249980+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:01.188222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251028+0000","last_change":"2024-09-19T08:38:48.848241+0000","last_active":"2024-09-19T08:38:51.251028+0000","last_peered":"2024-09-19T08:38:51.251028+0000","last_clean":"2024-09-19T08:38:51.251028+0000","last_became_active":"2024-09-19T08:38:48.847988+0000","last_became_peered":"2024-09-19T08:38:48.847988+0000","last_unstale":"2024-09-19T08:38:51.251028+0000","last_undegraded":"2024-09-19T08:38:51.251028+0000","last_fullsized":"2024-09-19T08:38:51.251028+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:04.274074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251757+0000","last_change":"2024-09-19T08:38:49.858822+0000","last_active":"2024-09-19T08:38:51.251757+0000","last_peered":"2024-09-19T08:38:51.251757+0000","last_clean":"2024-09-19T08:38:51.251757+0000","last_became_active":"2024-09-19T08:38:49.858381+0000","last_became_peered":"2024-09-19T08:38:49.858381+0000","last_unstale":"2024-09-19T08:38:51.251757+0000","last_undegraded":"2024-09-19T08:38:51.251757+0000","last_fullsized":"2024-09-19T08:38:51.251757+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:17.021357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250245+0000","last_change":"2024-09-19T08:38:48.840466+0000","last_active":"2024-09-19T08:38:51.250245+0000","last_peered":"2024-09-19T08:38:51.250245+0000","last_clean":"2024-09-19T08:38:51.250245+0000","last_became_active":"2024-09-19T08:38:48.840150+0000","last_became_peered":"2024-09-19T08:38:48.840150+0000","last_unstale":"2024-09-19T08:38:51.250245+0000","last_undegraded":"2024-09-19T08:38:51.250245+0000","last_fullsized":"2024-09-19T08:38:51.250245+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:42.121107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251264+0000","last_change":"2024-09-19T08:38:49.852949+0000","last_active":"2024-09-19T08:38:51.251264+0000","last_peered":"2024-09-19T08:38:51.251264+0000","last_clean":"2024-09-19T08:38:51.251264+0000","last_became_active":"2024-09-19T08:38:49.852266+0000","last_became_peered":"2024-09-19T08:38:49.852266+0000","last_unstale":"2024-09-19T08:38:51.251264+0000","last_undegraded":"2024-09-19T08:38:51.251264+0000","last_fullsized":"2024-09-19T08:38:51.251264+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:25:35.091420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.842207+0000","last_change":"2024-09-19T08:38:48.848111+0000","last_active":"2024-09-19T08:38:50.842207+0000","last_peered":"2024-09-19T08:38:50.842207+0000","last_clean":"2024-09-19T08:38:50.842207+0000","last_became_active":"2024-09-19T08:38:48.847803+0000","last_became_peered":"2024-09-19T08:38:48.847803+0000","last_unstale":"2024-09-19T08:38:50.842207+0000","last_undegraded":"2024-09-19T08:38:50.842207+0000","last_fullsized":"2024-09-19T08:38:50.842207+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:51.649802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844426+0000","last_change":"2024-09-19T08:38:49.845868+0000","last_active":"2024-09-19T08:38:50.844426+0000","last_peered":"2024-09-19T08:38:50.844426+0000","last_clean":"2024-09-19T08:38:50.844426+0000","last_became_active":"2024-09-19T08:38:49.845600+0000","last_became_peered":"2024-09-19T08:38:49.845600+0000","last_unstale":"2024-09-19T08:38:50.844426+0000","last_undegraded":"2024-09-19T08:38:50.844426+0000","last_fullsized":"2024-09-19T08:38:50.844426+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:32.986371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"51'8","reported_seq":22,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250252+0000","last_change":"2024-09-19T08:38:48.847054+0000","last_active":"2024-09-19T08:38:51.250252+0000","last_peered":"2024-09-19T08:38:51.250252+0000","last_clean":"2024-09-19T08:38:51.250252+0000","last_became_active":"2024-09-19T08:38:48.846733+0000","last_became_peered":"2024-09-19T08:38:48.846733+0000","last_unstale":"2024-09-19T08:38:51.250252+0000","last_undegraded":"2024-09-19T08:38:51.250252+0000","last_fullsized":"2024-09-19T08:38:51.250252+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:07.461886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250111+0000","last_change":"2024-09-19T08:38:49.846486+0000","last_active":"2024-09-19T08:38:51.250111+0000","last_peered":"2024-09-19T08:38:51.250111+0000","last_clean":"2024-09-19T08:38:51.250111+0000","last_became_active":"2024-09-19T08:38:49.846220+0000","last_became_peered":"2024-09-19T08:38:49.846220+0000","last_unstale":"2024-09-19T08:38:51.250111+0000","last_undegraded":"2024-09-19T08:38:51.250111+0000","last_fullsized":"2024-09-19T08:38:51.250111+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:34.315363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251317+0000","last_change":"2024-09-19T08:38:48.846146+0000","last_active":"2024-09-19T08:38:51.251317+0000","last_peered":"2024-09-19T08:38:51.251317+0000","last_clean":"2024-09-19T08:38:51.251317+0000","last_became_active":"2024-09-19T08:38:48.845885+0000","last_became_peered":"2024-09-19T08:38:48.845885+0000","last_unstale":"2024-09-19T08:38:51.251317+0000","last_undegraded":"2024-09-19T08:38:51.251317+0000","last_fullsized":"2024-09-19T08:38:51.251317+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:20:07.203808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250460+0000","last_change":"2024-09-19T08:38:49.851345+0000","last_active":"2024-09-19T08:38:51.250460+0000","last_peered":"2024-09-19T08:38:51.250460+0000","last_clean":"2024-09-19T08:38:51.250460+0000","last_became_active":"2024-09-19T08:38:49.851071+0000","last_became_peered":"2024-09-19T08:38:49.851071+0000","last_unstale":"2024-09-19T08:38:51.250460+0000","last_undegraded":"2024-09-19T08:38:51.250460+0000","last_fullsized":"2024-09-19T08:38:51.250460+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:07.738397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251264+0000","last_change":"2024-09-19T08:38:48.847801+0000","last_active":"2024-09-19T08:38:51.251264+0000","last_peered":"2024-09-19T08:38:51.251264+0000","last_clean":"2024-09-19T08:38:51.251264+0000","last_became_active":"2024-09-19T08:38:48.847514+0000","last_became_peered":"2024-09-19T08:38:48.847514+0000","last_unstale":"2024-09-19T08:38:51.251264+0000","last_undegraded":"2024-09-19T08:38:51.251264+0000","last_fullsized":"2024-09-19T08:38:51.251264+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:49.457995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.842260+0000","last_change":"2024-09-19T08:38:49.842699+0000","last_active":"2024-09-19T08:38:50.842260+0000","last_peered":"2024-09-19T08:38:50.842260+0000","last_clean":"2024-09-19T08:38:50.842260+0000","last_became_active":"2024-09-19T08:38:49.842436+0000","last_became_peered":"2024-09-19T08:38:49.842436+0000","last_unstale":"2024-09-19T08:38:50.842260+0000","last_undegraded":"2024-09-19T08:38:50.842260+0000","last_fullsized":"2024-09-19T08:38:50.842260+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:58.785393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250162+0000","last_change":"2024-09-19T08:38:48.841198+0000","last_active":"2024-09-19T08:38:51.250162+0000","last_peered":"2024-09-19T08:38:51.250162+0000","last_clean":"2024-09-19T08:38:51.250162+0000","last_became_active":"2024-09-19T08:38:48.840886+0000","last_became_peered":"2024-09-19T08:38:48.840886+0000","last_unstale":"2024-09-19T08:38:51.250162+0000","last_undegraded":"2024-09-19T08:38:51.250162+0000","last_fullsized":"2024-09-19T08:38:51.250162+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:30.256341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250771+0000","last_change":"2024-09-19T08:38:49.857362+0000","last_active":"2024-09-19T08:38:51.250771+0000","last_peered":"2024-09-19T08:38:51.250771+0000","last_clean":"2024-09-19T08:38:51.250771+0000","last_became_active":"2024-09-19T08:38:49.857115+0000","last_became_peered":"2024-09-19T08:38:49.857115+0000","last_unstale":"2024-09-19T08:38:51.250771+0000","last_undegraded":"2024-09-19T08:38:51.250771+0000","last_fullsized":"2024-09-19T08:38:51.250771+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:02.520132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.843523+0000","last_change":"2024-09-19T08:38:48.848664+0000","last_active":"2024-09-19T08:38:50.843523+0000","last_peered":"2024-09-19T08:38:50.843523+0000","last_clean":"2024-09-19T08:38:50.843523+0000","last_became_active":"2024-09-19T08:38:48.848356+0000","last_became_peered":"2024-09-19T08:38:48.848356+0000","last_unstale":"2024-09-19T08:38:50.843523+0000","last_undegraded":"2024-09-19T08:38:50.843523+0000","last_fullsized":"2024-09-19T08:38:50.843523+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:47.648762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.843487+0000","last_change":"2024-09-19T08:38:49.846920+0000","last_active":"2024-09-19T08:38:50.843487+0000","last_peered":"2024-09-19T08:38:50.843487+0000","last_clean":"2024-09-19T08:38:50.843487+0000","last_became_active":"2024-09-19T08:38:49.846640+0000","last_became_peered":"2024-09-19T08:38:49.846640+0000","last_unstale":"2024-09-19T08:38:50.843487+0000","last_undegraded":"2024-09-19T08:38:50.843487+0000","last_fullsized":"2024-09-19T08:38:50.843487+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:27.775301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251526+0000","last_change":"2024-09-19T08:38:48.848609+0000","last_active":"2024-09-19T08:38:51.251526+0000","last_peered":"2024-09-19T08:38:51.251526+0000","last_clean":"2024-09-19T08:38:51.251526+0000","last_became_active":"2024-09-19T08:38:48.848279+0000","last_became_peered":"2024-09-19T08:38:48.848279+0000","last_unstale":"2024-09-19T08:38:51.251526+0000","last_undegraded":"2024-09-19T08:38:51.251526+0000","last_fullsized":"2024-09-19T08:38:51.251526+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:58.858465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250067+0000","last_change":"2024-09-19T08:38:49.844866+0000","last_active":"2024-09-19T08:38:51.250067+0000","last_peered":"2024-09-19T08:38:51.250067+0000","last_clean":"2024-09-19T08:38:51.250067+0000","last_became_active":"2024-09-19T08:38:49.844604+0000","last_became_peered":"2024-09-19T08:38:49.844604+0000","last_unstale":"2024-09-19T08:38:51.250067+0000","last_undegraded":"2024-09-19T08:38:51.250067+0000","last_fullsized":"2024-09-19T08:38:51.250067+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:06.598613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844078+0000","last_change":"2024-09-19T08:38:48.843340+0000","last_active":"2024-09-19T08:38:50.844078+0000","last_peered":"2024-09-19T08:38:50.844078+0000","last_clean":"2024-09-19T08:38:50.844078+0000","last_became_active":"2024-09-19T08:38:48.843021+0000","last_became_peered":"2024-09-19T08:38:48.843021+0000","last_unstale":"2024-09-19T08:38:50.844078+0000","last_undegraded":"2024-09-19T08:38:50.844078+0000","last_fullsized":"2024-09-19T08:38:50.844078+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:54.758114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251597+0000","last_change":"2024-09-19T08:38:49.848805+0000","last_active":"2024-09-19T08:38:51.251597+0000","last_peered":"2024-09-19T08:38:51.251597+0000","last_clean":"2024-09-19T08:38:51.251597+0000","last_became_active":"2024-09-19T08:38:49.848521+0000","last_became_peered":"2024-09-19T08:38:49.848521+0000","last_unstale":"2024-09-19T08:38:51.251597+0000","last_undegraded":"2024-09-19T08:38:51.251597+0000","last_fullsized":"2024-09-19T08:38:51.251597+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:24.333204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250631+0000","last_change":"2024-09-19T08:38:48.845655+0000","last_active":"2024-09-19T08:38:51.250631+0000","last_peered":"2024-09-19T08:38:51.250631+0000","last_clean":"2024-09-19T08:38:51.250631+0000","last_became_active":"2024-09-19T08:38:48.845350+0000","last_became_peered":"2024-09-19T08:38:48.845350+0000","last_unstale":"2024-09-19T08:38:51.250631+0000","last_undegraded":"2024-09-19T08:38:51.250631+0000","last_fullsized":"2024-09-19T08:38:51.250631+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:12.741602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251418+0000","last_change":"2024-09-19T08:38:49.854179+0000","last_active":"2024-09-19T08:38:51.251418+0000","last_peered":"2024-09-19T08:38:51.251418+0000","last_clean":"2024-09-19T08:38:51.251418+0000","last_became_active":"2024-09-19T08:38:49.853888+0000","last_became_peered":"2024-09-19T08:38:49.853888+0000","last_unstale":"2024-09-19T08:38:51.251418+0000","last_undegraded":"2024-09-19T08:38:51.251418+0000","last_fullsized":"2024-09-19T08:38:51.251418+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:23.594519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250085+0000","last_change":"2024-09-19T08:38:48.839135+0000","last_active":"2024-09-19T08:38:51.250085+0000","last_peered":"2024-09-19T08:38:51.250085+0000","last_clean":"2024-09-19T08:38:51.250085+0000","last_became_active":"2024-09-19T08:38:48.838831+0000","last_became_peered":"2024-09-19T08:38:48.838831+0000","last_unstale":"2024-09-19T08:38:51.250085+0000","last_undegraded":"2024-09-19T08:38:51.250085+0000","last_fullsized":"2024-09-19T08:38:51.250085+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:24.848238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250386+0000","last_change":"2024-09-19T08:38:49.851797+0000","last_active":"2024-09-19T08:38:51.250386+0000","last_peered":"2024-09-19T08:38:51.250386+0000","last_clean":"2024-09-19T08:38:51.250386+0000","last_became_active":"2024-09-19T08:38:49.851511+0000","last_became_peered":"2024-09-19T08:38:49.851511+0000","last_unstale":"2024-09-19T08:38:51.250386+0000","last_undegraded":"2024-09-19T08:38:51.250386+0000","last_fullsized":"2024-09-19T08:38:51.250386+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:56.505664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.249826+0000","last_change":"2024-09-19T08:38:48.843087+0000","last_active":"2024-09-19T08:38:51.249826+0000","last_peered":"2024-09-19T08:38:51.249826+0000","last_clean":"2024-09-19T08:38:51.249826+0000","last_became_active":"2024-09-19T08:38:48.842831+0000","last_became_peered":"2024-09-19T08:38:48.842831+0000","last_unstale":"2024-09-19T08:38:51.249826+0000","last_undegraded":"2024-09-19T08:38:51.249826+0000","last_fullsized":"2024-09-19T08:38:51.249826+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:03.448865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250837+0000","last_change":"2024-09-19T08:38:49.858565+0000","last_active":"2024-09-19T08:38:51.250837+0000","last_peered":"2024-09-19T08:38:51.250837+0000","last_clean":"2024-09-19T08:38:51.250837+0000","last_became_active":"2024-09-19T08:38:49.857824+0000","last_became_peered":"2024-09-19T08:38:49.857824+0000","last_unstale":"2024-09-19T08:38:51.250837+0000","last_undegraded":"2024-09-19T08:38:51.250837+0000","last_fullsized":"2024-09-19T08:38:51.250837+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:52.093472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250161+0000","last_change":"2024-09-19T08:38:48.845188+0000","last_active":"2024-09-19T08:38:51.250161+0000","last_peered":"2024-09-19T08:38:51.250161+0000","last_clean":"2024-09-19T08:38:51.250161+0000","last_became_active":"2024-09-19T08:38:48.844772+0000","last_became_peered":"2024-09-19T08:38:48.844772+0000","last_unstale":"2024-09-19T08:38:51.250161+0000","last_undegraded":"2024-09-19T08:38:51.250161+0000","last_fullsized":"2024-09-19T08:38:51.250161+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:25:11.135022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844212+0000","last_change":"2024-09-19T08:38:49.846125+0000","last_active":"2024-09-19T08:38:50.844212+0000","last_peered":"2024-09-19T08:38:50.844212+0000","last_clean":"2024-09-19T08:38:50.844212+0000","last_became_active":"2024-09-19T08:38:49.845703+0000","last_became_peered":"2024-09-19T08:38:49.845703+0000","last_unstale":"2024-09-19T08:38:50.844212+0000","last_undegraded":"2024-09-19T08:38:50.844212+0000","last_fullsized":"2024-09-19T08:38:50.844212+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:54.030557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844482+0000","last_change":"2024-09-19T08:38:48.846578+0000","last_active":"2024-09-19T08:38:50.844482+0000","last_peered":"2024-09-19T08:38:50.844482+0000","last_clean":"2024-09-19T08:38:50.844482+0000","last_became_active":"2024-09-19T08:38:48.846308+0000","last_became_peered":"2024-09-19T08:38:48.846308+0000","last_unstale":"2024-09-19T08:38:50.844482+0000","last_undegraded":"2024-09-19T08:38:50.844482+0000","last_fullsized":"2024-09-19T08:38:50.844482+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:54.923768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251714+0000","last_change":"2024-09-19T08:38:49.855479+0000","last_active":"2024-09-19T08:38:51.251714+0000","last_peered":"2024-09-19T08:38:51.251714+0000","last_clean":"2024-09-19T08:38:51.251714+0000","last_became_active":"2024-09-19T08:38:49.855150+0000","last_became_peered":"2024-09-19T08:38:49.855150+0000","last_unstale":"2024-09-19T08:38:51.251714+0000","last_undegraded":"2024-09-19T08:38:51.251714+0000","last_fullsized":"2024-09-19T08:38:51.251714+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:22.270663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251963+0000","last_change":"2024-09-19T08:38:48.846502+0000","last_active":"2024-09-19T08:38:51.251963+0000","last_peered":"2024-09-19T08:38:51.251963+0000","last_clean":"2024-09-19T08:38:51.251963+0000","last_became_active":"2024-09-19T08:38:48.846138+0000","last_became_peered":"2024-09-19T08:38:48.846138+0000","last_unstale":"2024-09-19T08:38:51.251963+0000","last_undegraded":"2024-09-19T08:38:51.251963+0000","last_fullsized":"2024-09-19T08:38:51.251963+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:58.213274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.843396+0000","last_change":"2024-09-19T08:38:49.845503+0000","last_active":"2024-09-19T08:38:50.843396+0000","last_peered":"2024-09-19T08:38:50.843396+0000","last_clean":"2024-09-19T08:38:50.843396+0000","last_became_active":"2024-09-19T08:38:49.845247+0000","last_became_peered":"2024-09-19T08:38:49.845247+0000","last_unstale":"2024-09-19T08:38:50.843396+0000","last_undegraded":"2024-09-19T08:38:50.843396+0000","last_fullsized":"2024-09-19T08:38:50.843396+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:51.228891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.844231+0000","last_change":"2024-09-19T08:38:48.840200+0000","last_active":"2024-09-19T08:38:50.844231+0000","last_peered":"2024-09-19T08:38:50.844231+0000","last_clean":"2024-09-19T08:38:50.844231+0000","last_became_active":"2024-09-19T08:38:48.839660+0000","last_became_peered":"2024-09-19T08:38:48.839660+0000","last_unstale":"2024-09-19T08:38:50.844231+0000","last_undegraded":"2024-09-19T08:38:50.844231+0000","last_fullsized":"2024-09-19T08:38:50.844231+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:05.366264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.251550+0000","last_change":"2024-09-19T08:38:49.858328+0000","last_active":"2024-09-19T08:38:51.251550+0000","last_peered":"2024-09-19T08:38:51.251550+0000","last_clean":"2024-09-19T08:38:51.251550+0000","last_became_active":"2024-09-19T08:38:49.857699+0000","last_became_peered":"2024-09-19T08:38:49.857699+0000","last_unstale":"2024-09-19T08:38:51.251550+0000","last_undegraded":"2024-09-19T08:38:51.251550+0000","last_fullsized":"2024-09-19T08:38:51.251550+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:08.741277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:50.842271+0000","last_change":"2024-09-19T08:38:48.849977+0000","last_active":"2024-09-19T08:38:50.842271+0000","last_peered":"2024-09-19T08:38:50.842271+0000","last_clean":"2024-09-19T08:38:50.842271+0000","last_became_active":"2024-09-19T08:38:48.849707+0000","last_became_peered":"2024-09-19T08:38:48.849707+0000","last_unstale":"2024-09-19T08:38:50.842271+0000","last_undegraded":"2024-09-19T08:38:50.842271+0000","last_fullsized":"2024-09-19T08:38:50.842271+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:43.715182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250629+0000","last_change":"2024-09-19T08:38:49.861491+0000","last_active":"2024-09-19T08:38:51.250629+0000","last_peered":"2024-09-19T08:38:51.250629+0000","last_clean":"2024-09-19T08:38:51.250629+0000","last_became_active":"2024-09-19T08:38:49.861043+0000","last_became_peered":"2024-09-19T08:38:49.861043+0000","last_unstale":"2024-09-19T08:38:51.250629+0000","last_undegraded":"2024-09-19T08:38:51.250629+0000","last_fullsized":"2024-09-19T08:38:51.250629+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:56.910416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250157+0000","last_change":"2024-09-19T08:38:48.839797+0000","last_active":"2024-09-19T08:38:51.250157+0000","last_peered":"2024-09-19T08:38:51.250157+0000","last_clean":"2024-09-19T08:38:51.250157+0000","last_became_active":"2024-09-19T08:38:48.839284+0000","last_became_peered":"2024-09-19T08:38:48.839284+0000","last_unstale":"2024-09-19T08:38:51.250157+0000","last_undegraded":"2024-09-19T08:38:51.250157+0000","last_fullsized":"2024-09-19T08:38:51.250157+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:29.381132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.176673+0000","last_change":"2024-09-19T08:38:49.844787+0000","last_active":"2024-09-19T08:38:51.176673+0000","last_peered":"2024-09-19T08:38:51.176673+0000","last_clean":"2024-09-19T08:38:51.176673+0000","last_became_active":"2024-09-19T08:38:49.844516+0000","last_became_peered":"2024-09-19T08:38:49.844516+0000","last_unstale":"2024-09-19T08:38:51.176673+0000","last_undegraded":"2024-09-19T08:38:51.176673+0000","last_fullsized":"2024-09-19T08:38:51.176673+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:48.819487+0000","last_clean_scrub_stamp":"2024-09-19T08:38:48.819487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:12.682829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"52'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.833624+0000","last_change":"2024-09-19T08:38:48.843795+0000","last_active":"2024-09-19T08:38:51.833624+0000","last_peered":"2024-09-19T08:38:51.833624+0000","last_clean":"2024-09-19T08:38:51.833624+0000","last_became_active":"2024-09-19T08:38:48.843481+0000","last_became_peered":"2024-09-19T08:38:48.843481+0000","last_unstale":"2024-09-19T08:38:51.833624+0000","last_undegraded":"2024-09-19T08:38:51.833624+0000","last_fullsized":"2024-09-19T08:38:51.833624+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:38:47.814416+0000","last_clean_scrub_stamp":"2024-09-19T08:38:47.814416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:57.780322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":222,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-19T08:38:51.250210+0000","last_change":"2024-09-19T08:37:04.479071+0000","last_active":"2024-09-19T08:38:51.250210+0000","last_peered":"2024-09-19T08:38:51.250210+0000","last_clean":"2024-09-19T08:38:51.250210+0000","last_became_active":"2024-09-19T08:37:04.478199+0000","last_became_peered":"2024-09-19T08:37:04.478199+0000","last_unstale":"2024-09-19T08:38:51.250210+0000","last_undegraded":"2024-09-19T08:38:51.250210+0000","last_fullsized":"2024-09-19T08:38:51.250210+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_clean_scrub_stamp":"2024-09-19T08:37:02.519738+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:32.963748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":602112,"data_stored":261611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509466,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1220608,"data_stored":859791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509466,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":630784,"data_stored":269425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":267811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":614400,"data_stored":267755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509467,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28216,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343624,"statfs":{"total":96636764160,"available":96607870976,"internally_reserved":0,"allocated":1208320,"data_stored":858159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":614400,"data_stored":268303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":618496,"data_stored":267777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:38:57.453 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T08:38:57.453 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T08:38:57.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.595+0000 7f3dfcc5e640 1 Processor -- start 2024-09-19T08:38:57.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.595+0000 7f3dfcc5e640 1 -- start start 2024-09-19T08:38:57.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.596+0000 7f3dfcc5e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8155380 0x7f3df80708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:57.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.596+0000 7f3dfcc5e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3df80af860 0x7f3df80afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:57.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.596+0000 7f3dfcc5e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3df80b01c0 con 0x7f3df80add30 2024-09-19T08:38:57.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.596+0000 7f3dfcc5e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f3df815ea50 con 0x7f3df80af860 2024-09-19T08:38:57.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.596+0000 7f3dfcc5e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f3df815ed30 con 0x7f3df8155380 2024-09-19T08:38:57.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.596+0000 7f3deffff640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3df80af860 0x7f3df80afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:57.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.596+0000 7f3deffff640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3df80af860 0x7f3df80afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.117:39960/0 (socket says 172.21.15.117:39960) 2024-09-19T08:38:57.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.596+0000 7f3df6d9d640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3df80add30 0x7f3df80ae180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.117:44528/0 (socket says 172.21.15.117:44528) 2024-09-19T08:38:57.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.596+0000 7f3df659c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8155380 0x7f3df80708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:57.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.596+0000 7f3deffff640 1 -- 172.21.15.117:0/1471655085 learned_addr learned my addr 172.21.15.117:0/1471655085 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:57.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.596+0000 7f3deffff640 1 -- 172.21.15.117:0/1471655085 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8155380 msgr2=0x7f3df80708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:57.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.596+0000 7f3deffff640 1 --2- 172.21.15.117:0/1471655085 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8155380 0x7f3df80708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.596+0000 7f3deffff640 1 -- 172.21.15.117:0/1471655085 >> v1:172.21.15.146:6789/0 conn(0x7f3df80add30 legacy=0x7f3df80ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:57.597 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.596+0000 7f3deffff640 1 -- 172.21.15.117:0/1471655085 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df815f010 con 0x7f3df80af860 2024-09-19T08:38:57.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.597+0000 7f3deffff640 1 --2- 172.21.15.117:0/1471655085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df80af860 0x7f3df80afc80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009870 tx=0x7f3de002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9502641b4bedea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:57.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.597+0000 7f3df5d9b640 1 -- 172.21.15.117:0/1471655085 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de0037070 con 0x7f3df80af860 2024-09-19T08:38:57.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.597+0000 7f3df5d9b640 1 -- 172.21.15.117:0/1471655085 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3de0032440 con 0x7f3df80af860 2024-09-19T08:38:57.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.597+0000 7f3df5d9b640 1 -- 172.21.15.117:0/1471655085 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de0032810 con 0x7f3df80af860 2024-09-19T08:38:57.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.598+0000 7f3dfcc5e640 1 -- 172.21.15.117:0/1471655085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df80af860 msgr2=0x7f3df80afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:57.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.598+0000 7f3dfcc5e640 1 --2- 172.21.15.117:0/1471655085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df80af860 0x7f3df80afc80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009870 tx=0x7f3de002a270 comp rx=0 tx=0).stop 2024-09-19T08:38:57.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.598+0000 7f3dfcc5e640 1 -- 172.21.15.117:0/1471655085 shutdown_connections 2024-09-19T08:38:57.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.598+0000 7f3dfcc5e640 1 --2- 172.21.15.117:0/1471655085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df80af860 0x7f3df80afc80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.598+0000 7f3dfcc5e640 1 --2- 172.21.15.117:0/1471655085 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8155380 0x7f3df80708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.598+0000 7f3dfcc5e640 1 -- 172.21.15.117:0/1471655085 >> 172.21.15.117:0/1471655085 conn(0x7f3df8073480 msgr2=0x7f3df806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:57.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.598+0000 7f3dfcc5e640 1 -- 172.21.15.117:0/1471655085 shutdown_connections 2024-09-19T08:38:57.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.598+0000 7f3dfcc5e640 1 -- 172.21.15.117:0/1471655085 wait complete. 2024-09-19T08:38:57.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.599+0000 7f3dfcc5e640 1 Processor -- start 2024-09-19T08:38:57.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.599+0000 7f3dfcc5e640 1 -- start start 2024-09-19T08:38:57.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.600+0000 7f3dfcc5e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df80add30 0x7f3df8150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:57.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.600+0000 7f3dfcc5e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3df80af860 0x7f3df8156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:57.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.600+0000 7f3dfcc5e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8155380 0x7f3df81524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:57.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.600+0000 7f3dfcc5e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3df8155760 con 0x7f3df80af860 2024-09-19T08:38:57.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.600+0000 7f3dfcc5e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3df815f5d0 con 0x7f3df80add30 2024-09-19T08:38:57.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.600+0000 7f3dfcc5e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f3df8070e00 con 0x7f3df8155380 2024-09-19T08:38:57.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.600+0000 7f3deffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3df80af860 0x7f3df8156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:57.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.600+0000 7f3deffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3df80af860 0x7f3df8156c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58128/0 (socket says 172.21.15.117:58128) 2024-09-19T08:38:57.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.600+0000 7f3deffff640 1 -- 172.21.15.117:0/2469978498 learned_addr learned my addr 172.21.15.117:0/2469978498 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:57.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.600+0000 7f3df6d9d640 1 --2- 172.21.15.117:0/2469978498 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8155380 0x7f3df81524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:57.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.600+0000 7f3deffff640 1 -- 172.21.15.117:0/2469978498 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8155380 msgr2=0x7f3df81524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:57.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.600+0000 7f3deffff640 1 --2- 172.21.15.117:0/2469978498 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8155380 0x7f3df81524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.600+0000 7f3df659c640 1 --2- 172.21.15.117:0/2469978498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df80add30 0x7f3df8150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:57.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.600+0000 7f3deffff640 1 -- 172.21.15.117:0/2469978498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df80add30 msgr2=0x7f3df8150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:57.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.600+0000 7f3deffff640 1 --2- 172.21.15.117:0/2469978498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df80add30 0x7f3df8150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.600+0000 7f3deffff640 1 -- 172.21.15.117:0/2469978498 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df8150fc0 con 0x7f3df80af860 2024-09-19T08:38:57.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.600+0000 7f3df6d9d640 1 --2- 172.21.15.117:0/2469978498 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8155380 0x7f3df81524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:57.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.600+0000 7f3df659c640 1 --2- 172.21.15.117:0/2469978498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df80add30 0x7f3df8150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:57.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.600+0000 7f3deffff640 1 --2- 172.21.15.117:0/2469978498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3df80af860 0x7f3df8156c70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3de0000c00 tx=0x7f3de00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:57.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.601+0000 7f3deeffd640 1 -- 172.21.15.117:0/2469978498 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de0037040 con 0x7f3df80af860 2024-09-19T08:38:57.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.601+0000 7f3deeffd640 1 -- 172.21.15.117:0/2469978498 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3de0042070 con 0x7f3df80af860 2024-09-19T08:38:57.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.601+0000 7f3deeffd640 1 -- 172.21.15.117:0/2469978498 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de0030860 con 0x7f3df80af860 2024-09-19T08:38:57.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.601+0000 7f3dfcc5e640 1 -- 172.21.15.117:0/2469978498 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df814ebc0 con 0x7f3df80af860 2024-09-19T08:38:57.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.601+0000 7f3dfcc5e640 1 -- 172.21.15.117:0/2469978498 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df8156190 con 0x7f3df80af860 2024-09-19T08:38:57.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.602+0000 7f3dfcc5e640 1 -- 172.21.15.117:0/2469978498 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3df80af340 con 0x7f3df80af860 2024-09-19T08:38:57.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.602+0000 7f3deeffd640 1 -- 172.21.15.117:0/2469978498 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3de0030a00 con 0x7f3df80af860 2024-09-19T08:38:57.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.603+0000 7f3deeffd640 1 --2- 172.21.15.117:0/2469978498 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3dd806c2e0 0x7f3dd806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:57.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.603+0000 7f3deeffd640 1 -- 172.21.15.117:0/2469978498 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6130+0+0 (secure 0 0 0) 0x7f3de00abe50 con 0x7f3df80af860 2024-09-19T08:38:57.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.603+0000 7f3df659c640 1 --2- 172.21.15.117:0/2469978498 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3dd806c2e0 0x7f3dd806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:57.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.603+0000 7f3df659c640 1 --2- 172.21.15.117:0/2469978498 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3dd806c2e0 0x7f3dd806e7a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009a20 tx=0x7f3de8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:57.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.607+0000 7f3deeffd640 1 -- 172.21.15.117:0/2469978498 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3de0045360 con 0x7f3df80af860 2024-09-19T08:38:57.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.837+0000 7f3dfcc5e640 1 -- 172.21.15.117:0/2469978498 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f3df806c550 con 0x7f3df80af860 2024-09-19T08:38:57.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.839+0000 7f3deeffd640 1 -- 172.21.15.117:0/2469978498 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f3de007a420 con 0x7f3df80af860 2024-09-19T08:38:57.839 INFO:teuthology.orchestra.run.smithi117.stdout:[client.0] 2024-09-19T08:38:57.839 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQB44utm6+SOJBAAd1SCpjEGh0tRc3cpmnVJDA== 2024-09-19T08:38:57.839 INFO:teuthology.orchestra.run.smithi117.stdout: caps mds = "allow" 2024-09-19T08:38:57.839 INFO:teuthology.orchestra.run.smithi117.stdout: caps mon = "allow r" 2024-09-19T08:38:57.839 INFO:teuthology.orchestra.run.smithi117.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T08:38:57.839 INFO:teuthology.orchestra.run.smithi117.stderr:updated caps for client.0 2024-09-19T08:38:57.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.841+0000 7f3dfcc5e640 1 -- 172.21.15.117:0/2469978498 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3dd806c2e0 msgr2=0x7f3dd806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:57.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.841+0000 7f3dfcc5e640 1 --2- 172.21.15.117:0/2469978498 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3dd806c2e0 0x7f3dd806e7a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009a20 tx=0x7f3de8008040 comp rx=0 tx=0).stop 2024-09-19T08:38:57.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.841+0000 7f3dfcc5e640 1 -- 172.21.15.117:0/2469978498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3df80af860 msgr2=0x7f3df8156c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:57.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.841+0000 7f3dfcc5e640 1 --2- 172.21.15.117:0/2469978498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3df80af860 0x7f3df8156c70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3de0000c00 tx=0x7f3de00046c0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.841+0000 7f3dfcc5e640 1 -- 172.21.15.117:0/2469978498 shutdown_connections 2024-09-19T08:38:57.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.841+0000 7f3dfcc5e640 1 --2- 172.21.15.117:0/2469978498 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f3dd806c2e0 0x7f3dd806e7a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.841+0000 7f3dfcc5e640 1 --2- 172.21.15.117:0/2469978498 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8155380 0x7f3df81524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.841+0000 7f3dfcc5e640 1 --2- 172.21.15.117:0/2469978498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3df80af860 0x7f3df8156c70 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.841+0000 7f3dfcc5e640 1 --2- 172.21.15.117:0/2469978498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df80add30 0x7f3df8150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.841+0000 7f3dfcc5e640 1 -- 172.21.15.117:0/2469978498 >> 172.21.15.117:0/2469978498 conn(0x7f3df8073480 msgr2=0x7f3df8153880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:57.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.841+0000 7f3dfcc5e640 1 -- 172.21.15.117:0/2469978498 shutdown_connections 2024-09-19T08:38:57.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.841+0000 7f3dfcc5e640 1 -- 172.21.15.117:0/2469978498 wait complete. 2024-09-19T08:38:57.854 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:38:57.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.952+0000 7fcc04474640 1 Processor -- start 2024-09-19T08:38:57.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.952+0000 7fcc04474640 1 -- start start 2024-09-19T08:38:57.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.953+0000 7fcc04474640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcbfc0d21f0 0x7fcbfc0d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:57.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.953+0000 7fcc04474640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbfc141ad0 0x7fcbfc141f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:57.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.953+0000 7fcc04474640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbfc0d2b10 con 0x7fcbfc072590 2024-09-19T08:38:57.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.953+0000 7fcc04474640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fcbfc141750 con 0x7fcbfc0d21f0 2024-09-19T08:38:57.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.953+0000 7fcc04474640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fcbfc06d7f0 con 0x7fcbfc141ad0 2024-09-19T08:38:57.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.953+0000 7fcc02210640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcbfc0d21f0 0x7fcbfc0d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:57.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.953+0000 7fcc01a0f640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fcbfc072590 0x7fcbfc06d0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:55386/0 (socket says 172.21.15.117:55386) 2024-09-19T08:38:57.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.953+0000 7fcc01a0f640 1 -- 172.21.15.117:0/4024003722 learned_addr learned my addr 172.21.15.117:0/4024003722 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:57.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.953+0000 7fcc02210640 1 --2- 172.21.15.117:0/4024003722 >> v2:172.21.15.117:3300/0 conn(0x7fcbfc0d21f0 0x7fcbfc0d25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58136/0 (socket says 172.21.15.117:58136) 2024-09-19T08:38:57.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.953+0000 7fcc02210640 1 -- 172.21.15.117:0/4024003722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbfc141ad0 msgr2=0x7fcbfc141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:57.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.953+0000 7fcc02210640 1 --2- 172.21.15.117:0/4024003722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbfc141ad0 0x7fcbfc141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.953+0000 7fcc02210640 1 -- 172.21.15.117:0/4024003722 >> v1:172.21.15.117:6789/0 conn(0x7fcbfc072590 legacy=0x7fcbfc06d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:57.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.953+0000 7fcc02210640 1 -- 172.21.15.117:0/4024003722 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbfc1620b0 con 0x7fcbfc0d21f0 2024-09-19T08:38:57.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.954+0000 7fcc02210640 1 --2- 172.21.15.117:0/4024003722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbfc0d21f0 0x7fcbfc0d25d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcbf80097a0 tx=0x7fcbf802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4ff07ea330028c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:57.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.954+0000 7fcc0120e640 1 -- 172.21.15.117:0/4024003722 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8037070 con 0x7fcbfc0d21f0 2024-09-19T08:38:57.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.954+0000 7fcc0120e640 1 -- 172.21.15.117:0/4024003722 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf802ae50 con 0x7fcbfc0d21f0 2024-09-19T08:38:57.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.954+0000 7fcc0120e640 1 -- 172.21.15.117:0/4024003722 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8032660 con 0x7fcbfc0d21f0 2024-09-19T08:38:57.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.954+0000 7fcc04474640 1 -- 172.21.15.117:0/4024003722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbfc0d21f0 msgr2=0x7fcbfc0d25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:57.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.954+0000 7fcc04474640 1 --2- 172.21.15.117:0/4024003722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbfc0d21f0 0x7fcbfc0d25d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcbf80097a0 tx=0x7fcbf802a100 comp rx=0 tx=0).stop 2024-09-19T08:38:57.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.954+0000 7fcc04474640 1 -- 172.21.15.117:0/4024003722 shutdown_connections 2024-09-19T08:38:57.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.954+0000 7fcc04474640 1 --2- 172.21.15.117:0/4024003722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbfc141ad0 0x7fcbfc141f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.954+0000 7fcc04474640 1 --2- 172.21.15.117:0/4024003722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbfc0d21f0 0x7fcbfc0d25d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.954+0000 7fcc04474640 1 -- 172.21.15.117:0/4024003722 >> 172.21.15.117:0/4024003722 conn(0x7fcbfc0b3ed0 msgr2=0x7fcbfc0b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:57.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.955+0000 7fcc04474640 1 -- 172.21.15.117:0/4024003722 shutdown_connections 2024-09-19T08:38:57.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.955+0000 7fcc04474640 1 -- 172.21.15.117:0/4024003722 wait complete. 2024-09-19T08:38:57.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.956+0000 7fcc04474640 1 Processor -- start 2024-09-19T08:38:57.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.956+0000 7fcc04474640 1 -- start start 2024-09-19T08:38:57.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.956+0000 7fcc04474640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbfc072590 0x7fcbfc140b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:57.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.956+0000 7fcc04474640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbfc0d21f0 0x7fcbfc0b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:57.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.956+0000 7fcc04474640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbfc141ad0 0x7fcbfc15e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:57.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.956+0000 7fcc04474640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcbfc162930 con 0x7fcbfc072590 2024-09-19T08:38:57.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.956+0000 7fcc04474640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcbfc162650 con 0x7fcbfc0d21f0 2024-09-19T08:38:57.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.956+0000 7fcc04474640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fcbfc162c10 con 0x7fcbfc141ad0 2024-09-19T08:38:57.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.956+0000 7fcc02210640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbfc072590 0x7fcbfc140b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:57.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.956+0000 7fcc02210640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbfc072590 0x7fcbfc140b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58140/0 (socket says 172.21.15.117:58140) 2024-09-19T08:38:57.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.956+0000 7fcc02210640 1 -- 172.21.15.117:0/3932000350 learned_addr learned my addr 172.21.15.117:0/3932000350 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:57.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.957+0000 7fcc02210640 1 -- 172.21.15.117:0/3932000350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbfc141ad0 msgr2=0x7fcbfc15e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:57.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.957+0000 7fcc02210640 1 --2- 172.21.15.117:0/3932000350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbfc141ad0 0x7fcbfc15e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.957+0000 7fcc02210640 1 -- 172.21.15.117:0/3932000350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbfc0d21f0 msgr2=0x7fcbfc0b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:57.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.957+0000 7fcc02210640 1 --2- 172.21.15.117:0/3932000350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbfc0d21f0 0x7fcbfc0b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:57.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.957+0000 7fcc02210640 1 -- 172.21.15.117:0/3932000350 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbfc0b5710 con 0x7fcbfc072590 2024-09-19T08:38:57.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.957+0000 7fcc02210640 1 --2- 172.21.15.117:0/3932000350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbfc072590 0x7fcbfc140b40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8000c00 tx=0x7fcbf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:57.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.957+0000 7fcbf2ffd640 1 -- 172.21.15.117:0/3932000350 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8041070 con 0x7fcbfc072590 2024-09-19T08:38:57.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.957+0000 7fcbf2ffd640 1 -- 172.21.15.117:0/3932000350 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf803c670 con 0x7fcbfc072590 2024-09-19T08:38:57.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.957+0000 7fcc04474640 1 -- 172.21.15.117:0/3932000350 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbfc0b59e0 con 0x7fcbfc072590 2024-09-19T08:38:57.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.957+0000 7fcbf2ffd640 1 -- 172.21.15.117:0/3932000350 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8037040 con 0x7fcbfc072590 2024-09-19T08:38:57.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.957+0000 7fcc04474640 1 -- 172.21.15.117:0/3932000350 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbfc0b5fa0 con 0x7fcbfc072590 2024-09-19T08:38:57.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.958+0000 7fcc04474640 1 -- 172.21.15.117:0/3932000350 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbfc075640 con 0x7fcbfc072590 2024-09-19T08:38:57.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.959+0000 7fcbf2ffd640 1 -- 172.21.15.117:0/3932000350 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcbf8044070 con 0x7fcbfc072590 2024-09-19T08:38:57.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.959+0000 7fcbf2ffd640 1 --2- 172.21.15.117:0/3932000350 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcbe006c2b0 0x7fcbe006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:57.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.959+0000 7fcbf2ffd640 1 -- 172.21.15.117:0/3932000350 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6130+0+0 (secure 0 0 0) 0x7fcbf80abd90 con 0x7fcbfc072590 2024-09-19T08:38:57.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.959+0000 7fcc01a0f640 1 --2- 172.21.15.117:0/3932000350 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcbe006c2b0 0x7fcbe006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:57.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.960+0000 7fcc01a0f640 1 --2- 172.21.15.117:0/3932000350 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcbe006c2b0 0x7fcbe006e770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcbec000f60 tx=0x7fcbec007a80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:57.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:57.963+0000 7fcbf2ffd640 1 -- 172.21.15.117:0/3932000350 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcbfc075640 con 0x7fcbfc072590 2024-09-19T08:38:58.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.162+0000 7fcc04474640 1 -- 172.21.15.117:0/3932000350 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcbfc0690c0 con 0x7fcbfc072590 2024-09-19T08:38:58.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.163+0000 7fcbf2ffd640 1 -- 172.21.15.117:0/3932000350 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5232 (secure 0 0 0) 0x7fcbf807a3e0 con 0x7fcbfc072590 2024-09-19T08:38:58.163 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:38:58.163 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"btime":"2024-09-19T08:38:51:840984+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1753143760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1753143760},{"type":"v1","addr":"172.21.15.146:6836","nonce":1753143760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/283458533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":283458533},{"type":"v1","addr":"172.21.15.117:6835","nonce":283458533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3844667733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3844667733},{"type":"v1","addr":"172.21.15.117:6834","nonce":3844667733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:38:49.170502+0000","modified":"2024-09-19T08:38:51.165807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5352":{"gid":5352,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/4230307932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4230307932},{"type":"v1","addr":"172.21.15.146:6837","nonce":4230307932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5352,"qdb_cluster":[5352]},"id":3}]} 2024-09-19T08:38:58.163 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 22 2024-09-19T08:38:58.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.164+0000 7fcc04474640 1 -- 172.21.15.117:0/3932000350 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcbe006c2b0 msgr2=0x7fcbe006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:58.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.164+0000 7fcc04474640 1 --2- 172.21.15.117:0/3932000350 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcbe006c2b0 0x7fcbe006e770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcbec000f60 tx=0x7fcbec007a80 comp rx=0 tx=0).stop 2024-09-19T08:38:58.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.164+0000 7fcc04474640 1 -- 172.21.15.117:0/3932000350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbfc072590 msgr2=0x7fcbfc140b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:58.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.164+0000 7fcc04474640 1 --2- 172.21.15.117:0/3932000350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbfc072590 0x7fcbfc140b40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8000c00 tx=0x7fcbf80046c0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.165+0000 7fcc04474640 1 -- 172.21.15.117:0/3932000350 shutdown_connections 2024-09-19T08:38:58.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.165+0000 7fcc04474640 1 --2- 172.21.15.117:0/3932000350 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcbe006c2b0 0x7fcbe006e770 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.165+0000 7fcc04474640 1 --2- 172.21.15.117:0/3932000350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbfc141ad0 0x7fcbfc15e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.165+0000 7fcc04474640 1 --2- 172.21.15.117:0/3932000350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbfc0d21f0 0x7fcbfc0b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.165+0000 7fcc04474640 1 --2- 172.21.15.117:0/3932000350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbfc072590 0x7fcbfc140b40 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.165+0000 7fcc04474640 1 -- 172.21.15.117:0/3932000350 >> 172.21.15.117:0/3932000350 conn(0x7fcbfc0b3ed0 msgr2=0x7fcbfc15f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:58.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.165+0000 7fcc04474640 1 -- 172.21.15.117:0/3932000350 shutdown_connections 2024-09-19T08:38:58.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.165+0000 7fcc04474640 1 -- 172.21.15.117:0/3932000350 wait complete. 2024-09-19T08:38:58.578 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T08:38:49.170502+0000', 'modified': '2024-09-19T08:38:51.165807+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5352}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5352': {'gid': 5352, 'name': 'b', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6837/4230307932', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6835', 'nonce': 4230307932}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 4230307932}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5352, 'qdb_cluster': [5352]} 2024-09-19T08:38:58.579 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T08:38:58.579 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-19T08:38:58.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.679+0000 7f4bce823640 1 Processor -- start 2024-09-19T08:38:58.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.679+0000 7f4bce823640 1 -- start start 2024-09-19T08:38:58.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.680+0000 7f4bce823640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4bc80d0bc0 0x7f4bc80c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.680+0000 7f4bce823640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bc815b500 con 0x7f4bc815b120 2024-09-19T08:38:58.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.680+0000 7f4bce823640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bc806e940 con 0x7f4bc806f9e0 2024-09-19T08:38:58.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.680+0000 7f4bce823640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f4bc806ec20 con 0x7f4bc80d0bc0 2024-09-19T08:38:58.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.680+0000 7f4bc7fff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f4bc815b120 0x7f4bc806dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:55390/0 (socket says 172.21.15.117:55390) 2024-09-19T08:38:58.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.680+0000 7f4bc7fff640 1 -- 172.21.15.117:0/405785624 learned_addr learned my addr 172.21.15.117:0/405785624 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:38:58.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.680+0000 7f4bccdc0640 1 --2- 172.21.15.117:0/405785624 >> v2:172.21.15.146:3300/0 conn(0x7f4bc80d0bc0 0x7f4bc80c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.680+0000 7f4bc6ffd640 1 -- 172.21.15.117:0/405785624 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3030796174 0 0) 0x7f4bc815b500 con 0x7f4bc815b120 2024-09-19T08:38:58.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc6ffd640 1 -- 172.21.15.117:0/405785624 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bb0003520 con 0x7f4bc815b120 2024-09-19T08:38:58.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc6ffd640 1 -- 172.21.15.117:0/405785624 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3753913991 0 0) 0x7f4bc806e940 con 0x7f4bc806f9e0 2024-09-19T08:38:58.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc6ffd640 1 -- 172.21.15.117:0/405785624 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bc815b500 con 0x7f4bc806f9e0 2024-09-19T08:38:58.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc6ffd640 1 -- 172.21.15.117:0/405785624 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2771373731 0 0) 0x7f4bb0003520 con 0x7f4bc815b120 2024-09-19T08:38:58.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc6ffd640 1 -- 172.21.15.117:0/405785624 >> v2:172.21.15.146:3300/0 conn(0x7f4bc80d0bc0 msgr2=0x7f4bc80c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:58.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc6ffd640 1 --2- 172.21.15.117:0/405785624 >> v2:172.21.15.146:3300/0 conn(0x7f4bc80d0bc0 0x7f4bc80c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc6ffd640 1 -- 172.21.15.117:0/405785624 >> v1:172.21.15.146:6789/0 conn(0x7f4bc806f9e0 legacy=0x7f4bc80d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:58.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc6ffd640 1 -- 172.21.15.117:0/405785624 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc806ef00 con 0x7f4bc815b120 2024-09-19T08:38:58.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc6ffd640 1 -- 172.21.15.117:0/405785624 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f4bb8001670 con 0x7f4bc815b120 2024-09-19T08:38:58.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc6ffd640 1 -- 172.21.15.117:0/405785624 >> v1:172.21.15.117:6789/0 conn(0x7f4bc815b120 legacy=0x7f4bc806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:58.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc6ffd640 1 --2- 172.21.15.117:0/405785624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb0003b40 0x7f4bb0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc6ffd640 1 --2- 172.21.15.117:0/405785624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bb0004800 0x7f4bb0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc6ffd640 1 --2- 172.21.15.117:0/405785624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bb00051c0 0x7f4bb000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc6ffd640 1 -- 172.21.15.117:0/405785624 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc806ec20 con 0x7f4bb0003b40 2024-09-19T08:38:58.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc6ffd640 1 -- 172.21.15.117:0/405785624 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb000c040 con 0x7f4bb00051c0 2024-09-19T08:38:58.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc6ffd640 1 -- 172.21.15.117:0/405785624 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb000c240 con 0x7f4bb0004800 2024-09-19T08:38:58.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc7fff640 1 --2- 172.21.15.117:0/405785624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb0003b40 0x7f4bb0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc77fe640 1 --2- 172.21.15.117:0/405785624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bb0004800 0x7f4bb0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bccdc0640 1 --2- 172.21.15.117:0/405785624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bb00051c0 0x7f4bb000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc7fff640 1 -- 172.21.15.117:0/405785624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bb0004800 msgr2=0x7f4bb0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:58.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc7fff640 1 --2- 172.21.15.117:0/405785624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bb0004800 0x7f4bb0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc7fff640 1 -- 172.21.15.117:0/405785624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bb00051c0 msgr2=0x7f4bb000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:58.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc7fff640 1 --2- 172.21.15.117:0/405785624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bb00051c0 0x7f4bb000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bc7fff640 1 -- 172.21.15.117:0/405785624 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb0003520 con 0x7f4bb0003b40 2024-09-19T08:38:58.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.681+0000 7f4bccdc0640 1 -- 172.21.15.117:0/405785624 reap_dead start 2024-09-19T08:38:58.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.682+0000 7f4bc7fff640 1 --2- 172.21.15.117:0/405785624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb0003b40 0x7f4bb0003f40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800c190 tx=0x7f4bb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1625b0e6b06bb025 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:58.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.682+0000 7f4bc6ffd640 1 -- 172.21.15.117:0/405785624 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8007cc0 con 0x7f4bb0003b40 2024-09-19T08:38:58.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.682+0000 7f4bc6ffd640 1 -- 172.21.15.117:0/405785624 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb8005af0 con 0x7f4bb0003b40 2024-09-19T08:38:58.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.682+0000 7f4bc6ffd640 1 -- 172.21.15.117:0/405785624 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8007070 con 0x7f4bb0003b40 2024-09-19T08:38:58.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.682+0000 7f4bce823640 1 -- 172.21.15.117:0/405785624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb0003b40 msgr2=0x7f4bb0003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:58.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.682+0000 7f4bce823640 1 --2- 172.21.15.117:0/405785624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb0003b40 0x7f4bb0003f40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800c190 tx=0x7f4bb0005830 comp rx=0 tx=0).stop 2024-09-19T08:38:58.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.683+0000 7f4bce823640 1 -- 172.21.15.117:0/405785624 shutdown_connections 2024-09-19T08:38:58.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.683+0000 7f4bce823640 1 --2- 172.21.15.117:0/405785624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bb0003b40 0x7f4bb0003f40 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.683+0000 7f4bce823640 1 -- 172.21.15.117:0/405785624 >> 172.21.15.117:0/405785624 conn(0x7f4bc806bdf0 msgr2=0x7f4bc806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:58.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.683+0000 7f4bce823640 1 -- 172.21.15.117:0/405785624 shutdown_connections 2024-09-19T08:38:58.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.683+0000 7f4bce823640 1 -- 172.21.15.117:0/405785624 wait complete. 2024-09-19T08:38:58.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.684+0000 7f4bce823640 1 Processor -- start 2024-09-19T08:38:58.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.684+0000 7f4bce823640 1 -- start start 2024-09-19T08:38:58.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bce823640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bb0003b40 0x7f4bc814c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bce823640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bc80b34a0 0x7f4bc8143680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bce823640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bc8142af0 0x7f4bc8142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bce823640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc80ce060 con 0x7f4bc8142af0 2024-09-19T08:38:58.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bce823640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc806f4c0 con 0x7f4bc80b34a0 2024-09-19T08:38:58.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bce823640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f4bc80d04b0 con 0x7f4bb0003b40 2024-09-19T08:38:58.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bccdc0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bc8142af0 0x7f4bc8142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bccdc0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bc8142af0 0x7f4bc8142f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58144/0 (socket says 172.21.15.117:58144) 2024-09-19T08:38:58.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bccdc0640 1 -- 172.21.15.117:0/2929564359 learned_addr learned my addr 172.21.15.117:0/2929564359 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:58.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bc7fff640 1 --2- 172.21.15.117:0/2929564359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bb0003b40 0x7f4bc814c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bc77fe640 1 --2- 172.21.15.117:0/2929564359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bc80b34a0 0x7f4bc8143680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bccdc0640 1 -- 172.21.15.117:0/2929564359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bb0003b40 msgr2=0x7f4bc814c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:58.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bccdc0640 1 --2- 172.21.15.117:0/2929564359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bb0003b40 0x7f4bc814c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bccdc0640 1 -- 172.21.15.117:0/2929564359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bc80b34a0 msgr2=0x7f4bc8143680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:58.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bccdc0640 1 --2- 172.21.15.117:0/2929564359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bc80b34a0 0x7f4bc8143680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bccdc0640 1 -- 172.21.15.117:0/2929564359 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc814ca10 con 0x7f4bc8142af0 2024-09-19T08:38:58.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bccdc0640 1 --2- 172.21.15.117:0/2929564359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bc8142af0 0x7f4bc8142f70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4bc80b4c90 tx=0x7f4bc00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:58.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bc4ff9640 1 -- 172.21.15.117:0/2929564359 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0011e10 con 0x7f4bc8142af0 2024-09-19T08:38:58.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bc4ff9640 1 -- 172.21.15.117:0/2929564359 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc001b070 con 0x7f4bc8142af0 2024-09-19T08:38:58.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bce823640 1 -- 172.21.15.117:0/2929564359 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc8143ed0 con 0x7f4bc8142af0 2024-09-19T08:38:58.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bc4ff9640 1 -- 172.21.15.117:0/2929564359 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0003990 con 0x7f4bc8142af0 2024-09-19T08:38:58.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.685+0000 7f4bce823640 1 -- 172.21.15.117:0/2929564359 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc8144490 con 0x7f4bc8142af0 2024-09-19T08:38:58.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.687+0000 7f4bc4ff9640 1 -- 172.21.15.117:0/2929564359 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4bc0005d10 con 0x7f4bc8142af0 2024-09-19T08:38:58.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.687+0000 7f4bc4ff9640 1 --2- 172.21.15.117:0/2929564359 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4bb406c2b0 0x7f4bb406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.687+0000 7f4bc4ff9640 1 -- 172.21.15.117:0/2929564359 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6130+0+0 (secure 0 0 0) 0x7f4bc008b950 con 0x7f4bc8142af0 2024-09-19T08:38:58.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.688+0000 7f4bc7fff640 1 --2- 172.21.15.117:0/2929564359 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4bb406c2b0 0x7f4bb406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.688+0000 7f4bc7fff640 1 --2- 172.21.15.117:0/2929564359 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4bb406c2b0 0x7f4bb406e770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8032000 tx=0x7f4bb8009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:58.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.688+0000 7f4bd15bb740 1 Processor -- start 2024-09-19T08:38:58.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.688+0000 7f4bd15bb740 1 -- start start 2024-09-19T08:38:58.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.689+0000 7f4bd15bb740 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db9272c0 0x5651db96ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.689+0000 7f4bd15bb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db924a80 0x5651db9276a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.689+0000 7f4bd15bb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651db928a50 0x5651db9218b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.689+0000 7f4bd15bb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5651db889520 con 0x5651db924a80 2024-09-19T08:38:58.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.689+0000 7f4bd15bb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5651db8313e0 con 0x5651db928a50 2024-09-19T08:38:58.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.689+0000 7f4bd15bb740 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x5651db8854e0 con 0x5651db9272c0 2024-09-19T08:38:58.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.689+0000 7f4bc77fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db924a80 0x5651db9276a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.689+0000 7f4bc77fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db924a80 0x5651db9276a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58150/0 (socket says 172.21.15.117:58150) 2024-09-19T08:38:58.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.689+0000 7f4bc77fe640 1 -- 172.21.15.117:0/1385569266 learned_addr learned my addr 172.21.15.117:0/1385569266 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:58.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.689+0000 7f4bc7fff640 1 --2- 172.21.15.117:0/1385569266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db9272c0 0x5651db96ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.689+0000 7f4bccdc0640 1 --2- 172.21.15.117:0/1385569266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651db928a50 0x5651db9218b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.689+0000 7f4bc77fe640 1 -- 172.21.15.117:0/1385569266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db9272c0 msgr2=0x5651db96ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:58.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.689+0000 7f4bc77fe640 1 --2- 172.21.15.117:0/1385569266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db9272c0 0x5651db96ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.689+0000 7f4bc77fe640 1 -- 172.21.15.117:0/1385569266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651db928a50 msgr2=0x5651db9218b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:58.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.689+0000 7f4bc77fe640 1 --2- 172.21.15.117:0/1385569266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651db928a50 0x5651db9218b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.689+0000 7f4bc77fe640 1 -- 172.21.15.117:0/1385569266 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651db84c2f0 con 0x5651db924a80 2024-09-19T08:38:58.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.689+0000 7f4bc77fe640 1 --2- 172.21.15.117:0/1385569266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db924a80 0x5651db9276a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc001660 tx=0x7f4bbc001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a735cae65c631130 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:58.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.689+0000 7f4badffb640 1 -- 172.21.15.117:0/1385569266 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc005320 con 0x5651db924a80 2024-09-19T08:38:58.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.689+0000 7f4badffb640 1 -- 172.21.15.117:0/1385569266 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bbc011830 con 0x5651db924a80 2024-09-19T08:38:58.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.689+0000 7f4badffb640 1 -- 172.21.15.117:0/1385569266 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc0119e0 con 0x5651db924a80 2024-09-19T08:38:58.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.690+0000 7f4bd15bb740 1 -- 172.21.15.117:0/1385569266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db924a80 msgr2=0x5651db9276a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:58.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.690+0000 7f4bd15bb740 1 --2- 172.21.15.117:0/1385569266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db924a80 0x5651db9276a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc001660 tx=0x7f4bbc001b20 comp rx=0 tx=0).stop 2024-09-19T08:38:58.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.690+0000 7f4bd15bb740 1 -- 172.21.15.117:0/1385569266 shutdown_connections 2024-09-19T08:38:58.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.690+0000 7f4bd15bb740 1 --2- 172.21.15.117:0/1385569266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651db928a50 0x5651db9218b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.690+0000 7f4bd15bb740 1 --2- 172.21.15.117:0/1385569266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db924a80 0x5651db9276a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.690+0000 7f4bd15bb740 1 --2- 172.21.15.117:0/1385569266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db9272c0 0x5651db96ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.690+0000 7f4bd15bb740 1 -- 172.21.15.117:0/1385569266 >> 172.21.15.117:0/1385569266 conn(0x5651db923a80 msgr2=0x5651db96bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:58.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.690+0000 7f4bd15bb740 1 -- 172.21.15.117:0/1385569266 shutdown_connections 2024-09-19T08:38:58.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.690+0000 7f4bd15bb740 1 -- 172.21.15.117:0/1385569266 wait complete. 2024-09-19T08:38:58.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.691+0000 7f4bd15bb740 1 -- start start 2024-09-19T08:38:58.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.691+0000 7f4bd15bb740 1 Processor -- start 2024-09-19T08:38:58.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4bd15bb740 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db9272c0 0x5651db950bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4bd15bb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651db928a50 0x5651db947170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4bd15bb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db969450 0x5651db96aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4bd15bb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5651db922f20 con 0x5651db969450 2024-09-19T08:38:58.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4bd15bb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5651db812450 con 0x5651db928a50 2024-09-19T08:38:58.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4bd15bb740 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x5651db96d290 con 0x5651db9272c0 2024-09-19T08:38:58.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4bd15bb740 10 client.0 _ll_register_callbacks cb 0x5651db59bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:38:58.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4bccdc0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db969450 0x5651db96aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4bccdc0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db969450 0x5651db96aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58154/0 (socket says 172.21.15.117:58154) 2024-09-19T08:38:58.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4bccdc0640 1 -- 172.21.15.117:0/173927250 learned_addr learned my addr 172.21.15.117:0/173927250 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:58.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4bc77fe640 1 --2- 172.21.15.117:0/173927250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651db928a50 0x5651db947170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4bc7fff640 1 --2- 172.21.15.117:0/173927250 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db9272c0 0x5651db950bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4bccdc0640 1 -- 172.21.15.117:0/173927250 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db9272c0 msgr2=0x5651db950bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:58.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4bccdc0640 1 --2- 172.21.15.117:0/173927250 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db9272c0 0x5651db950bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4bccdc0640 1 -- 172.21.15.117:0/173927250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651db928a50 msgr2=0x5651db947170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:58.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4bccdc0640 1 --2- 172.21.15.117:0/173927250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651db928a50 0x5651db947170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4bccdc0640 1 -- 172.21.15.117:0/173927250 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651db59c2d0 con 0x5651db969450 2024-09-19T08:38:58.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4bccdc0640 1 --2- 172.21.15.117:0/173927250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db969450 0x5651db96aaf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0089d00 tx=0x7f4bc005dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b446ed2c6801abe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:58.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4ba6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-19T08:38:58.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4ba6ffd640 1 -- 172.21.15.117:0/173927250 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0061ff0 con 0x5651db969450 2024-09-19T08:38:58.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4ba6ffd640 1 -- 172.21.15.117:0/173927250 <== mon.0 v2:172.21.15.117:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6130+0+0 (secure 0 0 0) 0x7f4bc0062190 con 0x5651db969450 2024-09-19T08:38:58.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.692+0000 7f4bd15bb740 1 -- 172.21.15.117:0/173927250 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bbc011830 con 0x5651db969450 2024-09-19T08:38:58.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.693+0000 7f4ba6ffd640 1 -- 172.21.15.117:0/173927250 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f4bc0058da0 con 0x5651db969450 2024-09-19T08:38:58.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.693+0000 7f4bd15bb740 10 client.5490 fetch_fsmap learned FSMap version 22 2024-09-19T08:38:58.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.693+0000 7f4bd15bb740 1 -- 172.21.15.117:0/173927250 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x5651db6666b0 con 0x5651db969450 2024-09-19T08:38:58.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.693+0000 7f4ba6ffd640 1 -- 172.21.15.117:0/173927250 <== mon.0 v2:172.21.15.117:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bbc011830 con 0x5651db969450 2024-09-19T08:38:58.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.693+0000 7f4ba6ffd640 1 -- 172.21.15.117:0/173927250 <== mon.0 v2:172.21.15.117:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7f4bc0058f40 con 0x5651db969450 2024-09-19T08:38:58.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.693+0000 7f4bd15bb740 10 client.5490 fetch_fsmap finished waiting for FSMap version 22 2024-09-19T08:38:58.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.693+0000 7f4bd15bb740 10 client.5490 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:38:58.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.693+0000 7f4bd15bb740 20 client.5490 populate_metadata read hostname 'smithi117' 2024-09-19T08:38:58.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.693+0000 7f4bd15bb740 1 --2- 172.21.15.117:0/173927250 >> [v2:172.21.15.146:6835/4230307932,v1:172.21.15.146:6837/4230307932] conn(0x5651db97fd80 0x5651db980160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.693+0000 7f4bd15bb740 4 client.5490 mds_command: new command op to 5352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:38:58.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.693+0000 7f4bd15bb740 1 -- 172.21.15.117:0/173927250 --> [v2:172.21.15.146:6835/4230307932,v1:172.21.15.146:6837/4230307932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651db896c50 con 0x5651db97fd80 2024-09-19T08:38:58.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.693+0000 7f4bc7fff640 1 --2- 172.21.15.117:0/173927250 >> [v2:172.21.15.146:6835/4230307932,v1:172.21.15.146:6837/4230307932] conn(0x5651db97fd80 0x5651db980160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.694+0000 7f4ba6ffd640 10 client.5490 ms_handle_connect on v2:172.21.15.146:6835/4230307932 2024-09-19T08:38:58.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.694+0000 7f4bc7fff640 1 --2- 172.21.15.117:0/173927250 >> [v2:172.21.15.146:6835/4230307932,v1:172.21.15.146:6837/4230307932] conn(0x5651db97fd80 0x5651db980160 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33760444444d0163 server_cookie=d96d1ff7b0ea9534 in_seq=0 out_seq=0 2024-09-19T08:38:58.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.694+0000 7f4ba6ffd640 1 -- 172.21.15.117:0/173927250 <== mds.0 v2:172.21.15.146:6835/4230307932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5651db896c50 con 0x5651db97fd80 2024-09-19T08:38:58.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.694+0000 7f4ba6ffd640 10 client.5490 handle_command_reply: tid=0 2024-09-19T08:38:58.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.694+0000 7f4bd15bb740 1 client.5490 shutdown 2024-09-19T08:38:58.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.694+0000 7f4bd15bb740 1 -- 172.21.15.117:0/173927250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db969450 msgr2=0x5651db96aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:58.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.694+0000 7f4bd15bb740 1 --2- 172.21.15.117:0/173927250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db969450 0x5651db96aaf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0089d00 tx=0x7f4bc005dd90 comp rx=0 tx=0).stop 2024-09-19T08:38:58.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.695+0000 7f4bd15bb740 1 -- 172.21.15.117:0/173927250 shutdown_connections 2024-09-19T08:38:58.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.695+0000 7f4bd15bb740 1 --2- 172.21.15.117:0/173927250 >> [v2:172.21.15.146:6835/4230307932,v1:172.21.15.146:6837/4230307932] conn(0x5651db97fd80 0x5651db980160 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.695+0000 7f4bd15bb740 1 --2- 172.21.15.117:0/173927250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db969450 0x5651db96aaf0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.695+0000 7f4ba6ffd640 0 client.5490 ms_handle_reset on v2:172.21.15.146:6835/4230307932 2024-09-19T08:38:58.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.695+0000 7f4bd15bb740 1 --2- 172.21.15.117:0/173927250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651db928a50 0x5651db947170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.695+0000 7f4bd15bb740 1 --2- 172.21.15.117:0/173927250 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db9272c0 0x5651db950bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.695+0000 7f4bd15bb740 1 -- 172.21.15.117:0/173927250 >> 172.21.15.117:0/173927250 conn(0x5651db924a80 msgr2=0x5651db96f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:58.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.695+0000 7f4bd15bb740 1 -- 172.21.15.117:0/173927250 shutdown_connections 2024-09-19T08:38:58.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.695+0000 7f4bd15bb740 1 -- 172.21.15.117:0/173927250 wait complete. 2024-09-19T08:38:58.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.695+0000 7f4bd15bb740 20 client.5490 trim_cache size 0 max 16384 2024-09-19T08:38:58.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.712+0000 7f4bd15bb740 1 Processor -- start 2024-09-19T08:38:58.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.712+0000 7f4bd15bb740 1 -- start start 2024-09-19T08:38:58.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.713+0000 7f4bd15bb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651db9272c0 0x5651db94f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.713+0000 7f4bd15bb740 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db928a50 0x5651db950a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.713+0000 7f4bd15bb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db969450 0x5651db945f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.713+0000 7f4bd15bb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc81f0eb0 con 0x5651db969450 2024-09-19T08:38:58.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.713+0000 7f4bd15bb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc80aeed0 con 0x5651db9272c0 2024-09-19T08:38:58.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.713+0000 7f4bd15bb740 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f4bc81f0860 con 0x5651db928a50 2024-09-19T08:38:58.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.713+0000 7f4bccdc0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db969450 0x5651db945f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.713+0000 7f4bccdc0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db969450 0x5651db945f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58158/0 (socket says 172.21.15.117:58158) 2024-09-19T08:38:58.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.713+0000 7f4bccdc0640 1 -- 172.21.15.117:0/2188588153 learned_addr learned my addr 172.21.15.117:0/2188588153 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:58.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.713+0000 7f4bc7fff640 1 --2- 172.21.15.117:0/2188588153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651db9272c0 0x5651db94f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.713+0000 7f4bc77fe640 1 --2- 172.21.15.117:0/2188588153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db928a50 0x5651db950a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.713+0000 7f4bccdc0640 1 -- 172.21.15.117:0/2188588153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db928a50 msgr2=0x5651db950a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:58.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.713+0000 7f4bccdc0640 1 --2- 172.21.15.117:0/2188588153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db928a50 0x5651db950a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.713+0000 7f4bccdc0640 1 -- 172.21.15.117:0/2188588153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651db9272c0 msgr2=0x5651db94f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:58.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.713+0000 7f4bccdc0640 1 --2- 172.21.15.117:0/2188588153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651db9272c0 0x5651db94f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.713+0000 7f4bccdc0640 1 -- 172.21.15.117:0/2188588153 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651db947280 con 0x5651db969450 2024-09-19T08:38:58.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.713+0000 7f4bc77fe640 1 --2- 172.21.15.117:0/2188588153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db928a50 0x5651db950a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:58.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.713+0000 7f4bccdc0640 1 --2- 172.21.15.117:0/2188588153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db969450 0x5651db945f40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0055db0 tx=0x7f4bc006e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc4ac127eeb0b49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:58.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.713+0000 7f4bad7fa640 1 -- 172.21.15.117:0/2188588153 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0003d10 con 0x5651db969450 2024-09-19T08:38:58.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.713+0000 7f4bad7fa640 1 -- 172.21.15.117:0/2188588153 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc0058f40 con 0x5651db969450 2024-09-19T08:38:58.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.713+0000 7f4bad7fa640 1 -- 172.21.15.117:0/2188588153 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc00621f0 con 0x5651db969450 2024-09-19T08:38:58.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.714+0000 7f4bd15bb740 1 -- 172.21.15.117:0/2188588153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db969450 msgr2=0x5651db945f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:58.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.714+0000 7f4bd15bb740 1 --2- 172.21.15.117:0/2188588153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db969450 0x5651db945f40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0055db0 tx=0x7f4bc006e000 comp rx=0 tx=0).stop 2024-09-19T08:38:58.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.714+0000 7f4bd15bb740 1 -- 172.21.15.117:0/2188588153 shutdown_connections 2024-09-19T08:38:58.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.714+0000 7f4bd15bb740 1 --2- 172.21.15.117:0/2188588153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db969450 0x5651db945f40 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.714+0000 7f4bd15bb740 1 --2- 172.21.15.117:0/2188588153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db928a50 0x5651db950a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.714+0000 7f4bd15bb740 1 --2- 172.21.15.117:0/2188588153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651db9272c0 0x5651db94f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.714+0000 7f4bd15bb740 1 -- 172.21.15.117:0/2188588153 >> 172.21.15.117:0/2188588153 conn(0x5651db924a80 msgr2=0x5651db96c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:58.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.714+0000 7f4bd15bb740 1 -- 172.21.15.117:0/2188588153 shutdown_connections 2024-09-19T08:38:58.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.714+0000 7f4bd15bb740 1 -- 172.21.15.117:0/2188588153 wait complete. 2024-09-19T08:38:58.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.715+0000 7f4bd15bb740 1 -- start start 2024-09-19T08:38:58.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.715+0000 7f4bd15bb740 1 Processor -- start 2024-09-19T08:38:58.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.715+0000 7f4bd15bb740 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db9272c0 0x5651db950990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.715+0000 7f4bd15bb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651db928a50 0x5651db9e42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.715+0000 7f4bd15bb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db969450 0x5651db97a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.715+0000 7f4bd15bb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5651db948520 con 0x5651db969450 2024-09-19T08:38:58.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4bd15bb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5651db951450 con 0x5651db928a50 2024-09-19T08:38:58.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4bd15bb740 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x5651db9698b0 con 0x5651db9272c0 2024-09-19T08:38:58.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4bd15bb740 10 client.0 _ll_register_callbacks cb 0x7f4bc0055cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:38:58.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4bccdc0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db969450 0x5651db97a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4bccdc0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db969450 0x5651db97a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58162/0 (socket says 172.21.15.117:58162) 2024-09-19T08:38:58.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4bccdc0640 1 -- 172.21.15.117:0/4126010090 learned_addr learned my addr 172.21.15.117:0/4126010090 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:58.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4bc7fff640 1 --2- 172.21.15.117:0/4126010090 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db9272c0 0x5651db950990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4bc77fe640 1 --2- 172.21.15.117:0/4126010090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651db928a50 0x5651db9e42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4bccdc0640 1 -- 172.21.15.117:0/4126010090 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db9272c0 msgr2=0x5651db950990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:58.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4bccdc0640 1 --2- 172.21.15.117:0/4126010090 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db9272c0 0x5651db950990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4bccdc0640 1 -- 172.21.15.117:0/4126010090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651db928a50 msgr2=0x5651db9e42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:58.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4bccdc0640 1 --2- 172.21.15.117:0/4126010090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651db928a50 0x5651db9e42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4bccdc0640 1 -- 172.21.15.117:0/4126010090 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651db982c20 con 0x5651db969450 2024-09-19T08:38:58.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4bc7fff640 1 --2- 172.21.15.117:0/4126010090 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db9272c0 0x5651db950990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:58.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4bc77fe640 1 --2- 172.21.15.117:0/4126010090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651db928a50 0x5651db9e42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:38:58.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4bccdc0640 1 --2- 172.21.15.117:0/4126010090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db969450 0x5651db97a5c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0059650 tx=0x7f4bc0089c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c537f5c6a4f84f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:58.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4ba6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-19T08:38:58.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4ba6ffd640 1 -- 172.21.15.117:0/4126010090 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc007d060 con 0x5651db969450 2024-09-19T08:38:58.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4ba6ffd640 1 -- 172.21.15.117:0/4126010090 <== mon.0 v2:172.21.15.117:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6130+0+0 (secure 0 0 0) 0x7f4bc0071d10 con 0x5651db969450 2024-09-19T08:38:58.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4bd15bb740 1 -- 172.21.15.117:0/4126010090 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bc0058f40 con 0x5651db969450 2024-09-19T08:38:58.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4ba6ffd640 1 -- 172.21.15.117:0/4126010090 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f4bc00556a0 con 0x5651db969450 2024-09-19T08:38:58.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4bd15bb740 10 client.5496 fetch_fsmap learned FSMap version 22 2024-09-19T08:38:58.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4bd15bb740 1 -- 172.21.15.117:0/4126010090 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x5651db9e4820 con 0x5651db969450 2024-09-19T08:38:58.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.716+0000 7f4ba6ffd640 1 -- 172.21.15.117:0/4126010090 <== mon.0 v2:172.21.15.117:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc0058f40 con 0x5651db969450 2024-09-19T08:38:58.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.717+0000 7f4ba6ffd640 1 -- 172.21.15.117:0/4126010090 <== mon.0 v2:172.21.15.117:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7f4bc0055840 con 0x5651db969450 2024-09-19T08:38:58.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.717+0000 7f4bd15bb740 10 client.5496 fetch_fsmap finished waiting for FSMap version 22 2024-09-19T08:38:58.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.717+0000 7f4bd15bb740 10 client.5496 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:38:58.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.717+0000 7f4bd15bb740 20 client.5496 populate_metadata read hostname 'smithi117' 2024-09-19T08:38:58.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.717+0000 7f4bd15bb740 1 --2- 172.21.15.117:0/4126010090 >> [v2:172.21.15.146:6835/4230307932,v1:172.21.15.146:6837/4230307932] conn(0x5651db968860 0x5651db968c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.717+0000 7f4bd15bb740 4 client.5496 mds_command: new command op to 5352 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:38:58.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.717+0000 7f4bd15bb740 1 -- 172.21.15.117:0/4126010090 --> [v2:172.21.15.146:6835/4230307932,v1:172.21.15.146:6837/4230307932] -- command(tid 0: {"prefix": "status"}) -- 0x5651db890fa0 con 0x5651db968860 2024-09-19T08:38:58.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.717+0000 7f4bc7fff640 1 --2- 172.21.15.117:0/4126010090 >> [v2:172.21.15.146:6835/4230307932,v1:172.21.15.146:6837/4230307932] conn(0x5651db968860 0x5651db968c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.717+0000 7f4ba6ffd640 10 client.5496 ms_handle_connect on v2:172.21.15.146:6835/4230307932 2024-09-19T08:38:58.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.717+0000 7f4bc7fff640 1 --2- 172.21.15.117:0/4126010090 >> [v2:172.21.15.146:6835/4230307932,v1:172.21.15.146:6837/4230307932] conn(0x5651db968860 0x5651db968c40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae792c5070b6c0ed server_cookie=4122f110b57669ae in_seq=0 out_seq=0 2024-09-19T08:38:58.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.717+0000 7f4ba6ffd640 1 -- 172.21.15.117:0/4126010090 <== mds.0 v2:172.21.15.146:6835/4230307932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5651db890fa0 con 0x5651db968860 2024-09-19T08:38:58.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.717+0000 7f4ba6ffd640 10 client.5496 handle_command_reply: tid=0 2024-09-19T08:38:58.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.717+0000 7f4bd15bb740 1 client.5496 shutdown 2024-09-19T08:38:58.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bd15bb740 1 -- 172.21.15.117:0/4126010090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db969450 msgr2=0x5651db97a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:58.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bd15bb740 1 --2- 172.21.15.117:0/4126010090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db969450 0x5651db97a5c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0059650 tx=0x7f4bc0089c30 comp rx=0 tx=0).stop 2024-09-19T08:38:58.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bd15bb740 1 -- 172.21.15.117:0/4126010090 shutdown_connections 2024-09-19T08:38:58.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bd15bb740 1 --2- 172.21.15.117:0/4126010090 >> [v2:172.21.15.146:6835/4230307932,v1:172.21.15.146:6837/4230307932] conn(0x5651db968860 0x5651db968c40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bd15bb740 1 --2- 172.21.15.117:0/4126010090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5651db969450 0x5651db97a5c0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4ba6ffd640 0 client.5496 ms_handle_reset on v2:172.21.15.146:6835/4230307932 2024-09-19T08:38:58.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bd15bb740 1 --2- 172.21.15.117:0/4126010090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651db928a50 0x5651db9e42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bd15bb740 1 --2- 172.21.15.117:0/4126010090 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5651db9272c0 0x5651db950990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bd15bb740 1 -- 172.21.15.117:0/4126010090 >> 172.21.15.117:0/4126010090 conn(0x5651db924a80 msgr2=0x5651db947480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:58.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bd15bb740 1 -- 172.21.15.117:0/4126010090 shutdown_connections 2024-09-19T08:38:58.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bd15bb740 1 -- 172.21.15.117:0/4126010090 wait complete. 2024-09-19T08:38:58.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bd15bb740 20 client.5496 trim_cache size 0 max 16384 2024-09-19T08:38:58.729 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T08:38:58.729 INFO:teuthology.orchestra.run.smithi117.stdout: "cluster_fsid": "3be30853-f236-48ec-b905-15ecac86fc3f", 2024-09-19T08:38:58.729 INFO:teuthology.orchestra.run.smithi117.stdout: "whoami": 0, 2024-09-19T08:38:58.729 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 5352, 2024-09-19T08:38:58.729 INFO:teuthology.orchestra.run.smithi117.stdout: "want_state": "up:active", 2024-09-19T08:38:58.730 INFO:teuthology.orchestra.run.smithi117.stdout: "state": "up:active", 2024-09-19T08:38:58.730 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs", 2024-09-19T08:38:58.730 INFO:teuthology.orchestra.run.smithi117.stdout: "rank_uptime": 8.8905776270000008, 2024-09-19T08:38:58.730 INFO:teuthology.orchestra.run.smithi117.stdout: "mdsmap_epoch": 22, 2024-09-19T08:38:58.730 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_epoch": 54, 2024-09-19T08:38:58.730 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_epoch_barrier": 52, 2024-09-19T08:38:58.730 INFO:teuthology.orchestra.run.smithi117.stdout: "uptime": 12.947208602 2024-09-19T08:38:58.730 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T08:38:58.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bce823640 1 -- 172.21.15.117:0/2929564359 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4bb406c2b0 msgr2=0x7f4bb406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:58.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bce823640 1 --2- 172.21.15.117:0/2929564359 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4bb406c2b0 0x7f4bb406e770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8032000 tx=0x7f4bb8009030 comp rx=0 tx=0).stop 2024-09-19T08:38:58.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bce823640 1 -- 172.21.15.117:0/2929564359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bc8142af0 msgr2=0x7f4bc8142f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:58.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bce823640 1 --2- 172.21.15.117:0/2929564359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bc8142af0 0x7f4bc8142f70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4bc80b4c90 tx=0x7f4bc00115a0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bce823640 1 -- 172.21.15.117:0/2929564359 shutdown_connections 2024-09-19T08:38:58.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bce823640 1 --2- 172.21.15.117:0/2929564359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4bc8142af0 0x7f4bc8142f70 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bce823640 1 --2- 172.21.15.117:0/2929564359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bc80b34a0 0x7f4bc8143680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bce823640 1 --2- 172.21.15.117:0/2929564359 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4bb406c2b0 0x7f4bb406e770 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bce823640 1 --2- 172.21.15.117:0/2929564359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bb0003b40 0x7f4bc814c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bce823640 1 -- 172.21.15.117:0/2929564359 >> 172.21.15.117:0/2929564359 conn(0x7f4bc806bdf0 msgr2=0x7f4bc814ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:58.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bce823640 1 -- 172.21.15.117:0/2929564359 shutdown_connections 2024-09-19T08:38:58.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.718+0000 7f4bce823640 1 -- 172.21.15.117:0/2929564359 wait complete. 2024-09-19T08:38:58.734 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T08:38:58.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.832+0000 7f1032f9f640 1 Processor -- start 2024-09-19T08:38:58.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.832+0000 7f1032f9f640 1 -- start start 2024-09-19T08:38:58.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.833+0000 7f1032f9f640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f102c0d2b10 0x7f102c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.833+0000 7f1032f9f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f102c0b2e60 0x7f102c0b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.833+0000 7f1032f9f640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f102c0cf430 con 0x7f102c1618d0 2024-09-19T08:38:58.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.833+0000 7f1032f9f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f102c0cf710 con 0x7f102c0b2e60 2024-09-19T08:38:58.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.833+0000 7f1032f9f640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f102c0cf9f0 con 0x7f102c0d2b10 2024-09-19T08:38:58.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.833+0000 7f103279e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f102c0b2e60 0x7f102c0b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.833+0000 7f103279e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f102c0b2e60 0x7f102c0b0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58166/0 (socket says 172.21.15.117:58166) 2024-09-19T08:38:58.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.833+0000 7f103279e640 1 -- 172.21.15.117:0/436465928 learned_addr learned my addr 172.21.15.117:0/436465928 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:58.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.833+0000 7f103179c640 1 --2- 172.21.15.117:0/436465928 >> v2:172.21.15.146:3300/0 conn(0x7f102c0d2b10 0x7f102c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.833+0000 7f103279e640 1 -- 172.21.15.117:0/436465928 >> v2:172.21.15.146:3300/0 conn(0x7f102c0d2b10 msgr2=0x7f102c0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:38:58.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.833+0000 7f103279e640 1 --2- 172.21.15.117:0/436465928 >> v2:172.21.15.146:3300/0 conn(0x7f102c0d2b10 0x7f102c0cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.833+0000 7f103279e640 1 -- 172.21.15.117:0/436465928 >> v1:172.21.15.146:6789/0 conn(0x7f102c1618d0 legacy=0x7f102c0d2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:58.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.833+0000 7f103279e640 1 -- 172.21.15.117:0/436465928 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f102c0cfcd0 con 0x7f102c0b2e60 2024-09-19T08:38:58.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.833+0000 7f103179c640 1 --2- 172.21.15.117:0/436465928 >> v2:172.21.15.146:3300/0 conn(0x7f102c0d2b10 0x7f102c0cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:58.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.834+0000 7f103279e640 1 --2- 172.21.15.117:0/436465928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f102c0b2e60 0x7f102c0b0e00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f102c08db80 tx=0x7f102802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4babc59345c2a9b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:58.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.834+0000 7f1030f9b640 1 -- 172.21.15.117:0/436465928 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1028037070 con 0x7f102c0b2e60 2024-09-19T08:38:58.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.834+0000 7f1030f9b640 1 -- 172.21.15.117:0/436465928 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1028032440 con 0x7f102c0b2e60 2024-09-19T08:38:58.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.834+0000 7f1030f9b640 1 -- 172.21.15.117:0/436465928 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1028032810 con 0x7f102c0b2e60 2024-09-19T08:38:58.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.835+0000 7f1032f9f640 1 -- 172.21.15.117:0/436465928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f102c0b2e60 msgr2=0x7f102c0b0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:58.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.835+0000 7f1032f9f640 1 --2- 172.21.15.117:0/436465928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f102c0b2e60 0x7f102c0b0e00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f102c08db80 tx=0x7f102802a270 comp rx=0 tx=0).stop 2024-09-19T08:38:58.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.835+0000 7f1032f9f640 1 -- 172.21.15.117:0/436465928 shutdown_connections 2024-09-19T08:38:58.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.835+0000 7f1032f9f640 1 --2- 172.21.15.117:0/436465928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f102c0b2e60 0x7f102c0b0e00 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.835+0000 7f1032f9f640 1 --2- 172.21.15.117:0/436465928 >> v2:172.21.15.146:3300/0 conn(0x7f102c0d2b10 0x7f102c0cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.835+0000 7f1032f9f640 1 -- 172.21.15.117:0/436465928 >> 172.21.15.117:0/436465928 conn(0x7f102c09d510 msgr2=0x7f102c0d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:58.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.835+0000 7f1032f9f640 1 -- 172.21.15.117:0/436465928 shutdown_connections 2024-09-19T08:38:58.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.835+0000 7f1032f9f640 1 -- 172.21.15.117:0/436465928 wait complete. 2024-09-19T08:38:58.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.836+0000 7f1032f9f640 1 Processor -- start 2024-09-19T08:38:58.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.836+0000 7f1032f9f640 1 -- start start 2024-09-19T08:38:58.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f1032f9f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f102c0b2e60 0x7f102c15b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f1032f9f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f102c0d2b10 0x7f102c0cda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f1032f9f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f102c1618d0 0x7f102c0cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f1032f9f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f102c0d3200 con 0x7f102c1618d0 2024-09-19T08:38:58.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f1032f9f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f102c0d3080 con 0x7f102c0d2b10 2024-09-19T08:38:58.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f1032f9f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f102c161cb0 con 0x7f102c0b2e60 2024-09-19T08:38:58.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f103279e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f102c1618d0 0x7f102c0cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f103279e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f102c1618d0 0x7f102c0cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58182/0 (socket says 172.21.15.117:58182) 2024-09-19T08:38:58.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f103279e640 1 -- 172.21.15.117:0/1283209427 learned_addr learned my addr 172.21.15.117:0/1283209427 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:38:58.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f103179c640 1 --2- 172.21.15.117:0/1283209427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f102c0d2b10 0x7f102c0cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f1031f9d640 1 --2- 172.21.15.117:0/1283209427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f102c0b2e60 0x7f102c15b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f103279e640 1 -- 172.21.15.117:0/1283209427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f102c0b2e60 msgr2=0x7f102c15b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:58.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f103279e640 1 --2- 172.21.15.117:0/1283209427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f102c0b2e60 0x7f102c15b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f103279e640 1 -- 172.21.15.117:0/1283209427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f102c0d2b10 msgr2=0x7f102c0cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:58.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f103279e640 1 --2- 172.21.15.117:0/1283209427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f102c0d2b10 0x7f102c0cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:58.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f103279e640 1 -- 172.21.15.117:0/1283209427 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f102c0b9bc0 con 0x7f102c1618d0 2024-09-19T08:38:58.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f103179c640 1 --2- 172.21.15.117:0/1283209427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f102c0d2b10 0x7f102c0cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:38:58.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f103279e640 1 --2- 172.21.15.117:0/1283209427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f102c1618d0 0x7f102c0cdfb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f10280090b0 tx=0x7f10280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:58.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f10227fc640 1 -- 172.21.15.117:0/1283209427 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1028037040 con 0x7f102c1618d0 2024-09-19T08:38:58.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f10227fc640 1 -- 172.21.15.117:0/1283209427 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1028042070 con 0x7f102c1618d0 2024-09-19T08:38:58.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f1032f9f640 1 -- 172.21.15.117:0/1283209427 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f102c0b8b20 con 0x7f102c1618d0 2024-09-19T08:38:58.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.837+0000 7f10227fc640 1 -- 172.21.15.117:0/1283209427 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1028030920 con 0x7f102c1618d0 2024-09-19T08:38:58.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.838+0000 7f1032f9f640 1 -- 172.21.15.117:0/1283209427 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f102c0b90e0 con 0x7f102c1618d0 2024-09-19T08:38:58.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.838+0000 7f1032f9f640 1 -- 172.21.15.117:0/1283209427 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f102c073710 con 0x7f102c1618d0 2024-09-19T08:38:58.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.839+0000 7f10227fc640 1 -- 172.21.15.117:0/1283209427 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1028030ac0 con 0x7f102c1618d0 2024-09-19T08:38:58.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.839+0000 7f10227fc640 1 --2- 172.21.15.117:0/1283209427 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f101006c2b0 0x7f101006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:38:58.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.839+0000 7f10227fc640 1 -- 172.21.15.117:0/1283209427 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6130+0+0 (secure 0 0 0) 0x7f10280abf20 con 0x7f102c1618d0 2024-09-19T08:38:58.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.840+0000 7f1031f9d640 1 --2- 172.21.15.117:0/1283209427 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f101006c2b0 0x7f101006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:38:58.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.840+0000 7f1031f9d640 1 --2- 172.21.15.117:0/1283209427 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f101006c2b0 0x7f101006e770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1024001ca0 tx=0x7f1024009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:38:58.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:58.844+0000 7f10227fc640 1 -- 172.21.15.117:0/1283209427 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f102c073710 con 0x7f102c1618d0 2024-09-19T08:38:59.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:59.043+0000 7f1032f9f640 1 -- 172.21.15.117:0/1283209427 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f102c0b1b90 con 0x7f102c1618d0 2024-09-19T08:38:59.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:59.043+0000 7f10227fc640 1 -- 172.21.15.117:0/1283209427 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) ==== 53+0+73 (secure 0 0 0) 0x7f1028079e90 con 0x7f102c1618d0 2024-09-19T08:38:59.043 INFO:teuthology.orchestra.run.smithi117.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T08:38:59.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:59.045+0000 7f1032f9f640 1 -- 172.21.15.117:0/1283209427 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f101006c2b0 msgr2=0x7f101006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:59.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:59.045+0000 7f1032f9f640 1 --2- 172.21.15.117:0/1283209427 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f101006c2b0 0x7f101006e770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1024001ca0 tx=0x7f1024009040 comp rx=0 tx=0).stop 2024-09-19T08:38:59.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:59.045+0000 7f1032f9f640 1 -- 172.21.15.117:0/1283209427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f102c1618d0 msgr2=0x7f102c0cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:38:59.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:59.045+0000 7f1032f9f640 1 --2- 172.21.15.117:0/1283209427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f102c1618d0 0x7f102c0cdfb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f10280090b0 tx=0x7f10280046c0 comp rx=0 tx=0).stop 2024-09-19T08:38:59.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:59.045+0000 7f1032f9f640 1 -- 172.21.15.117:0/1283209427 shutdown_connections 2024-09-19T08:38:59.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:59.045+0000 7f1032f9f640 1 --2- 172.21.15.117:0/1283209427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f102c1618d0 0x7f102c0cdfb0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:59.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:59.045+0000 7f1032f9f640 1 --2- 172.21.15.117:0/1283209427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f102c0d2b10 0x7f102c0cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:59.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:59.045+0000 7f1032f9f640 1 --2- 172.21.15.117:0/1283209427 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f101006c2b0 0x7f101006e770 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:59.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:59.045+0000 7f1032f9f640 1 --2- 172.21.15.117:0/1283209427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f102c0b2e60 0x7f102c15b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:38:59.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:59.045+0000 7f1032f9f640 1 -- 172.21.15.117:0/1283209427 >> 172.21.15.117:0/1283209427 conn(0x7f102c09d510 msgr2=0x7f102c06e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:38:59.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:59.045+0000 7f1032f9f640 1 -- 172.21.15.117:0/1283209427 shutdown_connections 2024-09-19T08:38:59.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:59.045+0000 7f1032f9f640 1 -- 172.21.15.117:0/1283209427 wait complete. 2024-09-19T08:38:59.056 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T08:38:59.056 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T08:38:59.056 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2024-09-19T08:38:59.056 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T08:38:59.057 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T08:38:59.057 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T08:38:59.057 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T08:38:59.057 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T08:38:59.057 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T08:38:59.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:59.057 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2024-09-19T08:38:59.074 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T08:38:59.074 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T08:38:59.074 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T08:38:59.074 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:38:59.074 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-09-19T08:38:59.074 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:38:59.074 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:38:59.074 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2024-09-19T08:38:59.074 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2024-09-19T08:38:59.074 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:38:59.074 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2024-09-19T08:38:59.075 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2024-09-19T08:38:59.075 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:38:59.075 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:38:59.075 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T08:38:59.075 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:38:59.075 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T08:38:59.075 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42689sec preferred_lft 42689sec 2024-09-19T08:38:59.075 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link noprefixroute 2024-09-19T08:38:59.075 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:38:59.075 INFO:teuthology.orchestra.run.smithi117.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T08:38:59.075 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 3e:bb:c2:de:61:b2 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:38:59.075 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T08:38:59.075 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:38:59.075 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c454:b1ff:fe51:4d57/64 scope link 2024-09-19T08:38:59.076 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:38:59.076 INFO:teuthology.orchestra.run.smithi117.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T08:38:59.076 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 3e:bb:c2:de:61:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:38:59.076 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::3cbb:c2ff:fede:61b2/64 scope link 2024-09-19T08:38:59.076 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:38:59.076 INFO:teuthology.orchestra.run.smithi117.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T08:38:59.076 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether b2:58:c7:32:45:fe brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T08:38:59.076 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::b058:c7ff:fe32:45fe/64 scope link 2024-09-19T08:38:59.076 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:38:59.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:59.077 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T08:38:59.137 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-09-19T08:38:59.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:59.139 DEBUG:teuthology.orchestra.run.smithi117:> route 2024-09-19T08:38:59.196 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2024-09-19T08:38:59.196 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T08:38:59.196 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T08:38:59.196 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T08:38:59.196 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T08:38:59.196 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:38:59.196 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-09-19T08:38:59.197 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T08:38:59.197 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T08:38:59.197 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T08:38:59.197 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-09-19T08:38:59.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:38:59.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:38:59.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:59.322 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-09-19T08:38:59.337 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T08:38:59.337 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T08:38:59.337 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T08:38:59.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:59.338 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2024-09-19T08:38:59.403 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-19T08:38:59.403 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:38:59.403 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T08:38:59.458 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T08:38:59.458 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:38:59.459 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T08:38:59.514 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-09-19T08:38:59.580 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T08:38:59.636 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-09-19T08:38:59.637 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-09-19T08:38:59.637 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-09-19T08:38:59.637 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-09-19T08:38:59.637 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-09-19T08:38:59.637 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-09-19T08:38:59.637 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-09-19T08:38:59.637 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-09-19T08:38:59.637 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-09-19T08:38:59.638 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-09-19T08:38:59.638 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-09-19T08:38:59.638 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-09-19T08:38:59.638 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:38:59.638 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-09-19T08:38:59.638 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-09-19T08:38:59.638 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-09-19T08:38:59.638 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-09-19T08:38:59.638 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-09-19T08:38:59.638 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T08:38:59.638 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-09-19T08:38:59.638 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T08:38:59.638 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T08:38:59.639 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T08:38:59.639 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-09-19T08:38:59.639 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-09-19T08:38:59.639 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T08:38:59.639 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T08:38:59.639 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T08:38:59.639 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T08:38:59.639 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-09-19T08:38:59.639 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:38:59.639 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:38:59.639 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T08:38:59.639 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T08:38:59.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:59.640 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-09-19T08:38:59.692 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T08:38:59.693 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-19T08:38:59.735 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-09-19T08:38:59.760 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T08:38:59.816 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi117.stderr:2024-09-19T08:38:59.816+0000 7f1d0131b480 -1 init, newargv = 0x55d46e353980 newargc=15 2024-09-19T08:38:59.816 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi117.stderr:ceph-fuse[52401]: starting ceph client 2024-09-19T08:38:59.817 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-09-19T08:38:59.817 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-09-19T08:38:59.817 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-09-19T08:38:59.817 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-09-19T08:38:59.817 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-09-19T08:38:59.817 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-09-19T08:38:59.818 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-09-19T08:38:59.818 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-09-19T08:38:59.818 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-09-19T08:38:59.818 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-09-19T08:38:59.818 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-09-19T08:38:59.818 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-09-19T08:38:59.818 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T08:38:59.818 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-09-19T08:38:59.818 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-09-19T08:38:59.818 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-09-19T08:38:59.818 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-09-19T08:38:59.818 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-09-19T08:38:59.818 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T08:38:59.818 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-09-19T08:38:59.819 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T08:38:59.819 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T08:38:59.819 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T08:38:59.819 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-09-19T08:38:59.819 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-09-19T08:38:59.819 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-0 2024-09-19T08:38:59.819 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-1 2024-09-19T08:38:59.819 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-2 2024-09-19T08:38:59.819 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph/osd/ceph-3 2024-09-19T08:38:59.819 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-09-19T08:38:59.819 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:38:59.819 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:38:59.819 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T08:38:59.819 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T08:38:59.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:59.820 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-09-19T08:38:59.821 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi117.stderr:ceph-fuse[52401]: starting fuse 2024-09-19T08:38:59.835 INFO:teuthology.orchestra.run.smithi117.stdout:41 2024-09-19T08:38:59.835 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-19T08:38:59.836 DEBUG:teuthology.orchestra.run.smithi117:> sudo stdin-killer -- python3 -c ' 2024-09-19T08:38:59.836 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2024-09-19T08:38:59.836 DEBUG:teuthology.orchestra.run.smithi117:> import re 2024-09-19T08:38:59.836 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-09-19T08:38:59.836 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2024-09-19T08:38:59.836 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:38:59.836 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2024-09-19T08:38:59.836 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T08:38:59.836 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2024-09-19T08:38:59.836 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T08:38:59.836 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:38:59.836 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2024-09-19T08:38:59.836 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2024-09-19T08:38:59.837 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2024-09-19T08:38:59.837 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2024-09-19T08:38:59.837 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:38:59.837 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2024-09-19T08:38:59.837 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T08:38:59.837 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T08:38:59.837 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T08:38:59.837 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2024-09-19T08:38:59.837 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2024-09-19T08:38:59.837 DEBUG:teuthology.orchestra.run.smithi117:> return f 2024-09-19T08:38:59.837 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T08:38:59.837 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:38:59.837 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.0")) 2024-09-19T08:38:59.837 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-09-19T08:38:59.953 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.0.52401.asok 2024-09-19T08:38:59.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:38:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:38:59.963 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.52401.asok 2024-09-19T08:38:59.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:38:59.964 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.52401.asok status 2024-09-19T08:39:00.097 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T08:39:00.097 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2024-09-19T08:39:00.097 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T08:39:00.097 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:39:00.097 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "0", 2024-09-19T08:39:00.097 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2024-09-19T08:39:00.097 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T08:39:00.097 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "52401", 2024-09-19T08:39:00.097 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2024-09-19T08:39:00.097 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:39:00.098 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2024-09-19T08:39:00.098 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2024-09-19T08:39:00.098 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 5508, 2024-09-19T08:39:00.098 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2024-09-19T08:39:00.098 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2024-09-19T08:39:00.098 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2024-09-19T08:39:00.098 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 5508 2024-09-19T08:39:00.098 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:39:00.098 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-09-19T08:39:00.098 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-09-19T08:39:00.098 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-09-19T08:39:00.098 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 174078515 2024-09-19T08:39:00.099 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T08:39:00.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:39:00.099 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-09-19T08:39:00.099 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-09-19T08:39:00.099 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-09-19T08:39:00.099 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 174078515 2024-09-19T08:39:00.099 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T08:39:00.099 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.5508 192.168.0.1:0/174078515", 2024-09-19T08:39:00.099 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/174078515", 2024-09-19T08:39:00.099 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2024-09-19T08:39:00.099 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 22, 2024-09-19T08:39:00.099 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 54, 2024-09-19T08:39:00.100 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2024-09-19T08:39:00.100 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2024-09-19T08:39:00.100 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2024-09-19T08:39:00.100 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T08:39:00.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:39:00.106 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2024-09-19T08:39:00.106 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T08:39:00.122 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2024-09-19T08:39:00.122 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T08:39:00.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:39:00.122 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T08:39:00.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:39:00.189 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2024-09-19T08:39:00.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:39:00.252 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2024-09-19T08:39:00.311 DEBUG:teuthology.orchestra.run.smithi117:> stdin-killer -- python3 -c ' 2024-09-19T08:39:00.311 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-09-19T08:39:00.311 DEBUG:teuthology.orchestra.run.smithi117:> import stat 2024-09-19T08:39:00.311 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T08:39:00.311 DEBUG:teuthology.orchestra.run.smithi117:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2024-09-19T08:39:00.311 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-09-19T08:39:00.416 INFO:teuthology.orchestra.run.smithi117.stdout:1099511627777 2024-09-19T08:39:00.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:39:00.425 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:39:00.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.564+0000 7fee4ff4b640 1 Processor -- start 2024-09-19T08:39:00.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.564+0000 7fee4ff4b640 1 -- start start 2024-09-19T08:39:00.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.565+0000 7fee4ff4b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fee480cd040 0x7fee481653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:00.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.565+0000 7fee4ff4b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee480b4540 con 0x7fee480c5b00 2024-09-19T08:39:00.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.565+0000 7fee4ff4b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee480cf9b0 con 0x7fee4815a7b0 2024-09-19T08:39:00.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.565+0000 7fee4ff4b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fee480b4870 con 0x7fee480cd040 2024-09-19T08:39:00.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.565+0000 7fee4e4e8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fee480cd040 0x7fee481653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:00.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.565+0000 7fee4d4e6640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fee480c5b00 0x7fee480cc930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:55394/0 (socket says 172.21.15.117:55394) 2024-09-19T08:39:00.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.565+0000 7fee4d4e6640 1 -- 172.21.15.117:0/2334131019 learned_addr learned my addr 172.21.15.117:0/2334131019 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:00.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.565+0000 7fee4e4e8640 1 -- 172.21.15.117:0/2334131019 >> v1:172.21.15.146:6789/0 conn(0x7fee4815a7b0 legacy=0x7fee480cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:00.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.565+0000 7fee4e4e8640 1 -- 172.21.15.117:0/2334131019 >> v1:172.21.15.117:6789/0 conn(0x7fee480c5b00 legacy=0x7fee480cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:00.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.565+0000 7fee4e4e8640 1 -- 172.21.15.117:0/2334131019 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee480cfc90 con 0x7fee480cd040 2024-09-19T08:39:00.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.566+0000 7fee4e4e8640 1 --2- 172.21.15.117:0/2334131019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee480cd040 0x7fee481653d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fee400097a0 tx=0x7fee4002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8ae9b39fc01095 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:00.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.566+0000 7fee4cce5640 1 -- 172.21.15.117:0/2334131019 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40037070 con 0x7fee480cd040 2024-09-19T08:39:00.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.566+0000 7fee4cce5640 1 -- 172.21.15.117:0/2334131019 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee40032440 con 0x7fee480cd040 2024-09-19T08:39:00.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.566+0000 7fee4cce5640 1 -- 172.21.15.117:0/2334131019 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40032810 con 0x7fee480cd040 2024-09-19T08:39:00.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.566+0000 7fee4ff4b640 1 -- 172.21.15.117:0/2334131019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee480cd040 msgr2=0x7fee481653d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:00.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.566+0000 7fee4ff4b640 1 --2- 172.21.15.117:0/2334131019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee480cd040 0x7fee481653d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fee400097a0 tx=0x7fee4002a1e0 comp rx=0 tx=0).stop 2024-09-19T08:39:00.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.566+0000 7fee4ff4b640 1 -- 172.21.15.117:0/2334131019 shutdown_connections 2024-09-19T08:39:00.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.566+0000 7fee4ff4b640 1 --2- 172.21.15.117:0/2334131019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee480cd040 0x7fee481653d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:00.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.566+0000 7fee4ff4b640 1 -- 172.21.15.117:0/2334131019 >> 172.21.15.117:0/2334131019 conn(0x7fee4806bdf0 msgr2=0x7fee4806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:00.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.566+0000 7fee4ff4b640 1 -- 172.21.15.117:0/2334131019 shutdown_connections 2024-09-19T08:39:00.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.567+0000 7fee4ff4b640 1 -- 172.21.15.117:0/2334131019 wait complete. 2024-09-19T08:39:00.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.568+0000 7fee4ff4b640 1 Processor -- start 2024-09-19T08:39:00.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.568+0000 7fee4ff4b640 1 -- start start 2024-09-19T08:39:00.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.568+0000 7fee4ff4b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee480c5b00 0x7fee4809ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:00.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.568+0000 7fee4ff4b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee480cd040 0x7fee48147550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:00.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.568+0000 7fee4ff4b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee4815a7b0 0x7fee480c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:00.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.568+0000 7fee4ff4b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fee4815ab90 con 0x7fee4815a7b0 2024-09-19T08:39:00.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.568+0000 7fee4ff4b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fee480c5f40 con 0x7fee480c5b00 2024-09-19T08:39:00.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.568+0000 7fee4ff4b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fee480ca8c0 con 0x7fee480cd040 2024-09-19T08:39:00.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.568+0000 7fee4e4e8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee4815a7b0 0x7fee480c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:00.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.569+0000 7fee4e4e8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee4815a7b0 0x7fee480c9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58188/0 (socket says 172.21.15.117:58188) 2024-09-19T08:39:00.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.569+0000 7fee4e4e8640 1 -- 172.21.15.117:0/3777795048 learned_addr learned my addr 172.21.15.117:0/3777795048 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:00.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.569+0000 7fee4d4e6640 1 --2- 172.21.15.117:0/3777795048 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee480cd040 0x7fee48147550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:00.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.569+0000 7fee4dce7640 1 --2- 172.21.15.117:0/3777795048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee480c5b00 0x7fee4809ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:00.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.569+0000 7fee4e4e8640 1 -- 172.21.15.117:0/3777795048 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee480cd040 msgr2=0x7fee48147550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:00.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.569+0000 7fee4e4e8640 1 --2- 172.21.15.117:0/3777795048 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee480cd040 0x7fee48147550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:00.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.569+0000 7fee4e4e8640 1 -- 172.21.15.117:0/3777795048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee480c5b00 msgr2=0x7fee4809ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:00.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.569+0000 7fee4e4e8640 1 --2- 172.21.15.117:0/3777795048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee480c5b00 0x7fee4809ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:00.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.569+0000 7fee4e4e8640 1 -- 172.21.15.117:0/3777795048 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee480cbd60 con 0x7fee4815a7b0 2024-09-19T08:39:00.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.569+0000 7fee4e4e8640 1 --2- 172.21.15.117:0/3777795048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee4815a7b0 0x7fee480c9550 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fee400097a0 tx=0x7fee400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:00.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.569+0000 7fee3e7fc640 1 -- 172.21.15.117:0/3777795048 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40037040 con 0x7fee4815a7b0 2024-09-19T08:39:00.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.569+0000 7fee3e7fc640 1 -- 172.21.15.117:0/3777795048 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee40042070 con 0x7fee4815a7b0 2024-09-19T08:39:00.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.569+0000 7fee4ff4b640 1 -- 172.21.15.117:0/3777795048 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee4809a3a0 con 0x7fee4815a7b0 2024-09-19T08:39:00.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.569+0000 7fee3e7fc640 1 -- 172.21.15.117:0/3777795048 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40030b30 con 0x7fee4815a7b0 2024-09-19T08:39:00.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.569+0000 7fee4ff4b640 1 -- 172.21.15.117:0/3777795048 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee48147a90 con 0x7fee4815a7b0 2024-09-19T08:39:00.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.570+0000 7fee4ff4b640 1 -- 172.21.15.117:0/3777795048 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee480cc930 con 0x7fee4815a7b0 2024-09-19T08:39:00.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.571+0000 7fee3e7fc640 1 -- 172.21.15.117:0/3777795048 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fee40030cd0 con 0x7fee4815a7b0 2024-09-19T08:39:00.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.571+0000 7fee3e7fc640 1 --2- 172.21.15.117:0/3777795048 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fee2c06c2b0 0x7fee2c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:00.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.571+0000 7fee3e7fc640 1 -- 172.21.15.117:0/3777795048 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6130+0+0 (secure 0 0 0) 0x7fee400ac190 con 0x7fee4815a7b0 2024-09-19T08:39:00.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.571+0000 7fee4dce7640 1 --2- 172.21.15.117:0/3777795048 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fee2c06c2b0 0x7fee2c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:00.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.572+0000 7fee4dce7640 1 --2- 172.21.15.117:0/3777795048 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fee2c06c2b0 0x7fee2c06e770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fee44005520 tx=0x7fee44009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:00.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.576+0000 7fee3e7fc640 1 -- 172.21.15.117:0/3777795048 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fee4007a7e0 con 0x7fee4815a7b0 2024-09-19T08:39:00.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.773+0000 7fee4ff4b640 1 -- 172.21.15.117:0/3777795048 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee4806ce20 con 0x7fee4815a7b0 2024-09-19T08:39:00.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.774+0000 7fee3e7fc640 1 -- 172.21.15.117:0/3777795048 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5232 (secure 0 0 0) 0x7fee4007a0e0 con 0x7fee4815a7b0 2024-09-19T08:39:00.774 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:39:00.774 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"btime":"2024-09-19T08:38:51:840984+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1753143760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1753143760},{"type":"v1","addr":"172.21.15.146:6836","nonce":1753143760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/283458533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":283458533},{"type":"v1","addr":"172.21.15.117:6835","nonce":283458533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3844667733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3844667733},{"type":"v1","addr":"172.21.15.117:6834","nonce":3844667733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:38:49.170502+0000","modified":"2024-09-19T08:38:51.165807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5352":{"gid":5352,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/4230307932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4230307932},{"type":"v1","addr":"172.21.15.146:6837","nonce":4230307932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5352,"qdb_cluster":[5352]},"id":3}]} 2024-09-19T08:39:00.774 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 22 2024-09-19T08:39:00.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.776+0000 7fee4ff4b640 1 -- 172.21.15.117:0/3777795048 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fee2c06c2b0 msgr2=0x7fee2c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:00.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.776+0000 7fee4ff4b640 1 --2- 172.21.15.117:0/3777795048 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fee2c06c2b0 0x7fee2c06e770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fee44005520 tx=0x7fee44009040 comp rx=0 tx=0).stop 2024-09-19T08:39:00.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.776+0000 7fee4ff4b640 1 -- 172.21.15.117:0/3777795048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee4815a7b0 msgr2=0x7fee480c9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:00.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.776+0000 7fee4ff4b640 1 --2- 172.21.15.117:0/3777795048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee4815a7b0 0x7fee480c9550 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fee400097a0 tx=0x7fee400046c0 comp rx=0 tx=0).stop 2024-09-19T08:39:00.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.776+0000 7fee4ff4b640 1 -- 172.21.15.117:0/3777795048 shutdown_connections 2024-09-19T08:39:00.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.776+0000 7fee4ff4b640 1 --2- 172.21.15.117:0/3777795048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee4815a7b0 0x7fee480c9550 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:00.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.776+0000 7fee4ff4b640 1 --2- 172.21.15.117:0/3777795048 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fee2c06c2b0 0x7fee2c06e770 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:00.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.776+0000 7fee4ff4b640 1 --2- 172.21.15.117:0/3777795048 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee480cd040 0x7fee48147550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:00.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.776+0000 7fee4ff4b640 1 --2- 172.21.15.117:0/3777795048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee480c5b00 0x7fee4809ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:00.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.776+0000 7fee4ff4b640 1 -- 172.21.15.117:0/3777795048 >> 172.21.15.117:0/3777795048 conn(0x7fee4806bdf0 msgr2=0x7fee48073800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:00.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.776+0000 7fee4ff4b640 1 -- 172.21.15.117:0/3777795048 shutdown_connections 2024-09-19T08:39:00.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.776+0000 7fee4ff4b640 1 -- 172.21.15.117:0/3777795048 wait complete. 2024-09-19T08:39:00.787 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-09-19T08:39:00.926 INFO:teuthology.orchestra.run.smithi146.stdout:{"message":"","return_code":0} 2024-09-19T08:39:00.927 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-19T08:39:00.927 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-09-19T08:39:00.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.970+0000 7f33d251ef40 1 Processor -- start 2024-09-19T08:39:00.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.970+0000 7f33d251ef40 1 -- start start 2024-09-19T08:39:00.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.971+0000 7f33d251ef40 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556255a91dc0 0x556255b2bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:00.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.971+0000 7f33d251ef40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556255aa9bf0 0x556255aabc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:00.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.971+0000 7f33d251ef40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556255b38e80 0x556255aac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:00.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.971+0000 7f33d251ef40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5562559b3510 con 0x556255aa9bf0 2024-09-19T08:39:00.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.971+0000 7f33d251ef40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556255aab600 con 0x556255b38e80 2024-09-19T08:39:00.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.971+0000 7f33d251ef40 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x556255b2c4d0 con 0x556255a91dc0 2024-09-19T08:39:00.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.971+0000 7f33ceefb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556255aa9bf0 0x556255aabc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:00.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.971+0000 7f33ceefb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556255aa9bf0 0x556255aabc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58206/0 (socket says 172.21.15.117:58206) 2024-09-19T08:39:00.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.971+0000 7f33ceefb640 1 -- 172.21.15.117:0/2700903450 learned_addr learned my addr 172.21.15.117:0/2700903450 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:00.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.971+0000 7f33ceefb640 1 -- 172.21.15.117:0/2700903450 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556255a91dc0 msgr2=0x556255b2bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:00.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.971+0000 7f33ceefb640 1 --2- 172.21.15.117:0/2700903450 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556255a91dc0 0x556255b2bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:00.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.971+0000 7f33ceefb640 1 -- 172.21.15.117:0/2700903450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556255b38e80 msgr2=0x556255aac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:00.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.971+0000 7f33ceefb640 1 --2- 172.21.15.117:0/2700903450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556255b38e80 0x556255aac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:00.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.971+0000 7f33ceefb640 1 -- 172.21.15.117:0/2700903450 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556255b34f90 con 0x556255aa9bf0 2024-09-19T08:39:00.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.971+0000 7f33ceefb640 1 --2- 172.21.15.117:0/2700903450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556255aa9bf0 0x556255aabc90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f33b800b340 tx=0x7f33b800b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f00657a2a455af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:00.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.971+0000 7f33cdef9640 1 -- 172.21.15.117:0/2700903450 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b8008070 con 0x556255aa9bf0 2024-09-19T08:39:00.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.971+0000 7f33cdef9640 1 -- 172.21.15.117:0/2700903450 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b800d5c0 con 0x556255aa9bf0 2024-09-19T08:39:00.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.971+0000 7f33cdef9640 1 -- 172.21.15.117:0/2700903450 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b800d970 con 0x556255aa9bf0 2024-09-19T08:39:00.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.972+0000 7f33d251ef40 1 -- 172.21.15.117:0/2700903450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556255aa9bf0 msgr2=0x556255aabc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:00.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.972+0000 7f33d251ef40 1 --2- 172.21.15.117:0/2700903450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556255aa9bf0 0x556255aabc90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f33b800b340 tx=0x7f33b800b800 comp rx=0 tx=0).stop 2024-09-19T08:39:00.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.972+0000 7f33d251ef40 1 -- 172.21.15.117:0/2700903450 shutdown_connections 2024-09-19T08:39:00.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.972+0000 7f33d251ef40 1 --2- 172.21.15.117:0/2700903450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556255b38e80 0x556255aac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:00.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.972+0000 7f33d251ef40 1 --2- 172.21.15.117:0/2700903450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556255aa9bf0 0x556255aabc90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:00.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.972+0000 7f33d251ef40 1 --2- 172.21.15.117:0/2700903450 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556255a91dc0 0x556255b2bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:00.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.972+0000 7f33d251ef40 1 -- 172.21.15.117:0/2700903450 >> 172.21.15.117:0/2700903450 conn(0x556255a60af0 msgr2=0x556255b35b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:00.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.972+0000 7f33d251ef40 1 -- 172.21.15.117:0/2700903450 shutdown_connections 2024-09-19T08:39:00.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.972+0000 7f33d251ef40 1 -- 172.21.15.117:0/2700903450 wait complete. 2024-09-19T08:39:00.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.973+0000 7f33d251ef40 1 Processor -- start 2024-09-19T08:39:00.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.973+0000 7f33d251ef40 1 -- start start 2024-09-19T08:39:00.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.973+0000 7f33d251ef40 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556255a91dc0 0x556255b2ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:00.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.973+0000 7f33d251ef40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556255aa9bf0 0x556255aa8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:00.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.973+0000 7f33d251ef40 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556255b38e80 0x556255b352c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:00.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.973+0000 7f33d251ef40 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x556255aab830 con 0x556255a91dc0 2024-09-19T08:39:00.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.973+0000 7f33d251ef40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556255aa95c0 con 0x556255aa9bf0 2024-09-19T08:39:00.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.973+0000 7f33d251ef40 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x556255b337d0 con 0x556255b38e80 2024-09-19T08:39:00.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.973+0000 7f33cf6fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556255a91dc0 0x556255b2ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:00.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.973+0000 7f33cf6fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556255a91dc0 0x556255b2ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58222/0 (socket says 172.21.15.117:58222) 2024-09-19T08:39:00.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.973+0000 7f33cf6fc640 1 -- 172.21.15.117:0/45730414 learned_addr learned my addr 172.21.15.117:0/45730414 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:00.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.973+0000 7f33ceefb640 1 --2- 172.21.15.117:0/45730414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556255aa9bf0 0x556255aa8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:00.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.973+0000 7f33cfefd640 1 --2- 172.21.15.117:0/45730414 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556255b38e80 0x556255b352c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:00.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.974+0000 7f33cf6fc640 1 -- 172.21.15.117:0/45730414 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556255b38e80 msgr2=0x556255b352c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:00.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.974+0000 7f33cf6fc640 1 --2- 172.21.15.117:0/45730414 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556255b38e80 0x556255b352c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:00.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.974+0000 7f33cf6fc640 1 -- 172.21.15.117:0/45730414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556255aa9bf0 msgr2=0x556255aa8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:00.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.974+0000 7f33cf6fc640 1 --2- 172.21.15.117:0/45730414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556255aa9bf0 0x556255aa8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:00.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.974+0000 7f33cf6fc640 1 -- 172.21.15.117:0/45730414 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556255aac790 con 0x556255a91dc0 2024-09-19T08:39:00.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.974+0000 7f33cf6fc640 1 --2- 172.21.15.117:0/45730414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556255a91dc0 0x556255b2ab30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f33c800afd0 tx=0x7f33c80084f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:00.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.974+0000 7f33ccef7640 1 -- 172.21.15.117:0/45730414 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c8010640 con 0x556255a91dc0 2024-09-19T08:39:00.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.974+0000 7f33ccef7640 1 -- 172.21.15.117:0/45730414 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c8015070 con 0x556255a91dc0 2024-09-19T08:39:00.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.974+0000 7f33d251ef40 1 -- 172.21.15.117:0/45730414 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556255b3b750 con 0x556255a91dc0 2024-09-19T08:39:00.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.974+0000 7f33ccef7640 1 -- 172.21.15.117:0/45730414 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c8010a20 con 0x556255a91dc0 2024-09-19T08:39:00.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.974+0000 7f33d251ef40 1 -- 172.21.15.117:0/45730414 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556255b2ca40 con 0x556255a91dc0 2024-09-19T08:39:00.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.975+0000 7f33ccef7640 1 -- 172.21.15.117:0/45730414 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f33c8010bc0 con 0x556255a91dc0 2024-09-19T08:39:00.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.976+0000 7f33ccef7640 1 --2- 172.21.15.117:0/45730414 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f33b006ac90 0x7f33b006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:00.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.976+0000 7f33ccef7640 1 -- 172.21.15.117:0/45730414 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6130+0+0 (secure 0 0 0) 0x7f33c8089f30 con 0x556255a91dc0 2024-09-19T08:39:00.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.976+0000 7f33ceefb640 1 --2- 172.21.15.117:0/45730414 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f33b006ac90 0x7f33b006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:00.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.976+0000 7f33d251ef40 1 --2- 172.21.15.117:0/45730414 >> [v2:172.21.15.146:6800/3875302444,v1:172.21.15.146:6801/3875302444] conn(0x556255b39770 0x556255b39b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:00.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.976+0000 7f33d251ef40 1 -- 172.21.15.117:0/45730414 --> [v2:172.21.15.146:6800/3875302444,v1:172.21.15.146:6801/3875302444] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54) -- 0x556255b3a090 con 0x556255b39770 2024-09-19T08:39:00.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.976+0000 7f33cfefd640 1 --2- 172.21.15.117:0/45730414 >> [v2:172.21.15.146:6800/3875302444,v1:172.21.15.146:6801/3875302444] conn(0x556255b39770 0x556255b39b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:00.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.976+0000 7f33ceefb640 1 --2- 172.21.15.117:0/45730414 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f33b006ac90 0x7f33b006d150 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x5562559c9350 tx=0x7f33b8008000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:00.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.977+0000 7f33cfefd640 1 --2- 172.21.15.117:0/45730414 >> [v2:172.21.15.146:6800/3875302444,v1:172.21.15.146:6801/3875302444] conn(0x556255b39770 0x556255b39b50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:00.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.977+0000 7f33cfefd640 1 -- 172.21.15.117:0/45730414 <== osd.7 v2:172.21.15.146:6800/3875302444 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7f33c0050460 con 0x556255b39770 2024-09-19T08:39:00.981 INFO:teuthology.orchestra.run.smithi117.stdout:Yalphaparent_a 2024-09-19T08:39:00.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.977+0000 7f33d251ef40 1 -- 172.21.15.117:0/45730414 >> [v2:172.21.15.146:6800/3875302444,v1:172.21.15.146:6801/3875302444] conn(0x556255b39770 msgr2=0x556255b39b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:00.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.977+0000 7f33d251ef40 1 --2- 172.21.15.117:0/45730414 >> [v2:172.21.15.146:6800/3875302444,v1:172.21.15.146:6801/3875302444] conn(0x556255b39770 0x556255b39b50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:00.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.977+0000 7f33d251ef40 1 -- 172.21.15.117:0/45730414 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f33b006ac90 msgr2=0x7f33b006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:00.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.977+0000 7f33d251ef40 1 --2- 172.21.15.117:0/45730414 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f33b006ac90 0x7f33b006d150 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x5562559c9350 tx=0x7f33b8008000 comp rx=0 tx=0).stop 2024-09-19T08:39:00.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.977+0000 7f33d251ef40 1 -- 172.21.15.117:0/45730414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556255a91dc0 msgr2=0x556255b2ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:00.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.977+0000 7f33d251ef40 1 --2- 172.21.15.117:0/45730414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556255a91dc0 0x556255b2ab30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f33c800afd0 tx=0x7f33c80084f0 comp rx=0 tx=0).stop 2024-09-19T08:39:00.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.977+0000 7f33cfefd640 1 -- 172.21.15.117:0/45730414 reap_dead start 2024-09-19T08:39:00.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.977+0000 7f33d251ef40 1 -- 172.21.15.117:0/45730414 shutdown_connections 2024-09-19T08:39:00.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.977+0000 7f33d251ef40 1 -- 172.21.15.117:0/45730414 >> 172.21.15.117:0/45730414 conn(0x556255a60af0 msgr2=0x556255aaabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:00.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.977+0000 7f33d251ef40 1 -- 172.21.15.117:0/45730414 shutdown_connections 2024-09-19T08:39:00.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:00.977+0000 7f33d251ef40 1 -- 172.21.15.117:0/45730414 wait complete. 2024-09-19T08:39:00.983 DEBUG:teuthology.orchestra.run.smithi117:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-19T08:39:01.124 INFO:teuthology.orchestra.run.smithi117.stderr:error: stray data at end of buffer, offset 95 2024-09-19T08:39:01.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:39:01.133 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T08:39:01.134 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T08:39:01.179 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T08:39:01.242 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T08:39:01.242 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T08:39:01.243 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:39:01.243 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:39:01.259 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T08:39:01.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.398+0000 7fca77e27640 1 Processor -- start 2024-09-19T08:39:01.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.399+0000 7fca77e27640 1 -- start start 2024-09-19T08:39:01.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.399+0000 7fca77e27640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fca7015b300 0x7fca700cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:01.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.399+0000 7fca77e27640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca700ccbd0 0x7fca700cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:01.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.399+0000 7fca77e27640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca700cd910 con 0x7fca7015b6e0 2024-09-19T08:39:01.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.399+0000 7fca77e27640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fca700cd070 con 0x7fca7015b300 2024-09-19T08:39:01.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.399+0000 7fca77e27640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fca700cd350 con 0x7fca700ccbd0 2024-09-19T08:39:01.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.400+0000 7fca75bc3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fca7015b300 0x7fca700cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:01.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.400+0000 7fca75bc3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fca7015b300 0x7fca700cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58238/0 (socket says 172.21.15.117:58238) 2024-09-19T08:39:01.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.400+0000 7fca75bc3640 1 -- 172.21.15.117:0/2166586769 learned_addr learned my addr 172.21.15.117:0/2166586769 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:01.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.400+0000 7fca753c2640 1 --2- 172.21.15.117:0/2166586769 >> v2:172.21.15.146:3300/0 conn(0x7fca700ccbd0 0x7fca700cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:01.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.400+0000 7fca75bc3640 1 -- 172.21.15.117:0/2166586769 >> v2:172.21.15.146:3300/0 conn(0x7fca700ccbd0 msgr2=0x7fca700cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:01.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.400+0000 7fca75bc3640 1 --2- 172.21.15.117:0/2166586769 >> v2:172.21.15.146:3300/0 conn(0x7fca700ccbd0 0x7fca700cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:01.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.400+0000 7fca75bc3640 1 -- 172.21.15.117:0/2166586769 >> v1:172.21.15.146:6789/0 conn(0x7fca7015b6e0 legacy=0x7fca700cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:01.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.400+0000 7fca75bc3640 1 -- 172.21.15.117:0/2166586769 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca700cd630 con 0x7fca7015b300 2024-09-19T08:39:01.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.401+0000 7fca75bc3640 1 --2- 172.21.15.117:0/2166586769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca7015b300 0x7fca700cc690 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fca70072590 tx=0x7fca6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb927cd9ae3e729c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:01.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.401+0000 7fca74bc1640 1 -- 172.21.15.117:0/2166586769 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c037070 con 0x7fca7015b300 2024-09-19T08:39:01.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.401+0000 7fca74bc1640 1 -- 172.21.15.117:0/2166586769 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca6c032440 con 0x7fca7015b300 2024-09-19T08:39:01.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.401+0000 7fca74bc1640 1 -- 172.21.15.117:0/2166586769 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c032810 con 0x7fca7015b300 2024-09-19T08:39:01.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.401+0000 7fca77e27640 1 -- 172.21.15.117:0/2166586769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca7015b300 msgr2=0x7fca700cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:01.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.401+0000 7fca77e27640 1 --2- 172.21.15.117:0/2166586769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca7015b300 0x7fca700cc690 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fca70072590 tx=0x7fca6c02a270 comp rx=0 tx=0).stop 2024-09-19T08:39:01.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.401+0000 7fca77e27640 1 -- 172.21.15.117:0/2166586769 shutdown_connections 2024-09-19T08:39:01.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.401+0000 7fca77e27640 1 --2- 172.21.15.117:0/2166586769 >> v2:172.21.15.146:3300/0 conn(0x7fca700ccbd0 0x7fca700cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:01.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.401+0000 7fca77e27640 1 --2- 172.21.15.117:0/2166586769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca7015b300 0x7fca700cc690 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:01.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.401+0000 7fca77e27640 1 -- 172.21.15.117:0/2166586769 >> 172.21.15.117:0/2166586769 conn(0x7fca700b2d10 msgr2=0x7fca700b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:01.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.401+0000 7fca77e27640 1 -- 172.21.15.117:0/2166586769 shutdown_connections 2024-09-19T08:39:01.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.401+0000 7fca77e27640 1 -- 172.21.15.117:0/2166586769 wait complete. 2024-09-19T08:39:01.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.402+0000 7fca77e27640 1 Processor -- start 2024-09-19T08:39:01.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.403+0000 7fca77e27640 1 -- start start 2024-09-19T08:39:01.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.403+0000 7fca77e27640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca700ccbd0 0x7fca700ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:01.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.403+0000 7fca77e27640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca7015b300 0x7fca700b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:01.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.403+0000 7fca77e27640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca7015b6e0 0x7fca700b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:01.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.403+0000 7fca77e27640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fca700b3b70 con 0x7fca700ccbd0 2024-09-19T08:39:01.405 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.403+0000 7fca77e27640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fca700b39f0 con 0x7fca7015b300 2024-09-19T08:39:01.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.403+0000 7fca77e27640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fca700b2060 con 0x7fca7015b6e0 2024-09-19T08:39:01.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.403+0000 7fca75bc3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca700ccbd0 0x7fca700ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:01.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.403+0000 7fca75bc3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca700ccbd0 0x7fca700ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58250/0 (socket says 172.21.15.117:58250) 2024-09-19T08:39:01.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.403+0000 7fca75bc3640 1 -- 172.21.15.117:0/3781119156 learned_addr learned my addr 172.21.15.117:0/3781119156 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:01.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.403+0000 7fca753c2640 1 --2- 172.21.15.117:0/3781119156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca7015b300 0x7fca700b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:01.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.403+0000 7fca763c4640 1 --2- 172.21.15.117:0/3781119156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca7015b6e0 0x7fca700b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:01.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.404+0000 7fca75bc3640 1 -- 172.21.15.117:0/3781119156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca7015b6e0 msgr2=0x7fca700b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:01.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.404+0000 7fca75bc3640 1 --2- 172.21.15.117:0/3781119156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca7015b6e0 0x7fca700b4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:01.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.404+0000 7fca75bc3640 1 -- 172.21.15.117:0/3781119156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca7015b300 msgr2=0x7fca700b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:01.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.404+0000 7fca75bc3640 1 --2- 172.21.15.117:0/3781119156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca7015b300 0x7fca700b4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:01.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.404+0000 7fca75bc3640 1 -- 172.21.15.117:0/3781119156 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca700b5590 con 0x7fca700ccbd0 2024-09-19T08:39:01.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.404+0000 7fca753c2640 1 --2- 172.21.15.117:0/3781119156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca7015b300 0x7fca700b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:01.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.404+0000 7fca763c4640 1 --2- 172.21.15.117:0/3781119156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca7015b6e0 0x7fca700b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:01.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.404+0000 7fca75bc3640 1 --2- 172.21.15.117:0/3781119156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca700ccbd0 0x7fca700ca5f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fca6c000c00 tx=0x7fca6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:01.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.404+0000 7fca667fc640 1 -- 172.21.15.117:0/3781119156 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c037040 con 0x7fca700ccbd0 2024-09-19T08:39:01.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.404+0000 7fca667fc640 1 -- 172.21.15.117:0/3781119156 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca6c042070 con 0x7fca700ccbd0 2024-09-19T08:39:01.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.404+0000 7fca77e27640 1 -- 172.21.15.117:0/3781119156 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca700b5870 con 0x7fca700ccbd0 2024-09-19T08:39:01.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.404+0000 7fca667fc640 1 -- 172.21.15.117:0/3781119156 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c030880 con 0x7fca700ccbd0 2024-09-19T08:39:01.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.404+0000 7fca77e27640 1 -- 172.21.15.117:0/3781119156 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca7014c900 con 0x7fca700ccbd0 2024-09-19T08:39:01.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.405+0000 7fca77e27640 1 -- 172.21.15.117:0/3781119156 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca700cc690 con 0x7fca700ccbd0 2024-09-19T08:39:01.407 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.405+0000 7fca667fc640 1 -- 172.21.15.117:0/3781119156 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fca6c030a20 con 0x7fca700ccbd0 2024-09-19T08:39:01.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.406+0000 7fca667fc640 1 --2- 172.21.15.117:0/3781119156 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fca5406c2b0 0x7fca5406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:01.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.406+0000 7fca667fc640 1 -- 172.21.15.117:0/3781119156 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6130+0+0 (secure 0 0 0) 0x7fca6c0abe50 con 0x7fca700ccbd0 2024-09-19T08:39:01.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.406+0000 7fca753c2640 1 --2- 172.21.15.117:0/3781119156 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fca5406c2b0 0x7fca5406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:01.408 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.407+0000 7fca753c2640 1 --2- 172.21.15.117:0/3781119156 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fca5406c2b0 0x7fca5406e770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fca70153730 tx=0x7fca60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:01.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.410+0000 7fca667fc640 1 -- 172.21.15.117:0/3781119156 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fca6c07a410 con 0x7fca700ccbd0 2024-09-19T08:39:01.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.587+0000 7fca77e27640 1 -- 172.21.15.117:0/3781119156 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fca700d12d0 con 0x7fca700ccbd0 2024-09-19T08:39:01.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.587+0000 7fca667fc640 1 -- 172.21.15.117:0/3781119156 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) ==== 80+0+0 (secure 0 0 0) 0x7fca6c079d10 con 0x7fca700ccbd0 2024-09-19T08:39:01.587 INFO:teuthology.orchestra.run.smithi117.stderr:listed 0 entries 2024-09-19T08:39:01.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.590+0000 7fca77e27640 1 -- 172.21.15.117:0/3781119156 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fca5406c2b0 msgr2=0x7fca5406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:01.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.590+0000 7fca77e27640 1 --2- 172.21.15.117:0/3781119156 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fca5406c2b0 0x7fca5406e770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fca70153730 tx=0x7fca60008040 comp rx=0 tx=0).stop 2024-09-19T08:39:01.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.590+0000 7fca77e27640 1 -- 172.21.15.117:0/3781119156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca700ccbd0 msgr2=0x7fca700ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:01.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.590+0000 7fca77e27640 1 --2- 172.21.15.117:0/3781119156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca700ccbd0 0x7fca700ca5f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fca6c000c00 tx=0x7fca6c0046c0 comp rx=0 tx=0).stop 2024-09-19T08:39:01.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.590+0000 7fca77e27640 1 -- 172.21.15.117:0/3781119156 shutdown_connections 2024-09-19T08:39:01.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.590+0000 7fca77e27640 1 --2- 172.21.15.117:0/3781119156 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fca5406c2b0 0x7fca5406e770 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:01.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.590+0000 7fca77e27640 1 --2- 172.21.15.117:0/3781119156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca7015b6e0 0x7fca700b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:01.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.590+0000 7fca77e27640 1 --2- 172.21.15.117:0/3781119156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca7015b300 0x7fca700b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:01.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.590+0000 7fca77e27640 1 --2- 172.21.15.117:0/3781119156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca700ccbd0 0x7fca700ca5f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:01.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.590+0000 7fca77e27640 1 -- 172.21.15.117:0/3781119156 >> 172.21.15.117:0/3781119156 conn(0x7fca700b2d10 msgr2=0x7fca700705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:01.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.590+0000 7fca77e27640 1 -- 172.21.15.117:0/3781119156 shutdown_connections 2024-09-19T08:39:01.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:01.590+0000 7fca77e27640 1 -- 172.21.15.117:0/3781119156 wait complete. 2024-09-19T08:39:01.600 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2024-09-19T08:39:01.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:39:01.601 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T08:39:01.623 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi117.stderr:ceph-fuse[52401]: fuse finished with error 0 and tester_r 0 2024-09-19T08:39:01.625 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T08:39:01.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:39:01.626 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T08:39:01.792 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T08:39:01.792 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:39:01.792 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:39:01.809 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15971 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T08:39:01.809 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-19T08:39:01.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:39:01.809 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T08:39:01.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:39:01.865 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-09-19T08:39:01.865 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T08:39:01.865 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:39:01.865 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:39:01.881 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20491 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T08:39:01.881 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T08:39:01.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:39:01.881 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-19T08:39:01.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:39:01.936 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-19T08:39:01.937 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T08:39:01.937 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:39:01.937 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:39:01.954 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15971 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T08:39:01.954 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-19T08:39:01.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:39:01.954 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-19T08:39:02.009 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:39:02.009 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-19T08:39:02.010 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:39:02.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.107+0000 7f4b0d61e640 1 Processor -- start 2024-09-19T08:39:02.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.107+0000 7f4b0d61e640 1 -- start start 2024-09-19T08:39:02.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.108+0000 7f4b0d61e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0806cd20 0x7f4b0806d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:02.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.108+0000 7f4b0d61e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b0806d640 con 0x7f4b081425e0 2024-09-19T08:39:02.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.108+0000 7f4b0d61e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b08162b70 con 0x7f4b08161eb0 2024-09-19T08:39:02.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.108+0000 7f4b0d61e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f4b08162e50 con 0x7f4b0806cd20 2024-09-19T08:39:02.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.108+0000 7f4b077fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f4b081425e0 0x7f4b08142a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:55416/0 (socket says 172.21.15.117:55416) 2024-09-19T08:39:02.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.108+0000 7f4b077fe640 1 -- 172.21.15.117:0/1245173461 learned_addr learned my addr 172.21.15.117:0/1245173461 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:02.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.108+0000 7f4b06ffd640 1 --2- 172.21.15.117:0/1245173461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0806cd20 0x7f4b0806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:02.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.108+0000 7f4b067fc640 1 -- 172.21.15.117:0/1245173461 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2116496948 0 0) 0x7f4b0806d640 con 0x7f4b081425e0 2024-09-19T08:39:02.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.108+0000 7f4b067fc640 1 -- 172.21.15.117:0/1245173461 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4af4003520 con 0x7f4b081425e0 2024-09-19T08:39:02.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.108+0000 7f4b067fc640 1 -- 172.21.15.117:0/1245173461 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1649733582 0 0) 0x7f4b08162b70 con 0x7f4b08161eb0 2024-09-19T08:39:02.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.109+0000 7f4b067fc640 1 -- 172.21.15.117:0/1245173461 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b0806d640 con 0x7f4b08161eb0 2024-09-19T08:39:02.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.109+0000 7f4b06ffd640 1 -- 172.21.15.117:0/1245173461 >> v1:172.21.15.146:6789/0 conn(0x7f4b08161eb0 legacy=0x7f4b081622f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:02.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.109+0000 7f4b067fc640 1 -- 172.21.15.117:0/1245173461 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2623625823 0 0) 0x7f4af4003520 con 0x7f4b081425e0 2024-09-19T08:39:02.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.109+0000 7f4b06ffd640 1 -- 172.21.15.117:0/1245173461 >> v1:172.21.15.117:6789/0 conn(0x7f4b081425e0 legacy=0x7f4b08142a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:02.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.109+0000 7f4b06ffd640 1 -- 172.21.15.117:0/1245173461 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b08141b00 con 0x7f4b0806cd20 2024-09-19T08:39:02.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.109+0000 7f4b06ffd640 1 --2- 172.21.15.117:0/1245173461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0806cd20 0x7f4b0806d100 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009800 tx=0x7f4af802a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50acc227394b6d9f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:02.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.109+0000 7f4b067fc640 1 -- 172.21.15.117:0/1245173461 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8037070 con 0x7f4b0806cd20 2024-09-19T08:39:02.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.110+0000 7f4b067fc640 1 -- 172.21.15.117:0/1245173461 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af802abc0 con 0x7f4b0806cd20 2024-09-19T08:39:02.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.110+0000 7f4b067fc640 1 -- 172.21.15.117:0/1245173461 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b000019f0 con 0x7f4b0806cd20 2024-09-19T08:39:02.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.110+0000 7f4b0d61e640 1 -- 172.21.15.117:0/1245173461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0806cd20 msgr2=0x7f4b0806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:02.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.110+0000 7f4b0d61e640 1 --2- 172.21.15.117:0/1245173461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0806cd20 0x7f4b0806d100 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009800 tx=0x7f4af802a130 comp rx=0 tx=0).stop 2024-09-19T08:39:02.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.110+0000 7f4b0d61e640 1 -- 172.21.15.117:0/1245173461 shutdown_connections 2024-09-19T08:39:02.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.110+0000 7f4b0d61e640 1 --2- 172.21.15.117:0/1245173461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0806cd20 0x7f4b0806d100 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.110+0000 7f4b0d61e640 1 -- 172.21.15.117:0/1245173461 >> 172.21.15.117:0/1245173461 conn(0x7f4b080b3ed0 msgr2=0x7f4b080b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:02.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.110+0000 7f4b0d61e640 1 -- 172.21.15.117:0/1245173461 shutdown_connections 2024-09-19T08:39:02.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.110+0000 7f4b0d61e640 1 -- 172.21.15.117:0/1245173461 wait complete. 2024-09-19T08:39:02.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.111+0000 7f4b0d61e640 1 Processor -- start 2024-09-19T08:39:02.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.111+0000 7f4b0d61e640 1 -- start start 2024-09-19T08:39:02.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.112+0000 7f4b0d61e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0806cd20 0x7f4b08158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:02.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.112+0000 7f4b0d61e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b081425e0 0x7f4b0813fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:02.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.112+0000 7f4b0d61e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b08161eb0 0x7f4b08147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:02.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.112+0000 7f4b0d61e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4b08141600 con 0x7f4b081425e0 2024-09-19T08:39:02.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.112+0000 7f4b0d61e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4b08142150 con 0x7f4b08161eb0 2024-09-19T08:39:02.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.112+0000 7f4b0d61e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f4b081431a0 con 0x7f4b0806cd20 2024-09-19T08:39:02.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.112+0000 7f4afe7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b081425e0 0x7f4b0813fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:02.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.112+0000 7f4afe7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b081425e0 0x7f4b0813fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58266/0 (socket says 172.21.15.117:58266) 2024-09-19T08:39:02.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.112+0000 7f4afe7fc640 1 -- 172.21.15.117:0/3027056520 learned_addr learned my addr 172.21.15.117:0/3027056520 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:02.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.112+0000 7f4b077fe640 1 --2- 172.21.15.117:0/3027056520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b08161eb0 0x7f4b08147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:02.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.112+0000 7f4b06ffd640 1 --2- 172.21.15.117:0/3027056520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0806cd20 0x7f4b08158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:02.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.112+0000 7f4afe7fc640 1 -- 172.21.15.117:0/3027056520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0806cd20 msgr2=0x7f4b08158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:02.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.112+0000 7f4afe7fc640 1 --2- 172.21.15.117:0/3027056520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0806cd20 0x7f4b08158690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.112+0000 7f4afe7fc640 1 -- 172.21.15.117:0/3027056520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b08161eb0 msgr2=0x7f4b08147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:02.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.112+0000 7f4afe7fc640 1 --2- 172.21.15.117:0/3027056520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b08161eb0 0x7f4b08147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.112+0000 7f4afe7fc640 1 -- 172.21.15.117:0/3027056520 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b081574a0 con 0x7f4b081425e0 2024-09-19T08:39:02.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.113+0000 7f4afe7fc640 1 --2- 172.21.15.117:0/3027056520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b081425e0 0x7f4b0813fdf0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4af000c3f0 tx=0x7f4af000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:02.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.113+0000 7f4afffff640 1 -- 172.21.15.117:0/3027056520 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af0017070 con 0x7f4b081425e0 2024-09-19T08:39:02.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.113+0000 7f4afffff640 1 -- 172.21.15.117:0/3027056520 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af00052f0 con 0x7f4b081425e0 2024-09-19T08:39:02.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.113+0000 7f4b0d61e640 1 -- 172.21.15.117:0/3027056520 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b08157780 con 0x7f4b081425e0 2024-09-19T08:39:02.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.113+0000 7f4afffff640 1 -- 172.21.15.117:0/3027056520 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af0003830 con 0x7f4b081425e0 2024-09-19T08:39:02.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.113+0000 7f4b0d61e640 1 -- 172.21.15.117:0/3027056520 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b08157d40 con 0x7f4b081425e0 2024-09-19T08:39:02.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.114+0000 7f4b0d61e640 1 -- 172.21.15.117:0/3027056520 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b08162b70 con 0x7f4b081425e0 2024-09-19T08:39:02.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.114+0000 7f4afffff640 1 -- 172.21.15.117:0/3027056520 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4af001a070 con 0x7f4b081425e0 2024-09-19T08:39:02.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.115+0000 7f4afffff640 1 --2- 172.21.15.117:0/3027056520 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4ae806c2b0 0x7f4ae806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:02.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.115+0000 7f4afffff640 1 -- 172.21.15.117:0/3027056520 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6130+0+0 (secure 0 0 0) 0x7f4af008a9e0 con 0x7f4b081425e0 2024-09-19T08:39:02.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.115+0000 7f4b06ffd640 1 --2- 172.21.15.117:0/3027056520 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4ae806c2b0 0x7f4ae806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:02.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.115+0000 7f4b06ffd640 1 --2- 172.21.15.117:0/3027056520 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4ae806c2b0 0x7f4ae806e770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4af8034000 tx=0x7f4af802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:02.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.119+0000 7f4afffff640 1 -- 172.21.15.117:0/3027056520 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4af0058980 con 0x7f4b081425e0 2024-09-19T08:39:02.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.316+0000 7f4b0d61e640 1 -- 172.21.15.117:0/3027056520 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b080690c0 con 0x7f4b081425e0 2024-09-19T08:39:02.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.316+0000 7f4afffff640 1 -- 172.21.15.117:0/3027056520 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5232 (secure 0 0 0) 0x7f4af005cc80 con 0x7f4b081425e0 2024-09-19T08:39:02.316 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:39:02.316 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"btime":"2024-09-19T08:38:51:840984+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1753143760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1753143760},{"type":"v1","addr":"172.21.15.146:6836","nonce":1753143760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/283458533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":283458533},{"type":"v1","addr":"172.21.15.117:6835","nonce":283458533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3844667733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3844667733},{"type":"v1","addr":"172.21.15.117:6834","nonce":3844667733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:38:49.170502+0000","modified":"2024-09-19T08:38:51.165807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5352":{"gid":5352,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/4230307932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4230307932},{"type":"v1","addr":"172.21.15.146:6837","nonce":4230307932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5352,"qdb_cluster":[5352]},"id":3}]} 2024-09-19T08:39:02.317 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 22 2024-09-19T08:39:02.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.318+0000 7f4b0d61e640 1 -- 172.21.15.117:0/3027056520 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4ae806c2b0 msgr2=0x7f4ae806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:02.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.318+0000 7f4b0d61e640 1 --2- 172.21.15.117:0/3027056520 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4ae806c2b0 0x7f4ae806e770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4af8034000 tx=0x7f4af802e000 comp rx=0 tx=0).stop 2024-09-19T08:39:02.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.318+0000 7f4b0d61e640 1 -- 172.21.15.117:0/3027056520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b081425e0 msgr2=0x7f4b0813fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:02.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.318+0000 7f4b0d61e640 1 --2- 172.21.15.117:0/3027056520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b081425e0 0x7f4b0813fdf0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4af000c3f0 tx=0x7f4af000c8b0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.318+0000 7f4b0d61e640 1 -- 172.21.15.117:0/3027056520 shutdown_connections 2024-09-19T08:39:02.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.318+0000 7f4b0d61e640 1 --2- 172.21.15.117:0/3027056520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b08161eb0 0x7f4b08147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.318+0000 7f4b0d61e640 1 --2- 172.21.15.117:0/3027056520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b081425e0 0x7f4b0813fdf0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.318+0000 7f4b0d61e640 1 --2- 172.21.15.117:0/3027056520 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f4ae806c2b0 0x7f4ae806e770 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.318+0000 7f4b0d61e640 1 --2- 172.21.15.117:0/3027056520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0806cd20 0x7f4b08158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.318+0000 7f4b0d61e640 1 -- 172.21.15.117:0/3027056520 >> 172.21.15.117:0/3027056520 conn(0x7f4b080b3ed0 msgr2=0x7f4b08160240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:02.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.318+0000 7f4b0d61e640 1 -- 172.21.15.117:0/3027056520 shutdown_connections 2024-09-19T08:39:02.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.318+0000 7f4b0d61e640 1 -- 172.21.15.117:0/3027056520 wait complete. 2024-09-19T08:39:02.329 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:39:02.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.426+0000 7f60f10c0640 1 Processor -- start 2024-09-19T08:39:02.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.426+0000 7f60f10c0640 1 -- start start 2024-09-19T08:39:02.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.427+0000 7f60f10c0640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f60ec15b120 0x7f60ec06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:02.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.427+0000 7f60f10c0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60ec15b500 con 0x7f60ec0d0bc0 2024-09-19T08:39:02.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.427+0000 7f60f10c0640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60ec06e940 con 0x7f60ec06dec0 2024-09-19T08:39:02.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.427+0000 7f60f10c0640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f60ec06ec20 con 0x7f60ec15b120 2024-09-19T08:39:02.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.427+0000 7f60eb59e640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f60ec0d0bc0 0x7f60ec0c5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:55426/0 (socket says 172.21.15.117:55426) 2024-09-19T08:39:02.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.427+0000 7f60eb59e640 1 -- 172.21.15.117:0/3639614933 learned_addr learned my addr 172.21.15.117:0/3639614933 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:02.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.427+0000 7f60ead9d640 1 --2- 172.21.15.117:0/3639614933 >> v2:172.21.15.146:3300/0 conn(0x7f60ec15b120 0x7f60ec06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:02.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.427+0000 7f60ea59c640 1 -- 172.21.15.117:0/3639614933 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 730120035 0 0) 0x7f60ec15b500 con 0x7f60ec0d0bc0 2024-09-19T08:39:02.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.427+0000 7f60ea59c640 1 -- 172.21.15.117:0/3639614933 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60d8003520 con 0x7f60ec0d0bc0 2024-09-19T08:39:02.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.427+0000 7f60ea59c640 1 -- 172.21.15.117:0/3639614933 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3910495738 0 0) 0x7f60ec06e940 con 0x7f60ec06dec0 2024-09-19T08:39:02.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.427+0000 7f60ea59c640 1 -- 172.21.15.117:0/3639614933 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60ec15b500 con 0x7f60ec06dec0 2024-09-19T08:39:02.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.428+0000 7f60ead9d640 1 -- 172.21.15.117:0/3639614933 >> v1:172.21.15.146:6789/0 conn(0x7f60ec06dec0 legacy=0x7f60ec0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:02.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.428+0000 7f60ead9d640 1 -- 172.21.15.117:0/3639614933 >> v1:172.21.15.117:6789/0 conn(0x7f60ec0d0bc0 legacy=0x7f60ec0c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:02.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.428+0000 7f60ead9d640 1 -- 172.21.15.117:0/3639614933 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ec06ef00 con 0x7f60ec15b120 2024-09-19T08:39:02.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.428+0000 7f60ead9d640 1 --2- 172.21.15.117:0/3639614933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60ec15b120 0x7f60ec06f9e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0097a0 tx=0x7f60dc02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a912c5dd7ad46da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:02.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.428+0000 7f60ea59c640 1 -- 172.21.15.117:0/3639614933 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc037070 con 0x7f60ec15b120 2024-09-19T08:39:02.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.428+0000 7f60ea59c640 1 -- 172.21.15.117:0/3639614933 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60dc032440 con 0x7f60ec15b120 2024-09-19T08:39:02.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.428+0000 7f60ea59c640 1 -- 172.21.15.117:0/3639614933 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc032810 con 0x7f60ec15b120 2024-09-19T08:39:02.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.429+0000 7f60f10c0640 1 -- 172.21.15.117:0/3639614933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60ec15b120 msgr2=0x7f60ec06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:02.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.429+0000 7f60f10c0640 1 --2- 172.21.15.117:0/3639614933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60ec15b120 0x7f60ec06f9e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0097a0 tx=0x7f60dc02a230 comp rx=0 tx=0).stop 2024-09-19T08:39:02.431 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.429+0000 7f60f10c0640 1 -- 172.21.15.117:0/3639614933 shutdown_connections 2024-09-19T08:39:02.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.429+0000 7f60f10c0640 1 --2- 172.21.15.117:0/3639614933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60ec15b120 0x7f60ec06f9e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.429+0000 7f60f10c0640 1 -- 172.21.15.117:0/3639614933 >> 172.21.15.117:0/3639614933 conn(0x7f60ec06bdf0 msgr2=0x7f60ec06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:02.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.429+0000 7f60f10c0640 1 -- 172.21.15.117:0/3639614933 shutdown_connections 2024-09-19T08:39:02.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.429+0000 7f60f10c0640 1 -- 172.21.15.117:0/3639614933 wait complete. 2024-09-19T08:39:02.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.430+0000 7f60f10c0640 1 Processor -- start 2024-09-19T08:39:02.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.431+0000 7f60f10c0640 1 -- start start 2024-09-19T08:39:02.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.431+0000 7f60f10c0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60ec06dec0 0x7f60ec152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:02.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.431+0000 7f60f10c0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60ec0d0bc0 0x7f60ec0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:02.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.431+0000 7f60f10c0640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60ec15b120 0x7f60ec159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:02.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.431+0000 7f60f10c0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec0ce060 con 0x7f60ec06dec0 2024-09-19T08:39:02.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.431+0000 7f60f10c0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec06f4c0 con 0x7f60ec0d0bc0 2024-09-19T08:39:02.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.431+0000 7f60f10c0640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f60ec06e330 con 0x7f60ec15b120 2024-09-19T08:39:02.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.431+0000 7f60ead9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60ec06dec0 0x7f60ec152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:02.434 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.431+0000 7f60ead9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60ec06dec0 0x7f60ec152bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58268/0 (socket says 172.21.15.117:58268) 2024-09-19T08:39:02.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.431+0000 7f60ead9d640 1 -- 172.21.15.117:0/1822146983 learned_addr learned my addr 172.21.15.117:0/1822146983 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:02.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.432+0000 7f60ead9d640 1 -- 172.21.15.117:0/1822146983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60ec15b120 msgr2=0x7f60ec159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:02.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.432+0000 7f60ead9d640 1 --2- 172.21.15.117:0/1822146983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60ec15b120 0x7f60ec159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.432+0000 7f60ead9d640 1 -- 172.21.15.117:0/1822146983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60ec0d0bc0 msgr2=0x7f60ec0cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:02.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.432+0000 7f60ead9d640 1 --2- 172.21.15.117:0/1822146983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60ec0d0bc0 0x7f60ec0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.432+0000 7f60ead9d640 1 -- 172.21.15.117:0/1822146983 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ec0cd3d0 con 0x7f60ec06dec0 2024-09-19T08:39:02.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.432+0000 7f60ead9d640 1 --2- 172.21.15.117:0/1822146983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60ec06dec0 0x7f60ec152bf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f60dc035040 tx=0x7f60dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:02.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.432+0000 7f60e3fff640 1 -- 172.21.15.117:0/1822146983 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc037040 con 0x7f60ec06dec0 2024-09-19T08:39:02.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.432+0000 7f60e3fff640 1 -- 172.21.15.117:0/1822146983 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60dc042070 con 0x7f60ec06dec0 2024-09-19T08:39:02.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.432+0000 7f60f10c0640 1 -- 172.21.15.117:0/1822146983 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60ec0cd6b0 con 0x7f60ec06dec0 2024-09-19T08:39:02.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.432+0000 7f60e3fff640 1 -- 172.21.15.117:0/1822146983 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc03b930 con 0x7f60ec06dec0 2024-09-19T08:39:02.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.432+0000 7f60f10c0640 1 -- 172.21.15.117:0/1822146983 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60ec0b1a00 con 0x7f60ec06dec0 2024-09-19T08:39:02.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.433+0000 7f60f10c0640 1 -- 172.21.15.117:0/1822146983 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60ec0c6180 con 0x7f60ec06dec0 2024-09-19T08:39:02.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.433+0000 7f60e3fff640 1 -- 172.21.15.117:0/1822146983 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f60dc03bad0 con 0x7f60ec06dec0 2024-09-19T08:39:02.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.434+0000 7f60e3fff640 1 --2- 172.21.15.117:0/1822146983 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f60cc06c2b0 0x7f60cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:02.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.434+0000 7f60e3fff640 1 -- 172.21.15.117:0/1822146983 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6130+0+0 (secure 0 0 0) 0x7f60dc0abec0 con 0x7f60ec06dec0 2024-09-19T08:39:02.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.434+0000 7f60e259c640 1 --2- 172.21.15.117:0/1822146983 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f60cc06c2b0 0x7f60cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:02.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.435+0000 7f60e259c640 1 --2- 172.21.15.117:0/1822146983 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f60cc06c2b0 0x7f60cc06e770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f60d40010e0 tx=0x7f60d4007950 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:02.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.438+0000 7f60e3fff640 1 -- 172.21.15.117:0/1822146983 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f60ec0c6180 con 0x7f60ec06dec0 2024-09-19T08:39:02.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.637+0000 7f60f10c0640 1 -- 172.21.15.117:0/1822146983 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60ec06f9e0 con 0x7f60ec06dec0 2024-09-19T08:39:02.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.637+0000 7f60e3fff640 1 -- 172.21.15.117:0/1822146983 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5232 (secure 0 0 0) 0x7f60dc07a490 con 0x7f60ec06dec0 2024-09-19T08:39:02.638 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:39:02.639 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"btime":"2024-09-19T08:38:51:840984+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1753143760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1753143760},{"type":"v1","addr":"172.21.15.146:6836","nonce":1753143760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/283458533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":283458533},{"type":"v1","addr":"172.21.15.117:6835","nonce":283458533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3844667733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3844667733},{"type":"v1","addr":"172.21.15.117:6834","nonce":3844667733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:38:49.170502+0000","modified":"2024-09-19T08:38:51.165807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5352":{"gid":5352,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/4230307932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4230307932},{"type":"v1","addr":"172.21.15.146:6837","nonce":4230307932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5352,"qdb_cluster":[5352]},"id":3}]} 2024-09-19T08:39:02.639 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 22 2024-09-19T08:39:02.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.639+0000 7f60f10c0640 1 -- 172.21.15.117:0/1822146983 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f60cc06c2b0 msgr2=0x7f60cc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:02.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.639+0000 7f60f10c0640 1 --2- 172.21.15.117:0/1822146983 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f60cc06c2b0 0x7f60cc06e770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f60d40010e0 tx=0x7f60d4007950 comp rx=0 tx=0).stop 2024-09-19T08:39:02.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.639+0000 7f60f10c0640 1 -- 172.21.15.117:0/1822146983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60ec06dec0 msgr2=0x7f60ec152bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:02.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.639+0000 7f60f10c0640 1 --2- 172.21.15.117:0/1822146983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60ec06dec0 0x7f60ec152bf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f60dc035040 tx=0x7f60dc0046c0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.639+0000 7f60f10c0640 1 -- 172.21.15.117:0/1822146983 shutdown_connections 2024-09-19T08:39:02.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.639+0000 7f60f10c0640 1 --2- 172.21.15.117:0/1822146983 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f60cc06c2b0 0x7f60cc06e770 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.639+0000 7f60f10c0640 1 --2- 172.21.15.117:0/1822146983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60ec15b120 0x7f60ec159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.639+0000 7f60f10c0640 1 --2- 172.21.15.117:0/1822146983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60ec0d0bc0 0x7f60ec0cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.639+0000 7f60f10c0640 1 --2- 172.21.15.117:0/1822146983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60ec06dec0 0x7f60ec152bf0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.640+0000 7f60f10c0640 1 -- 172.21.15.117:0/1822146983 >> 172.21.15.117:0/1822146983 conn(0x7f60ec06bdf0 msgr2=0x7f60ec0c6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:02.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.640+0000 7f60f10c0640 1 -- 172.21.15.117:0/1822146983 shutdown_connections 2024-09-19T08:39:02.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.640+0000 7f60f10c0640 1 -- 172.21.15.117:0/1822146983 wait complete. 2024-09-19T08:39:02.652 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:39:02.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.749+0000 7fbc9af31640 1 Processor -- start 2024-09-19T08:39:02.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.749+0000 7fbc9af31640 1 -- start start 2024-09-19T08:39:02.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.749+0000 7fbc9af31640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbc940d0070 0x7fbc9415f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:02.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.750+0000 7fbc9af31640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbc940d4130 0x7fbc940d4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:02.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.750+0000 7fbc9af31640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc940d1b10 con 0x7fbc9415f0d0 2024-09-19T08:39:02.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.750+0000 7fbc9af31640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbc940cf2b0 con 0x7fbc940d4130 2024-09-19T08:39:02.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.750+0000 7fbc9af31640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fbc940cf590 con 0x7fbc940d0070 2024-09-19T08:39:02.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.750+0000 7fbc994ce640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbc940d4130 0x7fbc940d4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:02.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.750+0000 7fbc994ce640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbc940d4130 0x7fbc940d4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58276/0 (socket says 172.21.15.117:58276) 2024-09-19T08:39:02.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.750+0000 7fbc994ce640 1 -- 172.21.15.117:0/1753027168 learned_addr learned my addr 172.21.15.117:0/1753027168 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:02.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.750+0000 7fbc93fff640 1 --2- 172.21.15.117:0/1753027168 >> v2:172.21.15.146:3300/0 conn(0x7fbc940d0070 0x7fbc9415f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:02.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.750+0000 7fbc994ce640 1 -- 172.21.15.117:0/1753027168 >> v2:172.21.15.146:3300/0 conn(0x7fbc940d0070 msgr2=0x7fbc9415f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:02.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.750+0000 7fbc994ce640 1 --2- 172.21.15.117:0/1753027168 >> v2:172.21.15.146:3300/0 conn(0x7fbc940d0070 0x7fbc9415f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.750+0000 7fbc994ce640 1 -- 172.21.15.117:0/1753027168 >> v1:172.21.15.146:6789/0 conn(0x7fbc9415f0d0 legacy=0x7fbc940d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:02.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.750+0000 7fbc994ce640 1 -- 172.21.15.117:0/1753027168 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc940cf870 con 0x7fbc940d4130 2024-09-19T08:39:02.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.751+0000 7fbc994ce640 1 --2- 172.21.15.117:0/1753027168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc940d4130 0x7fbc940d4560 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbc94162fc0 tx=0x7fbc8c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f28c30e1dd030f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:02.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.751+0000 7fbc937fe640 1 -- 172.21.15.117:0/1753027168 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c036070 con 0x7fbc940d4130 2024-09-19T08:39:02.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.751+0000 7fbc937fe640 1 -- 172.21.15.117:0/1753027168 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc8c031600 con 0x7fbc940d4130 2024-09-19T08:39:02.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.751+0000 7fbc937fe640 1 -- 172.21.15.117:0/1753027168 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c0319d0 con 0x7fbc940d4130 2024-09-19T08:39:02.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.751+0000 7fbc9af31640 1 -- 172.21.15.117:0/1753027168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc940d4130 msgr2=0x7fbc940d4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:02.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.751+0000 7fbc9af31640 1 --2- 172.21.15.117:0/1753027168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc940d4130 0x7fbc940d4560 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbc94162fc0 tx=0x7fbc8c02a6a0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.751+0000 7fbc9af31640 1 -- 172.21.15.117:0/1753027168 shutdown_connections 2024-09-19T08:39:02.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.751+0000 7fbc9af31640 1 --2- 172.21.15.117:0/1753027168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc940d4130 0x7fbc940d4560 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.751+0000 7fbc9af31640 1 --2- 172.21.15.117:0/1753027168 >> v2:172.21.15.146:3300/0 conn(0x7fbc940d0070 0x7fbc9415f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.751+0000 7fbc9af31640 1 -- 172.21.15.117:0/1753027168 >> 172.21.15.117:0/1753027168 conn(0x7fbc9409d760 msgr2=0x7fbc9408bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:02.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.751+0000 7fbc9af31640 1 -- 172.21.15.117:0/1753027168 shutdown_connections 2024-09-19T08:39:02.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.751+0000 7fbc9af31640 1 -- 172.21.15.117:0/1753027168 wait complete. 2024-09-19T08:39:02.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.753+0000 7fbc9af31640 1 Processor -- start 2024-09-19T08:39:02.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.753+0000 7fbc9af31640 1 -- start start 2024-09-19T08:39:02.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.753+0000 7fbc9af31640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc940d0070 0x7fbc940cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:02.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.753+0000 7fbc9af31640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc940d4130 0x7fbc940b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:02.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.753+0000 7fbc9af31640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc9415f0d0 0x7fbc94149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:02.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.753+0000 7fbc9af31640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbc940cef60 con 0x7fbc940d4130 2024-09-19T08:39:02.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.753+0000 7fbc9af31640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbc940d4aa0 con 0x7fbc940d0070 2024-09-19T08:39:02.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.753+0000 7fbc9af31640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fbc940b2f70 con 0x7fbc9415f0d0 2024-09-19T08:39:02.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.754+0000 7fbc93fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc940d4130 0x7fbc940b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:02.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.754+0000 7fbc93fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc940d4130 0x7fbc940b4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58278/0 (socket says 172.21.15.117:58278) 2024-09-19T08:39:02.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.754+0000 7fbc93fff640 1 -- 172.21.15.117:0/1630384217 learned_addr learned my addr 172.21.15.117:0/1630384217 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:02.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.754+0000 7fbc98ccd640 1 --2- 172.21.15.117:0/1630384217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc940d0070 0x7fbc940cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:02.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.754+0000 7fbc994ce640 1 --2- 172.21.15.117:0/1630384217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc9415f0d0 0x7fbc94149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:02.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.754+0000 7fbc93fff640 1 -- 172.21.15.117:0/1630384217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc9415f0d0 msgr2=0x7fbc94149630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:02.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.754+0000 7fbc93fff640 1 --2- 172.21.15.117:0/1630384217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc9415f0d0 0x7fbc94149630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.754+0000 7fbc93fff640 1 -- 172.21.15.117:0/1630384217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc940d0070 msgr2=0x7fbc940cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:02.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.754+0000 7fbc93fff640 1 --2- 172.21.15.117:0/1630384217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc940d0070 0x7fbc940cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.754+0000 7fbc93fff640 1 -- 172.21.15.117:0/1630384217 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc941485b0 con 0x7fbc940d4130 2024-09-19T08:39:02.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.754+0000 7fbc93fff640 1 --2- 172.21.15.117:0/1630384217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc940d4130 0x7fbc940b4970 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbc8000d800 tx=0x7fbc8000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:02.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.754+0000 7fbc917fa640 1 -- 172.21.15.117:0/1630384217 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8000b6c0 con 0x7fbc940d4130 2024-09-19T08:39:02.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.754+0000 7fbc917fa640 1 -- 172.21.15.117:0/1630384217 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc80019070 con 0x7fbc940d4130 2024-09-19T08:39:02.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.754+0000 7fbc9af31640 1 -- 172.21.15.117:0/1630384217 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc94148870 con 0x7fbc940d4130 2024-09-19T08:39:02.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.754+0000 7fbc917fa640 1 -- 172.21.15.117:0/1630384217 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8000ba80 con 0x7fbc940d4130 2024-09-19T08:39:02.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.754+0000 7fbc9af31640 1 -- 172.21.15.117:0/1630384217 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc94148e30 con 0x7fbc940d4130 2024-09-19T08:39:02.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.755+0000 7fbc9af31640 1 -- 172.21.15.117:0/1630384217 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc940d4560 con 0x7fbc940d4130 2024-09-19T08:39:02.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.756+0000 7fbc917fa640 1 -- 172.21.15.117:0/1630384217 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbc8000bc20 con 0x7fbc940d4130 2024-09-19T08:39:02.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.756+0000 7fbc917fa640 1 --2- 172.21.15.117:0/1630384217 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbc7806c2e0 0x7fbc7806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:02.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.756+0000 7fbc917fa640 1 -- 172.21.15.117:0/1630384217 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6130+0+0 (secure 0 0 0) 0x7fbc8008b9c0 con 0x7fbc940d4130 2024-09-19T08:39:02.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.756+0000 7fbc98ccd640 1 --2- 172.21.15.117:0/1630384217 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbc7806c2e0 0x7fbc7806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:02.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.757+0000 7fbc98ccd640 1 --2- 172.21.15.117:0/1630384217 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbc7806c2e0 0x7fbc7806e7a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbc88000f60 tx=0x7fbc88009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:02.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.761+0000 7fbc917fa640 1 -- 172.21.15.117:0/1630384217 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbc8008de20 con 0x7fbc940d4130 2024-09-19T08:39:02.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.928+0000 7fbc9af31640 1 -- 172.21.15.117:0/1630384217 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc9406cf30 con 0x7fbc940d4130 2024-09-19T08:39:02.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.929+0000 7fbc917fa640 1 -- 172.21.15.117:0/1630384217 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+17039 (secure 0 0 0) 0x7fbc800598a0 con 0x7fbc940d4130 2024-09-19T08:39:02.930 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:39:02.930 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":54,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:38:55.861330+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:38:47.782719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-19T08:38:48.135062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2b","mappings":[{"from":2,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:39:02.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.931+0000 7fbc9af31640 1 -- 172.21.15.117:0/1630384217 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbc7806c2e0 msgr2=0x7fbc7806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:02.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.931+0000 7fbc9af31640 1 --2- 172.21.15.117:0/1630384217 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbc7806c2e0 0x7fbc7806e7a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbc88000f60 tx=0x7fbc88009040 comp rx=0 tx=0).stop 2024-09-19T08:39:02.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.931+0000 7fbc9af31640 1 -- 172.21.15.117:0/1630384217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc940d4130 msgr2=0x7fbc940b4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:02.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.931+0000 7fbc9af31640 1 --2- 172.21.15.117:0/1630384217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc940d4130 0x7fbc940b4970 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbc8000d800 tx=0x7fbc8000dcc0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.931+0000 7fbc9af31640 1 -- 172.21.15.117:0/1630384217 shutdown_connections 2024-09-19T08:39:02.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.931+0000 7fbc9af31640 1 --2- 172.21.15.117:0/1630384217 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbc7806c2e0 0x7fbc7806e7a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.931+0000 7fbc9af31640 1 --2- 172.21.15.117:0/1630384217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc9415f0d0 0x7fbc94149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.931+0000 7fbc9af31640 1 --2- 172.21.15.117:0/1630384217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc940d4130 0x7fbc940b4970 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.931+0000 7fbc9af31640 1 --2- 172.21.15.117:0/1630384217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc940d0070 0x7fbc940cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:02.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.931+0000 7fbc9af31640 1 -- 172.21.15.117:0/1630384217 >> 172.21.15.117:0/1630384217 conn(0x7fbc9409d760 msgr2=0x7fbc940b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:02.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.931+0000 7fbc9af31640 1 -- 172.21.15.117:0/1630384217 shutdown_connections 2024-09-19T08:39:02.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:02.931+0000 7fbc9af31640 1 -- 172.21.15.117:0/1630384217 wait complete. 2024-09-19T08:39:02.943 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T08:39:02.943 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:39:03.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.040+0000 7fc4b35c4640 1 Processor -- start 2024-09-19T08:39:03.041 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.040+0000 7fc4b35c4640 1 -- start start 2024-09-19T08:39:03.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.041+0000 7fc4b35c4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc4ac0d2750 0x7fc4ac13f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.041+0000 7fc4b35c4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac0726c0 0x7fc4ac160010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.041+0000 7fc4b35c4640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4ac13fda0 con 0x7fc4ac072250 2024-09-19T08:39:03.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.041+0000 7fc4b35c4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc4ac145bd0 con 0x7fc4ac0d2750 2024-09-19T08:39:03.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.041+0000 7fc4b35c4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fc4ac1427e0 con 0x7fc4ac0726c0 2024-09-19T08:39:03.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.041+0000 7fc4b1360640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc4ac0d2750 0x7fc4ac13f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.041+0000 7fc4b1360640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc4ac0d2750 0x7fc4ac13f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58292/0 (socket says 172.21.15.117:58292) 2024-09-19T08:39:03.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.041+0000 7fc4b1360640 1 -- 172.21.15.117:0/3763322930 learned_addr learned my addr 172.21.15.117:0/3763322930 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:03.043 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.042+0000 7fc4b1b61640 1 --2- 172.21.15.117:0/3763322930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac0726c0 0x7fc4ac160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.042+0000 7fc4b1360640 1 -- 172.21.15.117:0/3763322930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac0726c0 msgr2=0x7fc4ac160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:03.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.042+0000 7fc4b1360640 1 --2- 172.21.15.117:0/3763322930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac0726c0 0x7fc4ac160010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.042+0000 7fc4b1360640 1 -- 172.21.15.117:0/3763322930 >> v1:172.21.15.146:6789/0 conn(0x7fc4ac072250 legacy=0x7fc4ac0cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.042+0000 7fc4b1360640 1 -- 172.21.15.117:0/3763322930 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ac0d2b30 con 0x7fc4ac0d2750 2024-09-19T08:39:03.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.042+0000 7fc4b1360640 1 --2- 172.21.15.117:0/3763322930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ac0d2750 0x7fc4ac13f860 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009e50 tx=0x7fc4a802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf607747ceefb805 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:03.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.043+0000 7fc4a3fff640 1 -- 172.21.15.117:0/3763322930 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8036070 con 0x7fc4ac0d2750 2024-09-19T08:39:03.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.043+0000 7fc4a3fff640 1 -- 172.21.15.117:0/3763322930 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a8031600 con 0x7fc4ac0d2750 2024-09-19T08:39:03.045 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.043+0000 7fc4a3fff640 1 -- 172.21.15.117:0/3763322930 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a80319d0 con 0x7fc4ac0d2750 2024-09-19T08:39:03.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.043+0000 7fc4b35c4640 1 -- 172.21.15.117:0/3763322930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ac0d2750 msgr2=0x7fc4ac13f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.043+0000 7fc4b35c4640 1 --2- 172.21.15.117:0/3763322930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ac0d2750 0x7fc4ac13f860 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009e50 tx=0x7fc4a802a680 comp rx=0 tx=0).stop 2024-09-19T08:39:03.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.043+0000 7fc4b35c4640 1 -- 172.21.15.117:0/3763322930 shutdown_connections 2024-09-19T08:39:03.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.043+0000 7fc4b35c4640 1 --2- 172.21.15.117:0/3763322930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac0726c0 0x7fc4ac160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.043+0000 7fc4b35c4640 1 --2- 172.21.15.117:0/3763322930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ac0d2750 0x7fc4ac13f860 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.043+0000 7fc4b35c4640 1 -- 172.21.15.117:0/3763322930 >> 172.21.15.117:0/3763322930 conn(0x7fc4ac0b4040 msgr2=0x7fc4ac0b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:03.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.043+0000 7fc4b35c4640 1 -- 172.21.15.117:0/3763322930 shutdown_connections 2024-09-19T08:39:03.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.043+0000 7fc4b35c4640 1 -- 172.21.15.117:0/3763322930 wait complete. 2024-09-19T08:39:03.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.044+0000 7fc4b35c4640 1 Processor -- start 2024-09-19T08:39:03.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.044+0000 7fc4b35c4640 1 -- start start 2024-09-19T08:39:03.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.045+0000 7fc4b35c4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ac072250 0x7fc4ac1f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.045+0000 7fc4b35c4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac0726c0 0x7fc4ac0cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.045+0000 7fc4b35c4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4ac0d2750 0x7fc4ac1f3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.045+0000 7fc4b35c4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac142220 con 0x7fc4ac072250 2024-09-19T08:39:03.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.045+0000 7fc4b35c4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac141f40 con 0x7fc4ac0d2750 2024-09-19T08:39:03.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.045+0000 7fc4b35c4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fc4ac142500 con 0x7fc4ac0726c0 2024-09-19T08:39:03.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.045+0000 7fc4b1360640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ac072250 0x7fc4ac1f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.045+0000 7fc4b1360640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ac072250 0x7fc4ac1f4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58302/0 (socket says 172.21.15.117:58302) 2024-09-19T08:39:03.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.045+0000 7fc4b1360640 1 -- 172.21.15.117:0/4250605893 learned_addr learned my addr 172.21.15.117:0/4250605893 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:03.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.045+0000 7fc4b0b5f640 1 --2- 172.21.15.117:0/4250605893 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac0726c0 0x7fc4ac0cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.045+0000 7fc4b1b61640 1 --2- 172.21.15.117:0/4250605893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4ac0d2750 0x7fc4ac1f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.046+0000 7fc4b1360640 1 -- 172.21.15.117:0/4250605893 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac0726c0 msgr2=0x7fc4ac0cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.046+0000 7fc4b1360640 1 --2- 172.21.15.117:0/4250605893 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac0726c0 0x7fc4ac0cb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.046+0000 7fc4b1360640 1 -- 172.21.15.117:0/4250605893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4ac0d2750 msgr2=0x7fc4ac1f3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.046+0000 7fc4b1360640 1 --2- 172.21.15.117:0/4250605893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4ac0d2750 0x7fc4ac1f3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.046+0000 7fc4b1360640 1 -- 172.21.15.117:0/4250605893 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ac0cb940 con 0x7fc4ac072250 2024-09-19T08:39:03.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.046+0000 7fc4b1360640 1 --2- 172.21.15.117:0/4250605893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ac072250 0x7fc4ac1f4d10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8000f80 tx=0x7fc4a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:03.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.046+0000 7fc4a1ffb640 1 -- 172.21.15.117:0/4250605893 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8036050 con 0x7fc4ac072250 2024-09-19T08:39:03.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.046+0000 7fc4a1ffb640 1 -- 172.21.15.117:0/4250605893 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a8042070 con 0x7fc4ac072250 2024-09-19T08:39:03.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.046+0000 7fc4b35c4640 1 -- 172.21.15.117:0/4250605893 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4ac0b5200 con 0x7fc4ac072250 2024-09-19T08:39:03.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.046+0000 7fc4a1ffb640 1 -- 172.21.15.117:0/4250605893 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8009510 con 0x7fc4ac072250 2024-09-19T08:39:03.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.046+0000 7fc4b35c4640 1 -- 172.21.15.117:0/4250605893 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4ac0b57c0 con 0x7fc4ac072250 2024-09-19T08:39:03.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.047+0000 7fc4b35c4640 1 -- 172.21.15.117:0/4250605893 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4ac1418b0 con 0x7fc4ac072250 2024-09-19T08:39:03.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.048+0000 7fc4a1ffb640 1 -- 172.21.15.117:0/4250605893 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc4a8007c70 con 0x7fc4ac072250 2024-09-19T08:39:03.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.048+0000 7fc4a1ffb640 1 --2- 172.21.15.117:0/4250605893 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc49006c2b0 0x7fc49006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.048+0000 7fc4a1ffb640 1 -- 172.21.15.117:0/4250605893 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6130+0+0 (secure 0 0 0) 0x7fc4a80ac4c0 con 0x7fc4ac072250 2024-09-19T08:39:03.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.048+0000 7fc4b0b5f640 1 --2- 172.21.15.117:0/4250605893 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc49006c2b0 0x7fc49006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.049+0000 7fc4b0b5f640 1 --2- 172.21.15.117:0/4250605893 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc49006c2b0 0x7fc49006e770 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0b6e50 tx=0x7fc49c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:03.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.052+0000 7fc4a1ffb640 1 -- 172.21.15.117:0/4250605893 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc4a807aa80 con 0x7fc4ac072250 2024-09-19T08:39:03.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.249+0000 7fc4b35c4640 1 -- 172.21.15.117:0/4250605893 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4ac0b1e50 con 0x7fc4ac072250 2024-09-19T08:39:03.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.250+0000 7fc4a1ffb640 1 -- 172.21.15.117:0/4250605893 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5232 (secure 0 0 0) 0x7fc4a807a380 con 0x7fc4ac072250 2024-09-19T08:39:03.251 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:39:03.251 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"btime":"2024-09-19T08:38:51:840984+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1753143760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1753143760},{"type":"v1","addr":"172.21.15.146:6836","nonce":1753143760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/283458533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":283458533},{"type":"v1","addr":"172.21.15.117:6835","nonce":283458533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3844667733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3844667733},{"type":"v1","addr":"172.21.15.117:6834","nonce":3844667733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:38:49.170502+0000","modified":"2024-09-19T08:38:51.165807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5352":{"gid":5352,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/4230307932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4230307932},{"type":"v1","addr":"172.21.15.146:6837","nonce":4230307932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5352,"qdb_cluster":[5352]},"id":3}]} 2024-09-19T08:39:03.251 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 22 2024-09-19T08:39:03.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.252+0000 7fc4b35c4640 1 -- 172.21.15.117:0/4250605893 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc49006c2b0 msgr2=0x7fc49006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.252+0000 7fc4b35c4640 1 --2- 172.21.15.117:0/4250605893 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc49006c2b0 0x7fc49006e770 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0b6e50 tx=0x7fc49c009040 comp rx=0 tx=0).stop 2024-09-19T08:39:03.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.252+0000 7fc4b35c4640 1 -- 172.21.15.117:0/4250605893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ac072250 msgr2=0x7fc4ac1f4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.252+0000 7fc4b35c4640 1 --2- 172.21.15.117:0/4250605893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ac072250 0x7fc4ac1f4d10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8000f80 tx=0x7fc4a8004a40 comp rx=0 tx=0).stop 2024-09-19T08:39:03.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.252+0000 7fc4b35c4640 1 -- 172.21.15.117:0/4250605893 shutdown_connections 2024-09-19T08:39:03.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.252+0000 7fc4b35c4640 1 --2- 172.21.15.117:0/4250605893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4ac0d2750 0x7fc4ac1f3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.252+0000 7fc4b35c4640 1 --2- 172.21.15.117:0/4250605893 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc49006c2b0 0x7fc49006e770 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.252+0000 7fc4b35c4640 1 --2- 172.21.15.117:0/4250605893 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac0726c0 0x7fc4ac0cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.252+0000 7fc4b35c4640 1 --2- 172.21.15.117:0/4250605893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4ac072250 0x7fc4ac1f4d10 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.252+0000 7fc4b35c4640 1 -- 172.21.15.117:0/4250605893 >> 172.21.15.117:0/4250605893 conn(0x7fc4ac0b4040 msgr2=0x7fc4ac0cddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:03.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.252+0000 7fc4b35c4640 1 -- 172.21.15.117:0/4250605893 shutdown_connections 2024-09-19T08:39:03.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.252+0000 7fc4b35c4640 1 -- 172.21.15.117:0/4250605893 wait complete. 2024-09-19T08:39:03.264 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:39:03.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.362+0000 7f00265c4640 1 Processor -- start 2024-09-19T08:39:03.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.362+0000 7f00265c4640 1 -- start start 2024-09-19T08:39:03.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f00265c4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00200cd360 0x7f002006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f00265c4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00200b3c10 con 0x7f002015e7f0 2024-09-19T08:39:03.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f00265c4640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00200cb900 con 0x7f00200b03c0 2024-09-19T08:39:03.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f00265c4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f00200cc1f0 con 0x7f00200cd360 2024-09-19T08:39:03.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f001ffff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f002015e7f0 0x7f00200adff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:55440/0 (socket says 172.21.15.117:55440) 2024-09-19T08:39:03.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f001ffff640 1 -- 172.21.15.117:0/1990365171 learned_addr learned my addr 172.21.15.117:0/1990365171 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:03.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f0024b61640 1 --2- 172.21.15.117:0/1990365171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00200cd360 0x7f002006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f001f7fe640 1 -- 172.21.15.117:0/1990365171 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3338116477 0 0) 0x7f00200b3c10 con 0x7f002015e7f0 2024-09-19T08:39:03.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f001f7fe640 1 -- 172.21.15.117:0/1990365171 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f000c003520 con 0x7f002015e7f0 2024-09-19T08:39:03.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f001f7fe640 1 -- 172.21.15.117:0/1990365171 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3692197701 0 0) 0x7f00200cb900 con 0x7f00200b03c0 2024-09-19T08:39:03.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f001f7fe640 1 -- 172.21.15.117:0/1990365171 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00200b3c10 con 0x7f00200b03c0 2024-09-19T08:39:03.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f001f7fe640 1 -- 172.21.15.117:0/1990365171 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3921663056 0 0) 0x7f000c003520 con 0x7f002015e7f0 2024-09-19T08:39:03.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f001f7fe640 1 -- 172.21.15.117:0/1990365171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00200cd360 msgr2=0x7f002006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:03.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f001f7fe640 1 --2- 172.21.15.117:0/1990365171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00200cd360 0x7f002006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f001f7fe640 1 -- 172.21.15.117:0/1990365171 >> v1:172.21.15.146:6789/0 conn(0x7f00200b03c0 legacy=0x7f00200cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f001f7fe640 1 -- 172.21.15.117:0/1990365171 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f002015ebd0 con 0x7f002015e7f0 2024-09-19T08:39:03.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f001f7fe640 1 -- 172.21.15.117:0/1990365171 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f0010001670 con 0x7f002015e7f0 2024-09-19T08:39:03.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f001f7fe640 1 -- 172.21.15.117:0/1990365171 >> v1:172.21.15.117:6789/0 conn(0x7f002015e7f0 legacy=0x7f00200adff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f001f7fe640 1 --2- 172.21.15.117:0/1990365171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f000c003b70 0x7f000c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f001f7fe640 1 --2- 172.21.15.117:0/1990365171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f000c004800 0x7f000c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f001f7fe640 1 --2- 172.21.15.117:0/1990365171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00200cd360 0x7f000c005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f001f7fe640 1 -- 172.21.15.117:0/1990365171 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f00200cc1f0 con 0x7f000c004800 2024-09-19T08:39:03.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f001f7fe640 1 -- 172.21.15.117:0/1990365171 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f000c00bb80 con 0x7f000c003b70 2024-09-19T08:39:03.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f001f7fe640 1 -- 172.21.15.117:0/1990365171 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f000c00bd80 con 0x7f00200cd360 2024-09-19T08:39:03.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f0017fff640 1 --2- 172.21.15.117:0/1990365171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f000c004800 0x7f000c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.363+0000 7f001ffff640 1 --2- 172.21.15.117:0/1990365171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f000c003b70 0x7f000c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.364+0000 7f0024b61640 1 --2- 172.21.15.117:0/1990365171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00200cd360 0x7f000c005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.364+0000 7f0017fff640 1 -- 172.21.15.117:0/1990365171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00200cd360 msgr2=0x7f000c005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:03.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.364+0000 7f0017fff640 1 --2- 172.21.15.117:0/1990365171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00200cd360 0x7f000c005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.364+0000 7f0017fff640 1 -- 172.21.15.117:0/1990365171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f000c003b70 msgr2=0x7f000c003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:03.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.364+0000 7f0017fff640 1 --2- 172.21.15.117:0/1990365171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f000c003b70 0x7f000c003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.364+0000 7f0017fff640 1 -- 172.21.15.117:0/1990365171 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c003520 con 0x7f000c004800 2024-09-19T08:39:03.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.364+0000 7f0017fff640 1 --2- 172.21.15.117:0/1990365171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f000c004800 0x7f000c004c80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f00080018a0 tx=0x7f000c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9dd3055e9c86b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:03.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.365+0000 7f001f7fe640 1 -- 172.21.15.117:0/1990365171 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00080014f0 con 0x7f000c004800 2024-09-19T08:39:03.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.365+0000 7f001f7fe640 1 -- 172.21.15.117:0/1990365171 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00080052d0 con 0x7f000c004800 2024-09-19T08:39:03.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.365+0000 7f001f7fe640 1 -- 172.21.15.117:0/1990365171 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000802ac60 con 0x7f000c004800 2024-09-19T08:39:03.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.365+0000 7f00265c4640 1 -- 172.21.15.117:0/1990365171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f000c004800 msgr2=0x7f000c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.365+0000 7f00265c4640 1 --2- 172.21.15.117:0/1990365171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f000c004800 0x7f000c004c80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f00080018a0 tx=0x7f000c005830 comp rx=0 tx=0).stop 2024-09-19T08:39:03.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.365+0000 7f0024b61640 1 -- 172.21.15.117:0/1990365171 reap_dead start 2024-09-19T08:39:03.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.365+0000 7f00265c4640 1 -- 172.21.15.117:0/1990365171 shutdown_connections 2024-09-19T08:39:03.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.365+0000 7f00265c4640 1 -- 172.21.15.117:0/1990365171 >> 172.21.15.117:0/1990365171 conn(0x7f00200b2d10 msgr2=0x7f00200b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:03.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.365+0000 7f00265c4640 1 -- 172.21.15.117:0/1990365171 shutdown_connections 2024-09-19T08:39:03.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.365+0000 7f00265c4640 1 -- 172.21.15.117:0/1990365171 wait complete. 2024-09-19T08:39:03.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.366+0000 7f00265c4640 1 Processor -- start 2024-09-19T08:39:03.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.366+0000 7f00265c4640 1 -- start start 2024-09-19T08:39:03.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.367+0000 7f00265c4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f000c004800 0x7f00200c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.367+0000 7f00265c4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0020155210 0x7f00200b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.367+0000 7f00265c4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00200c8250 0x7f00200c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.367+0000 7f00265c4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f00200ae700 con 0x7f0020155210 2024-09-19T08:39:03.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.367+0000 7f00265c4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f00200cbe80 con 0x7f000c004800 2024-09-19T08:39:03.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.367+0000 7f00265c4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f00200b3830 con 0x7f00200c8250 2024-09-19T08:39:03.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.367+0000 7f0017fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0020155210 0x7f00200b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.367+0000 7f0017fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0020155210 0x7f00200b6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58322/0 (socket says 172.21.15.117:58322) 2024-09-19T08:39:03.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.367+0000 7f0017fff640 1 -- 172.21.15.117:0/3834537082 learned_addr learned my addr 172.21.15.117:0/3834537082 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:03.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.367+0000 7f001ffff640 1 --2- 172.21.15.117:0/3834537082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f000c004800 0x7f00200c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.367+0000 7f0024b61640 1 --2- 172.21.15.117:0/3834537082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00200c8250 0x7f00200c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.367+0000 7f0017fff640 1 -- 172.21.15.117:0/3834537082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00200c8250 msgr2=0x7f00200c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.367+0000 7f0017fff640 1 --2- 172.21.15.117:0/3834537082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00200c8250 0x7f00200c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.367+0000 7f0017fff640 1 -- 172.21.15.117:0/3834537082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f000c004800 msgr2=0x7f00200c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.367+0000 7f0017fff640 1 --2- 172.21.15.117:0/3834537082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f000c004800 0x7f00200c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.367+0000 7f0017fff640 1 -- 172.21.15.117:0/3834537082 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00200b66b0 con 0x7f0020155210 2024-09-19T08:39:03.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.367+0000 7f0024b61640 1 --2- 172.21.15.117:0/3834537082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00200c8250 0x7f00200c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:03.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.368+0000 7f0017fff640 1 --2- 172.21.15.117:0/3834537082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0020155210 0x7f00200b6170 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0008000c00 tx=0x7f00080012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:03.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.368+0000 7f001d7fa640 1 -- 172.21.15.117:0/3834537082 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0008040020 con 0x7f0020155210 2024-09-19T08:39:03.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.368+0000 7f001d7fa640 1 -- 172.21.15.117:0/3834537082 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0008005480 con 0x7f0020155210 2024-09-19T08:39:03.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.368+0000 7f00265c4640 1 -- 172.21.15.117:0/3834537082 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00201561c0 con 0x7f0020155210 2024-09-19T08:39:03.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.368+0000 7f001d7fa640 1 -- 172.21.15.117:0/3834537082 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00080014f0 con 0x7f0020155210 2024-09-19T08:39:03.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.368+0000 7f00265c4640 1 -- 172.21.15.117:0/3834537082 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0020156780 con 0x7f0020155210 2024-09-19T08:39:03.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.369+0000 7f00265c4640 1 -- 172.21.15.117:0/3834537082 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00200adff0 con 0x7f0020155210 2024-09-19T08:39:03.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.369+0000 7f001d7fa640 1 -- 172.21.15.117:0/3834537082 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0008043020 con 0x7f0020155210 2024-09-19T08:39:03.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.370+0000 7f001d7fa640 1 --2- 172.21.15.117:0/3834537082 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f000006c2b0 0x7f000006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.370+0000 7f001d7fa640 1 -- 172.21.15.117:0/3834537082 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6130+0+0 (secure 0 0 0) 0x7f00080ab7b0 con 0x7f0020155210 2024-09-19T08:39:03.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.370+0000 7f001ffff640 1 --2- 172.21.15.117:0/3834537082 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f000006c2b0 0x7f000006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.370+0000 7f001ffff640 1 --2- 172.21.15.117:0/3834537082 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f000006c2b0 0x7f000006e770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0010001eb0 tx=0x7f0010000fc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:03.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.374+0000 7f001d7fa640 1 -- 172.21.15.117:0/3834537082 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f000804a030 con 0x7f0020155210 2024-09-19T08:39:03.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.573+0000 7f00265c4640 1 -- 172.21.15.117:0/3834537082 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00200b68e0 con 0x7f0020155210 2024-09-19T08:39:03.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.573+0000 7f001d7fa640 1 -- 172.21.15.117:0/3834537082 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5232 (secure 0 0 0) 0x7f00200b66b0 con 0x7f0020155210 2024-09-19T08:39:03.574 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:39:03.574 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"btime":"2024-09-19T08:38:51:840984+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1753143760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1753143760},{"type":"v1","addr":"172.21.15.146:6836","nonce":1753143760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/283458533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":283458533},{"type":"v1","addr":"172.21.15.117:6835","nonce":283458533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3844667733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3844667733},{"type":"v1","addr":"172.21.15.117:6834","nonce":3844667733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T08:38:49.170502+0000","modified":"2024-09-19T08:38:51.165807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5352},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5352":{"gid":5352,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/4230307932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4230307932},{"type":"v1","addr":"172.21.15.146:6837","nonce":4230307932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5352,"qdb_cluster":[5352]},"id":3}]} 2024-09-19T08:39:03.575 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 22 2024-09-19T08:39:03.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.575+0000 7f00265c4640 1 -- 172.21.15.117:0/3834537082 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f000006c2b0 msgr2=0x7f000006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.575+0000 7f00265c4640 1 --2- 172.21.15.117:0/3834537082 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f000006c2b0 0x7f000006e770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0010001eb0 tx=0x7f0010000fc0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.575+0000 7f00265c4640 1 -- 172.21.15.117:0/3834537082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0020155210 msgr2=0x7f00200b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.575+0000 7f00265c4640 1 --2- 172.21.15.117:0/3834537082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0020155210 0x7f00200b6170 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0008000c00 tx=0x7f00080012d0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.575+0000 7f00265c4640 1 -- 172.21.15.117:0/3834537082 shutdown_connections 2024-09-19T08:39:03.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.575+0000 7f00265c4640 1 --2- 172.21.15.117:0/3834537082 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f000006c2b0 0x7f000006e770 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.575+0000 7f00265c4640 1 --2- 172.21.15.117:0/3834537082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00200c8250 0x7f00200c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.575+0000 7f00265c4640 1 --2- 172.21.15.117:0/3834537082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0020155210 0x7f00200b6170 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.575+0000 7f00265c4640 1 --2- 172.21.15.117:0/3834537082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f000c004800 0x7f00200c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.575+0000 7f00265c4640 1 -- 172.21.15.117:0/3834537082 >> 172.21.15.117:0/3834537082 conn(0x7f00200b2d10 msgr2=0x7f00201572e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:03.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.575+0000 7f00265c4640 1 -- 172.21.15.117:0/3834537082 shutdown_connections 2024-09-19T08:39:03.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.575+0000 7f00265c4640 1 -- 172.21.15.117:0/3834537082 wait complete. 2024-09-19T08:39:03.587 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:39:03.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.685+0000 7f89c1fd6640 1 Processor -- start 2024-09-19T08:39:03.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.685+0000 7f89c1fd6640 1 -- start start 2024-09-19T08:39:03.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.686+0000 7f89c1fd6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89bc15b120 0x7f89bc06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.686+0000 7f89c1fd6640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f89bc06dec0 0x7f89bc06e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.686+0000 7f89c1fd6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89bc15b500 con 0x7f89bc0d04b0 2024-09-19T08:39:03.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.686+0000 7f89c1fd6640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f89bc06e940 con 0x7f89bc06dec0 2024-09-19T08:39:03.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.686+0000 7f89c1fd6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f89bc06ec20 con 0x7f89bc15b120 2024-09-19T08:39:03.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.686+0000 7f89bbfff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f89bc0d04b0 0x7f89bc0c5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:55452/0 (socket says 172.21.15.117:55452) 2024-09-19T08:39:03.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.686+0000 7f89bbfff640 1 -- 172.21.15.117:0/1548760013 learned_addr learned my addr 172.21.15.117:0/1548760013 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:03.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.686+0000 7f89bb7fe640 1 --2- 172.21.15.117:0/1548760013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89bc15b120 0x7f89bc06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.686+0000 7f89ba7fc640 1 -- 172.21.15.117:0/1548760013 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3305924570 0 0) 0x7f89bc15b500 con 0x7f89bc0d04b0 2024-09-19T08:39:03.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.686+0000 7f89baffd640 1 --2- 172.21.15.117:0/1548760013 >> v2:172.21.15.146:3300/0 conn(0x7f89bc06dec0 0x7f89bc06e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.686+0000 7f89ba7fc640 1 -- 172.21.15.117:0/1548760013 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89a4003520 con 0x7f89bc0d04b0 2024-09-19T08:39:03.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.686+0000 7f89ba7fc640 1 -- 172.21.15.117:0/1548760013 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4048308516 0 0) 0x7f89a4003520 con 0x7f89bc0d04b0 2024-09-19T08:39:03.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.686+0000 7f89ba7fc640 1 -- 172.21.15.117:0/1548760013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89bc15b120 msgr2=0x7f89bc06f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:03.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.686+0000 7f89ba7fc640 1 --2- 172.21.15.117:0/1548760013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89bc15b120 0x7f89bc06f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.686+0000 7f89ba7fc640 1 -- 172.21.15.117:0/1548760013 >> v2:172.21.15.146:3300/0 conn(0x7f89bc06dec0 msgr2=0x7f89bc06e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:03.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.686+0000 7f89ba7fc640 1 --2- 172.21.15.117:0/1548760013 >> v2:172.21.15.146:3300/0 conn(0x7f89bc06dec0 0x7f89bc06e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.686+0000 7f89ba7fc640 1 -- 172.21.15.117:0/1548760013 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89bc06ef00 con 0x7f89bc0d04b0 2024-09-19T08:39:03.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.686+0000 7f89bb7fe640 1 --2- 172.21.15.117:0/1548760013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89bc15b120 0x7f89bc06f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:03.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.686+0000 7f89ba7fc640 1 -- 172.21.15.117:0/1548760013 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f89b40019f0 con 0x7f89bc0d04b0 2024-09-19T08:39:03.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.686+0000 7f89ba7fc640 1 -- 172.21.15.117:0/1548760013 >> v1:172.21.15.117:6789/0 conn(0x7f89bc0d04b0 legacy=0x7f89bc0c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.687+0000 7f89ba7fc640 1 --2- 172.21.15.117:0/1548760013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89a40039b0 0x7f89a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.687+0000 7f89ba7fc640 1 --2- 172.21.15.117:0/1548760013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89a4004800 0x7f89a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.687+0000 7f89ba7fc640 1 --2- 172.21.15.117:0/1548760013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89bc15b120 0x7f89a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.687+0000 7f89ba7fc640 1 -- 172.21.15.117:0/1548760013 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc06e940 con 0x7f89a40039b0 2024-09-19T08:39:03.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.687+0000 7f89ba7fc640 1 -- 172.21.15.117:0/1548760013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc06ec20 con 0x7f89a4004800 2024-09-19T08:39:03.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.687+0000 7f89ba7fc640 1 -- 172.21.15.117:0/1548760013 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f89a400ba40 con 0x7f89bc15b120 2024-09-19T08:39:03.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.687+0000 7f89bb7fe640 1 --2- 172.21.15.117:0/1548760013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89a40039b0 0x7f89a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.687+0000 7f89baffd640 1 --2- 172.21.15.117:0/1548760013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89a4004800 0x7f89a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.687+0000 7f89bbfff640 1 --2- 172.21.15.117:0/1548760013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89bc15b120 0x7f89a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.687+0000 7f89bb7fe640 1 -- 172.21.15.117:0/1548760013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89bc15b120 msgr2=0x7f89a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:03.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.687+0000 7f89bb7fe640 1 --2- 172.21.15.117:0/1548760013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89bc15b120 0x7f89a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.687+0000 7f89bb7fe640 1 -- 172.21.15.117:0/1548760013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89a4004800 msgr2=0x7f89a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:03.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.687+0000 7f89bb7fe640 1 --2- 172.21.15.117:0/1548760013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89a4004800 0x7f89a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.687+0000 7f89bb7fe640 1 -- 172.21.15.117:0/1548760013 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a4003520 con 0x7f89a40039b0 2024-09-19T08:39:03.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.687+0000 7f89bbfff640 1 --2- 172.21.15.117:0/1548760013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89bc15b120 0x7f89a40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:03.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.688+0000 7f89bb7fe640 1 --2- 172.21.15.117:0/1548760013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89a40039b0 0x7f89a4003dd0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0098a0 tx=0x7f89a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248a3fdecea5fa98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:03.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.688+0000 7f89ba7fc640 1 -- 172.21.15.117:0/1548760013 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac00f040 con 0x7f89a40039b0 2024-09-19T08:39:03.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.688+0000 7f89ba7fc640 1 -- 172.21.15.117:0/1548760013 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89ac02ace0 con 0x7f89a40039b0 2024-09-19T08:39:03.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.688+0000 7f89ba7fc640 1 -- 172.21.15.117:0/1548760013 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac004250 con 0x7f89a40039b0 2024-09-19T08:39:03.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.688+0000 7f89c1fd6640 1 -- 172.21.15.117:0/1548760013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89a40039b0 msgr2=0x7f89a4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.688+0000 7f89c1fd6640 1 --2- 172.21.15.117:0/1548760013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89a40039b0 0x7f89a4003dd0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0098a0 tx=0x7f89a4005830 comp rx=0 tx=0).stop 2024-09-19T08:39:03.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.688+0000 7f89bbfff640 1 -- 172.21.15.117:0/1548760013 reap_dead start 2024-09-19T08:39:03.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.688+0000 7f89c1fd6640 1 -- 172.21.15.117:0/1548760013 shutdown_connections 2024-09-19T08:39:03.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.688+0000 7f89c1fd6640 1 -- 172.21.15.117:0/1548760013 >> 172.21.15.117:0/1548760013 conn(0x7f89bc06bdf0 msgr2=0x7f89bc06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:03.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.688+0000 7f89c1fd6640 1 -- 172.21.15.117:0/1548760013 shutdown_connections 2024-09-19T08:39:03.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.688+0000 7f89c1fd6640 1 -- 172.21.15.117:0/1548760013 wait complete. 2024-09-19T08:39:03.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.689+0000 7f89c1fd6640 1 Processor -- start 2024-09-19T08:39:03.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.690+0000 7f89c1fd6640 1 -- start start 2024-09-19T08:39:03.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.690+0000 7f89c1fd6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89a40039b0 0x7f89bc150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.690+0000 7f89c1fd6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89bc0b1530 0x7f89bc0ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.690+0000 7f89c1fd6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89bc151370 0x7f89bc0ae800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.690+0000 7f89c1fd6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc0ce060 con 0x7f89bc0b1530 2024-09-19T08:39:03.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.690+0000 7f89c1fd6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc06f4c0 con 0x7f89bc151370 2024-09-19T08:39:03.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.690+0000 7f89c1fd6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f89bc06f9e0 con 0x7f89a40039b0 2024-09-19T08:39:03.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.690+0000 7f89baffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89bc0b1530 0x7f89bc0ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.690+0000 7f89baffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89bc0b1530 0x7f89bc0ae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58352/0 (socket says 172.21.15.117:58352) 2024-09-19T08:39:03.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.690+0000 7f89baffd640 1 -- 172.21.15.117:0/2821772700 learned_addr learned my addr 172.21.15.117:0/2821772700 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:03.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.691+0000 7f89baffd640 1 -- 172.21.15.117:0/2821772700 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89a40039b0 msgr2=0x7f89bc150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.691+0000 7f89baffd640 1 --2- 172.21.15.117:0/2821772700 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89a40039b0 0x7f89bc150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.691+0000 7f89baffd640 1 -- 172.21.15.117:0/2821772700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89bc151370 msgr2=0x7f89bc0ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.691+0000 7f89baffd640 1 --2- 172.21.15.117:0/2821772700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89bc151370 0x7f89bc0ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.691+0000 7f89baffd640 1 -- 172.21.15.117:0/2821772700 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89bc14ddd0 con 0x7f89bc0b1530 2024-09-19T08:39:03.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.691+0000 7f89baffd640 1 --2- 172.21.15.117:0/2821772700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89bc0b1530 0x7f89bc0ae2c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f89b00108f0 tx=0x7f89b0010db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:03.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.691+0000 7f89a3fff640 1 -- 172.21.15.117:0/2821772700 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b001a020 con 0x7f89bc0b1530 2024-09-19T08:39:03.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.691+0000 7f89a3fff640 1 -- 172.21.15.117:0/2821772700 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89b000e9a0 con 0x7f89bc0b1530 2024-09-19T08:39:03.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.691+0000 7f89c1fd6640 1 -- 172.21.15.117:0/2821772700 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89bc14e0b0 con 0x7f89bc0b1530 2024-09-19T08:39:03.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.691+0000 7f89a3fff640 1 -- 172.21.15.117:0/2821772700 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b000ed70 con 0x7f89bc0b1530 2024-09-19T08:39:03.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.691+0000 7f89c1fd6640 1 -- 172.21.15.117:0/2821772700 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89bc14e670 con 0x7f89bc0b1530 2024-09-19T08:39:03.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.692+0000 7f89c1fd6640 1 -- 172.21.15.117:0/2821772700 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89bc06e300 con 0x7f89bc0b1530 2024-09-19T08:39:03.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.692+0000 7f89a3fff640 1 -- 172.21.15.117:0/2821772700 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f89b001d020 con 0x7f89bc0b1530 2024-09-19T08:39:03.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.693+0000 7f89a3fff640 1 --2- 172.21.15.117:0/2821772700 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f89a806c2b0 0x7f89a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.693+0000 7f89a3fff640 1 -- 172.21.15.117:0/2821772700 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6130+0+0 (secure 0 0 0) 0x7f89b008bf30 con 0x7f89bc0b1530 2024-09-19T08:39:03.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.693+0000 7f89bb7fe640 1 --2- 172.21.15.117:0/2821772700 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f89a806c2b0 0x7f89a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.694+0000 7f89bb7fe640 1 --2- 172.21.15.117:0/2821772700 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f89a806c2b0 0x7f89a806e770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0098a0 tx=0x7f89ac02c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:03.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.697+0000 7f89a3fff640 1 -- 172.21.15.117:0/2821772700 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f89b0024020 con 0x7f89bc0b1530 2024-09-19T08:39:03.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.862+0000 7f89c1fd6640 1 -- 172.21.15.117:0/2821772700 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89bc0ce710 con 0x7f89bc0b1530 2024-09-19T08:39:03.864 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.863+0000 7f89a3fff640 1 -- 172.21.15.117:0/2821772700 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+17039 (secure 0 0 0) 0x7f89b005a4f0 con 0x7f89bc0b1530 2024-09-19T08:39:03.864 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:39:03.864 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":54,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:38:55.861330+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:38:47.782719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-19T08:38:48.135062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2b","mappings":[{"from":2,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:39:03.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.865+0000 7f89c1fd6640 1 -- 172.21.15.117:0/2821772700 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f89a806c2b0 msgr2=0x7f89a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.865+0000 7f89c1fd6640 1 --2- 172.21.15.117:0/2821772700 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f89a806c2b0 0x7f89a806e770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0098a0 tx=0x7f89ac02c000 comp rx=0 tx=0).stop 2024-09-19T08:39:03.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.865+0000 7f89c1fd6640 1 -- 172.21.15.117:0/2821772700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89bc0b1530 msgr2=0x7f89bc0ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.865+0000 7f89c1fd6640 1 --2- 172.21.15.117:0/2821772700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89bc0b1530 0x7f89bc0ae2c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f89b00108f0 tx=0x7f89b0010db0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.865+0000 7f89c1fd6640 1 -- 172.21.15.117:0/2821772700 shutdown_connections 2024-09-19T08:39:03.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.865+0000 7f89c1fd6640 1 --2- 172.21.15.117:0/2821772700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89bc151370 0x7f89bc0ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.865+0000 7f89c1fd6640 1 --2- 172.21.15.117:0/2821772700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89bc0b1530 0x7f89bc0ae2c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.865+0000 7f89c1fd6640 1 --2- 172.21.15.117:0/2821772700 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f89a806c2b0 0x7f89a806e770 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.865+0000 7f89c1fd6640 1 --2- 172.21.15.117:0/2821772700 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89a40039b0 0x7f89bc150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.865+0000 7f89c1fd6640 1 -- 172.21.15.117:0/2821772700 >> 172.21.15.117:0/2821772700 conn(0x7f89bc06bdf0 msgr2=0x7f89bc14f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:03.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.865+0000 7f89c1fd6640 1 -- 172.21.15.117:0/2821772700 shutdown_connections 2024-09-19T08:39:03.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.865+0000 7f89c1fd6640 1 -- 172.21.15.117:0/2821772700 wait complete. 2024-09-19T08:39:03.878 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T08:39:03.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.975+0000 7fd37b465640 1 Processor -- start 2024-09-19T08:39:03.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.975+0000 7fd37b465640 1 -- start start 2024-09-19T08:39:03.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.976+0000 7fd37b465640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd374167230 0x7fd374169620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.976+0000 7fd37b465640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd374162b70 con 0x7fd374161eb0 2024-09-19T08:39:03.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.976+0000 7fd37b465640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd374141b00 con 0x7fd37406cd20 2024-09-19T08:39:03.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.976+0000 7fd37b465640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fd374162e50 con 0x7fd374167230 2024-09-19T08:39:03.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.976+0000 7fd378a00640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fd374161eb0 0x7fd3741622f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:55460/0 (socket says 172.21.15.117:55460) 2024-09-19T08:39:03.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.976+0000 7fd378a00640 1 -- 172.21.15.117:0/1300725083 learned_addr learned my addr 172.21.15.117:0/1300725083 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:03.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.977+0000 7fd379a02640 1 --2- 172.21.15.117:0/1300725083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd374167230 0x7fd374169620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.977+0000 7fd36bfff640 1 -- 172.21.15.117:0/1300725083 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4045393599 0 0) 0x7fd374162b70 con 0x7fd374161eb0 2024-09-19T08:39:03.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.977+0000 7fd36bfff640 1 -- 172.21.15.117:0/1300725083 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd360003520 con 0x7fd374161eb0 2024-09-19T08:39:03.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.977+0000 7fd36bfff640 1 -- 172.21.15.117:0/1300725083 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2544365423 0 0) 0x7fd374141b00 con 0x7fd37406cd20 2024-09-19T08:39:03.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.977+0000 7fd36bfff640 1 -- 172.21.15.117:0/1300725083 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd374162b70 con 0x7fd37406cd20 2024-09-19T08:39:03.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.977+0000 7fd36bfff640 1 -- 172.21.15.117:0/1300725083 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2835536039 0 0) 0x7fd360003520 con 0x7fd374161eb0 2024-09-19T08:39:03.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.977+0000 7fd36bfff640 1 -- 172.21.15.117:0/1300725083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd374167230 msgr2=0x7fd374169620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:03.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.977+0000 7fd36bfff640 1 --2- 172.21.15.117:0/1300725083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd374167230 0x7fd374169620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.977+0000 7fd36bfff640 1 -- 172.21.15.117:0/1300725083 >> v1:172.21.15.146:6789/0 conn(0x7fd37406cd20 legacy=0x7fd37406d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.977+0000 7fd36bfff640 1 -- 172.21.15.117:0/1300725083 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd374141de0 con 0x7fd374161eb0 2024-09-19T08:39:03.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.977+0000 7fd36bfff640 1 -- 172.21.15.117:0/1300725083 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7fd364001670 con 0x7fd374161eb0 2024-09-19T08:39:03.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.977+0000 7fd36bfff640 1 -- 172.21.15.117:0/1300725083 >> v1:172.21.15.117:6789/0 conn(0x7fd374161eb0 legacy=0x7fd3741622f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.977+0000 7fd36bfff640 1 --2- 172.21.15.117:0/1300725083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd360003b70 0x7fd360003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.977+0000 7fd36bfff640 1 --2- 172.21.15.117:0/1300725083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd374167230 0x7fd360004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.977+0000 7fd36bfff640 1 --2- 172.21.15.117:0/1300725083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd360004d40 0x7fd3600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.977+0000 7fd36bfff640 1 -- 172.21.15.117:0/1300725083 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd374162e50 con 0x7fd360003b70 2024-09-19T08:39:03.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.977+0000 7fd36bfff640 1 -- 172.21.15.117:0/1300725083 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd36000bb80 con 0x7fd360004d40 2024-09-19T08:39:03.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.977+0000 7fd36bfff640 1 -- 172.21.15.117:0/1300725083 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fd36000bd80 con 0x7fd374167230 2024-09-19T08:39:03.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.977+0000 7fd379201640 1 --2- 172.21.15.117:0/1300725083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd360003b70 0x7fd360003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.977+0000 7fd378a00640 1 --2- 172.21.15.117:0/1300725083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd374167230 0x7fd360004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.977+0000 7fd379a02640 1 --2- 172.21.15.117:0/1300725083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd360004d40 0x7fd3600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.978+0000 7fd379201640 1 -- 172.21.15.117:0/1300725083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd374167230 msgr2=0x7fd360004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:03.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.978+0000 7fd379201640 1 --2- 172.21.15.117:0/1300725083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd374167230 0x7fd360004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.978+0000 7fd379201640 1 -- 172.21.15.117:0/1300725083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd360004d40 msgr2=0x7fd3600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:03.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.978+0000 7fd379201640 1 --2- 172.21.15.117:0/1300725083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd360004d40 0x7fd3600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.978+0000 7fd379201640 1 -- 172.21.15.117:0/1300725083 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd360003520 con 0x7fd360003b70 2024-09-19T08:39:03.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.978+0000 7fd378a00640 1 --2- 172.21.15.117:0/1300725083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd374167230 0x7fd360004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:03.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.978+0000 7fd379201640 1 --2- 172.21.15.117:0/1300725083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd360003b70 0x7fd360003f70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd3700018d0 tx=0x7fd360005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab856811d8d40855 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:03.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.978+0000 7fd36bfff640 1 -- 172.21.15.117:0/1300725083 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3700014f0 con 0x7fd360003b70 2024-09-19T08:39:03.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.978+0000 7fd36bfff640 1 -- 172.21.15.117:0/1300725083 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3700052d0 con 0x7fd360003b70 2024-09-19T08:39:03.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.978+0000 7fd36bfff640 1 -- 172.21.15.117:0/1300725083 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37002aca0 con 0x7fd360003b70 2024-09-19T08:39:03.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.979+0000 7fd37b465640 1 -- 172.21.15.117:0/1300725083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd360003b70 msgr2=0x7fd360003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.979+0000 7fd37b465640 1 --2- 172.21.15.117:0/1300725083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd360003b70 0x7fd360003f70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd3700018d0 tx=0x7fd360005830 comp rx=0 tx=0).stop 2024-09-19T08:39:03.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.979+0000 7fd379a02640 1 -- 172.21.15.117:0/1300725083 reap_dead start 2024-09-19T08:39:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.979+0000 7fd37b465640 1 -- 172.21.15.117:0/1300725083 shutdown_connections 2024-09-19T08:39:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.979+0000 7fd37b465640 1 -- 172.21.15.117:0/1300725083 >> 172.21.15.117:0/1300725083 conn(0x7fd3740b3ed0 msgr2=0x7fd3740b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.979+0000 7fd37b465640 1 -- 172.21.15.117:0/1300725083 shutdown_connections 2024-09-19T08:39:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.979+0000 7fd37b465640 1 -- 172.21.15.117:0/1300725083 wait complete. 2024-09-19T08:39:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.980+0000 7fd37b465640 1 Processor -- start 2024-09-19T08:39:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.980+0000 7fd37b465640 1 -- start start 2024-09-19T08:39:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.981+0000 7fd37b465640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd360003b70 0x7fd3740b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.981+0000 7fd37b465640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd374143950 0x7fd374143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.981+0000 7fd37b465640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3741401b0 0x7fd374140630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.981+0000 7fd37b465640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd3741435f0 con 0x7fd374143950 2024-09-19T08:39:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.981+0000 7fd37b465640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd374142150 con 0x7fd3741401b0 2024-09-19T08:39:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.981+0000 7fd37b465640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fd374143770 con 0x7fd360003b70 2024-09-19T08:39:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.981+0000 7fd378a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd374143950 0x7fd374143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.981+0000 7fd378a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd374143950 0x7fd374143dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58360/0 (socket says 172.21.15.117:58360) 2024-09-19T08:39:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.981+0000 7fd378a00640 1 -- 172.21.15.117:0/3541951576 learned_addr learned my addr 172.21.15.117:0/3541951576 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.981+0000 7fd379201640 1 --2- 172.21.15.117:0/3541951576 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd360003b70 0x7fd3740b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.981+0000 7fd379a02640 1 --2- 172.21.15.117:0/3541951576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3741401b0 0x7fd374140630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.981+0000 7fd378a00640 1 -- 172.21.15.117:0/3541951576 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd360003b70 msgr2=0x7fd3740b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.981+0000 7fd378a00640 1 --2- 172.21.15.117:0/3541951576 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd360003b70 0x7fd3740b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.981+0000 7fd378a00640 1 -- 172.21.15.117:0/3541951576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3741401b0 msgr2=0x7fd374140630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.981+0000 7fd378a00640 1 --2- 172.21.15.117:0/3541951576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3741401b0 0x7fd374140630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.981+0000 7fd378a00640 1 -- 172.21.15.117:0/3541951576 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd374140b70 con 0x7fd374143950 2024-09-19T08:39:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.982+0000 7fd378a00640 1 --2- 172.21.15.117:0/3541951576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd374143950 0x7fd374143dd0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd36400e7e0 tx=0x7fd36400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.982+0000 7fd369ffb640 1 -- 172.21.15.117:0/3541951576 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd364019070 con 0x7fd374143950 2024-09-19T08:39:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.982+0000 7fd369ffb640 1 -- 172.21.15.117:0/3541951576 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd36400c660 con 0x7fd374143950 2024-09-19T08:39:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.982+0000 7fd37b465640 1 -- 172.21.15.117:0/3541951576 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3740c8410 con 0x7fd374143950 2024-09-19T08:39:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.982+0000 7fd369ffb640 1 -- 172.21.15.117:0/3541951576 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36400ca10 con 0x7fd374143950 2024-09-19T08:39:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.982+0000 7fd37b465640 1 -- 172.21.15.117:0/3541951576 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3740c89d0 con 0x7fd374143950 2024-09-19T08:39:03.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.983+0000 7fd37b465640 1 -- 172.21.15.117:0/3541951576 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd374141b00 con 0x7fd374143950 2024-09-19T08:39:03.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.983+0000 7fd369ffb640 1 -- 172.21.15.117:0/3541951576 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd36400cbb0 con 0x7fd374143950 2024-09-19T08:39:03.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.984+0000 7fd369ffb640 1 --2- 172.21.15.117:0/3541951576 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd35806c2e0 0x7fd35806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:03.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.984+0000 7fd369ffb640 1 -- 172.21.15.117:0/3541951576 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6130+0+0 (secure 0 0 0) 0x7fd36408aae0 con 0x7fd374143950 2024-09-19T08:39:03.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.984+0000 7fd379201640 1 --2- 172.21.15.117:0/3541951576 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd35806c2e0 0x7fd35806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:03.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.984+0000 7fd379201640 1 --2- 172.21.15.117:0/3541951576 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd35806c2e0 0x7fd35806e7a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd370032000 tx=0x7fd370009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:03.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:03.988+0000 7fd369ffb640 1 -- 172.21.15.117:0/3541951576 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd364058ae0 con 0x7fd374143950 2024-09-19T08:39:04.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.185+0000 7fd37b465640 1 -- 172.21.15.117:0/3541951576 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd3740690c0 con 0x7fd374143950 2024-09-19T08:39:04.187 INFO:tasks.ceph.mon.a.smithi117.stderr:2024-09-19T08:39:04.186+0000 7f8064cfe640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T08:39:04.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.187+0000 7fd369ffb640 1 -- 172.21.15.117:0/3541951576 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) ==== 161+0+0 (secure 0 0 0) 0x7fd36405cde0 con 0x7fd374143950 2024-09-19T08:39:04.188 INFO:teuthology.orchestra.run.smithi117.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T08:39:04.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.190+0000 7fd37b465640 1 -- 172.21.15.117:0/3541951576 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd35806c2e0 msgr2=0x7fd35806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:04.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.190+0000 7fd37b465640 1 --2- 172.21.15.117:0/3541951576 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd35806c2e0 0x7fd35806e7a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd370032000 tx=0x7fd370009030 comp rx=0 tx=0).stop 2024-09-19T08:39:04.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.190+0000 7fd37b465640 1 -- 172.21.15.117:0/3541951576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd374143950 msgr2=0x7fd374143dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:04.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.190+0000 7fd37b465640 1 --2- 172.21.15.117:0/3541951576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd374143950 0x7fd374143dd0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd36400e7e0 tx=0x7fd36400eca0 comp rx=0 tx=0).stop 2024-09-19T08:39:04.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.190+0000 7fd37b465640 1 -- 172.21.15.117:0/3541951576 shutdown_connections 2024-09-19T08:39:04.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.190+0000 7fd37b465640 1 --2- 172.21.15.117:0/3541951576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3741401b0 0x7fd374140630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:04.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.190+0000 7fd37b465640 1 --2- 172.21.15.117:0/3541951576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd374143950 0x7fd374143dd0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:04.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.190+0000 7fd37b465640 1 --2- 172.21.15.117:0/3541951576 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd35806c2e0 0x7fd35806e7a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:04.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.190+0000 7fd37b465640 1 --2- 172.21.15.117:0/3541951576 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd360003b70 0x7fd3740b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:04.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.190+0000 7fd37b465640 1 -- 172.21.15.117:0/3541951576 >> 172.21.15.117:0/3541951576 conn(0x7fd3740b3ed0 msgr2=0x7fd3740b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:04.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.190+0000 7fd37b465640 1 -- 172.21.15.117:0/3541951576 shutdown_connections 2024-09-19T08:39:04.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.190+0000 7fd37b465640 1 -- 172.21.15.117:0/3541951576 wait complete. 2024-09-19T08:39:04.192 INFO:tasks.ceph.mds.b.smithi146.stderr: -3060> 2024-09-19T08:38:51.081+0000 7f3b710d4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T08:39:04.202 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T08:39:04.226 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2024-09-19T08:39:04.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.301+0000 7f68a798f640 1 Processor -- start 2024-09-19T08:39:04.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.301+0000 7f68a798f640 1 -- start start 2024-09-19T08:39:04.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.302+0000 7f68a798f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f68a0072590 0x7f68a006d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:04.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.302+0000 7f68a798f640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f68a0141ad0 0x7f68a0141f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:04.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.302+0000 7f68a798f640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68a01620b0 con 0x7f68a00d21f0 2024-09-19T08:39:04.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.302+0000 7f68a798f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f68a0141750 con 0x7f68a0072590 2024-09-19T08:39:04.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.302+0000 7f68a798f640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f68a0162370 con 0x7f68a0141ad0 2024-09-19T08:39:04.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.302+0000 7f68a4f2a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f68a0072590 0x7f68a006d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:04.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.302+0000 7f68a4f2a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f68a0072590 0x7f68a006d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58370/0 (socket says 172.21.15.117:58370) 2024-09-19T08:39:04.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.302+0000 7f68a4f2a640 1 -- 172.21.15.117:0/985594996 learned_addr learned my addr 172.21.15.117:0/985594996 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:04.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.303+0000 7f68a4f2a640 1 -- 172.21.15.117:0/985594996 >> v2:172.21.15.146:3300/0 conn(0x7f68a0141ad0 msgr2=0x7f68a0141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:04.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.303+0000 7f68a5f2c640 1 --2- 172.21.15.117:0/985594996 >> v2:172.21.15.146:3300/0 conn(0x7f68a0141ad0 0x7f68a0141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:04.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.303+0000 7f68a4f2a640 1 --2- 172.21.15.117:0/985594996 >> v2:172.21.15.146:3300/0 conn(0x7f68a0141ad0 0x7f68a0141f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:04.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.303+0000 7f68a4f2a640 1 -- 172.21.15.117:0/985594996 >> v1:172.21.15.146:6789/0 conn(0x7f68a00d21f0 legacy=0x7f68a00d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:04.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.303+0000 7f68a4f2a640 1 -- 172.21.15.117:0/985594996 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a0162650 con 0x7f68a0072590 2024-09-19T08:39:04.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.303+0000 7f68a5f2c640 1 --2- 172.21.15.117:0/985594996 >> v2:172.21.15.146:3300/0 conn(0x7f68a0141ad0 0x7f68a0141f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:39:04.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.303+0000 7f68a4f2a640 1 --2- 172.21.15.117:0/985594996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68a0072590 0x7f68a006d0e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f68a00b1df0 tx=0x7f689402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cdb6d044038470f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:04.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.303+0000 7f689ffff640 1 -- 172.21.15.117:0/985594996 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6894037070 con 0x7f68a0072590 2024-09-19T08:39:04.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.303+0000 7f689ffff640 1 -- 172.21.15.117:0/985594996 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6894032440 con 0x7f68a0072590 2024-09-19T08:39:04.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.303+0000 7f689ffff640 1 -- 172.21.15.117:0/985594996 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6894032810 con 0x7f68a0072590 2024-09-19T08:39:04.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.304+0000 7f68a798f640 1 -- 172.21.15.117:0/985594996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68a0072590 msgr2=0x7f68a006d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:04.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.304+0000 7f68a798f640 1 --2- 172.21.15.117:0/985594996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68a0072590 0x7f68a006d0e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f68a00b1df0 tx=0x7f689402a1a0 comp rx=0 tx=0).stop 2024-09-19T08:39:04.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.304+0000 7f68a798f640 1 -- 172.21.15.117:0/985594996 shutdown_connections 2024-09-19T08:39:04.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.304+0000 7f68a798f640 1 --2- 172.21.15.117:0/985594996 >> v2:172.21.15.146:3300/0 conn(0x7f68a0141ad0 0x7f68a0141f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:04.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.304+0000 7f68a798f640 1 --2- 172.21.15.117:0/985594996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68a0072590 0x7f68a006d0e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:04.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.304+0000 7f68a798f640 1 -- 172.21.15.117:0/985594996 >> 172.21.15.117:0/985594996 conn(0x7f68a00b3ed0 msgr2=0x7f68a00b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:04.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.304+0000 7f68a798f640 1 -- 172.21.15.117:0/985594996 shutdown_connections 2024-09-19T08:39:04.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.304+0000 7f68a798f640 1 -- 172.21.15.117:0/985594996 wait complete. 2024-09-19T08:39:04.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.305+0000 7f68a798f640 1 Processor -- start 2024-09-19T08:39:04.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.305+0000 7f68a798f640 1 -- start start 2024-09-19T08:39:04.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.306+0000 7f68a798f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68a0072590 0x7f68a0140cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:04.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.306+0000 7f68a798f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68a00d21f0 0x7f68a00b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:04.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.306+0000 7f68a798f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a0141ad0 0x7f68a00b7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:04.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.306+0000 7f68a798f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f68a006d620 con 0x7f68a00d21f0 2024-09-19T08:39:04.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.306+0000 7f68a798f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f68a0162c10 con 0x7f68a0141ad0 2024-09-19T08:39:04.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.306+0000 7f68a798f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f68a006d7a0 con 0x7f68a0072590 2024-09-19T08:39:04.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.306+0000 7f68a4f2a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68a00d21f0 0x7f68a00b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:04.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.306+0000 7f68a4f2a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68a00d21f0 0x7f68a00b6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58374/0 (socket says 172.21.15.117:58374) 2024-09-19T08:39:04.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.306+0000 7f68a4f2a640 1 -- 172.21.15.117:0/2565671610 learned_addr learned my addr 172.21.15.117:0/2565671610 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:04.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.306+0000 7f68a5f2c640 1 --2- 172.21.15.117:0/2565671610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a0141ad0 0x7f68a00b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:04.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.306+0000 7f68a572b640 1 --2- 172.21.15.117:0/2565671610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68a0072590 0x7f68a0140cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:04.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.306+0000 7f68a4f2a640 1 -- 172.21.15.117:0/2565671610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68a0072590 msgr2=0x7f68a0140cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:04.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.306+0000 7f68a4f2a640 1 --2- 172.21.15.117:0/2565671610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68a0072590 0x7f68a0140cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:04.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.306+0000 7f68a4f2a640 1 -- 172.21.15.117:0/2565671610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a0141ad0 msgr2=0x7f68a00b7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:04.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.306+0000 7f68a4f2a640 1 --2- 172.21.15.117:0/2565671610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a0141ad0 0x7f68a00b7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:04.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.306+0000 7f68a4f2a640 1 -- 172.21.15.117:0/2565671610 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a0141210 con 0x7f68a00d21f0 2024-09-19T08:39:04.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.307+0000 7f68a4f2a640 1 --2- 172.21.15.117:0/2565671610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68a00d21f0 0x7f68a00b6cd0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6894000c00 tx=0x7f68940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:04.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.307+0000 7f689dffb640 1 -- 172.21.15.117:0/2565671610 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6894041070 con 0x7f68a00d21f0 2024-09-19T08:39:04.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.307+0000 7f689dffb640 1 -- 172.21.15.117:0/2565671610 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f689403c870 con 0x7f68a00d21f0 2024-09-19T08:39:04.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.307+0000 7f68a798f640 1 -- 172.21.15.117:0/2565671610 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a01f3db0 con 0x7f68a00d21f0 2024-09-19T08:39:04.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.307+0000 7f689dffb640 1 -- 172.21.15.117:0/2565671610 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6894037040 con 0x7f68a00d21f0 2024-09-19T08:39:04.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.307+0000 7f68a798f640 1 -- 172.21.15.117:0/2565671610 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a015d140 con 0x7f68a00d21f0 2024-09-19T08:39:04.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.308+0000 7f68a798f640 1 -- 172.21.15.117:0/2565671610 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68a0158c30 con 0x7f68a00d21f0 2024-09-19T08:39:04.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.308+0000 7f689dffb640 1 -- 172.21.15.117:0/2565671610 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6894044070 con 0x7f68a00d21f0 2024-09-19T08:39:04.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.309+0000 7f689dffb640 1 --2- 172.21.15.117:0/2565671610 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f688c06c2b0 0x7f688c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:04.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.309+0000 7f689dffb640 1 -- 172.21.15.117:0/2565671610 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6216+0+0 (secure 0 0 0) 0x7f68940ac310 con 0x7f68a00d21f0 2024-09-19T08:39:04.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.309+0000 7f68a572b640 1 --2- 172.21.15.117:0/2565671610 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f688c06c2b0 0x7f688c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:04.312 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.310+0000 7f68a572b640 1 --2- 172.21.15.117:0/2565671610 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f688c06c2b0 0x7f688c06e770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6890005660 tx=0x7f6890003d90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:04.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.313+0000 7f689dffb640 1 -- 172.21.15.117:0/2565671610 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f689407a3e0 con 0x7f68a00d21f0 2024-09-19T08:39:04.515 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:04.514+0000 7f68a798f640 1 -- 172.21.15.117:0/2565671610 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f68a00690c0 con 0x7f68a00d21f0 2024-09-19T08:39:05.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.188+0000 7f689dffb640 1 -- 172.21.15.117:0/2565671610 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) ==== 104+0+0 (secure 0 0 0) 0x7f689407e6e0 con 0x7f68a00d21f0 2024-09-19T08:39:05.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.191+0000 7f68a798f640 1 -- 172.21.15.117:0/2565671610 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f688c06c2b0 msgr2=0x7f688c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:05.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.191+0000 7f68a798f640 1 --2- 172.21.15.117:0/2565671610 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f688c06c2b0 0x7f688c06e770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6890005660 tx=0x7f6890003d90 comp rx=0 tx=0).stop 2024-09-19T08:39:05.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.191+0000 7f68a798f640 1 -- 172.21.15.117:0/2565671610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68a00d21f0 msgr2=0x7f68a00b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:05.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.191+0000 7f68a798f640 1 --2- 172.21.15.117:0/2565671610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68a00d21f0 0x7f68a00b6cd0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6894000c00 tx=0x7f68940046c0 comp rx=0 tx=0).stop 2024-09-19T08:39:05.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.191+0000 7f68a798f640 1 -- 172.21.15.117:0/2565671610 shutdown_connections 2024-09-19T08:39:05.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.191+0000 7f68a798f640 1 --2- 172.21.15.117:0/2565671610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a0141ad0 0x7f68a00b7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:05.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.191+0000 7f68a798f640 1 --2- 172.21.15.117:0/2565671610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68a00d21f0 0x7f68a00b6cd0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:05.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.191+0000 7f68a798f640 1 --2- 172.21.15.117:0/2565671610 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f688c06c2b0 0x7f688c06e770 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:05.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.191+0000 7f68a798f640 1 --2- 172.21.15.117:0/2565671610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68a0072590 0x7f68a0140cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:05.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.191+0000 7f68a798f640 1 -- 172.21.15.117:0/2565671610 >> 172.21.15.117:0/2565671610 conn(0x7f68a00b3ed0 msgr2=0x7f68a00b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:05.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.191+0000 7f68a798f640 1 -- 172.21.15.117:0/2565671610 shutdown_connections 2024-09-19T08:39:05.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.191+0000 7f68a798f640 1 -- 172.21.15.117:0/2565671610 wait complete. 2024-09-19T08:39:05.203 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T08:39:05.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.305+0000 7f9b36ea5640 1 Processor -- start 2024-09-19T08:39:05.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.305+0000 7f9b36ea5640 1 -- start start 2024-09-19T08:39:05.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.306+0000 7f9b36ea5640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9b3015bee0 0x7f9b300d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:05.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.306+0000 7f9b36ea5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9b3015c2c0 0x7f9b300d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:05.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.306+0000 7f9b36ea5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b300cf200 0x7f9b300cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:05.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.306+0000 7f9b36ea5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f9b300ceaf0 con 0x7f9b3015c2c0 2024-09-19T08:39:05.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.306+0000 7f9b36ea5640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f9b300cdee0 con 0x7f9b3015bee0 2024-09-19T08:39:05.309 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.306+0000 7f9b36ea5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f9b300ce1c0 con 0x7f9b300cf200 2024-09-19T08:39:05.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.306+0000 7f9b27fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9b3015c2c0 0x7f9b300d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:05.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.306+0000 7f9b27fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9b3015c2c0 0x7f9b300d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45374/0 (socket says 172.21.15.117:45374) 2024-09-19T08:39:05.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.306+0000 7f9b27fff640 1 -- 172.21.15.117:0/4035438819 learned_addr learned my addr 172.21.15.117:0/4035438819 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:05.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.306+0000 7f9b27fff640 1 -- 172.21.15.117:0/4035438819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b300cf200 msgr2=0x7f9b300cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:05.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.306+0000 7f9b34c41640 1 --2- 172.21.15.117:0/4035438819 >> v2:172.21.15.146:3300/0 conn(0x7f9b3015bee0 0x7f9b300d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:05.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.306+0000 7f9b35442640 1 --2- 172.21.15.117:0/4035438819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b300cf200 0x7f9b300cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:05.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.306+0000 7f9b27fff640 1 --2- 172.21.15.117:0/4035438819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b300cf200 0x7f9b300cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:05.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.306+0000 7f9b27fff640 1 -- 172.21.15.117:0/4035438819 >> v2:172.21.15.146:3300/0 conn(0x7f9b3015bee0 msgr2=0x7f9b300d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:05.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.306+0000 7f9b27fff640 1 --2- 172.21.15.117:0/4035438819 >> v2:172.21.15.146:3300/0 conn(0x7f9b3015bee0 0x7f9b300d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:05.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.306+0000 7f9b27fff640 1 -- 172.21.15.117:0/4035438819 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b300ce4a0 con 0x7f9b3015c2c0 2024-09-19T08:39:05.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.307+0000 7f9b34c41640 1 --2- 172.21.15.117:0/4035438819 >> v2:172.21.15.146:3300/0 conn(0x7f9b3015bee0 0x7f9b300d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:39:05.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.307+0000 7f9b35442640 1 --2- 172.21.15.117:0/4035438819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b300cf200 0x7f9b300cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:39:05.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.307+0000 7f9b27fff640 1 --2- 172.21.15.117:0/4035438819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b3015c2c0 0x7f9b300d09f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f9b300b2f40 tx=0x7f9b2002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405a3c12c6d41d74 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:05.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.307+0000 7f9b277fe640 1 -- 172.21.15.117:0/4035438819 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20037070 con 0x7f9b3015c2c0 2024-09-19T08:39:05.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.307+0000 7f9b277fe640 1 -- 172.21.15.117:0/4035438819 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b20032440 con 0x7f9b3015c2c0 2024-09-19T08:39:05.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.307+0000 7f9b277fe640 1 -- 172.21.15.117:0/4035438819 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20032810 con 0x7f9b3015c2c0 2024-09-19T08:39:05.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.308+0000 7f9b36ea5640 1 -- 172.21.15.117:0/4035438819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b3015c2c0 msgr2=0x7f9b300d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:05.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.308+0000 7f9b36ea5640 1 --2- 172.21.15.117:0/4035438819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b3015c2c0 0x7f9b300d09f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f9b300b2f40 tx=0x7f9b2002a1e0 comp rx=0 tx=0).stop 2024-09-19T08:39:05.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.308+0000 7f9b36ea5640 1 -- 172.21.15.117:0/4035438819 shutdown_connections 2024-09-19T08:39:05.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.308+0000 7f9b36ea5640 1 --2- 172.21.15.117:0/4035438819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b300cf200 0x7f9b300cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:05.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.308+0000 7f9b36ea5640 1 --2- 172.21.15.117:0/4035438819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b3015c2c0 0x7f9b300d09f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:05.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.308+0000 7f9b36ea5640 1 --2- 172.21.15.117:0/4035438819 >> v2:172.21.15.146:3300/0 conn(0x7f9b3015bee0 0x7f9b300d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:05.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.308+0000 7f9b36ea5640 1 -- 172.21.15.117:0/4035438819 >> 172.21.15.117:0/4035438819 conn(0x7f9b3006bdf0 msgr2=0x7f9b3006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:05.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.308+0000 7f9b36ea5640 1 -- 172.21.15.117:0/4035438819 shutdown_connections 2024-09-19T08:39:05.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.308+0000 7f9b36ea5640 1 -- 172.21.15.117:0/4035438819 wait complete. 2024-09-19T08:39:05.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.309+0000 7f9b36ea5640 1 Processor -- start 2024-09-19T08:39:05.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.309+0000 7f9b36ea5640 1 -- start start 2024-09-19T08:39:05.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.310+0000 7f9b36ea5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b300cf200 0x7f9b30150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:05.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.310+0000 7f9b36ea5640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b3015bee0 0x7f9b300c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:05.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.310+0000 7f9b36ea5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b3015c2c0 0x7f9b300b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:05.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.310+0000 7f9b36ea5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3015fd40 con 0x7f9b300cf200 2024-09-19T08:39:05.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.310+0000 7f9b36ea5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9b300cfbd0 con 0x7f9b3015c2c0 2024-09-19T08:39:05.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.310+0000 7f9b36ea5640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f9b3015fec0 con 0x7f9b3015bee0 2024-09-19T08:39:05.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.310+0000 7f9b34c41640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b300cf200 0x7f9b30150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:05.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.310+0000 7f9b34c41640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b300cf200 0x7f9b30150880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45386/0 (socket says 172.21.15.117:45386) 2024-09-19T08:39:05.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.310+0000 7f9b34c41640 1 -- 172.21.15.117:0/13782734 learned_addr learned my addr 172.21.15.117:0/13782734 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:05.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.310+0000 7f9b34c41640 1 -- 172.21.15.117:0/13782734 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b3015bee0 msgr2=0x7f9b300c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:05.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.310+0000 7f9b34c41640 1 --2- 172.21.15.117:0/13782734 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b3015bee0 0x7f9b300c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:05.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.310+0000 7f9b34c41640 1 -- 172.21.15.117:0/13782734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b3015c2c0 msgr2=0x7f9b300b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:05.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.310+0000 7f9b34c41640 1 --2- 172.21.15.117:0/13782734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b3015c2c0 0x7f9b300b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:05.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.310+0000 7f9b34c41640 1 -- 172.21.15.117:0/13782734 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b300c9ba0 con 0x7f9b300cf200 2024-09-19T08:39:05.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.311+0000 7f9b34c41640 1 --2- 172.21.15.117:0/13782734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b300cf200 0x7f9b30150880 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00c820 tx=0x7f9b2c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:05.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.311+0000 7f9b257fa640 1 -- 172.21.15.117:0/13782734 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c015070 con 0x7f9b300cf200 2024-09-19T08:39:05.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.311+0000 7f9b257fa640 1 -- 172.21.15.117:0/13782734 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b2c007a30 con 0x7f9b300cf200 2024-09-19T08:39:05.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.311+0000 7f9b36ea5640 1 -- 172.21.15.117:0/13782734 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b300c9e80 con 0x7f9b300cf200 2024-09-19T08:39:05.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.311+0000 7f9b257fa640 1 -- 172.21.15.117:0/13782734 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c007e00 con 0x7f9b300cf200 2024-09-19T08:39:05.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.311+0000 7f9b36ea5640 1 -- 172.21.15.117:0/13782734 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b300ca440 con 0x7f9b300cf200 2024-09-19T08:39:05.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.312+0000 7f9b36ea5640 1 -- 172.21.15.117:0/13782734 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b300cf690 con 0x7f9b300cf200 2024-09-19T08:39:05.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.312+0000 7f9b257fa640 1 -- 172.21.15.117:0/13782734 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9b2c018070 con 0x7f9b300cf200 2024-09-19T08:39:05.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.313+0000 7f9b257fa640 1 --2- 172.21.15.117:0/13782734 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9b1c06c2b0 0x7f9b1c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:05.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.313+0000 7f9b257fa640 1 -- 172.21.15.117:0/13782734 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6216+0+0 (secure 0 0 0) 0x7f9b2c08b580 con 0x7f9b300cf200 2024-09-19T08:39:05.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.313+0000 7f9b27fff640 1 --2- 172.21.15.117:0/13782734 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9b1c06c2b0 0x7f9b1c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:05.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.314+0000 7f9b27fff640 1 --2- 172.21.15.117:0/13782734 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9b1c06c2b0 0x7f9b1c06e770 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9b20034000 tx=0x7f9b2002c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:05.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.317+0000 7f9b257fa640 1 -- 172.21.15.117:0/13782734 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9b2c059af0 con 0x7f9b300cf200 2024-09-19T08:39:05.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:05.484+0000 7f9b36ea5640 1 -- 172.21.15.117:0/13782734 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9b300cbaf0 con 0x7f9b300cf200 2024-09-19T08:39:06.122 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T08:39:06.125 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T08:39:06.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.199+0000 7f9b257fa640 1 -- 172.21.15.117:0/13782734 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) ==== 181+0+0 (secure 0 0 0) 0x7f9b2c0593f0 con 0x7f9b300cf200 2024-09-19T08:39:06.200 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'cephfs_metadata' removed 2024-09-19T08:39:06.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.202+0000 7f9b36ea5640 1 -- 172.21.15.117:0/13782734 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9b1c06c2b0 msgr2=0x7f9b1c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:06.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.202+0000 7f9b36ea5640 1 --2- 172.21.15.117:0/13782734 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9b1c06c2b0 0x7f9b1c06e770 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9b20034000 tx=0x7f9b2002c000 comp rx=0 tx=0).stop 2024-09-19T08:39:06.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.202+0000 7f9b36ea5640 1 -- 172.21.15.117:0/13782734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b300cf200 msgr2=0x7f9b30150880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:06.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.202+0000 7f9b36ea5640 1 --2- 172.21.15.117:0/13782734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b300cf200 0x7f9b30150880 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00c820 tx=0x7f9b2c00cc20 comp rx=0 tx=0).stop 2024-09-19T08:39:06.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.202+0000 7f9b36ea5640 1 -- 172.21.15.117:0/13782734 shutdown_connections 2024-09-19T08:39:06.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.202+0000 7f9b36ea5640 1 --2- 172.21.15.117:0/13782734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b3015c2c0 0x7f9b300b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:06.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.202+0000 7f9b36ea5640 1 --2- 172.21.15.117:0/13782734 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f9b1c06c2b0 0x7f9b1c06e770 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:06.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.202+0000 7f9b36ea5640 1 --2- 172.21.15.117:0/13782734 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b3015bee0 0x7f9b300c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:06.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.202+0000 7f9b36ea5640 1 --2- 172.21.15.117:0/13782734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b300cf200 0x7f9b30150880 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:06.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.202+0000 7f9b36ea5640 1 -- 172.21.15.117:0/13782734 >> 172.21.15.117:0/13782734 conn(0x7f9b3006bdf0 msgr2=0x7f9b300b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:06.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.202+0000 7f9b36ea5640 1 -- 172.21.15.117:0/13782734 shutdown_connections 2024-09-19T08:39:06.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.202+0000 7f9b36ea5640 1 -- 172.21.15.117:0/13782734 wait complete. 2024-09-19T08:39:06.215 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T08:39:06.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.318+0000 7f7be1378640 1 Processor -- start 2024-09-19T08:39:06.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.318+0000 7f7be1378640 1 -- start start 2024-09-19T08:39:06.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.319+0000 7f7be1378640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bdc15e2a0 0x7f7bdc06d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:06.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.319+0000 7f7be1378640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7bdc15e680 0x7f7bdc0cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:06.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.319+0000 7f7be1378640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bdc0d1880 con 0x7f7bdc06d960 2024-09-19T08:39:06.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.319+0000 7f7be1378640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f7bdc0d1b60 con 0x7f7bdc15e680 2024-09-19T08:39:06.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.319+0000 7f7be1378640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f7bdc0cf2d0 con 0x7f7bdc15e2a0 2024-09-19T08:39:06.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.319+0000 7f7bd3fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7bdc15e680 0x7f7bdc0cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:06.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.319+0000 7f7bdb7fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f7bdc06d960 0x7f7bdc0d4370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50086/0 (socket says 172.21.15.117:50086) 2024-09-19T08:39:06.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.319+0000 7f7bdb7fe640 1 -- 172.21.15.117:0/2395550732 learned_addr learned my addr 172.21.15.117:0/2395550732 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:06.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.319+0000 7f7bdaffd640 1 --2- 172.21.15.117:0/2395550732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bdc15e2a0 0x7f7bdc06d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:06.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.319+0000 7f7bd3fff640 1 -- 172.21.15.117:0/2395550732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bdc15e2a0 msgr2=0x7f7bdc06d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:06.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.319+0000 7f7bd3fff640 1 --2- 172.21.15.117:0/2395550732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bdc15e2a0 0x7f7bdc06d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:06.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.319+0000 7f7bd3fff640 1 -- 172.21.15.117:0/2395550732 >> v1:172.21.15.117:6789/0 conn(0x7f7bdc06d960 legacy=0x7f7bdc0d4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:06.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.319+0000 7f7bd3fff640 1 -- 172.21.15.117:0/2395550732 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bdc0cf5b0 con 0x7f7bdc15e680 2024-09-19T08:39:06.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.319+0000 7f7bda7fc640 1 -- 172.21.15.117:0/2395550732 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3851883475 0 0) 0x7f7bdc0d1880 con 0x7f7bdc06d960 2024-09-19T08:39:06.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.320+0000 7f7bd3fff640 1 --2- 172.21.15.117:0/2395550732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bdc15e680 0x7f7bdc0cfad0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40097a0 tx=0x7f7bc402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b379f07f4b5dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:06.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.320+0000 7f7bda7fc640 1 -- 172.21.15.117:0/2395550732 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4037070 con 0x7f7bdc15e680 2024-09-19T08:39:06.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.320+0000 7f7bda7fc640 1 -- 172.21.15.117:0/2395550732 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc4032440 con 0x7f7bdc15e680 2024-09-19T08:39:06.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.320+0000 7f7bda7fc640 1 -- 172.21.15.117:0/2395550732 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4032810 con 0x7f7bdc15e680 2024-09-19T08:39:06.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.321+0000 7f7be1378640 1 -- 172.21.15.117:0/2395550732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bdc15e680 msgr2=0x7f7bdc0cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:06.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.321+0000 7f7be1378640 1 --2- 172.21.15.117:0/2395550732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bdc15e680 0x7f7bdc0cfad0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40097a0 tx=0x7f7bc402a180 comp rx=0 tx=0).stop 2024-09-19T08:39:06.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.321+0000 7f7be1378640 1 -- 172.21.15.117:0/2395550732 shutdown_connections 2024-09-19T08:39:06.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.321+0000 7f7be1378640 1 --2- 172.21.15.117:0/2395550732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bdc15e680 0x7f7bdc0cfad0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:06.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.321+0000 7f7be1378640 1 --2- 172.21.15.117:0/2395550732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bdc15e2a0 0x7f7bdc06d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:06.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.321+0000 7f7be1378640 1 -- 172.21.15.117:0/2395550732 >> 172.21.15.117:0/2395550732 conn(0x7f7bdc09d760 msgr2=0x7f7bdc08bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:06.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.321+0000 7f7be1378640 1 -- 172.21.15.117:0/2395550732 shutdown_connections 2024-09-19T08:39:06.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.321+0000 7f7be1378640 1 -- 172.21.15.117:0/2395550732 wait complete. 2024-09-19T08:39:06.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.322+0000 7f7be1378640 1 Processor -- start 2024-09-19T08:39:06.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.322+0000 7f7be1378640 1 -- start start 2024-09-19T08:39:06.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7be1378640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bdc06d960 0x7f7bdc1ea610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:06.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7be1378640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bdc15e2a0 0x7f7bdc1496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:06.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7be1378640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bdc15e680 0x7f7bdc160f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:06.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7be1378640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc0d4c00 con 0x7f7bdc15e680 2024-09-19T08:39:06.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7be1378640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc0d4a80 con 0x7f7bdc15e2a0 2024-09-19T08:39:06.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7be1378640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f7bdc0d0010 con 0x7f7bdc06d960 2024-09-19T08:39:06.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7bdb7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bdc15e680 0x7f7bdc160f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:06.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7bdb7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bdc15e680 0x7f7bdc160f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45392/0 (socket says 172.21.15.117:45392) 2024-09-19T08:39:06.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7bdb7fe640 1 -- 172.21.15.117:0/233932231 learned_addr learned my addr 172.21.15.117:0/233932231 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:06.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7bdaffd640 1 --2- 172.21.15.117:0/233932231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bdc06d960 0x7f7bdc1ea610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:06.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7bd3fff640 1 --2- 172.21.15.117:0/233932231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bdc15e2a0 0x7f7bdc1496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:06.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7bdb7fe640 1 -- 172.21.15.117:0/233932231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bdc06d960 msgr2=0x7f7bdc1ea610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:06.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7bdb7fe640 1 --2- 172.21.15.117:0/233932231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bdc06d960 0x7f7bdc1ea610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:06.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7bdb7fe640 1 -- 172.21.15.117:0/233932231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bdc15e2a0 msgr2=0x7f7bdc1496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:06.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7bdb7fe640 1 --2- 172.21.15.117:0/233932231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bdc15e2a0 0x7f7bdc1496a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:06.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7bdb7fe640 1 -- 172.21.15.117:0/233932231 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bdc0cd940 con 0x7f7bdc15e680 2024-09-19T08:39:06.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7bdb7fe640 1 --2- 172.21.15.117:0/233932231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bdc15e680 0x7f7bdc160f20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400c7a0 tx=0x7f7bd400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:06.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7bd37fe640 1 -- 172.21.15.117:0/233932231 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4018070 con 0x7f7bdc15e680 2024-09-19T08:39:06.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7bd37fe640 1 -- 172.21.15.117:0/233932231 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd400a640 con 0x7f7bdc15e680 2024-09-19T08:39:06.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7bd37fe640 1 -- 172.21.15.117:0/233932231 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd400aab0 con 0x7f7bdc15e680 2024-09-19T08:39:06.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7be1378640 1 -- 172.21.15.117:0/233932231 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bdc0cdc20 con 0x7f7bdc15e680 2024-09-19T08:39:06.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.323+0000 7f7be1378640 1 -- 172.21.15.117:0/233932231 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bdc0ce1e0 con 0x7f7bdc15e680 2024-09-19T08:39:06.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.324+0000 7f7be1378640 1 -- 172.21.15.117:0/233932231 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bdc06d420 con 0x7f7bdc15e680 2024-09-19T08:39:06.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.325+0000 7f7bd37fe640 1 -- 172.21.15.117:0/233932231 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7bd400ac50 con 0x7f7bdc15e680 2024-09-19T08:39:06.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.325+0000 7f7bd37fe640 1 --2- 172.21.15.117:0/233932231 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7bbc06c2e0 0x7f7bbc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:06.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.325+0000 7f7bd37fe640 1 -- 172.21.15.117:0/233932231 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5778+0+0 (secure 0 0 0) 0x7f7bd408a860 con 0x7f7bdc15e680 2024-09-19T08:39:06.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.325+0000 7f7bdaffd640 1 --2- 172.21.15.117:0/233932231 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7bbc06c2e0 0x7f7bbc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:06.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.326+0000 7f7bdaffd640 1 --2- 172.21.15.117:0/233932231 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7bbc06c2e0 0x7f7bbc06e7a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc006fd0 tx=0x7f7bcc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:06.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.330+0000 7f7bd37fe640 1 -- 172.21.15.117:0/233932231 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7bd40589c0 con 0x7f7bdc15e680 2024-09-19T08:39:06.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:06.496+0000 7f7be1378640 1 -- 172.21.15.117:0/233932231 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7bdc0d3ab0 con 0x7f7bdc15e680 2024-09-19T08:39:07.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.200+0000 7f7bd37fe640 1 -- 172.21.15.117:0/233932231 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) ==== 169+0+0 (secure 0 0 0) 0x7f7bd405ccc0 con 0x7f7bdc15e680 2024-09-19T08:39:07.201 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'cephfs_data' removed 2024-09-19T08:39:07.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.203+0000 7f7be1378640 1 -- 172.21.15.117:0/233932231 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7bbc06c2e0 msgr2=0x7f7bbc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:07.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.203+0000 7f7be1378640 1 --2- 172.21.15.117:0/233932231 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7bbc06c2e0 0x7f7bbc06e7a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc006fd0 tx=0x7f7bcc008040 comp rx=0 tx=0).stop 2024-09-19T08:39:07.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.203+0000 7f7be1378640 1 -- 172.21.15.117:0/233932231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bdc15e680 msgr2=0x7f7bdc160f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:07.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.203+0000 7f7be1378640 1 --2- 172.21.15.117:0/233932231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bdc15e680 0x7f7bdc160f20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400c7a0 tx=0x7f7bd400cc60 comp rx=0 tx=0).stop 2024-09-19T08:39:07.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.204+0000 7f7be1378640 1 -- 172.21.15.117:0/233932231 shutdown_connections 2024-09-19T08:39:07.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.204+0000 7f7be1378640 1 --2- 172.21.15.117:0/233932231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bdc15e680 0x7f7bdc160f20 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:07.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.204+0000 7f7be1378640 1 --2- 172.21.15.117:0/233932231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bdc15e2a0 0x7f7bdc1496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:07.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.204+0000 7f7be1378640 1 --2- 172.21.15.117:0/233932231 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f7bbc06c2e0 0x7f7bbc06e7a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:07.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.204+0000 7f7be1378640 1 --2- 172.21.15.117:0/233932231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bdc06d960 0x7f7bdc1ea610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:07.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.204+0000 7f7be1378640 1 -- 172.21.15.117:0/233932231 >> 172.21.15.117:0/233932231 conn(0x7f7bdc09d760 msgr2=0x7f7bdc15f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:07.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.204+0000 7f7be1378640 1 -- 172.21.15.117:0/233932231 shutdown_connections 2024-09-19T08:39:07.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.204+0000 7f7be1378640 1 -- 172.21.15.117:0/233932231 wait complete. 2024-09-19T08:39:07.221 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T08:39:07.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.324+0000 7f70bfec3640 1 Processor -- start 2024-09-19T08:39:07.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.324+0000 7f70bfec3640 1 -- start start 2024-09-19T08:39:07.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.324+0000 7f70bfec3640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f70b815c270 0x7f70b806c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:07.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.324+0000 7f70bfec3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f70b80ae270 0x7f70b80cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:07.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.324+0000 7f70bfec3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70b80b36a0 0x7f70b80cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:07.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.324+0000 7f70bfec3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f70b80cfda0 con 0x7f70b80ae270 2024-09-19T08:39:07.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.324+0000 7f70bfec3640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f70b80ccf80 con 0x7f70b815c270 2024-09-19T08:39:07.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.324+0000 7f70bfec3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f70b80cd260 con 0x7f70b80b36a0 2024-09-19T08:39:07.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.324+0000 7f70bd45e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f70b80ae270 0x7f70b80cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:07.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.324+0000 7f70bd45e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f70b80ae270 0x7f70b80cef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45404/0 (socket says 172.21.15.117:45404) 2024-09-19T08:39:07.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.324+0000 7f70bd45e640 1 -- 172.21.15.117:0/36324838 learned_addr learned my addr 172.21.15.117:0/36324838 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:07.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.324+0000 7f70bdc5f640 1 --2- 172.21.15.117:0/36324838 >> v2:172.21.15.146:3300/0 conn(0x7f70b815c270 0x7f70b806c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:07.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.324+0000 7f70be460640 1 --2- 172.21.15.117:0/36324838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70b80b36a0 0x7f70b80cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:07.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.324+0000 7f70bd45e640 1 -- 172.21.15.117:0/36324838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70b80b36a0 msgr2=0x7f70b80cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:07.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.324+0000 7f70bd45e640 1 --2- 172.21.15.117:0/36324838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70b80b36a0 0x7f70b80cf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:07.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.324+0000 7f70bd45e640 1 -- 172.21.15.117:0/36324838 >> v2:172.21.15.146:3300/0 conn(0x7f70b815c270 msgr2=0x7f70b806c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:07.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.324+0000 7f70bd45e640 1 --2- 172.21.15.117:0/36324838 >> v2:172.21.15.146:3300/0 conn(0x7f70b815c270 0x7f70b806c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:07.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.324+0000 7f70bd45e640 1 -- 172.21.15.117:0/36324838 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b80cd540 con 0x7f70b80ae270 2024-09-19T08:39:07.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.325+0000 7f70bd45e640 1 --2- 172.21.15.117:0/36324838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70b80ae270 0x7f70b80cef70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f70b8071220 tx=0x7f70a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cdd32c6c8ee4ad9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:07.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.325+0000 7f70bcc5d640 1 -- 172.21.15.117:0/36324838 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8037070 con 0x7f70b80ae270 2024-09-19T08:39:07.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.325+0000 7f70bcc5d640 1 -- 172.21.15.117:0/36324838 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a8032440 con 0x7f70b80ae270 2024-09-19T08:39:07.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.325+0000 7f70bcc5d640 1 -- 172.21.15.117:0/36324838 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8032810 con 0x7f70b80ae270 2024-09-19T08:39:07.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.326+0000 7f70bfec3640 1 -- 172.21.15.117:0/36324838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70b80ae270 msgr2=0x7f70b80cef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:07.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.326+0000 7f70bfec3640 1 --2- 172.21.15.117:0/36324838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70b80ae270 0x7f70b80cef70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f70b8071220 tx=0x7f70a802a1e0 comp rx=0 tx=0).stop 2024-09-19T08:39:07.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.326+0000 7f70bfec3640 1 -- 172.21.15.117:0/36324838 shutdown_connections 2024-09-19T08:39:07.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.326+0000 7f70bfec3640 1 --2- 172.21.15.117:0/36324838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70b80b36a0 0x7f70b80cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:07.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.326+0000 7f70bfec3640 1 --2- 172.21.15.117:0/36324838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70b80ae270 0x7f70b80cef70 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:07.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.326+0000 7f70bfec3640 1 --2- 172.21.15.117:0/36324838 >> v2:172.21.15.146:3300/0 conn(0x7f70b815c270 0x7f70b806c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:07.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.326+0000 7f70bfec3640 1 -- 172.21.15.117:0/36324838 >> 172.21.15.117:0/36324838 conn(0x7f70b809a9f0 msgr2=0x7f70b80b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:07.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.326+0000 7f70bfec3640 1 -- 172.21.15.117:0/36324838 shutdown_connections 2024-09-19T08:39:07.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.326+0000 7f70bfec3640 1 -- 172.21.15.117:0/36324838 wait complete. 2024-09-19T08:39:07.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.327+0000 7f70bfec3640 1 Processor -- start 2024-09-19T08:39:07.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.327+0000 7f70bfec3640 1 -- start start 2024-09-19T08:39:07.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.328+0000 7f70bfec3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70b80ae270 0x7f70b8155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:07.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.328+0000 7f70bfec3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70b80b36a0 0x7f70b81f4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:07.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.328+0000 7f70bfec3640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70b815c270 0x7f70b80b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:07.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.328+0000 7f70bfec3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f70b815c7d0 con 0x7f70b80ae270 2024-09-19T08:39:07.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.328+0000 7f70bfec3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f70b815c650 con 0x7f70b80b36a0 2024-09-19T08:39:07.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.328+0000 7f70bfec3640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f70b80ccba0 con 0x7f70b815c270 2024-09-19T08:39:07.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.328+0000 7f70bdc5f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70b80ae270 0x7f70b8155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:07.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.328+0000 7f70bdc5f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70b80ae270 0x7f70b8155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45420/0 (socket says 172.21.15.117:45420) 2024-09-19T08:39:07.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.328+0000 7f70bdc5f640 1 -- 172.21.15.117:0/2357514430 learned_addr learned my addr 172.21.15.117:0/2357514430 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:07.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.328+0000 7f70bd45e640 1 --2- 172.21.15.117:0/2357514430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70b80b36a0 0x7f70b81f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:07.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.328+0000 7f70be460640 1 --2- 172.21.15.117:0/2357514430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70b815c270 0x7f70b80b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:07.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.328+0000 7f70bdc5f640 1 -- 172.21.15.117:0/2357514430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70b815c270 msgr2=0x7f70b80b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:07.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.328+0000 7f70bdc5f640 1 --2- 172.21.15.117:0/2357514430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70b815c270 0x7f70b80b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:07.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.328+0000 7f70bdc5f640 1 -- 172.21.15.117:0/2357514430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70b80b36a0 msgr2=0x7f70b81f4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:07.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.328+0000 7f70bdc5f640 1 --2- 172.21.15.117:0/2357514430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70b80b36a0 0x7f70b81f4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:07.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.328+0000 7f70bdc5f640 1 -- 172.21.15.117:0/2357514430 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b81f4f90 con 0x7f70b80ae270 2024-09-19T08:39:07.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.328+0000 7f70bdc5f640 1 --2- 172.21.15.117:0/2357514430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70b80ae270 0x7f70b8155860 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f70b400e870 tx=0x7f70b400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:07.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.329+0000 7f70ae7fc640 1 -- 172.21.15.117:0/2357514430 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b4017070 con 0x7f70b80ae270 2024-09-19T08:39:07.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.329+0000 7f70ae7fc640 1 -- 172.21.15.117:0/2357514430 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b400c940 con 0x7f70b80ae270 2024-09-19T08:39:07.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.329+0000 7f70bfec3640 1 -- 172.21.15.117:0/2357514430 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70b81f5270 con 0x7f70b80ae270 2024-09-19T08:39:07.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.329+0000 7f70ae7fc640 1 -- 172.21.15.117:0/2357514430 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b400cd30 con 0x7f70b80ae270 2024-09-19T08:39:07.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.329+0000 7f70bfec3640 1 -- 172.21.15.117:0/2357514430 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70b80c8880 con 0x7f70b80ae270 2024-09-19T08:39:07.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.330+0000 7f70bfec3640 1 -- 172.21.15.117:0/2357514430 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70b806c620 con 0x7f70b80ae270 2024-09-19T08:39:07.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.330+0000 7f70ae7fc640 1 -- 172.21.15.117:0/2357514430 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f70b401a070 con 0x7f70b80ae270 2024-09-19T08:39:07.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.331+0000 7f70ae7fc640 1 --2- 172.21.15.117:0/2357514430 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f709c06c2b0 0x7f709c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:07.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.331+0000 7f70ae7fc640 1 -- 172.21.15.117:0/2357514430 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f70b408b3f0 con 0x7f70b80ae270 2024-09-19T08:39:07.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.331+0000 7f70bd45e640 1 --2- 172.21.15.117:0/2357514430 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f709c06c2b0 0x7f709c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:07.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.331+0000 7f70bd45e640 1 --2- 172.21.15.117:0/2357514430 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f709c06c2b0 0x7f709c06e770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f70a8034000 tx=0x7f70a802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:07.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.336+0000 7f70ae7fc640 1 -- 172.21.15.117:0/2357514430 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f70b4059710 con 0x7f70b80ae270 2024-09-19T08:39:07.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.500+0000 7f70bfec3640 1 -- 172.21.15.117:0/2357514430 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f70b806bfb0 con 0x7f70b80ae270 2024-09-19T08:39:07.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.503+0000 7f70ae7fc640 1 -- 172.21.15.117:0/2357514430 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f70b405da10 con 0x7f70b80ae270 2024-09-19T08:39:07.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.506+0000 7f70bfec3640 1 -- 172.21.15.117:0/2357514430 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f709c06c2b0 msgr2=0x7f709c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:07.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.506+0000 7f70bfec3640 1 --2- 172.21.15.117:0/2357514430 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f709c06c2b0 0x7f709c06e770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f70a8034000 tx=0x7f70a802e000 comp rx=0 tx=0).stop 2024-09-19T08:39:07.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.506+0000 7f70bfec3640 1 -- 172.21.15.117:0/2357514430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70b80ae270 msgr2=0x7f70b8155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:07.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.506+0000 7f70bfec3640 1 --2- 172.21.15.117:0/2357514430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70b80ae270 0x7f70b8155860 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f70b400e870 tx=0x7f70b400ed30 comp rx=0 tx=0).stop 2024-09-19T08:39:07.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.506+0000 7f70bfec3640 1 -- 172.21.15.117:0/2357514430 shutdown_connections 2024-09-19T08:39:07.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.506+0000 7f70bfec3640 1 --2- 172.21.15.117:0/2357514430 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f709c06c2b0 0x7f709c06e770 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:07.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.506+0000 7f70bfec3640 1 --2- 172.21.15.117:0/2357514430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70b815c270 0x7f70b80b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:07.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.506+0000 7f70bfec3640 1 --2- 172.21.15.117:0/2357514430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70b80b36a0 0x7f70b81f4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:07.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.506+0000 7f70bfec3640 1 --2- 172.21.15.117:0/2357514430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70b80ae270 0x7f70b8155860 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:07.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.506+0000 7f70bfec3640 1 -- 172.21.15.117:0/2357514430 >> 172.21.15.117:0/2357514430 conn(0x7f70b809a9f0 msgr2=0x7f70b80b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:07.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.506+0000 7f70bfec3640 1 -- 172.21.15.117:0/2357514430 shutdown_connections 2024-09-19T08:39:07.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.506+0000 7f70bfec3640 1 -- 172.21.15.117:0/2357514430 wait complete. 2024-09-19T08:39:07.517 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-09-19T08:39:07.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.616+0000 7f21b3c3c640 1 Processor -- start 2024-09-19T08:39:07.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.616+0000 7f21b3c3c640 1 -- start start 2024-09-19T08:39:07.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.617+0000 7f21b3c3c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21ac15a7b0 0x7f21ac0c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:07.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.617+0000 7f21b3c3c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21ac0b4540 con 0x7f21ac0cd040 2024-09-19T08:39:07.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.617+0000 7f21b3c3c640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21ac0cf9b0 con 0x7f21ac0cde40 2024-09-19T08:39:07.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.617+0000 7f21b3c3c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f21ac0b4870 con 0x7f21ac15a7b0 2024-09-19T08:39:07.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.617+0000 7f21b21d9640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f21ac0cd040 0x7f21ac0b3180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50102/0 (socket says 172.21.15.117:50102) 2024-09-19T08:39:07.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.617+0000 7f21b21d9640 1 -- 172.21.15.117:0/1979649797 learned_addr learned my addr 172.21.15.117:0/1979649797 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:07.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.617+0000 7f21b09d6640 1 -- 172.21.15.117:0/1979649797 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277865239 0 0) 0x7f21ac0b4540 con 0x7f21ac0cd040 2024-09-19T08:39:07.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.617+0000 7f21b09d6640 1 -- 172.21.15.117:0/1979649797 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2198003520 con 0x7f21ac0cd040 2024-09-19T08:39:07.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b19d8640 1 --2- 172.21.15.117:0/1979649797 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21ac15a7b0 0x7f21ac0c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:07.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b09d6640 1 -- 172.21.15.117:0/1979649797 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 677104850 0 0) 0x7f2198003520 con 0x7f21ac0cd040 2024-09-19T08:39:07.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b09d6640 1 -- 172.21.15.117:0/1979649797 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21ac15a7b0 msgr2=0x7f21ac0c5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:07.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b09d6640 1 --2- 172.21.15.117:0/1979649797 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21ac15a7b0 0x7f21ac0c5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:07.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b09d6640 1 -- 172.21.15.117:0/1979649797 >> v1:172.21.15.146:6789/0 conn(0x7f21ac0cde40 legacy=0x7f21ac0cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:07.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b09d6640 1 -- 172.21.15.117:0/1979649797 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ac0cfc90 con 0x7f21ac0cd040 2024-09-19T08:39:07.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b09d6640 1 -- 172.21.15.117:0/1979649797 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f21a40019f0 con 0x7f21ac0cd040 2024-09-19T08:39:07.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b09d6640 1 -- 172.21.15.117:0/1979649797 >> v1:172.21.15.117:6789/0 conn(0x7f21ac0cd040 legacy=0x7f21ac0b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:07.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b09d6640 1 --2- 172.21.15.117:0/1979649797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21980039e0 0x7f2198003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:07.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b09d6640 1 --2- 172.21.15.117:0/1979649797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2198004800 0x7f2198004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:07.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b09d6640 1 --2- 172.21.15.117:0/1979649797 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21ac15a7b0 0x7f2198005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:07.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b09d6640 1 -- 172.21.15.117:0/1979649797 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f21ac0b4870 con 0x7f2198004800 2024-09-19T08:39:07.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b09d6640 1 -- 172.21.15.117:0/1979649797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f219800baf0 con 0x7f21980039e0 2024-09-19T08:39:07.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b09d6640 1 -- 172.21.15.117:0/1979649797 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f219800bcf0 con 0x7f21ac15a7b0 2024-09-19T08:39:07.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b11d7640 1 --2- 172.21.15.117:0/1979649797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2198004800 0x7f2198004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:07.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b19d8640 1 --2- 172.21.15.117:0/1979649797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21980039e0 0x7f2198003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:07.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b21d9640 1 --2- 172.21.15.117:0/1979649797 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21ac15a7b0 0x7f2198005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:07.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b11d7640 1 -- 172.21.15.117:0/1979649797 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21ac15a7b0 msgr2=0x7f2198005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:07.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b11d7640 1 --2- 172.21.15.117:0/1979649797 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21ac15a7b0 0x7f2198005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:07.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b11d7640 1 -- 172.21.15.117:0/1979649797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21980039e0 msgr2=0x7f2198003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:07.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b11d7640 1 --2- 172.21.15.117:0/1979649797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21980039e0 0x7f2198003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:07.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.618+0000 7f21b11d7640 1 -- 172.21.15.117:0/1979649797 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2198003520 con 0x7f2198004800 2024-09-19T08:39:07.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.619+0000 7f21b11d7640 1 --2- 172.21.15.117:0/1979649797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2198004800 0x7f2198004c80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f219c0015c0 tx=0x7f2198005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da7cf33518a95a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:07.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.619+0000 7f21b09d6640 1 -- 172.21.15.117:0/1979649797 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c001290 con 0x7f2198004800 2024-09-19T08:39:07.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.619+0000 7f21b09d6640 1 -- 172.21.15.117:0/1979649797 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f219c0052f0 con 0x7f2198004800 2024-09-19T08:39:07.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.619+0000 7f21b09d6640 1 -- 172.21.15.117:0/1979649797 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c003830 con 0x7f2198004800 2024-09-19T08:39:07.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.620+0000 7f21b3c3c640 1 -- 172.21.15.117:0/1979649797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2198004800 msgr2=0x7f2198004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:07.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.620+0000 7f21b3c3c640 1 --2- 172.21.15.117:0/1979649797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2198004800 0x7f2198004c80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f219c0015c0 tx=0x7f2198005830 comp rx=0 tx=0).stop 2024-09-19T08:39:07.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.620+0000 7f21b21d9640 1 -- 172.21.15.117:0/1979649797 reap_dead start 2024-09-19T08:39:07.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.620+0000 7f21b3c3c640 1 -- 172.21.15.117:0/1979649797 shutdown_connections 2024-09-19T08:39:07.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.620+0000 7f21b3c3c640 1 -- 172.21.15.117:0/1979649797 >> 172.21.15.117:0/1979649797 conn(0x7f21ac06bdf0 msgr2=0x7f21ac06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:07.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.620+0000 7f21b3c3c640 1 -- 172.21.15.117:0/1979649797 shutdown_connections 2024-09-19T08:39:07.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.620+0000 7f21b3c3c640 1 -- 172.21.15.117:0/1979649797 wait complete. 2024-09-19T08:39:07.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.621+0000 7f21b3c3c640 1 Processor -- start 2024-09-19T08:39:07.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.621+0000 7f21b3c3c640 1 -- start start 2024-09-19T08:39:07.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21b3c3c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2198004800 0x7f21ac0b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:07.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21b3c3c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21ac14d8e0 0x7f21ac0b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:07.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21b3c3c640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21ac0b0920 0x7f21ac0c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:07.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21b3c3c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f21ac0ca8c0 con 0x7f2198004800 2024-09-19T08:39:07.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21b3c3c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f21ac15ab90 con 0x7f21ac14d8e0 2024-09-19T08:39:07.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21b3c3c640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f21ac0ce280 con 0x7f21ac0b0920 2024-09-19T08:39:07.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21b19d8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2198004800 0x7f21ac0b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:07.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21b19d8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2198004800 0x7f21ac0b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45440/0 (socket says 172.21.15.117:45440) 2024-09-19T08:39:07.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21b19d8640 1 -- 172.21.15.117:0/2398830749 learned_addr learned my addr 172.21.15.117:0/2398830749 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:07.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21b11d7640 1 --2- 172.21.15.117:0/2398830749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21ac14d8e0 0x7f21ac0b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:07.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21b21d9640 1 --2- 172.21.15.117:0/2398830749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21ac0b0920 0x7f21ac0c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:07.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21b19d8640 1 -- 172.21.15.117:0/2398830749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21ac0b0920 msgr2=0x7f21ac0c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:07.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21b19d8640 1 --2- 172.21.15.117:0/2398830749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21ac0b0920 0x7f21ac0c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:07.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21b19d8640 1 -- 172.21.15.117:0/2398830749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21ac14d8e0 msgr2=0x7f21ac0b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:07.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21b19d8640 1 --2- 172.21.15.117:0/2398830749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21ac14d8e0 0x7f21ac0b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:07.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21b19d8640 1 -- 172.21.15.117:0/2398830749 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ac0afc60 con 0x7f2198004800 2024-09-19T08:39:07.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21b21d9640 1 --2- 172.21.15.117:0/2398830749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21ac0b0920 0x7f21ac0c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:07.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21b19d8640 1 --2- 172.21.15.117:0/2398830749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2198004800 0x7f21ac0b2480 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f21a80039e0 tx=0x7f21a8003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:07.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21a27fc640 1 -- 172.21.15.117:0/2398830749 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a8020070 con 0x7f2198004800 2024-09-19T08:39:07.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21a27fc640 1 -- 172.21.15.117:0/2398830749 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a8014ba0 con 0x7f2198004800 2024-09-19T08:39:07.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21b3c3c640 1 -- 172.21.15.117:0/2398830749 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21ac0c7720 con 0x7f2198004800 2024-09-19T08:39:07.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21a27fc640 1 -- 172.21.15.117:0/2398830749 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a801b480 con 0x7f2198004800 2024-09-19T08:39:07.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.622+0000 7f21b3c3c640 1 -- 172.21.15.117:0/2398830749 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21ac0c7ce0 con 0x7f2198004800 2024-09-19T08:39:07.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.623+0000 7f21b3c3c640 1 -- 172.21.15.117:0/2398830749 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21ac0b0d30 con 0x7f2198004800 2024-09-19T08:39:07.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.624+0000 7f21a27fc640 1 -- 172.21.15.117:0/2398830749 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f21a8023070 con 0x7f2198004800 2024-09-19T08:39:07.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.624+0000 7f21a27fc640 1 --2- 172.21.15.117:0/2398830749 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f219006c2b0 0x7f219006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:07.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.624+0000 7f21a27fc640 1 -- 172.21.15.117:0/2398830749 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f21a808eea0 con 0x7f2198004800 2024-09-19T08:39:07.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.624+0000 7f21b11d7640 1 --2- 172.21.15.117:0/2398830749 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f219006c2b0 0x7f219006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:07.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.625+0000 7f21b11d7640 1 --2- 172.21.15.117:0/2398830749 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f219006c2b0 0x7f219006e770 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f219c032000 tx=0x7f219c02f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:07.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.629+0000 7f21a27fc640 1 -- 172.21.15.117:0/2398830749 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f21ac0b0d30 con 0x7f2198004800 2024-09-19T08:39:07.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:07.857+0000 7f21b3c3c640 1 -- 172.21.15.117:0/2398830749 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) -- 0x7f21ac0c5b00 con 0x7f2198004800 2024-09-19T08:39:08.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:08.208+0000 7f21a27fc640 1 -- 172.21.15.117:0/2398830749 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v124) ==== 149+0+0 (secure 0 0 0) 0x7f21ac0afc60 con 0x7f2198004800 2024-09-19T08:39:08.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:08.211+0000 7f21b3c3c640 1 -- 172.21.15.117:0/2398830749 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f219006c2b0 msgr2=0x7f219006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:08.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:08.211+0000 7f21b3c3c640 1 --2- 172.21.15.117:0/2398830749 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f219006c2b0 0x7f219006e770 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f219c032000 tx=0x7f219c02f000 comp rx=0 tx=0).stop 2024-09-19T08:39:08.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:08.211+0000 7f21b3c3c640 1 -- 172.21.15.117:0/2398830749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2198004800 msgr2=0x7f21ac0b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:08.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:08.211+0000 7f21b3c3c640 1 --2- 172.21.15.117:0/2398830749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2198004800 0x7f21ac0b2480 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f21a80039e0 tx=0x7f21a8003ea0 comp rx=0 tx=0).stop 2024-09-19T08:39:08.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:08.211+0000 7f21b3c3c640 1 -- 172.21.15.117:0/2398830749 shutdown_connections 2024-09-19T08:39:08.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:08.211+0000 7f21b3c3c640 1 --2- 172.21.15.117:0/2398830749 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f219006c2b0 0x7f219006e770 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:08.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:08.211+0000 7f21b3c3c640 1 --2- 172.21.15.117:0/2398830749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21ac0b0920 0x7f21ac0c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:08.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:08.211+0000 7f21b3c3c640 1 --2- 172.21.15.117:0/2398830749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21ac14d8e0 0x7f21ac0b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:08.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:08.211+0000 7f21b3c3c640 1 --2- 172.21.15.117:0/2398830749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2198004800 0x7f21ac0b2480 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:08.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:08.211+0000 7f21b3c3c640 1 -- 172.21.15.117:0/2398830749 >> 172.21.15.117:0/2398830749 conn(0x7f21ac06bdf0 msgr2=0x7f21ac0cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:08.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:08.211+0000 7f21b3c3c640 1 -- 172.21.15.117:0/2398830749 shutdown_connections 2024-09-19T08:39:08.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:08.211+0000 7f21b3c3c640 1 -- 172.21.15.117:0/2398830749 wait complete. 2024-09-19T08:39:08.224 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ERROR 2024-09-19T08:39:08.224 INFO:tasks.cephfs_test_runner: 2024-09-19T08:39:08.224 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-19T08:39:08.224 INFO:tasks.cephfs_test_runner:ERROR: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-09-19T08:39:08.224 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool 2024-09-19T08:39:08.225 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-19T08:39:08.225 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-19T08:39:08.225 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/test_forward_scrub.py", line 294, in test_backtrace_repair 2024-09-19T08:39:08.225 INFO:tasks.cephfs_test_runner: backtrace = self.fs.read_backtrace(file_ino) 2024-09-19T08:39:08.225 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-19T08:39:08.225 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-19T08:39:08.225 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-19T08:39:08.225 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-19T08:39:08.225 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-19T08:39:08.225 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-19T08:39:08.225 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-19T08:39:08.226 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-19T08:39:08.226 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-19T08:39:08.226 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-19T08:39:08.226 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-19T08:39:08.226 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-19T08:39:08.226 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-19T08:39:08.226 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-19T08:39:08.226 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi117 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-19T08:39:08.227 INFO:tasks.cephfs_test_runner: 2024-09-19T08:39:08.227 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-19T08:39:08.227 INFO:tasks.cephfs_test_runner:Ran 2 tests in 79.868s 2024-09-19T08:39:08.227 INFO:tasks.cephfs_test_runner: 2024-09-19T08:39:08.227 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-09-19T08:39:08.227 INFO:tasks.cephfs_test_runner: 2024-09-19T08:39:08.228 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-19T08:39:08.228 INFO:tasks.cephfs_test_runner:ERROR: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-09-19T08:39:08.228 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool 2024-09-19T08:39:08.228 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-19T08:39:08.228 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-19T08:39:08.229 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/test_forward_scrub.py", line 294, in test_backtrace_repair 2024-09-19T08:39:08.229 INFO:tasks.cephfs_test_runner: backtrace = self.fs.read_backtrace(file_ino) 2024-09-19T08:39:08.229 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-19T08:39:08.229 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-19T08:39:08.229 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-19T08:39:08.229 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-19T08:39:08.229 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-19T08:39:08.230 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-19T08:39:08.230 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-19T08:39:08.230 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-19T08:39:08.230 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-19T08:39:08.230 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-19T08:39:08.230 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-19T08:39:08.230 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-19T08:39:08.230 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-19T08:39:08.230 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-19T08:39:08.230 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi117 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-19T08:39:08.230 INFO:tasks.cephfs_test_runner: 2024-09-19T08:39:08.231 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-09-19T08:39:08.473 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=30a20160d42a4f22b83f37a2bf1ed6e5 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-09-19T08:39:08.474 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-19T08:39:08.488 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-19T08:39:08.526 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-19T08:39:08.526 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:39:08.527 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:39:08.546 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20491 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T08:39:08.546 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T08:39:08.546 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:39:08.603 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20491 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T08:39:08.603 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:39:08.603 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:39:08.623 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15971 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T08:39:08.624 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-19T08:39:08.624 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:39:08.686 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056027,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15971 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T08:39:08.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:39:08.686 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-09-19T08:39:08.702 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T08:39:08.703 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T08:39:08.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:39:08.703 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T08:39:08.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:39:08.769 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:39:08.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:39:08.834 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2024-09-19T08:39:08.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:39:08.931 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-19T08:39:08.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-19T08:39:08.950 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-19T08:39:08.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:39:08.951 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T08:39:09.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:39:09.021 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T08:39:09.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:39:09.090 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2024-09-19T08:39:09.197 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-19T08:39:09.212 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T08:39:09.212 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:39:09.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.316+0000 7fae75e5e640 1 Processor -- start 2024-09-19T08:39:09.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.316+0000 7fae75e5e640 1 -- start start 2024-09-19T08:39:09.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.317+0000 7fae75e5e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fae700c5b00 0x7fae700cc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:09.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.317+0000 7fae75e5e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fae700cce70 0x7fae700b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:09.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.317+0000 7fae75e5e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae700b4540 con 0x7fae7015a7b0 2024-09-19T08:39:09.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.317+0000 7fae75e5e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fae700b4870 con 0x7fae700c5b00 2024-09-19T08:39:09.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.317+0000 7fae75e5e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fae700c5f40 con 0x7fae700cce70 2024-09-19T08:39:09.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.317+0000 7fae6effd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fae700c5b00 0x7fae700cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:09.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.317+0000 7fae6effd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fae700c5b00 0x7fae700cc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45448/0 (socket says 172.21.15.117:45448) 2024-09-19T08:39:09.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.317+0000 7fae6effd640 1 -- 172.21.15.117:0/3335568160 learned_addr learned my addr 172.21.15.117:0/3335568160 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:09.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.317+0000 7fae6ffff640 1 --2- 172.21.15.117:0/3335568160 >> v2:172.21.15.146:3300/0 conn(0x7fae700cce70 0x7fae700b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:09.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.318+0000 7fae6effd640 1 -- 172.21.15.117:0/3335568160 >> v2:172.21.15.146:3300/0 conn(0x7fae700cce70 msgr2=0x7fae700b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:09.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.318+0000 7fae6effd640 1 --2- 172.21.15.117:0/3335568160 >> v2:172.21.15.146:3300/0 conn(0x7fae700cce70 0x7fae700b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.318+0000 7fae6effd640 1 -- 172.21.15.117:0/3335568160 >> v1:172.21.15.146:6789/0 conn(0x7fae7015a7b0 legacy=0x7fae700cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:09.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.318+0000 7fae6effd640 1 -- 172.21.15.117:0/3335568160 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae700cf9b0 con 0x7fae700c5b00 2024-09-19T08:39:09.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.318+0000 7fae6effd640 1 --2- 172.21.15.117:0/3335568160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae700c5b00 0x7fae700cc930 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fae700d1070 tx=0x7fae6402c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a732caa5d263fd08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:09.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.318+0000 7fae6e7fc640 1 -- 172.21.15.117:0/3335568160 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae64036020 con 0x7fae700c5b00 2024-09-19T08:39:09.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.318+0000 7fae6e7fc640 1 -- 172.21.15.117:0/3335568160 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae64032640 con 0x7fae700c5b00 2024-09-19T08:39:09.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.318+0000 7fae6e7fc640 1 -- 172.21.15.117:0/3335568160 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae64032a10 con 0x7fae700c5b00 2024-09-19T08:39:09.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.319+0000 7fae75e5e640 1 -- 172.21.15.117:0/3335568160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae700c5b00 msgr2=0x7fae700cc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:09.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.319+0000 7fae75e5e640 1 --2- 172.21.15.117:0/3335568160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae700c5b00 0x7fae700cc930 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fae700d1070 tx=0x7fae6402c940 comp rx=0 tx=0).stop 2024-09-19T08:39:09.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.319+0000 7fae75e5e640 1 -- 172.21.15.117:0/3335568160 shutdown_connections 2024-09-19T08:39:09.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.319+0000 7fae75e5e640 1 --2- 172.21.15.117:0/3335568160 >> v2:172.21.15.146:3300/0 conn(0x7fae700cce70 0x7fae700b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.319+0000 7fae75e5e640 1 --2- 172.21.15.117:0/3335568160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae700c5b00 0x7fae700cc930 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.319+0000 7fae75e5e640 1 -- 172.21.15.117:0/3335568160 >> 172.21.15.117:0/3335568160 conn(0x7fae7006bdf0 msgr2=0x7fae7006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:09.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.319+0000 7fae75e5e640 1 -- 172.21.15.117:0/3335568160 shutdown_connections 2024-09-19T08:39:09.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.319+0000 7fae75e5e640 1 -- 172.21.15.117:0/3335568160 wait complete. 2024-09-19T08:39:09.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.320+0000 7fae75e5e640 1 Processor -- start 2024-09-19T08:39:09.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.321+0000 7fae75e5e640 1 -- start start 2024-09-19T08:39:09.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.321+0000 7fae75e5e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae700c5b00 0x7fae700c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:09.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.321+0000 7fae75e5e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae700cce70 0x7fae700ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:09.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.321+0000 7fae75e5e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae7015a7b0 0x7fae700c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:09.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.321+0000 7fae75e5e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fae7015ab90 con 0x7fae700c5b00 2024-09-19T08:39:09.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.321+0000 7fae75e5e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fae700cff70 con 0x7fae7015a7b0 2024-09-19T08:39:09.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.321+0000 7fae75e5e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fae700ca8c0 con 0x7fae700cce70 2024-09-19T08:39:09.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.321+0000 7fae6f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae700c5b00 0x7fae700c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:09.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.321+0000 7fae6f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae700c5b00 0x7fae700c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45456/0 (socket says 172.21.15.117:45456) 2024-09-19T08:39:09.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.321+0000 7fae6f7fe640 1 -- 172.21.15.117:0/2042379115 learned_addr learned my addr 172.21.15.117:0/2042379115 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:09.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.321+0000 7fae6effd640 1 --2- 172.21.15.117:0/2042379115 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae700cce70 0x7fae700ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:09.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.321+0000 7fae6ffff640 1 --2- 172.21.15.117:0/2042379115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae7015a7b0 0x7fae700c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:09.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.322+0000 7fae6f7fe640 1 -- 172.21.15.117:0/2042379115 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae700cce70 msgr2=0x7fae700ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:09.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.322+0000 7fae6f7fe640 1 --2- 172.21.15.117:0/2042379115 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae700cce70 0x7fae700ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.322+0000 7fae6f7fe640 1 -- 172.21.15.117:0/2042379115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae7015a7b0 msgr2=0x7fae700c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:09.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.322+0000 7fae6f7fe640 1 --2- 172.21.15.117:0/2042379115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae7015a7b0 0x7fae700c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.322+0000 7fae6f7fe640 1 -- 172.21.15.117:0/2042379115 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae700c7a90 con 0x7fae700c5b00 2024-09-19T08:39:09.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.322+0000 7fae6f7fe640 1 --2- 172.21.15.117:0/2042379115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae700c5b00 0x7fae700c8850 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fae6000c400 tx=0x7fae6000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:09.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.322+0000 7fae57fff640 1 -- 172.21.15.117:0/2042379115 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae600052d0 con 0x7fae700c5b00 2024-09-19T08:39:09.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.322+0000 7fae57fff640 1 -- 172.21.15.117:0/2042379115 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae60005490 con 0x7fae700c5b00 2024-09-19T08:39:09.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.322+0000 7fae75e5e640 1 -- 172.21.15.117:0/2042379115 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae700c7d70 con 0x7fae700c5b00 2024-09-19T08:39:09.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.322+0000 7fae57fff640 1 -- 172.21.15.117:0/2042379115 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae60007260 con 0x7fae700c5b00 2024-09-19T08:39:09.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.322+0000 7fae75e5e640 1 -- 172.21.15.117:0/2042379115 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae700c8330 con 0x7fae700c5b00 2024-09-19T08:39:09.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.323+0000 7fae75e5e640 1 -- 172.21.15.117:0/2042379115 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae700cc930 con 0x7fae700c5b00 2024-09-19T08:39:09.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.323+0000 7fae57fff640 1 -- 172.21.15.117:0/2042379115 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fae60007400 con 0x7fae700c5b00 2024-09-19T08:39:09.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.324+0000 7fae57fff640 1 --2- 172.21.15.117:0/2042379115 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fae5c06c2b0 0x7fae5c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:09.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.324+0000 7fae57fff640 1 -- 172.21.15.117:0/2042379115 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fae6008a6c0 con 0x7fae700c5b00 2024-09-19T08:39:09.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.324+0000 7fae6effd640 1 --2- 172.21.15.117:0/2042379115 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fae5c06c2b0 0x7fae5c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:09.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.325+0000 7fae6effd640 1 --2- 172.21.15.117:0/2042379115 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fae5c06c2b0 0x7fae5c06e770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fae64037000 tx=0x7fae64032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:09.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.328+0000 7fae57fff640 1 -- 172.21.15.117:0/2042379115 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fae600589e0 con 0x7fae700c5b00 2024-09-19T08:39:09.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.490+0000 7fae75e5e640 1 -- 172.21.15.117:0/2042379115 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fae700b4070 con 0x7fae5c06c2b0 2024-09-19T08:39:09.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.491+0000 7fae57fff640 1 -- 172.21.15.117:0/2042379115 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13415 (secure 0 0 0) 0x7fae700b4070 con 0x7fae5c06c2b0 2024-09-19T08:39:09.491 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:39:09.492 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-09-19T08:39:09.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.493+0000 7fae75e5e640 1 -- 172.21.15.117:0/2042379115 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fae5c06c2b0 msgr2=0x7fae5c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:09.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.493+0000 7fae75e5e640 1 --2- 172.21.15.117:0/2042379115 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fae5c06c2b0 0x7fae5c06e770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fae64037000 tx=0x7fae64032000 comp rx=0 tx=0).stop 2024-09-19T08:39:09.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.493+0000 7fae75e5e640 1 -- 172.21.15.117:0/2042379115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae700c5b00 msgr2=0x7fae700c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:09.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.493+0000 7fae75e5e640 1 --2- 172.21.15.117:0/2042379115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae700c5b00 0x7fae700c8850 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fae6000c400 tx=0x7fae6000c8c0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.493+0000 7fae75e5e640 1 -- 172.21.15.117:0/2042379115 shutdown_connections 2024-09-19T08:39:09.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.493+0000 7fae75e5e640 1 --2- 172.21.15.117:0/2042379115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae7015a7b0 0x7fae700c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.493+0000 7fae75e5e640 1 --2- 172.21.15.117:0/2042379115 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fae5c06c2b0 0x7fae5c06e770 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.493+0000 7fae75e5e640 1 --2- 172.21.15.117:0/2042379115 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae700cce70 0x7fae700ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.493+0000 7fae75e5e640 1 --2- 172.21.15.117:0/2042379115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae700c5b00 0x7fae700c8850 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.493+0000 7fae75e5e640 1 -- 172.21.15.117:0/2042379115 >> 172.21.15.117:0/2042379115 conn(0x7fae7006bdf0 msgr2=0x7fae7006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:09.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.493+0000 7fae75e5e640 1 -- 172.21.15.117:0/2042379115 shutdown_connections 2024-09-19T08:39:09.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.493+0000 7fae75e5e640 1 -- 172.21.15.117:0/2042379115 wait complete. 2024-09-19T08:39:09.505 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-09-19T08:39:07.873293+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222516,"kb_used_data":6296,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752204,"statfs":{"total":773094113280,"available":772866256896,"internally_reserved":0,"allocated":6447104,"data_stored":3500802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-49,"num_write_kb":-15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001576"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":229,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T08:39:04.191252+0000","last_change":"2024-09-19T08:37:04.479071+0000","last_active":"2024-09-19T08:39:04.191252+0000","last_peered":"2024-09-19T08:39:04.191252+0000","last_clean":"2024-09-19T08:39:04.191252+0000","last_became_active":"2024-09-19T08:37:04.478199+0000","last_became_peered":"2024-09-19T08:37:04.478199+0000","last_unstale":"2024-09-19T08:39:04.191252+0000","last_undegraded":"2024-09-19T08:39:04.191252+0000","last_fullsized":"2024-09-19T08:39:04.191252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_clean_scrub_stamp":"2024-09-19T08:37:02.519738+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:32.963748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":287502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28264,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343576,"statfs":{"total":96636764160,"available":96607821824,"internally_reserved":0,"allocated":1265664,"data_stored":889017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509469,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":675840,"data_stored":298651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509468,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":293344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509469,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":286954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509470,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1245184,"data_stored":877358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509468,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":287502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":643072,"data_stored":280474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:39:09.506 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:39:09.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.605+0000 7fd61f72a640 1 Processor -- start 2024-09-19T08:39:09.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.605+0000 7fd61f72a640 1 -- start start 2024-09-19T08:39:09.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.606+0000 7fd61f72a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd618070930 0x7fd6180b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:09.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.606+0000 7fd61f72a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd618070ea0 con 0x7fd61815e4f0 2024-09-19T08:39:09.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.606+0000 7fd61f72a640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd61806e8c0 con 0x7fd6180add30 2024-09-19T08:39:09.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.606+0000 7fd61f72a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fd61806eba0 con 0x7fd618070930 2024-09-19T08:39:09.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.606+0000 7fd61dcc7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd618070930 0x7fd6180b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:09.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.606+0000 7fd61ccc5640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fd61815e4f0 0x7fd6180b5050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50118/0 (socket says 172.21.15.117:50118) 2024-09-19T08:39:09.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.606+0000 7fd61ccc5640 1 -- 172.21.15.117:0/2331676270 learned_addr learned my addr 172.21.15.117:0/2331676270 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:09.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.606+0000 7fd61dcc7640 1 --2- 172.21.15.117:0/2331676270 >> v2:172.21.15.117:3300/0 conn(0x7fd618070930 0x7fd6180b00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45472/0 (socket says 172.21.15.117:45472) 2024-09-19T08:39:09.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.606+0000 7fd61dcc7640 1 -- 172.21.15.117:0/2331676270 >> v1:172.21.15.146:6789/0 conn(0x7fd6180add30 legacy=0x7fd6180ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:09.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.606+0000 7fd61dcc7640 1 -- 172.21.15.117:0/2331676270 >> v1:172.21.15.117:6789/0 conn(0x7fd61815e4f0 legacy=0x7fd6180b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:09.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.606+0000 7fd61dcc7640 1 -- 172.21.15.117:0/2331676270 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61806ee80 con 0x7fd618070930 2024-09-19T08:39:09.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.606+0000 7fd60ffff640 1 -- 172.21.15.117:0/2331676270 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2670202848 0 0) 0x7fd618070ea0 con 0x7fd61815e4f0 2024-09-19T08:39:09.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.607+0000 7fd61dcc7640 1 --2- 172.21.15.117:0/2331676270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd618070930 0x7fd6180b00f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd610009d90 tx=0x7fd61002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4378d51055f6126e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:09.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.607+0000 7fd60ffff640 1 -- 172.21.15.117:0/2331676270 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd610007740 con 0x7fd618070930 2024-09-19T08:39:09.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.607+0000 7fd60ffff640 1 -- 172.21.15.117:0/2331676270 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6100078e0 con 0x7fd618070930 2024-09-19T08:39:09.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.607+0000 7fd60ffff640 1 -- 172.21.15.117:0/2331676270 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd610007cb0 con 0x7fd618070930 2024-09-19T08:39:09.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.607+0000 7fd61f72a640 1 -- 172.21.15.117:0/2331676270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd618070930 msgr2=0x7fd6180b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:09.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.607+0000 7fd61f72a640 1 --2- 172.21.15.117:0/2331676270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd618070930 0x7fd6180b00f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd610009d90 tx=0x7fd61002a6f0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.607+0000 7fd61f72a640 1 -- 172.21.15.117:0/2331676270 shutdown_connections 2024-09-19T08:39:09.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.607+0000 7fd61f72a640 1 --2- 172.21.15.117:0/2331676270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd618070930 0x7fd6180b00f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.607+0000 7fd61f72a640 1 -- 172.21.15.117:0/2331676270 >> 172.21.15.117:0/2331676270 conn(0x7fd61806bc10 msgr2=0x7fd61806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:09.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.608+0000 7fd61f72a640 1 -- 172.21.15.117:0/2331676270 shutdown_connections 2024-09-19T08:39:09.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.608+0000 7fd61f72a640 1 -- 172.21.15.117:0/2331676270 wait complete. 2024-09-19T08:39:09.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.609+0000 7fd61f72a640 1 Processor -- start 2024-09-19T08:39:09.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.609+0000 7fd61f72a640 1 -- start start 2024-09-19T08:39:09.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.609+0000 7fd61f72a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd618070930 0x7fd618158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:09.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.609+0000 7fd61f72a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6180add30 0x7fd618153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:09.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.609+0000 7fd61f72a640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd61815e4f0 0x7fd61815a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:09.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.609+0000 7fd61f72a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd61806f520 con 0x7fd618070930 2024-09-19T08:39:09.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.609+0000 7fd61f72a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd61806f3a0 con 0x7fd6180add30 2024-09-19T08:39:09.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.609+0000 7fd61f72a640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fd61806f6a0 con 0x7fd61815e4f0 2024-09-19T08:39:09.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.609+0000 7fd61d4c6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd618070930 0x7fd618158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:09.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.610+0000 7fd61d4c6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd618070930 0x7fd618158f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45480/0 (socket says 172.21.15.117:45480) 2024-09-19T08:39:09.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.610+0000 7fd61d4c6640 1 -- 172.21.15.117:0/4109818684 learned_addr learned my addr 172.21.15.117:0/4109818684 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:09.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.610+0000 7fd61ccc5640 1 --2- 172.21.15.117:0/4109818684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6180add30 0x7fd618153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:09.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.610+0000 7fd61dcc7640 1 --2- 172.21.15.117:0/4109818684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd61815e4f0 0x7fd61815a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:09.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.610+0000 7fd61d4c6640 1 -- 172.21.15.117:0/4109818684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd61815e4f0 msgr2=0x7fd61815a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:09.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.610+0000 7fd61d4c6640 1 --2- 172.21.15.117:0/4109818684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd61815e4f0 0x7fd61815a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.610+0000 7fd61d4c6640 1 -- 172.21.15.117:0/4109818684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6180add30 msgr2=0x7fd618153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:09.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.610+0000 7fd61d4c6640 1 --2- 172.21.15.117:0/4109818684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6180add30 0x7fd618153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.610+0000 7fd61d4c6640 1 -- 172.21.15.117:0/4109818684 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6181e9b80 con 0x7fd618070930 2024-09-19T08:39:09.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.610+0000 7fd61d4c6640 1 --2- 172.21.15.117:0/4109818684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd618070930 0x7fd618158f50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd61400c480 tx=0x7fd61400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:09.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.610+0000 7fd60dffb640 1 -- 172.21.15.117:0/4109818684 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6140052d0 con 0x7fd618070930 2024-09-19T08:39:09.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.610+0000 7fd60dffb640 1 -- 172.21.15.117:0/4109818684 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd614005470 con 0x7fd618070930 2024-09-19T08:39:09.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.610+0000 7fd61f72a640 1 -- 172.21.15.117:0/4109818684 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6181e9e60 con 0x7fd618070930 2024-09-19T08:39:09.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.610+0000 7fd60dffb640 1 -- 172.21.15.117:0/4109818684 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd614012870 con 0x7fd618070930 2024-09-19T08:39:09.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.610+0000 7fd61f72a640 1 -- 172.21.15.117:0/4109818684 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6181ea420 con 0x7fd618070930 2024-09-19T08:39:09.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.611+0000 7fd61f72a640 1 -- 172.21.15.117:0/4109818684 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6180b00f0 con 0x7fd618070930 2024-09-19T08:39:09.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.612+0000 7fd60dffb640 1 -- 172.21.15.117:0/4109818684 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd614012a10 con 0x7fd618070930 2024-09-19T08:39:09.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.612+0000 7fd60dffb640 1 --2- 172.21.15.117:0/4109818684 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd5fc06c2b0 0x7fd5fc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:09.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.612+0000 7fd60dffb640 1 -- 172.21.15.117:0/4109818684 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fd61408ae20 con 0x7fd618070930 2024-09-19T08:39:09.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.612+0000 7fd61ccc5640 1 --2- 172.21.15.117:0/4109818684 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd5fc06c2b0 0x7fd5fc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:09.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.613+0000 7fd61ccc5640 1 --2- 172.21.15.117:0/4109818684 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd5fc06c2b0 0x7fd5fc06e770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd618158780 tx=0x7fd608007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:09.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.616+0000 7fd60dffb640 1 -- 172.21.15.117:0/4109818684 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd614059790 con 0x7fd618070930 2024-09-19T08:39:09.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.780+0000 7fd61f72a640 1 -- 172.21.15.117:0/4109818684 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd61815c9d0 con 0x7fd5fc06c2b0 2024-09-19T08:39:09.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.781+0000 7fd60dffb640 1 -- 172.21.15.117:0/4109818684 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13415 (secure 0 0 0) 0x7fd61815c9d0 con 0x7fd5fc06c2b0 2024-09-19T08:39:09.781 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:39:09.782 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-09-19T08:39:09.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.783+0000 7fd61f72a640 1 -- 172.21.15.117:0/4109818684 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd5fc06c2b0 msgr2=0x7fd5fc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:09.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.783+0000 7fd61f72a640 1 --2- 172.21.15.117:0/4109818684 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd5fc06c2b0 0x7fd5fc06e770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd618158780 tx=0x7fd608007e40 comp rx=0 tx=0).stop 2024-09-19T08:39:09.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.783+0000 7fd61f72a640 1 -- 172.21.15.117:0/4109818684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd618070930 msgr2=0x7fd618158f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:09.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.783+0000 7fd61f72a640 1 --2- 172.21.15.117:0/4109818684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd618070930 0x7fd618158f50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd61400c480 tx=0x7fd61400c940 comp rx=0 tx=0).stop 2024-09-19T08:39:09.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.783+0000 7fd61f72a640 1 -- 172.21.15.117:0/4109818684 shutdown_connections 2024-09-19T08:39:09.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.783+0000 7fd61f72a640 1 --2- 172.21.15.117:0/4109818684 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fd5fc06c2b0 0x7fd5fc06e770 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.783+0000 7fd61f72a640 1 --2- 172.21.15.117:0/4109818684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd61815e4f0 0x7fd61815a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.783+0000 7fd61f72a640 1 --2- 172.21.15.117:0/4109818684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6180add30 0x7fd618153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.783+0000 7fd61f72a640 1 --2- 172.21.15.117:0/4109818684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd618070930 0x7fd618158f50 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.783+0000 7fd61f72a640 1 -- 172.21.15.117:0/4109818684 >> 172.21.15.117:0/4109818684 conn(0x7fd61806bc10 msgr2=0x7fd6180b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:09.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.783+0000 7fd61f72a640 1 -- 172.21.15.117:0/4109818684 shutdown_connections 2024-09-19T08:39:09.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.783+0000 7fd61f72a640 1 -- 172.21.15.117:0/4109818684 wait complete. 2024-09-19T08:39:09.794 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-09-19T08:39:07.873293+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222516,"kb_used_data":6296,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752204,"statfs":{"total":773094113280,"available":772866256896,"internally_reserved":0,"allocated":6447104,"data_stored":3500802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-49,"num_write_kb":-15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001576"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":229,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T08:39:04.191252+0000","last_change":"2024-09-19T08:37:04.479071+0000","last_active":"2024-09-19T08:39:04.191252+0000","last_peered":"2024-09-19T08:39:04.191252+0000","last_clean":"2024-09-19T08:39:04.191252+0000","last_became_active":"2024-09-19T08:37:04.478199+0000","last_became_peered":"2024-09-19T08:37:04.478199+0000","last_unstale":"2024-09-19T08:39:04.191252+0000","last_undegraded":"2024-09-19T08:39:04.191252+0000","last_fullsized":"2024-09-19T08:39:04.191252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_clean_scrub_stamp":"2024-09-19T08:37:02.519738+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:32.963748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":287502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28264,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343576,"statfs":{"total":96636764160,"available":96607821824,"internally_reserved":0,"allocated":1265664,"data_stored":889017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509469,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":675840,"data_stored":298651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509468,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":293344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509469,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":286954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509470,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1245184,"data_stored":877358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509468,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":287502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":643072,"data_stored":280474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:39:09.794 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T08:39:09.795 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:39:09.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.893+0000 7fbc9a61e640 1 Processor -- start 2024-09-19T08:39:09.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.893+0000 7fbc9a61e640 1 -- start start 2024-09-19T08:39:09.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.893+0000 7fbc9a61e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbc940add30 0x7fbc940ae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:09.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.893+0000 7fbc9a61e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbc9415e4f0 0x7fbc940b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:09.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.893+0000 7fbc9a61e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc940ae650 con 0x7fbc94070930 2024-09-19T08:39:09.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.893+0000 7fbc9a61e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fbc940b5590 con 0x7fbc940add30 2024-09-19T08:39:09.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.893+0000 7fbc9a61e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fbc94070ea0 con 0x7fbc9415e4f0 2024-09-19T08:39:09.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.894+0000 7fbc93fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbc940add30 0x7fbc940ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:09.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.894+0000 7fbc93fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbc940add30 0x7fbc940ae110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45486/0 (socket says 172.21.15.117:45486) 2024-09-19T08:39:09.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.894+0000 7fbc93fff640 1 -- 172.21.15.117:0/3244465052 learned_addr learned my addr 172.21.15.117:0/3244465052 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:09.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.894+0000 7fbc937fe640 1 --2- 172.21.15.117:0/3244465052 >> v2:172.21.15.146:3300/0 conn(0x7fbc9415e4f0 0x7fbc940b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:09.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.894+0000 7fbc93fff640 1 -- 172.21.15.117:0/3244465052 >> v2:172.21.15.146:3300/0 conn(0x7fbc9415e4f0 msgr2=0x7fbc940b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:09.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.894+0000 7fbc93fff640 1 --2- 172.21.15.117:0/3244465052 >> v2:172.21.15.146:3300/0 conn(0x7fbc9415e4f0 0x7fbc940b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.894+0000 7fbc93fff640 1 -- 172.21.15.117:0/3244465052 >> v1:172.21.15.117:6789/0 conn(0x7fbc94070930 legacy=0x7fbc940b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:09.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.894+0000 7fbc93fff640 1 -- 172.21.15.117:0/3244465052 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc9406e8c0 con 0x7fbc940add30 2024-09-19T08:39:09.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.894+0000 7fbc92ffd640 1 -- 172.21.15.117:0/3244465052 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 71782116 0 0) 0x7fbc940ae650 con 0x7fbc94070930 2024-09-19T08:39:09.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.895+0000 7fbc93fff640 1 --2- 172.21.15.117:0/3244465052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc940add30 0x7fbc940ae110 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fbc940b4ae0 tx=0x7fbc8402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae92e477a164403 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:09.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.895+0000 7fbc92ffd640 1 -- 172.21.15.117:0/3244465052 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84037070 con 0x7fbc940add30 2024-09-19T08:39:09.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.895+0000 7fbc92ffd640 1 -- 172.21.15.117:0/3244465052 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc84032440 con 0x7fbc940add30 2024-09-19T08:39:09.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.895+0000 7fbc92ffd640 1 -- 172.21.15.117:0/3244465052 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84032810 con 0x7fbc940add30 2024-09-19T08:39:09.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.895+0000 7fbc9a61e640 1 -- 172.21.15.117:0/3244465052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc940add30 msgr2=0x7fbc940ae110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:09.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.895+0000 7fbc9a61e640 1 --2- 172.21.15.117:0/3244465052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc940add30 0x7fbc940ae110 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fbc940b4ae0 tx=0x7fbc8402a1e0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.895+0000 7fbc9a61e640 1 -- 172.21.15.117:0/3244465052 shutdown_connections 2024-09-19T08:39:09.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.895+0000 7fbc9a61e640 1 --2- 172.21.15.117:0/3244465052 >> v2:172.21.15.146:3300/0 conn(0x7fbc9415e4f0 0x7fbc940b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.895+0000 7fbc9a61e640 1 --2- 172.21.15.117:0/3244465052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc940add30 0x7fbc940ae110 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.895+0000 7fbc9a61e640 1 -- 172.21.15.117:0/3244465052 >> 172.21.15.117:0/3244465052 conn(0x7fbc9406bc10 msgr2=0x7fbc9406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:09.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.895+0000 7fbc9a61e640 1 -- 172.21.15.117:0/3244465052 shutdown_connections 2024-09-19T08:39:09.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.895+0000 7fbc9a61e640 1 -- 172.21.15.117:0/3244465052 wait complete. 2024-09-19T08:39:09.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.896+0000 7fbc9a61e640 1 Processor -- start 2024-09-19T08:39:09.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.897+0000 7fbc9a61e640 1 -- start start 2024-09-19T08:39:09.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.897+0000 7fbc9a61e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc94070930 0x7fbc9414e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:09.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.897+0000 7fbc9a61e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc940add30 0x7fbc940cef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:09.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.897+0000 7fbc9a61e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc9415e4f0 0x7fbc940cf450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:09.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.897+0000 7fbc9a61e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9406f3a0 con 0x7fbc94070930 2024-09-19T08:39:09.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.897+0000 7fbc9a61e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9406ee80 con 0x7fbc9415e4f0 2024-09-19T08:39:09.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.897+0000 7fbc9a61e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fbc9406f520 con 0x7fbc940add30 2024-09-19T08:39:09.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.897+0000 7fbc93fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc94070930 0x7fbc9414e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:09.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.897+0000 7fbc93fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc94070930 0x7fbc9414e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45496/0 (socket says 172.21.15.117:45496) 2024-09-19T08:39:09.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.897+0000 7fbc93fff640 1 -- 172.21.15.117:0/930619132 learned_addr learned my addr 172.21.15.117:0/930619132 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:09.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.898+0000 7fbc98bbb640 1 --2- 172.21.15.117:0/930619132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc9415e4f0 0x7fbc940cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:09.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.898+0000 7fbc937fe640 1 --2- 172.21.15.117:0/930619132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc940add30 0x7fbc940cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:09.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.898+0000 7fbc93fff640 1 -- 172.21.15.117:0/930619132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc940add30 msgr2=0x7fbc940cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:09.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.898+0000 7fbc93fff640 1 --2- 172.21.15.117:0/930619132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc940add30 0x7fbc940cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.898+0000 7fbc93fff640 1 -- 172.21.15.117:0/930619132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc9415e4f0 msgr2=0x7fbc940cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:09.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.898+0000 7fbc93fff640 1 --2- 172.21.15.117:0/930619132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc9415e4f0 0x7fbc940cf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:09.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.898+0000 7fbc93fff640 1 -- 172.21.15.117:0/930619132 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc9414e630 con 0x7fbc94070930 2024-09-19T08:39:09.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.898+0000 7fbc937fe640 1 --2- 172.21.15.117:0/930619132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc940add30 0x7fbc940cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:39:09.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.898+0000 7fbc93fff640 1 --2- 172.21.15.117:0/930619132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc94070930 0x7fbc9414e0f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbc84000c00 tx=0x7fbc840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:09.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.898+0000 7fbc90ff9640 1 -- 172.21.15.117:0/930619132 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84037040 con 0x7fbc94070930 2024-09-19T08:39:09.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.898+0000 7fbc90ff9640 1 -- 172.21.15.117:0/930619132 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc84004230 con 0x7fbc94070930 2024-09-19T08:39:09.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.898+0000 7fbc9a61e640 1 -- 172.21.15.117:0/930619132 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc9414f6e0 con 0x7fbc94070930 2024-09-19T08:39:09.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.898+0000 7fbc90ff9640 1 -- 172.21.15.117:0/930619132 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84003610 con 0x7fbc94070930 2024-09-19T08:39:09.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.898+0000 7fbc9a61e640 1 -- 172.21.15.117:0/930619132 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc941e92b0 con 0x7fbc94070930 2024-09-19T08:39:09.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.899+0000 7fbc9a61e640 1 -- 172.21.15.117:0/930619132 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc94161770 con 0x7fbc94070930 2024-09-19T08:39:09.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.899+0000 7fbc90ff9640 1 -- 172.21.15.117:0/930619132 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbc840037b0 con 0x7fbc94070930 2024-09-19T08:39:09.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.900+0000 7fbc90ff9640 1 --2- 172.21.15.117:0/930619132 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbc7406c2b0 0x7fbc7406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:09.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.900+0000 7fbc90ff9640 1 -- 172.21.15.117:0/930619132 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fbc840ac0d0 con 0x7fbc94070930 2024-09-19T08:39:09.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.900+0000 7fbc937fe640 1 --2- 172.21.15.117:0/930619132 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbc7406c2b0 0x7fbc7406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:09.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.901+0000 7fbc937fe640 1 --2- 172.21.15.117:0/930619132 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbc7406c2b0 0x7fbc7406e770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c006fd0 tx=0x7fbc7c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:09.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:09.904+0000 7fbc90ff9640 1 -- 172.21.15.117:0/930619132 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbc94161770 con 0x7fbc94070930 2024-09-19T08:39:10.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.066+0000 7fbc9a61e640 1 -- 172.21.15.117:0/930619132 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbc940b5050 con 0x7fbc7406c2b0 2024-09-19T08:39:10.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.067+0000 7fbc90ff9640 1 -- 172.21.15.117:0/930619132 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13416 (secure 0 0 0) 0x7fbc940b5050 con 0x7fbc7406c2b0 2024-09-19T08:39:10.067 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:39:10.068 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-09-19T08:39:10.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.069+0000 7fbc9a61e640 1 -- 172.21.15.117:0/930619132 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbc7406c2b0 msgr2=0x7fbc7406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:10.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.069+0000 7fbc9a61e640 1 --2- 172.21.15.117:0/930619132 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbc7406c2b0 0x7fbc7406e770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c006fd0 tx=0x7fbc7c008040 comp rx=0 tx=0).stop 2024-09-19T08:39:10.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.069+0000 7fbc9a61e640 1 -- 172.21.15.117:0/930619132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc94070930 msgr2=0x7fbc9414e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:10.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.069+0000 7fbc9a61e640 1 --2- 172.21.15.117:0/930619132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc94070930 0x7fbc9414e0f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbc84000c00 tx=0x7fbc840046c0 comp rx=0 tx=0).stop 2024-09-19T08:39:10.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.069+0000 7fbc9a61e640 1 -- 172.21.15.117:0/930619132 shutdown_connections 2024-09-19T08:39:10.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.069+0000 7fbc9a61e640 1 --2- 172.21.15.117:0/930619132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc9415e4f0 0x7fbc940cf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:10.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.069+0000 7fbc9a61e640 1 --2- 172.21.15.117:0/930619132 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fbc7406c2b0 0x7fbc7406e770 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:10.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.069+0000 7fbc9a61e640 1 --2- 172.21.15.117:0/930619132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc940add30 0x7fbc940cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:10.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.069+0000 7fbc9a61e640 1 --2- 172.21.15.117:0/930619132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc94070930 0x7fbc9414e0f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:10.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.069+0000 7fbc9a61e640 1 -- 172.21.15.117:0/930619132 >> 172.21.15.117:0/930619132 conn(0x7fbc9406bc10 msgr2=0x7fbc940b0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:10.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.069+0000 7fbc9a61e640 1 -- 172.21.15.117:0/930619132 shutdown_connections 2024-09-19T08:39:10.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.069+0000 7fbc9a61e640 1 -- 172.21.15.117:0/930619132 wait complete. 2024-09-19T08:39:10.080 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2024-09-19T08:39:09.873557+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222516,"kb_used_data":6296,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752204,"statfs":{"total":773094113280,"available":772866256896,"internally_reserved":0,"allocated":6447104,"data_stored":3500802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12437,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-68,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001507"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":229,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-19T08:39:04.191252+0000","last_change":"2024-09-19T08:37:04.479071+0000","last_active":"2024-09-19T08:39:04.191252+0000","last_peered":"2024-09-19T08:39:04.191252+0000","last_clean":"2024-09-19T08:39:04.191252+0000","last_became_active":"2024-09-19T08:37:04.478199+0000","last_became_peered":"2024-09-19T08:37:04.478199+0000","last_unstale":"2024-09-19T08:39:04.191252+0000","last_undegraded":"2024-09-19T08:39:04.191252+0000","last_fullsized":"2024-09-19T08:39:04.191252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_clean_scrub_stamp":"2024-09-19T08:37:02.519738+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:32.963748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":287502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28264,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343576,"statfs":{"total":96636764160,"available":96607821824,"internally_reserved":0,"allocated":1265664,"data_stored":889017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509469,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":675840,"data_stored":298651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509468,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":293344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509469,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":286954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509470,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1245184,"data_stored":877358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509468,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":287502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":643072,"data_stored":280474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:39:10.081 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:39:10.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.180+0000 7f58dd437640 1 Processor -- start 2024-09-19T08:39:10.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.180+0000 7f58dd437640 1 -- start start 2024-09-19T08:39:10.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.180+0000 7f58dd437640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f58d80d0070 0x7f58d815f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:10.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.180+0000 7f58dd437640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58d80d4130 0x7f58d80d45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:10.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.180+0000 7f58dd437640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d80d4ae0 con 0x7f58d815f0d0 2024-09-19T08:39:10.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.180+0000 7f58dd437640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f58d80d1b10 con 0x7f58d80d0070 2024-09-19T08:39:10.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.180+0000 7f58dd437640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f58d80cf2b0 con 0x7f58d80d4130 2024-09-19T08:39:10.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d6ffd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f58d815f0d0 0x7f58d80d1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50130/0 (socket says 172.21.15.117:50130) 2024-09-19T08:39:10.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d6ffd640 1 -- 172.21.15.117:0/1899672570 learned_addr learned my addr 172.21.15.117:0/1899672570 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:10.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d67fc640 1 --2- 172.21.15.117:0/1899672570 >> v2:172.21.15.146:3300/0 conn(0x7f58d80d0070 0x7f58d815f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:10.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d77fe640 1 --2- 172.21.15.117:0/1899672570 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58d80d4130 0x7f58d80d45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:10.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d5ffb640 1 -- 172.21.15.117:0/1899672570 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 358900686 0 0) 0x7f58d80d4ae0 con 0x7f58d815f0d0 2024-09-19T08:39:10.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d5ffb640 1 -- 172.21.15.117:0/1899672570 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58c0003520 con 0x7f58d815f0d0 2024-09-19T08:39:10.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d5ffb640 1 -- 172.21.15.117:0/1899672570 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3755937329 0 0) 0x7f58c0003520 con 0x7f58d815f0d0 2024-09-19T08:39:10.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d5ffb640 1 -- 172.21.15.117:0/1899672570 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58d80d4130 msgr2=0x7f58d80d45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:10.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d5ffb640 1 --2- 172.21.15.117:0/1899672570 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58d80d4130 0x7f58d80d45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:10.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d5ffb640 1 -- 172.21.15.117:0/1899672570 >> v2:172.21.15.146:3300/0 conn(0x7f58d80d0070 msgr2=0x7f58d815f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:10.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d5ffb640 1 --2- 172.21.15.117:0/1899672570 >> v2:172.21.15.146:3300/0 conn(0x7f58d80d0070 0x7f58d815f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:10.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d5ffb640 1 -- 172.21.15.117:0/1899672570 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d80cf590 con 0x7f58d815f0d0 2024-09-19T08:39:10.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d5ffb640 1 -- 172.21.15.117:0/1899672570 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f58c8001670 con 0x7f58d815f0d0 2024-09-19T08:39:10.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d5ffb640 1 -- 172.21.15.117:0/1899672570 >> v1:172.21.15.117:6789/0 conn(0x7f58d815f0d0 legacy=0x7f58d80d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:10.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d5ffb640 1 --2- 172.21.15.117:0/1899672570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58c00039b0 0x7f58c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:10.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d5ffb640 1 --2- 172.21.15.117:0/1899672570 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58d80d4130 0x7f58c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:10.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d5ffb640 1 --2- 172.21.15.117:0/1899672570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58c0004d40 0x7f58c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:10.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d5ffb640 1 -- 172.21.15.117:0/1899672570 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f58d80d1b10 con 0x7f58c00039b0 2024-09-19T08:39:10.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d5ffb640 1 -- 172.21.15.117:0/1899672570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f58d80cf2b0 con 0x7f58c0004d40 2024-09-19T08:39:10.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d5ffb640 1 -- 172.21.15.117:0/1899672570 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f58c000b9c0 con 0x7f58d80d4130 2024-09-19T08:39:10.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d6ffd640 1 --2- 172.21.15.117:0/1899672570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58c00039b0 0x7f58c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:10.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d67fc640 1 --2- 172.21.15.117:0/1899672570 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58d80d4130 0x7f58c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:10.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.181+0000 7f58d77fe640 1 --2- 172.21.15.117:0/1899672570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58c0004d40 0x7f58c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:10.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.182+0000 7f58d6ffd640 1 -- 172.21.15.117:0/1899672570 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58d80d4130 msgr2=0x7f58c0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:10.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.182+0000 7f58d6ffd640 1 --2- 172.21.15.117:0/1899672570 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58d80d4130 0x7f58c0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:10.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.182+0000 7f58d6ffd640 1 -- 172.21.15.117:0/1899672570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58c0004d40 msgr2=0x7f58c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:10.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.182+0000 7f58d6ffd640 1 --2- 172.21.15.117:0/1899672570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58c0004d40 0x7f58c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:10.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.182+0000 7f58d6ffd640 1 -- 172.21.15.117:0/1899672570 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c0003520 con 0x7f58c00039b0 2024-09-19T08:39:10.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.182+0000 7f58d77fe640 1 --2- 172.21.15.117:0/1899672570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58c0004d40 0x7f58c00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:10.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.182+0000 7f58d6ffd640 1 --2- 172.21.15.117:0/1899672570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58c00039b0 0x7f58c0003dd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f58c8001050 tx=0x7f58c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a01b64844f0e9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:10.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.182+0000 7f58d5ffb640 1 -- 172.21.15.117:0/1899672570 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c802e070 con 0x7f58c00039b0 2024-09-19T08:39:10.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.182+0000 7f58d5ffb640 1 -- 172.21.15.117:0/1899672570 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c8005af0 con 0x7f58c00039b0 2024-09-19T08:39:10.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.182+0000 7f58d5ffb640 1 -- 172.21.15.117:0/1899672570 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8007d70 con 0x7f58c00039b0 2024-09-19T08:39:10.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.183+0000 7f58dd437640 1 -- 172.21.15.117:0/1899672570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58c00039b0 msgr2=0x7f58c0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:10.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.183+0000 7f58dd437640 1 --2- 172.21.15.117:0/1899672570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58c00039b0 0x7f58c0003dd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f58c8001050 tx=0x7f58c0005830 comp rx=0 tx=0).stop 2024-09-19T08:39:10.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.183+0000 7f58d77fe640 1 -- 172.21.15.117:0/1899672570 reap_dead start 2024-09-19T08:39:10.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.183+0000 7f58dd437640 1 -- 172.21.15.117:0/1899672570 shutdown_connections 2024-09-19T08:39:10.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.183+0000 7f58dd437640 1 -- 172.21.15.117:0/1899672570 >> 172.21.15.117:0/1899672570 conn(0x7f58d809d760 msgr2=0x7f58d808bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:10.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.183+0000 7f58dd437640 1 -- 172.21.15.117:0/1899672570 shutdown_connections 2024-09-19T08:39:10.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.183+0000 7f58dd437640 1 -- 172.21.15.117:0/1899672570 wait complete. 2024-09-19T08:39:10.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.184+0000 7f58dd437640 1 Processor -- start 2024-09-19T08:39:10.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.184+0000 7f58dd437640 1 -- start start 2024-09-19T08:39:10.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.185+0000 7f58dd437640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58c00039b0 0x7f58d80ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:10.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.185+0000 7f58dd437640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58d80cb4b0 0x7f58d80b9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:10.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.185+0000 7f58dd437640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58d80b52c0 0x7f58d8160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:10.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.185+0000 7f58dd437640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f58d80cef60 con 0x7f58d80cb4b0 2024-09-19T08:39:10.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.185+0000 7f58dd437640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f58d80cfb50 con 0x7f58c00039b0 2024-09-19T08:39:10.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.185+0000 7f58dd437640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f58d80d45a0 con 0x7f58d80b52c0 2024-09-19T08:39:10.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.185+0000 7f58d67fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58d80cb4b0 0x7f58d80b9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:10.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.185+0000 7f58d67fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58d80cb4b0 0x7f58d80b9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45522/0 (socket says 172.21.15.117:45522) 2024-09-19T08:39:10.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.185+0000 7f58d67fc640 1 -- 172.21.15.117:0/2261516858 learned_addr learned my addr 172.21.15.117:0/2261516858 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:10.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.185+0000 7f58d77fe640 1 --2- 172.21.15.117:0/2261516858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58d80b52c0 0x7f58d8160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:10.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.185+0000 7f58d6ffd640 1 --2- 172.21.15.117:0/2261516858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58c00039b0 0x7f58d80ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:10.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.185+0000 7f58d67fc640 1 -- 172.21.15.117:0/2261516858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58d80b52c0 msgr2=0x7f58d8160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:10.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.185+0000 7f58d67fc640 1 --2- 172.21.15.117:0/2261516858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58d80b52c0 0x7f58d8160970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:10.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.185+0000 7f58d67fc640 1 -- 172.21.15.117:0/2261516858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58c00039b0 msgr2=0x7f58d80ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:10.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.185+0000 7f58d67fc640 1 --2- 172.21.15.117:0/2261516858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58c00039b0 0x7f58d80ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:10.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.185+0000 7f58d67fc640 1 -- 172.21.15.117:0/2261516858 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d80cbb90 con 0x7f58d80cb4b0 2024-09-19T08:39:10.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.185+0000 7f58d6ffd640 1 --2- 172.21.15.117:0/2261516858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58c00039b0 0x7f58d80ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:10.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.186+0000 7f58d67fc640 1 --2- 172.21.15.117:0/2261516858 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58d80cb4b0 0x7f58d80b9db0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f58cc011ad0 tx=0x7f58cc011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:10.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.186+0000 7f58bf7fe640 1 -- 172.21.15.117:0/2261516858 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc00fb50 con 0x7f58d80cb4b0 2024-09-19T08:39:10.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.186+0000 7f58bf7fe640 1 -- 172.21.15.117:0/2261516858 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58cc00fcf0 con 0x7f58d80cb4b0 2024-09-19T08:39:10.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.186+0000 7f58dd437640 1 -- 172.21.15.117:0/2261516858 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d80cbe70 con 0x7f58d80cb4b0 2024-09-19T08:39:10.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.186+0000 7f58bf7fe640 1 -- 172.21.15.117:0/2261516858 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc00fea0 con 0x7f58d80cb4b0 2024-09-19T08:39:10.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.186+0000 7f58dd437640 1 -- 172.21.15.117:0/2261516858 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d80cc430 con 0x7f58d80cb4b0 2024-09-19T08:39:10.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.187+0000 7f58dd437640 1 -- 172.21.15.117:0/2261516858 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58d80d4960 con 0x7f58d80cb4b0 2024-09-19T08:39:10.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.187+0000 7f58bf7fe640 1 -- 172.21.15.117:0/2261516858 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f58cc012040 con 0x7f58d80cb4b0 2024-09-19T08:39:10.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.188+0000 7f58bf7fe640 1 --2- 172.21.15.117:0/2261516858 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f58c406c2b0 0x7f58c406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:10.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.188+0000 7f58bf7fe640 1 -- 172.21.15.117:0/2261516858 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f58cc08b910 con 0x7f58d80cb4b0 2024-09-19T08:39:10.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.188+0000 7f58d6ffd640 1 --2- 172.21.15.117:0/2261516858 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f58c406c2b0 0x7f58c406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:10.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.188+0000 7f58d6ffd640 1 --2- 172.21.15.117:0/2261516858 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f58c406c2b0 0x7f58c406e770 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f58c8033000 tx=0x7f58c8009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:10.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.192+0000 7f58bf7fe640 1 -- 172.21.15.117:0/2261516858 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f58cc019030 con 0x7f58d80cb4b0 2024-09-19T08:39:10.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.358+0000 7f58dd437640 1 -- 172.21.15.117:0/2261516858 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58d806cf30 con 0x7f58d80cb4b0 2024-09-19T08:39:10.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.358+0000 7f58bf7fe640 1 -- 172.21.15.117:0/2261516858 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+13355 (secure 0 0 0) 0x7f58cc05a1f0 con 0x7f58d80cb4b0 2024-09-19T08:39:10.359 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:39:10.359 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":57,"fsid":"3be30853-f236-48ec-b905-15ecac86fc3f","created":"2024-09-19T08:36:49.620278+0000","modified":"2024-09-19T08:39:07.201043+0000","last_up_change":"2024-09-19T08:37:01.517692+0000","last_in_change":"2024-09-19T08:36:51.728223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:37:01.875773+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dab3472e-2259-47fd-912f-24c427b3c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6809","nonce":1962525121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6811","nonce":1962525121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6815","nonce":1962525121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1962525121},{"type":"v1","addr":"172.21.15.117:6813","nonce":1962525121}]},"public_addr":"172.21.15.117:6809/1962525121","cluster_addr":"172.21.15.117:6811/1962525121","heartbeat_back_addr":"172.21.15.117:6815/1962525121","heartbeat_front_addr":"172.21.15.117:6813/1962525121","state":["exists","up"]},{"osd":1,"uuid":"1c52ad63-39de-4ce6-a85e-75a815269b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6825","nonce":782460519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6827","nonce":782460519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6831","nonce":782460519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":782460519},{"type":"v1","addr":"172.21.15.117:6829","nonce":782460519}]},"public_addr":"172.21.15.117:6825/782460519","cluster_addr":"172.21.15.117:6827/782460519","heartbeat_back_addr":"172.21.15.117:6831/782460519","heartbeat_front_addr":"172.21.15.117:6829/782460519","state":["exists","up"]},{"osd":2,"uuid":"80197f7c-2aab-482a-998f-3cd9a87c0349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6801","nonce":2056750572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6803","nonce":2056750572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6807","nonce":2056750572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2056750572},{"type":"v1","addr":"172.21.15.117:6805","nonce":2056750572}]},"public_addr":"172.21.15.117:6801/2056750572","cluster_addr":"172.21.15.117:6803/2056750572","heartbeat_back_addr":"172.21.15.117:6807/2056750572","heartbeat_front_addr":"172.21.15.117:6805/2056750572","state":["exists","up"]},{"osd":3,"uuid":"a26f33dd-5d70-4c6e-b951-1a08a2e13054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6817","nonce":1107529373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6819","nonce":1107529373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6823","nonce":1107529373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1107529373},{"type":"v1","addr":"172.21.15.117:6821","nonce":1107529373}]},"public_addr":"172.21.15.117:6817/1107529373","cluster_addr":"172.21.15.117:6819/1107529373","heartbeat_back_addr":"172.21.15.117:6823/1107529373","heartbeat_front_addr":"172.21.15.117:6821/1107529373","state":["exists","up"]},{"osd":4,"uuid":"5f2b0d06-4755-400d-a907-969bb3db18a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6817","nonce":128066450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6819","nonce":128066450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6823","nonce":128066450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":128066450},{"type":"v1","addr":"172.21.15.146:6821","nonce":128066450}]},"public_addr":"172.21.15.146:6817/128066450","cluster_addr":"172.21.15.146:6819/128066450","heartbeat_back_addr":"172.21.15.146:6823/128066450","heartbeat_front_addr":"172.21.15.146:6821/128066450","state":["exists","up"]},{"osd":5,"uuid":"df72b48a-47c7-4ca5-9e37-a596302a6c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6825","nonce":1051984651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6827","nonce":1051984651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6831","nonce":1051984651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":1051984651},{"type":"v1","addr":"172.21.15.146:6829","nonce":1051984651}]},"public_addr":"172.21.15.146:6825/1051984651","cluster_addr":"172.21.15.146:6827/1051984651","heartbeat_back_addr":"172.21.15.146:6831/1051984651","heartbeat_front_addr":"172.21.15.146:6829/1051984651","state":["exists","up"]},{"osd":6,"uuid":"e3c825e6-660d-4a1b-8833-78dda4219eaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6809","nonce":2379859639}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6811","nonce":2379859639}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6815","nonce":2379859639}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2379859639},{"type":"v1","addr":"172.21.15.146:6813","nonce":2379859639}]},"public_addr":"172.21.15.146:6809/2379859639","cluster_addr":"172.21.15.146:6811/2379859639","heartbeat_back_addr":"172.21.15.146:6815/2379859639","heartbeat_front_addr":"172.21.15.146:6813/2379859639","state":["exists","up"]},{"osd":7,"uuid":"d68921b4-1f6f-4941-a565-ba078c12d25e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6801","nonce":3875302444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6803","nonce":3875302444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6807","nonce":3875302444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":3875302444},{"type":"v1","addr":"172.21.15.146:6805","nonce":3875302444}]},"public_addr":"172.21.15.146:6801/3875302444","cluster_addr":"172.21.15.146:6803/3875302444","heartbeat_back_addr":"172.21.15.146:6807/3875302444","heartbeat_front_addr":"172.21.15.146:6805/3875302444","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.966551+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.479759+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.059120+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.545100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.984822+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.525479+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:58.197803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:36:57.559175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6837/4230307932":"2024-09-20T08:39:04.187807+0000","172.21.15.146:6835/4230307932":"2024-09-20T08:39:04.187807+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:39:10.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.360+0000 7f58dd437640 1 -- 172.21.15.117:0/2261516858 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f58c406c2b0 msgr2=0x7f58c406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:10.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.360+0000 7f58dd437640 1 --2- 172.21.15.117:0/2261516858 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f58c406c2b0 0x7f58c406e770 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f58c8033000 tx=0x7f58c8009030 comp rx=0 tx=0).stop 2024-09-19T08:39:10.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.360+0000 7f58dd437640 1 -- 172.21.15.117:0/2261516858 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58d80cb4b0 msgr2=0x7f58d80b9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:10.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.360+0000 7f58dd437640 1 --2- 172.21.15.117:0/2261516858 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58d80cb4b0 0x7f58d80b9db0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f58cc011ad0 tx=0x7f58cc011f90 comp rx=0 tx=0).stop 2024-09-19T08:39:10.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.360+0000 7f58dd437640 1 -- 172.21.15.117:0/2261516858 shutdown_connections 2024-09-19T08:39:10.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.360+0000 7f58dd437640 1 --2- 172.21.15.117:0/2261516858 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f58c406c2b0 0x7f58c406e770 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:10.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.360+0000 7f58dd437640 1 --2- 172.21.15.117:0/2261516858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58d80b52c0 0x7f58d8160970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:10.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.361+0000 7f58dd437640 1 --2- 172.21.15.117:0/2261516858 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58d80cb4b0 0x7f58d80b9db0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:10.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.361+0000 7f58dd437640 1 --2- 172.21.15.117:0/2261516858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58c00039b0 0x7f58d80ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:10.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.361+0000 7f58dd437640 1 -- 172.21.15.117:0/2261516858 >> 172.21.15.117:0/2261516858 conn(0x7f58d809d760 msgr2=0x7f58d815c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:10.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.361+0000 7f58dd437640 1 -- 172.21.15.117:0/2261516858 shutdown_connections 2024-09-19T08:39:10.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:10.361+0000 7f58dd437640 1 -- 172.21.15.117:0/2261516858 wait complete. 2024-09-19T08:39:11.373 INFO:tasks.ceph:Scrubbing osd.0 2024-09-19T08:39:11.373 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-19T08:39:11.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.489+0000 7f366161e640 1 Processor -- start 2024-09-19T08:39:11.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.489+0000 7f366161e640 1 -- start start 2024-09-19T08:39:11.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.489+0000 7f366161e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f365c15f0d0 0x7f365c15f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:11.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.489+0000 7f366161e640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f365c0d4130 0x7f365c0d4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:11.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.489+0000 7f366161e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f365c0d1b10 con 0x7f365c0d0070 2024-09-19T08:39:11.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.489+0000 7f366161e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f365c0cf2b0 con 0x7f365c15f0d0 2024-09-19T08:39:11.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.489+0000 7f366161e640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f365c0cf590 con 0x7f365c0d4130 2024-09-19T08:39:11.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.490+0000 7f365affd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f365c15f0d0 0x7f365c15f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:11.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.490+0000 7f365a7fc640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f365c0d0070 0x7f365c0d1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50144/0 (socket says 172.21.15.117:50144) 2024-09-19T08:39:11.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.490+0000 7f365a7fc640 1 -- 172.21.15.117:0/2148866876 learned_addr learned my addr 172.21.15.117:0/2148866876 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:11.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.490+0000 7f365affd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f365c15f0d0 0x7f365c15f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45526/0 (socket says 172.21.15.117:45526) 2024-09-19T08:39:11.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.490+0000 7f365b7fe640 1 --2- 172.21.15.117:0/2148866876 >> v2:172.21.15.146:3300/0 conn(0x7f365c0d4130 0x7f365c0d4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:11.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.490+0000 7f365affd640 1 -- 172.21.15.117:0/2148866876 >> v2:172.21.15.146:3300/0 conn(0x7f365c0d4130 msgr2=0x7f365c0d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:11.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.490+0000 7f365affd640 1 --2- 172.21.15.117:0/2148866876 >> v2:172.21.15.146:3300/0 conn(0x7f365c0d4130 0x7f365c0d4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.490+0000 7f365affd640 1 -- 172.21.15.117:0/2148866876 >> v1:172.21.15.117:6789/0 conn(0x7f365c0d0070 legacy=0x7f365c0d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:11.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.490+0000 7f365affd640 1 -- 172.21.15.117:0/2148866876 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365c0cf870 con 0x7f365c15f0d0 2024-09-19T08:39:11.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.491+0000 7f365affd640 1 --2- 172.21.15.117:0/2148866876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f365c15f0d0 0x7f365c15f4b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f365c0d04e0 tx=0x7f364c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2059592314bc0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:11.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.491+0000 7f3659ffb640 1 -- 172.21.15.117:0/2148866876 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c007740 con 0x7f365c15f0d0 2024-09-19T08:39:11.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.491+0000 7f3659ffb640 1 -- 172.21.15.117:0/2148866876 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364c0078e0 con 0x7f365c15f0d0 2024-09-19T08:39:11.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.491+0000 7f3659ffb640 1 -- 172.21.15.117:0/2148866876 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c007cb0 con 0x7f365c15f0d0 2024-09-19T08:39:11.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.491+0000 7f366161e640 1 -- 172.21.15.117:0/2148866876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f365c15f0d0 msgr2=0x7f365c15f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:11.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.491+0000 7f366161e640 1 --2- 172.21.15.117:0/2148866876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f365c15f0d0 0x7f365c15f4b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f365c0d04e0 tx=0x7f364c02a5f0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.491+0000 7f366161e640 1 -- 172.21.15.117:0/2148866876 shutdown_connections 2024-09-19T08:39:11.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.491+0000 7f366161e640 1 --2- 172.21.15.117:0/2148866876 >> v2:172.21.15.146:3300/0 conn(0x7f365c0d4130 0x7f365c0d4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.491+0000 7f366161e640 1 --2- 172.21.15.117:0/2148866876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f365c15f0d0 0x7f365c15f4b0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.491+0000 7f366161e640 1 -- 172.21.15.117:0/2148866876 >> 172.21.15.117:0/2148866876 conn(0x7f365c09d760 msgr2=0x7f365c08bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:11.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.492+0000 7f366161e640 1 -- 172.21.15.117:0/2148866876 shutdown_connections 2024-09-19T08:39:11.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.492+0000 7f366161e640 1 -- 172.21.15.117:0/2148866876 wait complete. 2024-09-19T08:39:11.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.493+0000 7f366161e640 1 Processor -- start 2024-09-19T08:39:11.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.493+0000 7f366161e640 1 -- start start 2024-09-19T08:39:11.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f366161e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f365c0d0070 0x7f365c14d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:11.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f366161e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f365c0d4130 0x7f365c162380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:11.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f366161e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f365c15f0d0 0x7f365c1628c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:11.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f366161e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f365c0cef60 con 0x7f365c0d0070 2024-09-19T08:39:11.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f366161e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f365c0d4aa0 con 0x7f365c15f0d0 2024-09-19T08:39:11.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f366161e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f365c0b2f70 con 0x7f365c0d4130 2024-09-19T08:39:11.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f365affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f365c0d0070 0x7f365c14d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:11.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f365affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f365c0d0070 0x7f365c14d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45530/0 (socket says 172.21.15.117:45530) 2024-09-19T08:39:11.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f365affd640 1 -- 172.21.15.117:0/780970516 learned_addr learned my addr 172.21.15.117:0/780970516 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:11.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f365a7fc640 1 --2- 172.21.15.117:0/780970516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f365c0d4130 0x7f365c162380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:11.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f365b7fe640 1 --2- 172.21.15.117:0/780970516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f365c15f0d0 0x7f365c1628c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:11.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f365affd640 1 -- 172.21.15.117:0/780970516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f365c0d4130 msgr2=0x7f365c162380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:11.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f365affd640 1 --2- 172.21.15.117:0/780970516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f365c0d4130 0x7f365c162380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f365affd640 1 -- 172.21.15.117:0/780970516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f365c15f0d0 msgr2=0x7f365c1628c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:11.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f365affd640 1 --2- 172.21.15.117:0/780970516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f365c15f0d0 0x7f365c1628c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f365affd640 1 -- 172.21.15.117:0/780970516 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365c14c800 con 0x7f365c0d0070 2024-09-19T08:39:11.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f365b7fe640 1 --2- 172.21.15.117:0/780970516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f365c15f0d0 0x7f365c1628c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:11.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f365affd640 1 --2- 172.21.15.117:0/780970516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f365c0d0070 0x7f365c14d070 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f364c02abe0 tx=0x7f364c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:11.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f36537fe640 1 -- 172.21.15.117:0/780970516 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c03f070 con 0x7f365c0d0070 2024-09-19T08:39:11.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f36537fe640 1 -- 172.21.15.117:0/780970516 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364c031c40 con 0x7f365c0d0070 2024-09-19T08:39:11.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f366161e640 1 -- 172.21.15.117:0/780970516 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f365c14d940 con 0x7f365c0d0070 2024-09-19T08:39:11.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.494+0000 7f36537fe640 1 -- 172.21.15.117:0/780970516 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c043410 con 0x7f365c0d0070 2024-09-19T08:39:11.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.495+0000 7f366161e640 1 -- 172.21.15.117:0/780970516 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f365c14df00 con 0x7f365c0d0070 2024-09-19T08:39:11.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.495+0000 7f366161e640 1 -- 172.21.15.117:0/780970516 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f365c14e2e0 con 0x7f365c0d0070 2024-09-19T08:39:11.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.496+0000 7f36537fe640 1 -- 172.21.15.117:0/780970516 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f364c0435b0 con 0x7f365c0d0070 2024-09-19T08:39:11.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.496+0000 7f36537fe640 1 --2- 172.21.15.117:0/780970516 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f363c06c2b0 0x7f363c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:11.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.496+0000 7f36537fe640 1 -- 172.21.15.117:0/780970516 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f364c0ac600 con 0x7f365c0d0070 2024-09-19T08:39:11.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.497+0000 7f36537fe640 1 --2- 172.21.15.117:0/780970516 >> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] conn(0x7f363c072750 0x7f363c074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:11.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.497+0000 7f36537fe640 1 -- 172.21.15.117:0/780970516 --> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f364c03de50 con 0x7f363c072750 2024-09-19T08:39:11.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.497+0000 7f36537fe640 1 -- 172.21.15.117:0/780970516 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f364c0b3050 con 0x7f365c0d0070 2024-09-19T08:39:11.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.497+0000 7f365b7fe640 1 --2- 172.21.15.117:0/780970516 >> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] conn(0x7f363c072750 0x7f363c074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:11.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.497+0000 7f365a7fc640 1 --2- 172.21.15.117:0/780970516 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f363c06c2b0 0x7f363c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:11.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.497+0000 7f365b7fe640 1 --2- 172.21.15.117:0/780970516 >> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] conn(0x7f363c072750 0x7f363c074b90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:11.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.497+0000 7f365a7fc640 1 --2- 172.21.15.117:0/780970516 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f363c06c2b0 0x7f363c06e770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f365c14b530 tx=0x7f3644009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:11.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.498+0000 7f36537fe640 1 -- 172.21.15.117:0/780970516 <== osd.0 v2:172.21.15.117:6808/1962525121 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f364c03de50 con 0x7f363c072750 2024-09-19T08:39:11.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.510+0000 7f366161e640 1 -- 172.21.15.117:0/780970516 --> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f365c0d4560 con 0x7f363c072750 2024-09-19T08:39:11.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.510+0000 7f36537fe640 1 -- 172.21.15.117:0/780970516 <== osd.0 v2:172.21.15.117:6808/1962525121 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f365c0d4560 con 0x7f363c072750 2024-09-19T08:39:11.510 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T08:39:11.510 INFO:teuthology.orchestra.run.smithi117.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T08:39:11.511 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T08:39:11.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.510+0000 7f366161e640 1 -- 172.21.15.117:0/780970516 >> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] conn(0x7f363c072750 msgr2=0x7f363c074b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:11.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.510+0000 7f366161e640 1 --2- 172.21.15.117:0/780970516 >> [v2:172.21.15.117:6808/1962525121,v1:172.21.15.117:6809/1962525121] conn(0x7f363c072750 0x7f363c074b90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.511+0000 7f366161e640 1 -- 172.21.15.117:0/780970516 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f363c06c2b0 msgr2=0x7f363c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:11.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.511+0000 7f366161e640 1 --2- 172.21.15.117:0/780970516 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f363c06c2b0 0x7f363c06e770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f365c14b530 tx=0x7f3644009040 comp rx=0 tx=0).stop 2024-09-19T08:39:11.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.511+0000 7f366161e640 1 -- 172.21.15.117:0/780970516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f365c0d0070 msgr2=0x7f365c14d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:11.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.511+0000 7f366161e640 1 --2- 172.21.15.117:0/780970516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f365c0d0070 0x7f365c14d070 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f364c02abe0 tx=0x7f364c004a40 comp rx=0 tx=0).stop 2024-09-19T08:39:11.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.511+0000 7f365b7fe640 1 -- 172.21.15.117:0/780970516 reap_dead start 2024-09-19T08:39:11.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.511+0000 7f366161e640 1 -- 172.21.15.117:0/780970516 shutdown_connections 2024-09-19T08:39:11.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.511+0000 7f366161e640 1 -- 172.21.15.117:0/780970516 >> 172.21.15.117:0/780970516 conn(0x7f365c09d760 msgr2=0x7f365c06deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:11.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.511+0000 7f366161e640 1 -- 172.21.15.117:0/780970516 shutdown_connections 2024-09-19T08:39:11.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.511+0000 7f366161e640 1 -- 172.21.15.117:0/780970516 wait complete. 2024-09-19T08:39:11.522 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-19T08:39:11.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.621+0000 7fcd368ac640 1 Processor -- start 2024-09-19T08:39:11.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.621+0000 7fcd368ac640 1 -- start start 2024-09-19T08:39:11.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.622+0000 7fcd368ac640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcd300c8d20 0x7fcd3006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:11.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.622+0000 7fcd368ac640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcd3006d260 0x7fcd301439f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:11.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.622+0000 7fcd368ac640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd30143f30 0x7fcd300d1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:11.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.622+0000 7fcd368ac640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fcd3006d6d0 con 0x7fcd3006d260 2024-09-19T08:39:11.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.622+0000 7fcd368ac640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7fcd30141960 con 0x7fcd300c8d20 2024-09-19T08:39:11.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.622+0000 7fcd368ac640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fcd30142200 con 0x7fcd30143f30 2024-09-19T08:39:11.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.622+0000 7fcd2f7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcd3006d260 0x7fcd301439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:11.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.622+0000 7fcd2f7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcd3006d260 0x7fcd301439f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45536/0 (socket says 172.21.15.117:45536) 2024-09-19T08:39:11.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.622+0000 7fcd2f7fe640 1 -- 172.21.15.117:0/3729929460 learned_addr learned my addr 172.21.15.117:0/3729929460 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:11.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.622+0000 7fcd2ffff640 1 --2- 172.21.15.117:0/3729929460 >> v2:172.21.15.146:3300/0 conn(0x7fcd300c8d20 0x7fcd3006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:11.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.622+0000 7fcd34e49640 1 --2- 172.21.15.117:0/3729929460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd30143f30 0x7fcd300d1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:11.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.623+0000 7fcd2f7fe640 1 -- 172.21.15.117:0/3729929460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd30143f30 msgr2=0x7fcd300d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:11.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.623+0000 7fcd2f7fe640 1 --2- 172.21.15.117:0/3729929460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd30143f30 0x7fcd300d1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.623+0000 7fcd2f7fe640 1 -- 172.21.15.117:0/3729929460 >> v2:172.21.15.146:3300/0 conn(0x7fcd300c8d20 msgr2=0x7fcd3006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:11.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.623+0000 7fcd2f7fe640 1 --2- 172.21.15.117:0/3729929460 >> v2:172.21.15.146:3300/0 conn(0x7fcd300c8d20 0x7fcd3006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.623+0000 7fcd2f7fe640 1 -- 172.21.15.117:0/3729929460 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd300c7140 con 0x7fcd3006d260 2024-09-19T08:39:11.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.623+0000 7fcd2f7fe640 1 --2- 172.21.15.117:0/3729929460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd3006d260 0x7fcd301439f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fcd300d2e50 tx=0x7fcd2402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e3049936fbf000 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:11.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.624+0000 7fcd2effd640 1 -- 172.21.15.117:0/3729929460 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd24037070 con 0x7fcd3006d260 2024-09-19T08:39:11.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.624+0000 7fcd2effd640 1 -- 172.21.15.117:0/3729929460 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd2402ae00 con 0x7fcd3006d260 2024-09-19T08:39:11.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.624+0000 7fcd2effd640 1 -- 172.21.15.117:0/3729929460 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd24032660 con 0x7fcd3006d260 2024-09-19T08:39:11.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.624+0000 7fcd368ac640 1 -- 172.21.15.117:0/3729929460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd3006d260 msgr2=0x7fcd301439f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:11.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.624+0000 7fcd368ac640 1 --2- 172.21.15.117:0/3729929460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd3006d260 0x7fcd301439f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fcd300d2e50 tx=0x7fcd2402a0b0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.624+0000 7fcd368ac640 1 -- 172.21.15.117:0/3729929460 shutdown_connections 2024-09-19T08:39:11.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.624+0000 7fcd368ac640 1 --2- 172.21.15.117:0/3729929460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd30143f30 0x7fcd300d1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.624+0000 7fcd368ac640 1 --2- 172.21.15.117:0/3729929460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd3006d260 0x7fcd301439f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.624+0000 7fcd368ac640 1 --2- 172.21.15.117:0/3729929460 >> v2:172.21.15.146:3300/0 conn(0x7fcd300c8d20 0x7fcd3006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.624+0000 7fcd368ac640 1 -- 172.21.15.117:0/3729929460 >> 172.21.15.117:0/3729929460 conn(0x7fcd300b3ed0 msgr2=0x7fcd300b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:11.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.624+0000 7fcd368ac640 1 -- 172.21.15.117:0/3729929460 shutdown_connections 2024-09-19T08:39:11.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.624+0000 7fcd368ac640 1 -- 172.21.15.117:0/3729929460 wait complete. 2024-09-19T08:39:11.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.625+0000 7fcd368ac640 1 Processor -- start 2024-09-19T08:39:11.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.626+0000 7fcd368ac640 1 -- start start 2024-09-19T08:39:11.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.626+0000 7fcd368ac640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd3006d260 0x7fcd301f39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:11.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.626+0000 7fcd368ac640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd300c8d20 0x7fcd300ce570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:11.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.626+0000 7fcd368ac640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd30143f30 0x7fcd300ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:11.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.626+0000 7fcd368ac640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcd30141bb0 con 0x7fcd300c8d20 2024-09-19T08:39:11.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.626+0000 7fcd368ac640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcd30144760 con 0x7fcd30143f30 2024-09-19T08:39:11.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.626+0000 7fcd368ac640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fcd30141e90 con 0x7fcd3006d260 2024-09-19T08:39:11.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.626+0000 7fcd2f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd300c8d20 0x7fcd300ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:11.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.626+0000 7fcd2f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd300c8d20 0x7fcd300ce570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45540/0 (socket says 172.21.15.117:45540) 2024-09-19T08:39:11.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.626+0000 7fcd2f7fe640 1 -- 172.21.15.117:0/2359674461 learned_addr learned my addr 172.21.15.117:0/2359674461 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:11.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.627+0000 7fcd34e49640 1 --2- 172.21.15.117:0/2359674461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd30143f30 0x7fcd300ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:11.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.627+0000 7fcd2ffff640 1 --2- 172.21.15.117:0/2359674461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd3006d260 0x7fcd301f39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:11.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.627+0000 7fcd2f7fe640 1 -- 172.21.15.117:0/2359674461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd3006d260 msgr2=0x7fcd301f39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:11.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.627+0000 7fcd2f7fe640 1 --2- 172.21.15.117:0/2359674461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd3006d260 0x7fcd301f39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.627+0000 7fcd2f7fe640 1 -- 172.21.15.117:0/2359674461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd30143f30 msgr2=0x7fcd300ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:11.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.627+0000 7fcd2f7fe640 1 --2- 172.21.15.117:0/2359674461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd30143f30 0x7fcd300ceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.627+0000 7fcd2f7fe640 1 -- 172.21.15.117:0/2359674461 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd301e94b0 con 0x7fcd300c8d20 2024-09-19T08:39:11.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.627+0000 7fcd2f7fe640 1 --2- 172.21.15.117:0/2359674461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd300c8d20 0x7fcd300ce570 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fcd2402a0f0 tx=0x7fcd240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:11.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.627+0000 7fcd2cff9640 1 -- 172.21.15.117:0/2359674461 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd24041070 con 0x7fcd300c8d20 2024-09-19T08:39:11.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.627+0000 7fcd2cff9640 1 -- 172.21.15.117:0/2359674461 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd2403c460 con 0x7fcd300c8d20 2024-09-19T08:39:11.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.627+0000 7fcd368ac640 1 -- 172.21.15.117:0/2359674461 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd301e9790 con 0x7fcd300c8d20 2024-09-19T08:39:11.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.627+0000 7fcd2cff9640 1 -- 172.21.15.117:0/2359674461 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd24037040 con 0x7fcd300c8d20 2024-09-19T08:39:11.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.627+0000 7fcd368ac640 1 -- 172.21.15.117:0/2359674461 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd300b6280 con 0x7fcd300c8d20 2024-09-19T08:39:11.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.628+0000 7fcd368ac640 1 -- 172.21.15.117:0/2359674461 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd30144340 con 0x7fcd300c8d20 2024-09-19T08:39:11.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.629+0000 7fcd2cff9640 1 -- 172.21.15.117:0/2359674461 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcd2403a070 con 0x7fcd300c8d20 2024-09-19T08:39:11.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.629+0000 7fcd2cff9640 1 --2- 172.21.15.117:0/2359674461 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcd1c06c2e0 0x7fcd1c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:11.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.629+0000 7fcd2cff9640 1 -- 172.21.15.117:0/2359674461 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fcd240aafd0 con 0x7fcd300c8d20 2024-09-19T08:39:11.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.629+0000 7fcd2ffff640 1 --2- 172.21.15.117:0/2359674461 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcd1c06c2e0 0x7fcd1c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:11.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.630+0000 7fcd2ffff640 1 --2- 172.21.15.117:0/2359674461 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcd1c06c2e0 0x7fcd1c06e7a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009a20 tx=0x7fcd20009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:11.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.633+0000 7fcd2cff9640 1 -- 172.21.15.117:0/2359674461 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcd300c7140 con 0x7fcd300c8d20 2024-09-19T08:39:11.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.801+0000 7fcd368ac640 1 -- 172.21.15.117:0/2359674461 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fcd30072290 con 0x7fcd1c06c2e0 2024-09-19T08:39:11.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.801+0000 7fcd2cff9640 1 -- 172.21.15.117:0/2359674461 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcd30072290 con 0x7fcd1c06c2e0 2024-09-19T08:39:11.802 INFO:teuthology.orchestra.run.smithi117.stderr:instructed osd(s) 0 to deep-scrub 2024-09-19T08:39:11.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.803+0000 7fcd368ac640 1 -- 172.21.15.117:0/2359674461 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcd1c06c2e0 msgr2=0x7fcd1c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:11.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.803+0000 7fcd368ac640 1 --2- 172.21.15.117:0/2359674461 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcd1c06c2e0 0x7fcd1c06e7a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009a20 tx=0x7fcd20009190 comp rx=0 tx=0).stop 2024-09-19T08:39:11.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.803+0000 7fcd368ac640 1 -- 172.21.15.117:0/2359674461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd300c8d20 msgr2=0x7fcd300ce570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:11.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.803+0000 7fcd368ac640 1 --2- 172.21.15.117:0/2359674461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd300c8d20 0x7fcd300ce570 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fcd2402a0f0 tx=0x7fcd240046c0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.804+0000 7fcd368ac640 1 -- 172.21.15.117:0/2359674461 shutdown_connections 2024-09-19T08:39:11.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.804+0000 7fcd368ac640 1 --2- 172.21.15.117:0/2359674461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd30143f30 0x7fcd300ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.804+0000 7fcd368ac640 1 --2- 172.21.15.117:0/2359674461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd300c8d20 0x7fcd300ce570 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.804+0000 7fcd368ac640 1 --2- 172.21.15.117:0/2359674461 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fcd1c06c2e0 0x7fcd1c06e7a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.804+0000 7fcd368ac640 1 --2- 172.21.15.117:0/2359674461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd3006d260 0x7fcd301f39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.804+0000 7fcd368ac640 1 -- 172.21.15.117:0/2359674461 >> 172.21.15.117:0/2359674461 conn(0x7fcd300b3ed0 msgr2=0x7fcd3015fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:11.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.804+0000 7fcd368ac640 1 -- 172.21.15.117:0/2359674461 shutdown_connections 2024-09-19T08:39:11.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.804+0000 7fcd368ac640 1 -- 172.21.15.117:0/2359674461 wait complete. 2024-09-19T08:39:11.814 INFO:tasks.ceph:Scrubbing osd.1 2024-09-19T08:39:11.815 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-19T08:39:11.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.917+0000 7f2a448d9640 1 Processor -- start 2024-09-19T08:39:11.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.917+0000 7f2a448d9640 1 -- start start 2024-09-19T08:39:11.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.918+0000 7f2a448d9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2a400c5b00 0x7f2a400cc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:11.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.918+0000 7f2a448d9640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2a400cce70 0x7f2a400b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:11.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.918+0000 7f2a448d9640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a400b4540 con 0x7f2a4015a7b0 2024-09-19T08:39:11.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.918+0000 7f2a448d9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2a400b4870 con 0x7f2a400c5b00 2024-09-19T08:39:11.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.918+0000 7f2a448d9640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f2a400c5f40 con 0x7f2a400cce70 2024-09-19T08:39:11.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.918+0000 7f2a35d9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2a400c5b00 0x7f2a400cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:11.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.918+0000 7f2a35d9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2a400c5b00 0x7f2a400cc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45552/0 (socket says 172.21.15.117:45552) 2024-09-19T08:39:11.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.918+0000 7f2a35d9b640 1 -- 172.21.15.117:0/3039548475 learned_addr learned my addr 172.21.15.117:0/3039548475 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:11.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.918+0000 7f2a3ed9d640 1 --2- 172.21.15.117:0/3039548475 >> v2:172.21.15.146:3300/0 conn(0x7f2a400cce70 0x7f2a400b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:11.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.918+0000 7f2a35d9b640 1 -- 172.21.15.117:0/3039548475 >> v2:172.21.15.146:3300/0 conn(0x7f2a400cce70 msgr2=0x7f2a400b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:11.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.918+0000 7f2a35d9b640 1 --2- 172.21.15.117:0/3039548475 >> v2:172.21.15.146:3300/0 conn(0x7f2a400cce70 0x7f2a400b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.918+0000 7f2a35d9b640 1 -- 172.21.15.117:0/3039548475 >> v1:172.21.15.146:6789/0 conn(0x7f2a4015a7b0 legacy=0x7f2a400cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:11.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.918+0000 7f2a35d9b640 1 -- 172.21.15.117:0/3039548475 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a400cf9b0 con 0x7f2a400c5b00 2024-09-19T08:39:11.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.918+0000 7f2a3ed9d640 1 --2- 172.21.15.117:0/3039548475 >> v2:172.21.15.146:3300/0 conn(0x7f2a400cce70 0x7f2a400b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:11.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.919+0000 7f2a35d9b640 1 --2- 172.21.15.117:0/3039548475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a400c5b00 0x7f2a400cc930 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2a400d1070 tx=0x7f2a2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55aba349982d2e38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:11.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.919+0000 7f2a3dd9b640 1 -- 172.21.15.117:0/3039548475 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a28037070 con 0x7f2a400c5b00 2024-09-19T08:39:11.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.919+0000 7f2a3dd9b640 1 -- 172.21.15.117:0/3039548475 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a28032440 con 0x7f2a400c5b00 2024-09-19T08:39:11.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.919+0000 7f2a3dd9b640 1 -- 172.21.15.117:0/3039548475 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a28032810 con 0x7f2a400c5b00 2024-09-19T08:39:11.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.919+0000 7f2a448d9640 1 -- 172.21.15.117:0/3039548475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a400c5b00 msgr2=0x7f2a400cc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:11.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.919+0000 7f2a448d9640 1 --2- 172.21.15.117:0/3039548475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a400c5b00 0x7f2a400cc930 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2a400d1070 tx=0x7f2a2802a270 comp rx=0 tx=0).stop 2024-09-19T08:39:11.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.920+0000 7f2a448d9640 1 -- 172.21.15.117:0/3039548475 shutdown_connections 2024-09-19T08:39:11.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.920+0000 7f2a448d9640 1 --2- 172.21.15.117:0/3039548475 >> v2:172.21.15.146:3300/0 conn(0x7f2a400cce70 0x7f2a400b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.920+0000 7f2a448d9640 1 --2- 172.21.15.117:0/3039548475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a400c5b00 0x7f2a400cc930 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.920+0000 7f2a448d9640 1 -- 172.21.15.117:0/3039548475 >> 172.21.15.117:0/3039548475 conn(0x7f2a4006bdf0 msgr2=0x7f2a4006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:11.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.920+0000 7f2a448d9640 1 -- 172.21.15.117:0/3039548475 shutdown_connections 2024-09-19T08:39:11.923 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.920+0000 7f2a448d9640 1 -- 172.21.15.117:0/3039548475 wait complete. 2024-09-19T08:39:11.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.921+0000 7f2a448d9640 1 Processor -- start 2024-09-19T08:39:11.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.921+0000 7f2a448d9640 1 -- start start 2024-09-19T08:39:11.926 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.922+0000 7f2a448d9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a400c5b00 0x7f2a401598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:11.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.922+0000 7f2a448d9640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a400cce70 0x7f2a4015bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:11.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.922+0000 7f2a448d9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a4015a7b0 0x7f2a400ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:11.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.922+0000 7f2a448d9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4015ab90 con 0x7f2a400c5b00 2024-09-19T08:39:11.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.922+0000 7f2a448d9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2a400cff70 con 0x7f2a4015a7b0 2024-09-19T08:39:11.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.922+0000 7f2a448d9640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f2a400ca8c0 con 0x7f2a400cce70 2024-09-19T08:39:11.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.922+0000 7f2a3e59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a400c5b00 0x7f2a401598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:11.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.922+0000 7f2a3e59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a400c5b00 0x7f2a401598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45556/0 (socket says 172.21.15.117:45556) 2024-09-19T08:39:11.927 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.922+0000 7f2a3e59c640 1 -- 172.21.15.117:0/3249101812 learned_addr learned my addr 172.21.15.117:0/3249101812 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:11.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.922+0000 7f2a3ed9d640 1 --2- 172.21.15.117:0/3249101812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a4015a7b0 0x7f2a400ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:11.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.922+0000 7f2a35d9b640 1 --2- 172.21.15.117:0/3249101812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a400cce70 0x7f2a4015bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:11.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.922+0000 7f2a3e59c640 1 -- 172.21.15.117:0/3249101812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a400cce70 msgr2=0x7f2a4015bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:11.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.922+0000 7f2a3e59c640 1 --2- 172.21.15.117:0/3249101812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a400cce70 0x7f2a4015bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.922+0000 7f2a3e59c640 1 -- 172.21.15.117:0/3249101812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a4015a7b0 msgr2=0x7f2a400ae5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:11.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.922+0000 7f2a3e59c640 1 --2- 172.21.15.117:0/3249101812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a4015a7b0 0x7f2a400ae5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.928 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.922+0000 7f2a3e59c640 1 -- 172.21.15.117:0/3249101812 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a400ad520 con 0x7f2a400c5b00 2024-09-19T08:39:11.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.922+0000 7f2a35d9b640 1 --2- 172.21.15.117:0/3249101812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a400cce70 0x7f2a4015bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:39:11.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.922+0000 7f2a3e59c640 1 --2- 172.21.15.117:0/3249101812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a400c5b00 0x7f2a401598d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2a3000c400 tx=0x7f2a3000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:11.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.922+0000 7f2a377fe640 1 -- 172.21.15.117:0/3249101812 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a300052d0 con 0x7f2a400c5b00 2024-09-19T08:39:11.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.922+0000 7f2a377fe640 1 -- 172.21.15.117:0/3249101812 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a30005490 con 0x7f2a400c5b00 2024-09-19T08:39:11.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.923+0000 7f2a448d9640 1 -- 172.21.15.117:0/3249101812 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a400ad800 con 0x7f2a400c5b00 2024-09-19T08:39:11.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.923+0000 7f2a377fe640 1 -- 172.21.15.117:0/3249101812 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a30007260 con 0x7f2a400c5b00 2024-09-19T08:39:11.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.923+0000 7f2a448d9640 1 -- 172.21.15.117:0/3249101812 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a400addc0 con 0x7f2a400c5b00 2024-09-19T08:39:11.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.923+0000 7f2a448d9640 1 -- 172.21.15.117:0/3249101812 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2a40159e10 con 0x7f2a400c5b00 2024-09-19T08:39:11.929 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.924+0000 7f2a377fe640 1 -- 172.21.15.117:0/3249101812 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2a30007400 con 0x7f2a400c5b00 2024-09-19T08:39:11.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.924+0000 7f2a377fe640 1 --2- 172.21.15.117:0/3249101812 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2a2006c2b0 0x7f2a2006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:11.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.925+0000 7f2a377fe640 1 -- 172.21.15.117:0/3249101812 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f2a3008a7c0 con 0x7f2a400c5b00 2024-09-19T08:39:11.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.925+0000 7f2a35d9b640 1 --2- 172.21.15.117:0/3249101812 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2a2006c2b0 0x7f2a2006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:11.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.925+0000 7f2a377fe640 1 --2- 172.21.15.117:0/3249101812 >> [v2:172.21.15.117:6824/782460519,v1:172.21.15.117:6825/782460519] conn(0x7f2a20072750 0x7f2a20074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:11.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.925+0000 7f2a377fe640 1 -- 172.21.15.117:0/3249101812 --> [v2:172.21.15.117:6824/782460519,v1:172.21.15.117:6825/782460519] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2a30009e50 con 0x7f2a20072750 2024-09-19T08:39:11.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.925+0000 7f2a377fe640 1 -- 172.21.15.117:0/3249101812 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f2a3008f2c0 con 0x7f2a400c5b00 2024-09-19T08:39:11.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.925+0000 7f2a3ed9d640 1 --2- 172.21.15.117:0/3249101812 >> [v2:172.21.15.117:6824/782460519,v1:172.21.15.117:6825/782460519] conn(0x7f2a20072750 0x7f2a20074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:11.930 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.925+0000 7f2a35d9b640 1 --2- 172.21.15.117:0/3249101812 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2a2006c2b0 0x7f2a2006e770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2a28034000 tx=0x7f2a2802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:11.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.925+0000 7f2a3ed9d640 1 --2- 172.21.15.117:0/3249101812 >> [v2:172.21.15.117:6824/782460519,v1:172.21.15.117:6825/782460519] conn(0x7f2a20072750 0x7f2a20074b90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:11.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.926+0000 7f2a377fe640 1 -- 172.21.15.117:0/3249101812 <== osd.1 v2:172.21.15.117:6824/782460519 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2a30009e50 con 0x7f2a20072750 2024-09-19T08:39:11.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.938+0000 7f2a448d9640 1 -- 172.21.15.117:0/3249101812 --> [v2:172.21.15.117:6824/782460519,v1:172.21.15.117:6825/782460519] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2a400cedf0 con 0x7f2a20072750 2024-09-19T08:39:11.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.938+0000 7f2a377fe640 1 -- 172.21.15.117:0/3249101812 <== osd.1 v2:172.21.15.117:6824/782460519 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2a400cedf0 con 0x7f2a20072750 2024-09-19T08:39:11.939 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T08:39:11.939 INFO:teuthology.orchestra.run.smithi117.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T08:39:11.939 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T08:39:11.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.939+0000 7f2a448d9640 1 -- 172.21.15.117:0/3249101812 >> [v2:172.21.15.117:6824/782460519,v1:172.21.15.117:6825/782460519] conn(0x7f2a20072750 msgr2=0x7f2a20074b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:11.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.939+0000 7f2a448d9640 1 --2- 172.21.15.117:0/3249101812 >> [v2:172.21.15.117:6824/782460519,v1:172.21.15.117:6825/782460519] conn(0x7f2a20072750 0x7f2a20074b90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.939+0000 7f2a448d9640 1 -- 172.21.15.117:0/3249101812 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2a2006c2b0 msgr2=0x7f2a2006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:11.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.939+0000 7f2a448d9640 1 --2- 172.21.15.117:0/3249101812 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2a2006c2b0 0x7f2a2006e770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2a28034000 tx=0x7f2a2802e000 comp rx=0 tx=0).stop 2024-09-19T08:39:11.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.939+0000 7f2a448d9640 1 -- 172.21.15.117:0/3249101812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a400c5b00 msgr2=0x7f2a401598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:11.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.939+0000 7f2a448d9640 1 --2- 172.21.15.117:0/3249101812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a400c5b00 0x7f2a401598d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2a3000c400 tx=0x7f2a3000c8c0 comp rx=0 tx=0).stop 2024-09-19T08:39:11.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.939+0000 7f2a3ed9d640 1 -- 172.21.15.117:0/3249101812 reap_dead start 2024-09-19T08:39:11.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.939+0000 7f2a448d9640 1 -- 172.21.15.117:0/3249101812 shutdown_connections 2024-09-19T08:39:11.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.939+0000 7f2a448d9640 1 -- 172.21.15.117:0/3249101812 >> 172.21.15.117:0/3249101812 conn(0x7f2a4006bdf0 msgr2=0x7f2a40074ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:11.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.939+0000 7f2a448d9640 1 -- 172.21.15.117:0/3249101812 shutdown_connections 2024-09-19T08:39:11.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:11.939+0000 7f2a448d9640 1 -- 172.21.15.117:0/3249101812 wait complete. 2024-09-19T08:39:11.949 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-19T08:39:12.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.049+0000 7f7931b9f640 1 Processor -- start 2024-09-19T08:39:12.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.049+0000 7f7931b9f640 1 -- start start 2024-09-19T08:39:12.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.049+0000 7f7931b9f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f792c0739e0 0x7f792c072a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.049+0000 7f7931b9f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f792c072f90 0x7f792c06f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.049+0000 7f7931b9f640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f792c0cfd40 con 0x7f792c0710d0 2024-09-19T08:39:12.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.049+0000 7f7931b9f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f792c0d0020 con 0x7f792c0739e0 2024-09-19T08:39:12.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.049+0000 7f7931b9f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f792c0d0300 con 0x7f792c072f90 2024-09-19T08:39:12.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.050+0000 7f792bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f792c0739e0 0x7f792c072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.050+0000 7f792bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f792c0739e0 0x7f792c072a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45566/0 (socket says 172.21.15.117:45566) 2024-09-19T08:39:12.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.050+0000 7f792bfff640 1 -- 172.21.15.117:0/24854098 learned_addr learned my addr 172.21.15.117:0/24854098 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:12.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.050+0000 7f793139e640 1 --2- 172.21.15.117:0/24854098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f792c072f90 0x7f792c06f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.050+0000 7f792bfff640 1 -- 172.21.15.117:0/24854098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f792c072f90 msgr2=0x7f792c06f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:12.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.050+0000 7f792bfff640 1 --2- 172.21.15.117:0/24854098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f792c072f90 0x7f792c06f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.050+0000 7f792bfff640 1 -- 172.21.15.117:0/24854098 >> v1:172.21.15.146:6789/0 conn(0x7f792c0710d0 legacy=0x7f792c0cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.050+0000 7f792bfff640 1 -- 172.21.15.117:0/24854098 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f792c0d05e0 con 0x7f792c0739e0 2024-09-19T08:39:12.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.051+0000 7f792bfff640 1 --2- 172.21.15.117:0/24854098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f792c0739e0 0x7f792c072a50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f791c00d150 tx=0x7f791c02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d36218b051146 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:12.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.051+0000 7f792b7fe640 1 -- 172.21.15.117:0/24854098 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c039070 con 0x7f792c0739e0 2024-09-19T08:39:12.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.051+0000 7f792b7fe640 1 -- 172.21.15.117:0/24854098 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f791c009600 con 0x7f792c0739e0 2024-09-19T08:39:12.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.051+0000 7f792b7fe640 1 -- 172.21.15.117:0/24854098 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c0099d0 con 0x7f792c0739e0 2024-09-19T08:39:12.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.051+0000 7f7931b9f640 1 -- 172.21.15.117:0/24854098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f792c0739e0 msgr2=0x7f792c072a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.051+0000 7f7931b9f640 1 --2- 172.21.15.117:0/24854098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f792c0739e0 0x7f792c072a50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f791c00d150 tx=0x7f791c02c890 comp rx=0 tx=0).stop 2024-09-19T08:39:12.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.051+0000 7f7931b9f640 1 -- 172.21.15.117:0/24854098 shutdown_connections 2024-09-19T08:39:12.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.051+0000 7f7931b9f640 1 --2- 172.21.15.117:0/24854098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f792c072f90 0x7f792c06f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.051+0000 7f7931b9f640 1 --2- 172.21.15.117:0/24854098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f792c0739e0 0x7f792c072a50 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.051+0000 7f7931b9f640 1 -- 172.21.15.117:0/24854098 >> 172.21.15.117:0/24854098 conn(0x7f792c0d0f30 msgr2=0x7f792c0d1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:12.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.051+0000 7f7931b9f640 1 -- 172.21.15.117:0/24854098 shutdown_connections 2024-09-19T08:39:12.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.051+0000 7f7931b9f640 1 -- 172.21.15.117:0/24854098 wait complete. 2024-09-19T08:39:12.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.053+0000 7f7931b9f640 1 Processor -- start 2024-09-19T08:39:12.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.053+0000 7f7931b9f640 1 -- start start 2024-09-19T08:39:12.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.053+0000 7f7931b9f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f792c0710d0 0x7f792c1f0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.053+0000 7f7931b9f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f792c072f90 0x7f792c15df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.053+0000 7f7931b9f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f792c0739e0 0x7f792c0a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.053+0000 7f7931b9f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f792c06fa60 con 0x7f792c072f90 2024-09-19T08:39:12.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.053+0000 7f7931b9f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f792c06f8e0 con 0x7f792c0710d0 2024-09-19T08:39:12.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.053+0000 7f7931b9f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f792c06fbe0 con 0x7f792c0739e0 2024-09-19T08:39:12.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.054+0000 7f792bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f792c072f90 0x7f792c15df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.054+0000 7f792bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f792c072f90 0x7f792c15df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45580/0 (socket says 172.21.15.117:45580) 2024-09-19T08:39:12.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.054+0000 7f792bfff640 1 -- 172.21.15.117:0/4151575299 learned_addr learned my addr 172.21.15.117:0/4151575299 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:12.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.054+0000 7f7930b9d640 1 --2- 172.21.15.117:0/4151575299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f792c0710d0 0x7f792c1f0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.054+0000 7f793139e640 1 --2- 172.21.15.117:0/4151575299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f792c0739e0 0x7f792c0a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.054+0000 7f792bfff640 1 -- 172.21.15.117:0/4151575299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f792c0739e0 msgr2=0x7f792c0a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.054+0000 7f792bfff640 1 --2- 172.21.15.117:0/4151575299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f792c0739e0 0x7f792c0a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.054+0000 7f792bfff640 1 -- 172.21.15.117:0/4151575299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f792c0710d0 msgr2=0x7f792c1f0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.054+0000 7f792bfff640 1 --2- 172.21.15.117:0/4151575299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f792c0710d0 0x7f792c1f0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.054+0000 7f792bfff640 1 -- 172.21.15.117:0/4151575299 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f792c1f0540 con 0x7f792c072f90 2024-09-19T08:39:12.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.054+0000 7f792bfff640 1 --2- 172.21.15.117:0/4151575299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f792c072f90 0x7f792c15df20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f791c037040 tx=0x7f791c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:12.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.054+0000 7f79297fa640 1 -- 172.21.15.117:0/4151575299 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c044020 con 0x7f792c072f90 2024-09-19T08:39:12.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.054+0000 7f79297fa640 1 -- 172.21.15.117:0/4151575299 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f791c009de0 con 0x7f792c072f90 2024-09-19T08:39:12.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.054+0000 7f7931b9f640 1 -- 172.21.15.117:0/4151575299 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f792c0c9600 con 0x7f792c072f90 2024-09-19T08:39:12.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.054+0000 7f79297fa640 1 -- 172.21.15.117:0/4151575299 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c039040 con 0x7f792c072f90 2024-09-19T08:39:12.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.054+0000 7f7931b9f640 1 -- 172.21.15.117:0/4151575299 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f792c0c9b80 con 0x7f792c072f90 2024-09-19T08:39:12.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.055+0000 7f7931b9f640 1 -- 172.21.15.117:0/4151575299 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f792c06f3a0 con 0x7f792c072f90 2024-09-19T08:39:12.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.056+0000 7f79297fa640 1 -- 172.21.15.117:0/4151575299 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f791c047020 con 0x7f792c072f90 2024-09-19T08:39:12.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.056+0000 7f79297fa640 1 --2- 172.21.15.117:0/4151575299 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f790c06c2b0 0x7f790c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.056+0000 7f79297fa640 1 -- 172.21.15.117:0/4151575299 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f791c0adf40 con 0x7f792c072f90 2024-09-19T08:39:12.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.056+0000 7f7930b9d640 1 --2- 172.21.15.117:0/4151575299 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f790c06c2b0 0x7f790c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.057+0000 7f7930b9d640 1 --2- 172.21.15.117:0/4151575299 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f790c06c2b0 0x7f790c06e770 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f792c0b6cc0 tx=0x7f7924009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:12.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.060+0000 7f79297fa640 1 -- 172.21.15.117:0/4151575299 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f791c04e030 con 0x7f792c072f90 2024-09-19T08:39:12.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.225+0000 7f7931b9f640 1 -- 172.21.15.117:0/4151575299 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f792c069660 con 0x7f790c06c2b0 2024-09-19T08:39:12.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.226+0000 7f79297fa640 1 -- 172.21.15.117:0/4151575299 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f792c069660 con 0x7f790c06c2b0 2024-09-19T08:39:12.226 INFO:teuthology.orchestra.run.smithi117.stderr:instructed osd(s) 1 to deep-scrub 2024-09-19T08:39:12.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.228+0000 7f7931b9f640 1 -- 172.21.15.117:0/4151575299 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f790c06c2b0 msgr2=0x7f790c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.228+0000 7f7931b9f640 1 --2- 172.21.15.117:0/4151575299 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f790c06c2b0 0x7f790c06e770 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f792c0b6cc0 tx=0x7f7924009040 comp rx=0 tx=0).stop 2024-09-19T08:39:12.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.228+0000 7f7931b9f640 1 -- 172.21.15.117:0/4151575299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f792c072f90 msgr2=0x7f792c15df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.228 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.228+0000 7f7931b9f640 1 --2- 172.21.15.117:0/4151575299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f792c072f90 0x7f792c15df20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f791c037040 tx=0x7f791c004a40 comp rx=0 tx=0).stop 2024-09-19T08:39:12.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.228+0000 7f7931b9f640 1 -- 172.21.15.117:0/4151575299 shutdown_connections 2024-09-19T08:39:12.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.228+0000 7f7931b9f640 1 --2- 172.21.15.117:0/4151575299 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f790c06c2b0 0x7f790c06e770 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.228+0000 7f7931b9f640 1 --2- 172.21.15.117:0/4151575299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f792c0739e0 0x7f792c0a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.228+0000 7f7931b9f640 1 --2- 172.21.15.117:0/4151575299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f792c072f90 0x7f792c15df20 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.228+0000 7f7931b9f640 1 --2- 172.21.15.117:0/4151575299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f792c0710d0 0x7f792c1f0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.228+0000 7f7931b9f640 1 -- 172.21.15.117:0/4151575299 >> 172.21.15.117:0/4151575299 conn(0x7f792c0d0f30 msgr2=0x7f792c075120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:12.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.228+0000 7f7931b9f640 1 -- 172.21.15.117:0/4151575299 shutdown_connections 2024-09-19T08:39:12.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.228+0000 7f7931b9f640 1 -- 172.21.15.117:0/4151575299 wait complete. 2024-09-19T08:39:12.239 INFO:tasks.ceph:Scrubbing osd.2 2024-09-19T08:39:12.239 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-19T08:39:12.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.343+0000 7ff7b4677640 1 Processor -- start 2024-09-19T08:39:12.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.343+0000 7ff7b4677640 1 -- start start 2024-09-19T08:39:12.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.344+0000 7ff7b4677640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7ac15e2a0 0x7ff7ac06d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.344+0000 7ff7b4677640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff7ac15e680 0x7ff7ac0cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.344+0000 7ff7b4677640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff7ac06d960 0x7ff7ac0d0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.344+0000 7ff7b4677640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff7ac0d1880 con 0x7ff7ac06d960 2024-09-19T08:39:12.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.344+0000 7ff7b4677640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7ff7ac0d1b60 con 0x7ff7ac15e680 2024-09-19T08:39:12.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.344+0000 7ff7b4677640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ac0cf2d0 con 0x7ff7ac15e2a0 2024-09-19T08:39:12.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.344+0000 7ff7b2c14640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff7ac06d960 0x7ff7ac0d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.344+0000 7ff7b2c14640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff7ac06d960 0x7ff7ac0d0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45592/0 (socket says 172.21.15.117:45592) 2024-09-19T08:39:12.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.344+0000 7ff7b2c14640 1 -- 172.21.15.117:0/1391341226 learned_addr learned my addr 172.21.15.117:0/1391341226 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:12.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.344+0000 7ff7b1c12640 1 --2- 172.21.15.117:0/1391341226 >> v2:172.21.15.146:3300/0 conn(0x7ff7ac15e680 0x7ff7ac0cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.344+0000 7ff7b2413640 1 --2- 172.21.15.117:0/1391341226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7ac15e2a0 0x7ff7ac06d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.344+0000 7ff7b2c14640 1 -- 172.21.15.117:0/1391341226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7ac15e2a0 msgr2=0x7ff7ac06d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:12.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.344+0000 7ff7b2c14640 1 --2- 172.21.15.117:0/1391341226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7ac15e2a0 0x7ff7ac06d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.344+0000 7ff7b2c14640 1 -- 172.21.15.117:0/1391341226 >> v2:172.21.15.146:3300/0 conn(0x7ff7ac15e680 msgr2=0x7ff7ac0cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:12.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.344+0000 7ff7b2c14640 1 --2- 172.21.15.117:0/1391341226 >> v2:172.21.15.146:3300/0 conn(0x7ff7ac15e680 0x7ff7ac0cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.344+0000 7ff7b2c14640 1 -- 172.21.15.117:0/1391341226 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ac0cf5b0 con 0x7ff7ac06d960 2024-09-19T08:39:12.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.344+0000 7ff7b2413640 1 --2- 172.21.15.117:0/1391341226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7ac15e2a0 0x7ff7ac06d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:39:12.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.345+0000 7ff7b2c14640 1 --2- 172.21.15.117:0/1391341226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7ac06d960 0x7ff7ac0d0010 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0d1f60 tx=0x7ff7a402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8b69e96182cf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:12.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.345+0000 7ff7b1411640 1 -- 172.21.15.117:0/1391341226 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4036070 con 0x7ff7ac06d960 2024-09-19T08:39:12.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.345+0000 7ff7b1411640 1 -- 172.21.15.117:0/1391341226 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a4031600 con 0x7ff7ac06d960 2024-09-19T08:39:12.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.345+0000 7ff7b1411640 1 -- 172.21.15.117:0/1391341226 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a40319d0 con 0x7ff7ac06d960 2024-09-19T08:39:12.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.346+0000 7ff7b4677640 1 -- 172.21.15.117:0/1391341226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7ac06d960 msgr2=0x7ff7ac0d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.346+0000 7ff7b4677640 1 --2- 172.21.15.117:0/1391341226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7ac06d960 0x7ff7ac0d0010 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0d1f60 tx=0x7ff7a402a6a0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.346+0000 7ff7b4677640 1 -- 172.21.15.117:0/1391341226 shutdown_connections 2024-09-19T08:39:12.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.346+0000 7ff7b4677640 1 --2- 172.21.15.117:0/1391341226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7ac06d960 0x7ff7ac0d0010 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.346+0000 7ff7b4677640 1 --2- 172.21.15.117:0/1391341226 >> v2:172.21.15.146:3300/0 conn(0x7ff7ac15e680 0x7ff7ac0cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.346+0000 7ff7b4677640 1 --2- 172.21.15.117:0/1391341226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7ac15e2a0 0x7ff7ac06d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.346+0000 7ff7b4677640 1 -- 172.21.15.117:0/1391341226 >> 172.21.15.117:0/1391341226 conn(0x7ff7ac09d760 msgr2=0x7ff7ac08bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:12.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.346+0000 7ff7b4677640 1 -- 172.21.15.117:0/1391341226 shutdown_connections 2024-09-19T08:39:12.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.346+0000 7ff7b4677640 1 -- 172.21.15.117:0/1391341226 wait complete. 2024-09-19T08:39:12.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.347+0000 7ff7b4677640 1 Processor -- start 2024-09-19T08:39:12.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.347+0000 7ff7b4677640 1 -- start start 2024-09-19T08:39:12.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7b4677640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7ac06d960 0x7ff7ac159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7b4677640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7ac15e2a0 0x7ff7ac156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7b4677640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7ac15e680 0x7ff7ac157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7b4677640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac0d44f0 con 0x7ff7ac15e680 2024-09-19T08:39:12.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7b4677640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac0d4370 con 0x7ff7ac15e2a0 2024-09-19T08:39:12.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7b4677640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ac0d4670 con 0x7ff7ac06d960 2024-09-19T08:39:12.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7b2c14640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7ac15e680 0x7ff7ac157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7b2c14640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7ac15e680 0x7ff7ac157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45606/0 (socket says 172.21.15.117:45606) 2024-09-19T08:39:12.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7b2c14640 1 -- 172.21.15.117:0/3911277704 learned_addr learned my addr 172.21.15.117:0/3911277704 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:12.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7b2413640 1 --2- 172.21.15.117:0/3911277704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7ac06d960 0x7ff7ac159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7b1c12640 1 --2- 172.21.15.117:0/3911277704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7ac15e2a0 0x7ff7ac156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7b2c14640 1 -- 172.21.15.117:0/3911277704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7ac06d960 msgr2=0x7ff7ac159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7b2c14640 1 --2- 172.21.15.117:0/3911277704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7ac06d960 0x7ff7ac159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7b2c14640 1 -- 172.21.15.117:0/3911277704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7ac15e2a0 msgr2=0x7ff7ac156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7b2c14640 1 --2- 172.21.15.117:0/3911277704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7ac15e2a0 0x7ff7ac156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7b2c14640 1 -- 172.21.15.117:0/3911277704 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ac15a0f0 con 0x7ff7ac15e680 2024-09-19T08:39:12.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7b2c14640 1 --2- 172.21.15.117:0/3911277704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7ac15e680 0x7ff7ac157500 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009f40 tx=0x7ff7a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:12.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7a2ffd640 1 -- 172.21.15.117:0/3911277704 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4041020 con 0x7ff7ac15e680 2024-09-19T08:39:12.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7a2ffd640 1 -- 172.21.15.117:0/3911277704 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a40077a0 con 0x7ff7ac15e680 2024-09-19T08:39:12.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7b4677640 1 -- 172.21.15.117:0/3911277704 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7ac15a3d0 con 0x7ff7ac15e680 2024-09-19T08:39:12.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7a2ffd640 1 -- 172.21.15.117:0/3911277704 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4036040 con 0x7ff7ac15e680 2024-09-19T08:39:12.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.348+0000 7ff7b4677640 1 -- 172.21.15.117:0/3911277704 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7ac0c8f70 con 0x7ff7ac15e680 2024-09-19T08:39:12.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.349+0000 7ff7b4677640 1 -- 172.21.15.117:0/3911277704 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff7ac15a610 con 0x7ff7ac15e680 2024-09-19T08:39:12.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.350+0000 7ff7a2ffd640 1 -- 172.21.15.117:0/3911277704 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff7a4044020 con 0x7ff7ac15e680 2024-09-19T08:39:12.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.350+0000 7ff7a2ffd640 1 --2- 172.21.15.117:0/3911277704 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff79006c2b0 0x7ff79006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.350+0000 7ff7a2ffd640 1 -- 172.21.15.117:0/3911277704 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7ff7a40abe60 con 0x7ff7ac15e680 2024-09-19T08:39:12.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.350+0000 7ff7a2ffd640 1 --2- 172.21.15.117:0/3911277704 >> [v2:172.21.15.117:6800/2056750572,v1:172.21.15.117:6801/2056750572] conn(0x7ff790072750 0x7ff790074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.350+0000 7ff7a2ffd640 1 -- 172.21.15.117:0/3911277704 --> [v2:172.21.15.117:6800/2056750572,v1:172.21.15.117:6801/2056750572] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff790075260 con 0x7ff790072750 2024-09-19T08:39:12.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.350+0000 7ff7a2ffd640 1 -- 172.21.15.117:0/3911277704 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7ff7a40ae560 con 0x7ff7ac15e680 2024-09-19T08:39:12.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.350+0000 7ff7b2413640 1 --2- 172.21.15.117:0/3911277704 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff79006c2b0 0x7ff79006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.350+0000 7ff7b1c12640 1 --2- 172.21.15.117:0/3911277704 >> [v2:172.21.15.117:6800/2056750572,v1:172.21.15.117:6801/2056750572] conn(0x7ff790072750 0x7ff790074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.351+0000 7ff7b1c12640 1 --2- 172.21.15.117:0/3911277704 >> [v2:172.21.15.117:6800/2056750572,v1:172.21.15.117:6801/2056750572] conn(0x7ff790072750 0x7ff790074b90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:12.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.351+0000 7ff7b2413640 1 --2- 172.21.15.117:0/3911277704 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff79006c2b0 0x7ff79006e770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0d1200 tx=0x7ff7a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:12.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.351+0000 7ff7a2ffd640 1 -- 172.21.15.117:0/3911277704 <== osd.2 v2:172.21.15.117:6800/2056750572 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff790075260 con 0x7ff790072750 2024-09-19T08:39:12.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.364+0000 7ff7b4677640 1 -- 172.21.15.117:0/3911277704 --> [v2:172.21.15.117:6800/2056750572,v1:172.21.15.117:6801/2056750572] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff7ac0d4a40 con 0x7ff790072750 2024-09-19T08:39:12.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.364+0000 7ff7a2ffd640 1 -- 172.21.15.117:0/3911277704 <== osd.2 v2:172.21.15.117:6800/2056750572 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff7ac0d4a40 con 0x7ff790072750 2024-09-19T08:39:12.364 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T08:39:12.364 INFO:teuthology.orchestra.run.smithi117.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T08:39:12.364 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T08:39:12.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.364+0000 7ff7b4677640 1 -- 172.21.15.117:0/3911277704 >> [v2:172.21.15.117:6800/2056750572,v1:172.21.15.117:6801/2056750572] conn(0x7ff790072750 msgr2=0x7ff790074b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.364+0000 7ff7b4677640 1 --2- 172.21.15.117:0/3911277704 >> [v2:172.21.15.117:6800/2056750572,v1:172.21.15.117:6801/2056750572] conn(0x7ff790072750 0x7ff790074b90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.364+0000 7ff7b4677640 1 -- 172.21.15.117:0/3911277704 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff79006c2b0 msgr2=0x7ff79006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.364+0000 7ff7b4677640 1 --2- 172.21.15.117:0/3911277704 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff79006c2b0 0x7ff79006e770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0d1200 tx=0x7ff7a8008040 comp rx=0 tx=0).stop 2024-09-19T08:39:12.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.364+0000 7ff7b4677640 1 -- 172.21.15.117:0/3911277704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7ac15e680 msgr2=0x7ff7ac157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.364+0000 7ff7b4677640 1 --2- 172.21.15.117:0/3911277704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7ac15e680 0x7ff7ac157500 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009f40 tx=0x7ff7a4004a40 comp rx=0 tx=0).stop 2024-09-19T08:39:12.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.364+0000 7ff7b2c14640 1 -- 172.21.15.117:0/3911277704 reap_dead start 2024-09-19T08:39:12.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.364+0000 7ff7b4677640 1 -- 172.21.15.117:0/3911277704 shutdown_connections 2024-09-19T08:39:12.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.364+0000 7ff7b4677640 1 -- 172.21.15.117:0/3911277704 >> 172.21.15.117:0/3911277704 conn(0x7ff7ac09d760 msgr2=0x7ff7ac15f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:12.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.364+0000 7ff7b4677640 1 -- 172.21.15.117:0/3911277704 shutdown_connections 2024-09-19T08:39:12.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.364+0000 7ff7b4677640 1 -- 172.21.15.117:0/3911277704 wait complete. 2024-09-19T08:39:12.377 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-19T08:39:12.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.476+0000 7f337bea6640 1 Processor -- start 2024-09-19T08:39:12.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.477+0000 7f337bea6640 1 -- start start 2024-09-19T08:39:12.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f337bea6640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f33740c7770 0x7f3374162580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f337bea6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3374143b40 con 0x7f33741621a0 2024-09-19T08:39:12.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f337bea6640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337415efb0 con 0x7f337415ea80 2024-09-19T08:39:12.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f337bea6640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f33741421a0 con 0x7f33740c7770 2024-09-19T08:39:12.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f3379c42640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f33741621a0 0x7f3374141a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50156/0 (socket says 172.21.15.117:50156) 2024-09-19T08:39:12.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f3379c42640 1 -- 172.21.15.117:0/772491099 learned_addr learned my addr 172.21.15.117:0/772491099 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:12.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f337a443640 1 --2- 172.21.15.117:0/772491099 >> v2:172.21.15.146:3300/0 conn(0x7f33740c7770 0x7f3374162580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f3378c40640 1 -- 172.21.15.117:0/772491099 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 491841028 0 0) 0x7f3374143b40 con 0x7f33741621a0 2024-09-19T08:39:12.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f3378c40640 1 -- 172.21.15.117:0/772491099 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3360003520 con 0x7f33741621a0 2024-09-19T08:39:12.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f3378c40640 1 -- 172.21.15.117:0/772491099 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 749138532 0 0) 0x7f3360003520 con 0x7f33741621a0 2024-09-19T08:39:12.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f3378c40640 1 -- 172.21.15.117:0/772491099 >> v2:172.21.15.146:3300/0 conn(0x7f33740c7770 msgr2=0x7f3374162580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:12.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f3378c40640 1 --2- 172.21.15.117:0/772491099 >> v2:172.21.15.146:3300/0 conn(0x7f33740c7770 0x7f3374162580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f3378c40640 1 -- 172.21.15.117:0/772491099 >> v1:172.21.15.146:6789/0 conn(0x7f337415ea80 legacy=0x7f33740c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f3378c40640 1 -- 172.21.15.117:0/772491099 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337415f290 con 0x7f33741621a0 2024-09-19T08:39:12.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f3378c40640 1 -- 172.21.15.117:0/772491099 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f3364001670 con 0x7f33741621a0 2024-09-19T08:39:12.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f3378c40640 1 -- 172.21.15.117:0/772491099 >> v1:172.21.15.117:6789/0 conn(0x7f33741621a0 legacy=0x7f3374141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f3378c40640 1 --2- 172.21.15.117:0/772491099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33600039b0 0x7f3360003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f3378c40640 1 --2- 172.21.15.117:0/772491099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3360004800 0x7f3360004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f3378c40640 1 --2- 172.21.15.117:0/772491099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33600051c0 0x7f336000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f3378c40640 1 -- 172.21.15.117:0/772491099 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f33741421a0 con 0x7f33600039b0 2024-09-19T08:39:12.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f3378c40640 1 -- 172.21.15.117:0/772491099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f336000c060 con 0x7f3360004800 2024-09-19T08:39:12.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f3378c40640 1 -- 172.21.15.117:0/772491099 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f336000c260 con 0x7f33600051c0 2024-09-19T08:39:12.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.478+0000 7f3379c42640 1 --2- 172.21.15.117:0/772491099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33600039b0 0x7f3360003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.479+0000 7f3379441640 1 --2- 172.21.15.117:0/772491099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3360004800 0x7f3360004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.479+0000 7f337a443640 1 --2- 172.21.15.117:0/772491099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33600051c0 0x7f336000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.479+0000 7f3379c42640 1 -- 172.21.15.117:0/772491099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33600051c0 msgr2=0x7f336000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:12.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.479+0000 7f3379c42640 1 --2- 172.21.15.117:0/772491099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33600051c0 0x7f336000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.479+0000 7f3379c42640 1 -- 172.21.15.117:0/772491099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3360004800 msgr2=0x7f3360004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:12.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.479+0000 7f3379c42640 1 --2- 172.21.15.117:0/772491099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3360004800 0x7f3360004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.479+0000 7f3379c42640 1 -- 172.21.15.117:0/772491099 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3360003520 con 0x7f33600039b0 2024-09-19T08:39:12.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.479+0000 7f337a443640 1 -- 172.21.15.117:0/772491099 reap_dead start 2024-09-19T08:39:12.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.479+0000 7f3379441640 1 --2- 172.21.15.117:0/772491099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3360004800 0x7f3360004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:12.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.479+0000 7f3379c42640 1 --2- 172.21.15.117:0/772491099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33600039b0 0x7f3360003dd0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f336400c210 tx=0x7f3360005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c7abd142a78d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:12.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.480+0000 7f3378c40640 1 -- 172.21.15.117:0/772491099 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3364007d30 con 0x7f33600039b0 2024-09-19T08:39:12.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.480+0000 7f3378c40640 1 -- 172.21.15.117:0/772491099 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3364005ad0 con 0x7f33600039b0 2024-09-19T08:39:12.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.480+0000 7f3378c40640 1 -- 172.21.15.117:0/772491099 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3364007070 con 0x7f33600039b0 2024-09-19T08:39:12.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.480+0000 7f337bea6640 1 -- 172.21.15.117:0/772491099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33600039b0 msgr2=0x7f3360003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.480+0000 7f337bea6640 1 --2- 172.21.15.117:0/772491099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33600039b0 0x7f3360003dd0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f336400c210 tx=0x7f3360005830 comp rx=0 tx=0).stop 2024-09-19T08:39:12.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.480+0000 7f337bea6640 1 -- 172.21.15.117:0/772491099 shutdown_connections 2024-09-19T08:39:12.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.480+0000 7f337bea6640 1 --2- 172.21.15.117:0/772491099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33600039b0 0x7f3360003dd0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.480+0000 7f337bea6640 1 -- 172.21.15.117:0/772491099 >> 172.21.15.117:0/772491099 conn(0x7f3374067fe0 msgr2=0x7f337406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:12.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.480+0000 7f337bea6640 1 -- 172.21.15.117:0/772491099 shutdown_connections 2024-09-19T08:39:12.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.480+0000 7f337bea6640 1 -- 172.21.15.117:0/772491099 wait complete. 2024-09-19T08:39:12.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.481+0000 7f337bea6640 1 Processor -- start 2024-09-19T08:39:12.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.482+0000 7f337bea6640 1 -- start start 2024-09-19T08:39:12.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.482+0000 7f337bea6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33600039b0 0x7f33741f4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.482+0000 7f337bea6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33740b7e20 0x7f337415b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.482+0000 7f337bea6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33740d20f0 0x7f33740d2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.482+0000 7f337bea6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f33740cfa50 con 0x7f33740d20f0 2024-09-19T08:39:12.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.482+0000 7f337bea6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f337415f850 con 0x7f33740b7e20 2024-09-19T08:39:12.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.482+0000 7f337bea6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f33740d2a90 con 0x7f33600039b0 2024-09-19T08:39:12.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.482+0000 7f337a443640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33740d20f0 0x7f33740d2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.482+0000 7f337a443640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33740d20f0 0x7f33740d2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45624/0 (socket says 172.21.15.117:45624) 2024-09-19T08:39:12.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.482+0000 7f337a443640 1 -- 172.21.15.117:0/2093074358 learned_addr learned my addr 172.21.15.117:0/2093074358 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:12.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.482+0000 7f3379c42640 1 --2- 172.21.15.117:0/2093074358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33600039b0 0x7f33741f4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.483+0000 7f3379441640 1 --2- 172.21.15.117:0/2093074358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33740b7e20 0x7f337415b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.483+0000 7f337a443640 1 -- 172.21.15.117:0/2093074358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33600039b0 msgr2=0x7f33741f4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.483+0000 7f337a443640 1 --2- 172.21.15.117:0/2093074358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33600039b0 0x7f33741f4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.483+0000 7f337a443640 1 -- 172.21.15.117:0/2093074358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33740b7e20 msgr2=0x7f337415b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.483+0000 7f337a443640 1 --2- 172.21.15.117:0/2093074358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33740b7e20 0x7f337415b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.483+0000 7f337a443640 1 -- 172.21.15.117:0/2093074358 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33741f5020 con 0x7f33740d20f0 2024-09-19T08:39:12.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.483+0000 7f337a443640 1 --2- 172.21.15.117:0/2093074358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33740d20f0 0x7f33740d2550 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f33740b4d20 tx=0x7f336c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:12.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.483+0000 7f336a7fc640 1 -- 172.21.15.117:0/2093074358 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c011e40 con 0x7f33740d20f0 2024-09-19T08:39:12.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.483+0000 7f336a7fc640 1 -- 172.21.15.117:0/2093074358 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f336c01b070 con 0x7f33740d20f0 2024-09-19T08:39:12.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.483+0000 7f336a7fc640 1 -- 172.21.15.117:0/2093074358 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c003990 con 0x7f33740d20f0 2024-09-19T08:39:12.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.483+0000 7f337bea6640 1 -- 172.21.15.117:0/2093074358 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f337413e470 con 0x7f33740d20f0 2024-09-19T08:39:12.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.483+0000 7f337bea6640 1 -- 172.21.15.117:0/2093074358 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f337413ea30 con 0x7f33740d20f0 2024-09-19T08:39:12.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.484+0000 7f337bea6640 1 -- 172.21.15.117:0/2093074358 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33740c7060 con 0x7f33740d20f0 2024-09-19T08:39:12.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.484+0000 7f336a7fc640 1 -- 172.21.15.117:0/2093074358 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f336c005d10 con 0x7f33740d20f0 2024-09-19T08:39:12.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.485+0000 7f336a7fc640 1 --2- 172.21.15.117:0/2093074358 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f335806c2b0 0x7f335806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.485+0000 7f336a7fc640 1 -- 172.21.15.117:0/2093074358 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f336c08b5b0 con 0x7f33740d20f0 2024-09-19T08:39:12.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.485+0000 7f3379c42640 1 --2- 172.21.15.117:0/2093074358 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f335806c2b0 0x7f335806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.486+0000 7f3379c42640 1 --2- 172.21.15.117:0/2093074358 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f335806c2b0 0x7f335806e770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3364032000 tx=0x7f336402d000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:12.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.489+0000 7f336a7fc640 1 -- 172.21.15.117:0/2093074358 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f336c025020 con 0x7f33740d20f0 2024-09-19T08:39:12.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.657+0000 7f337bea6640 1 -- 172.21.15.117:0/2093074358 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f33740cf600 con 0x7f335806c2b0 2024-09-19T08:39:12.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.657+0000 7f336a7fc640 1 -- 172.21.15.117:0/2093074358 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f33740cf600 con 0x7f335806c2b0 2024-09-19T08:39:12.657 INFO:teuthology.orchestra.run.smithi117.stderr:instructed osd(s) 2 to deep-scrub 2024-09-19T08:39:12.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.659+0000 7f337bea6640 1 -- 172.21.15.117:0/2093074358 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f335806c2b0 msgr2=0x7f335806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.659+0000 7f337bea6640 1 --2- 172.21.15.117:0/2093074358 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f335806c2b0 0x7f335806e770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3364032000 tx=0x7f336402d000 comp rx=0 tx=0).stop 2024-09-19T08:39:12.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.659+0000 7f337bea6640 1 -- 172.21.15.117:0/2093074358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33740d20f0 msgr2=0x7f33740d2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.659+0000 7f337bea6640 1 --2- 172.21.15.117:0/2093074358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33740d20f0 0x7f33740d2550 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f33740b4d20 tx=0x7f336c0115a0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.659+0000 7f337bea6640 1 -- 172.21.15.117:0/2093074358 shutdown_connections 2024-09-19T08:39:12.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.659+0000 7f337bea6640 1 --2- 172.21.15.117:0/2093074358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33740d20f0 0x7f33740d2550 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.659+0000 7f337bea6640 1 --2- 172.21.15.117:0/2093074358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33740b7e20 0x7f337415b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.659+0000 7f337bea6640 1 --2- 172.21.15.117:0/2093074358 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f335806c2b0 0x7f335806e770 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.660 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.659+0000 7f337bea6640 1 --2- 172.21.15.117:0/2093074358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33600039b0 0x7f33741f4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.659+0000 7f337bea6640 1 -- 172.21.15.117:0/2093074358 >> 172.21.15.117:0/2093074358 conn(0x7f3374067fe0 msgr2=0x7f33741429e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:12.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.659+0000 7f337bea6640 1 -- 172.21.15.117:0/2093074358 shutdown_connections 2024-09-19T08:39:12.661 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.659+0000 7f337bea6640 1 -- 172.21.15.117:0/2093074358 wait complete. 2024-09-19T08:39:12.670 INFO:tasks.ceph:Scrubbing osd.3 2024-09-19T08:39:12.670 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-19T08:39:12.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.774+0000 7f86fe118640 1 Processor -- start 2024-09-19T08:39:12.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.774+0000 7f86fe118640 1 -- start start 2024-09-19T08:39:12.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.774+0000 7f86fe118640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f86f81621a0 0x7f86f8141a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.774+0000 7f86fe118640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86f80c7770 0x7f86f8162580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.774+0000 7f86fe118640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86f8143b40 con 0x7f86f815ea80 2024-09-19T08:39:12.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.774+0000 7f86fe118640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f86f815efb0 con 0x7f86f80c7770 2024-09-19T08:39:12.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.774+0000 7f86fe118640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f86f815f290 con 0x7f86f81621a0 2024-09-19T08:39:12.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.775+0000 7f86f7fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86f80c7770 0x7f86f8162580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.775+0000 7f86f6ffd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f86f815ea80 0x7f86f80c7060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50172/0 (socket says 172.21.15.117:50172) 2024-09-19T08:39:12.776 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.775+0000 7f86f7fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f86f80c7770 0x7f86f8162580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45630/0 (socket says 172.21.15.117:45630) 2024-09-19T08:39:12.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.775+0000 7f86f6ffd640 1 -- 172.21.15.117:0/1124122698 learned_addr learned my addr 172.21.15.117:0/1124122698 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:12.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.775+0000 7f86f77fe640 1 --2- 172.21.15.117:0/1124122698 >> v2:172.21.15.146:3300/0 conn(0x7f86f81621a0 0x7f86f8141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.775+0000 7f86f7fff640 1 -- 172.21.15.117:0/1124122698 >> v2:172.21.15.146:3300/0 conn(0x7f86f81621a0 msgr2=0x7f86f8141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:12.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.775+0000 7f86f7fff640 1 --2- 172.21.15.117:0/1124122698 >> v2:172.21.15.146:3300/0 conn(0x7f86f81621a0 0x7f86f8141a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.775+0000 7f86f7fff640 1 -- 172.21.15.117:0/1124122698 >> v1:172.21.15.117:6789/0 conn(0x7f86f815ea80 legacy=0x7f86f80c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.775+0000 7f86f7fff640 1 -- 172.21.15.117:0/1124122698 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f815f570 con 0x7f86f80c7770 2024-09-19T08:39:12.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.775+0000 7f86f67fc640 1 -- 172.21.15.117:0/1124122698 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3685226405 0 0) 0x7f86f8143b40 con 0x7f86f815ea80 2024-09-19T08:39:12.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.776+0000 7f86f7fff640 1 --2- 172.21.15.117:0/1124122698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86f80c7770 0x7f86f8162580 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f86f80d3280 tx=0x7f86f002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f742e42eb41f9df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:12.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.776+0000 7f86f67fc640 1 -- 172.21.15.117:0/1124122698 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f0007740 con 0x7f86f80c7770 2024-09-19T08:39:12.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.776+0000 7f86f67fc640 1 -- 172.21.15.117:0/1124122698 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f00078e0 con 0x7f86f80c7770 2024-09-19T08:39:12.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.776+0000 7f86f67fc640 1 -- 172.21.15.117:0/1124122698 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f0007cb0 con 0x7f86f80c7770 2024-09-19T08:39:12.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.776+0000 7f86fe118640 1 -- 172.21.15.117:0/1124122698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86f80c7770 msgr2=0x7f86f8162580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.776+0000 7f86fe118640 1 --2- 172.21.15.117:0/1124122698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86f80c7770 0x7f86f8162580 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f86f80d3280 tx=0x7f86f002a680 comp rx=0 tx=0).stop 2024-09-19T08:39:12.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.776+0000 7f86fe118640 1 -- 172.21.15.117:0/1124122698 shutdown_connections 2024-09-19T08:39:12.782 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.776+0000 7f86fe118640 1 --2- 172.21.15.117:0/1124122698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86f80c7770 0x7f86f8162580 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.776+0000 7f86fe118640 1 --2- 172.21.15.117:0/1124122698 >> v2:172.21.15.146:3300/0 conn(0x7f86f81621a0 0x7f86f8141a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.776+0000 7f86fe118640 1 -- 172.21.15.117:0/1124122698 >> 172.21.15.117:0/1124122698 conn(0x7f86f8067fe0 msgr2=0x7f86f806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:12.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.776+0000 7f86fe118640 1 -- 172.21.15.117:0/1124122698 shutdown_connections 2024-09-19T08:39:12.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.776+0000 7f86fe118640 1 -- 172.21.15.117:0/1124122698 wait complete. 2024-09-19T08:39:12.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.778+0000 7f86fe118640 1 Processor -- start 2024-09-19T08:39:12.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.778+0000 7f86fe118640 1 -- start start 2024-09-19T08:39:12.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.778+0000 7f86fe118640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86f80c7770 0x7f86f81405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.778+0000 7f86fe118640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86f815ea80 0x7f86f815d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.778+0000 7f86fe118640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86f81621a0 0x7f86f815d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.778+0000 7f86fe118640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f86f80cfa50 con 0x7f86f81621a0 2024-09-19T08:39:12.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.778+0000 7f86fe118640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f86f8141fd0 con 0x7f86f815ea80 2024-09-19T08:39:12.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.778+0000 7f86fe118640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f86f813f120 con 0x7f86f80c7770 2024-09-19T08:39:12.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.779+0000 7f86f7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86f81621a0 0x7f86f815d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.779+0000 7f86f7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86f81621a0 0x7f86f815d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45646/0 (socket says 172.21.15.117:45646) 2024-09-19T08:39:12.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.779+0000 7f86f7fff640 1 -- 172.21.15.117:0/1928073945 learned_addr learned my addr 172.21.15.117:0/1928073945 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:12.784 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.779+0000 7f86f77fe640 1 --2- 172.21.15.117:0/1928073945 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86f80c7770 0x7f86f81405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.779+0000 7f86f6ffd640 1 --2- 172.21.15.117:0/1928073945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86f815ea80 0x7f86f815d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.779+0000 7f86f7fff640 1 -- 172.21.15.117:0/1928073945 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86f80c7770 msgr2=0x7f86f81405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.779+0000 7f86f7fff640 1 --2- 172.21.15.117:0/1928073945 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86f80c7770 0x7f86f81405b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.779+0000 7f86f7fff640 1 -- 172.21.15.117:0/1928073945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86f815ea80 msgr2=0x7f86f815d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.779+0000 7f86f7fff640 1 --2- 172.21.15.117:0/1928073945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86f815ea80 0x7f86f815d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.779+0000 7f86f7fff640 1 -- 172.21.15.117:0/1928073945 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f81f3c40 con 0x7f86f81621a0 2024-09-19T08:39:12.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.779+0000 7f86f6ffd640 1 --2- 172.21.15.117:0/1928073945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86f815ea80 0x7f86f815d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:12.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.779+0000 7f86f7fff640 1 --2- 172.21.15.117:0/1928073945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86f81621a0 0x7f86f815d8d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f86f002ac70 tx=0x7f86f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:12.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.779+0000 7f86dffff640 1 -- 172.21.15.117:0/1928073945 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f003f070 con 0x7f86f81621a0 2024-09-19T08:39:12.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.779+0000 7f86dffff640 1 -- 172.21.15.117:0/1928073945 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f0031bc0 con 0x7f86f81621a0 2024-09-19T08:39:12.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.779+0000 7f86fe118640 1 -- 172.21.15.117:0/1928073945 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f8140af0 con 0x7f86f81621a0 2024-09-19T08:39:12.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.779+0000 7f86dffff640 1 -- 172.21.15.117:0/1928073945 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f0044460 con 0x7f86f81621a0 2024-09-19T08:39:12.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.779+0000 7f86fe118640 1 -- 172.21.15.117:0/1928073945 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f813ead0 con 0x7f86f81621a0 2024-09-19T08:39:12.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.780+0000 7f86fe118640 1 -- 172.21.15.117:0/1928073945 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f86f813e8c0 con 0x7f86f81621a0 2024-09-19T08:39:12.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.781+0000 7f86dffff640 1 -- 172.21.15.117:0/1928073945 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f86f0007790 con 0x7f86f81621a0 2024-09-19T08:39:12.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.781+0000 7f86dffff640 1 --2- 172.21.15.117:0/1928073945 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f86e406c2b0 0x7f86e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.781+0000 7f86dffff640 1 -- 172.21.15.117:0/1928073945 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f86f00acae0 con 0x7f86f81621a0 2024-09-19T08:39:12.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.781+0000 7f86dffff640 1 --2- 172.21.15.117:0/1928073945 >> [v2:172.21.15.117:6816/1107529373,v1:172.21.15.117:6817/1107529373] conn(0x7f86e4072750 0x7f86e4074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.781+0000 7f86dffff640 1 -- 172.21.15.117:0/1928073945 --> [v2:172.21.15.117:6816/1107529373,v1:172.21.15.117:6817/1107529373] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f86f003de50 con 0x7f86e4072750 2024-09-19T08:39:12.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.781+0000 7f86dffff640 1 -- 172.21.15.117:0/1928073945 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f86f00b12c0 con 0x7f86f81621a0 2024-09-19T08:39:12.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.781+0000 7f86f6ffd640 1 --2- 172.21.15.117:0/1928073945 >> [v2:172.21.15.117:6816/1107529373,v1:172.21.15.117:6817/1107529373] conn(0x7f86e4072750 0x7f86e4074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.781+0000 7f86f77fe640 1 --2- 172.21.15.117:0/1928073945 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f86e406c2b0 0x7f86e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.782+0000 7f86f6ffd640 1 --2- 172.21.15.117:0/1928073945 >> [v2:172.21.15.117:6816/1107529373,v1:172.21.15.117:6817/1107529373] conn(0x7f86e4072750 0x7f86e4074b90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:12.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.782+0000 7f86f77fe640 1 --2- 172.21.15.117:0/1928073945 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f86e406c2b0 0x7f86e406e770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f86e8006fd0 tx=0x7f86e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:12.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.782+0000 7f86dffff640 1 -- 172.21.15.117:0/1928073945 <== osd.3 v2:172.21.15.117:6816/1107529373 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f86f003de50 con 0x7f86e4072750 2024-09-19T08:39:12.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.794+0000 7f86fe118640 1 -- 172.21.15.117:0/1928073945 --> [v2:172.21.15.117:6816/1107529373,v1:172.21.15.117:6817/1107529373] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f86f8141a90 con 0x7f86e4072750 2024-09-19T08:39:12.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.795+0000 7f86dffff640 1 -- 172.21.15.117:0/1928073945 <== osd.3 v2:172.21.15.117:6816/1107529373 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f86f8141a90 con 0x7f86e4072750 2024-09-19T08:39:12.795 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T08:39:12.795 INFO:teuthology.orchestra.run.smithi117.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T08:39:12.795 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T08:39:12.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.795+0000 7f86fe118640 1 -- 172.21.15.117:0/1928073945 >> [v2:172.21.15.117:6816/1107529373,v1:172.21.15.117:6817/1107529373] conn(0x7f86e4072750 msgr2=0x7f86e4074b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.795+0000 7f86fe118640 1 --2- 172.21.15.117:0/1928073945 >> [v2:172.21.15.117:6816/1107529373,v1:172.21.15.117:6817/1107529373] conn(0x7f86e4072750 0x7f86e4074b90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.795+0000 7f86fe118640 1 -- 172.21.15.117:0/1928073945 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f86e406c2b0 msgr2=0x7f86e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.795+0000 7f86fe118640 1 --2- 172.21.15.117:0/1928073945 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f86e406c2b0 0x7f86e406e770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f86e8006fd0 tx=0x7f86e8008040 comp rx=0 tx=0).stop 2024-09-19T08:39:12.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.795+0000 7f86fe118640 1 -- 172.21.15.117:0/1928073945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86f81621a0 msgr2=0x7f86f815d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.795+0000 7f86fe118640 1 --2- 172.21.15.117:0/1928073945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86f81621a0 0x7f86f815d8d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f86f002ac70 tx=0x7f86f0004a40 comp rx=0 tx=0).stop 2024-09-19T08:39:12.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.795+0000 7f86f7fff640 1 -- 172.21.15.117:0/1928073945 reap_dead start 2024-09-19T08:39:12.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.795+0000 7f86fe118640 1 -- 172.21.15.117:0/1928073945 shutdown_connections 2024-09-19T08:39:12.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.795+0000 7f86fe118640 1 -- 172.21.15.117:0/1928073945 >> 172.21.15.117:0/1928073945 conn(0x7f86f8067fe0 msgr2=0x7f86f80c7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:12.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.795+0000 7f86fe118640 1 -- 172.21.15.117:0/1928073945 shutdown_connections 2024-09-19T08:39:12.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.795+0000 7f86fe118640 1 -- 172.21.15.117:0/1928073945 wait complete. 2024-09-19T08:39:12.805 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-19T08:39:12.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.905+0000 7f6ed8f6f640 1 Processor -- start 2024-09-19T08:39:12.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.905+0000 7f6ed8f6f640 1 -- start start 2024-09-19T08:39:12.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.906+0000 7f6ed8f6f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ed40d0540 0x7f6ed4141a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.906+0000 7f6ed8f6f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ed415d710 con 0x7f6ed4141fa0 2024-09-19T08:39:12.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.906+0000 7f6ed8f6f640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ed415c950 con 0x7f6ed4141680 2024-09-19T08:39:12.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.906+0000 7f6ed8f6f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f6ed415c6f0 con 0x7f6ed40d0540 2024-09-19T08:39:12.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.906+0000 7f6ed2d9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f6ed4141fa0 0x7f6ed413f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50176/0 (socket says 172.21.15.117:50176) 2024-09-19T08:39:12.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.906+0000 7f6ed2d9d640 1 -- 172.21.15.117:0/594790074 learned_addr learned my addr 172.21.15.117:0/594790074 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:12.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.906+0000 7f6ec9d9b640 1 --2- 172.21.15.117:0/594790074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ed40d0540 0x7f6ed4141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.906+0000 7f6ed1d9b640 1 -- 172.21.15.117:0/594790074 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 255570751 0 0) 0x7f6ed415d710 con 0x7f6ed4141fa0 2024-09-19T08:39:12.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.906+0000 7f6ed1d9b640 1 -- 172.21.15.117:0/594790074 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ec0003520 con 0x7f6ed4141fa0 2024-09-19T08:39:12.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.906+0000 7f6ed1d9b640 1 -- 172.21.15.117:0/594790074 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2870873212 0 0) 0x7f6ed415c950 con 0x7f6ed4141680 2024-09-19T08:39:12.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.906+0000 7f6ed1d9b640 1 -- 172.21.15.117:0/594790074 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ed415d710 con 0x7f6ed4141680 2024-09-19T08:39:12.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.906+0000 7f6ed1d9b640 1 -- 172.21.15.117:0/594790074 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 420143703 0 0) 0x7f6ec0003520 con 0x7f6ed4141fa0 2024-09-19T08:39:12.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.906+0000 7f6ed1d9b640 1 -- 172.21.15.117:0/594790074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ed40d0540 msgr2=0x7f6ed4141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:12.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.906+0000 7f6ed1d9b640 1 --2- 172.21.15.117:0/594790074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ed40d0540 0x7f6ed4141a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.906+0000 7f6ed1d9b640 1 -- 172.21.15.117:0/594790074 >> v1:172.21.15.146:6789/0 conn(0x7f6ed4141680 legacy=0x7f6ed40cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.906+0000 7f6ed1d9b640 1 -- 172.21.15.117:0/594790074 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed415cc30 con 0x7f6ed4141fa0 2024-09-19T08:39:12.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.906+0000 7f6ed1d9b640 1 -- 172.21.15.117:0/594790074 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f6ecc0019f0 con 0x7f6ed4141fa0 2024-09-19T08:39:12.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.906+0000 7f6ed1d9b640 1 -- 172.21.15.117:0/594790074 >> v1:172.21.15.117:6789/0 conn(0x7f6ed4141fa0 legacy=0x7f6ed413f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.906+0000 7f6ed1d9b640 1 --2- 172.21.15.117:0/594790074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ec0003b70 0x7f6ec0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.906+0000 7f6ed1d9b640 1 --2- 172.21.15.117:0/594790074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ed40d0540 0x7f6ec0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.907+0000 7f6ed1d9b640 1 --2- 172.21.15.117:0/594790074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ec0004d40 0x7f6ec00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.907+0000 7f6ed1d9b640 1 -- 172.21.15.117:0/594790074 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed415c6f0 con 0x7f6ec0003b70 2024-09-19T08:39:12.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.907+0000 7f6ed1d9b640 1 -- 172.21.15.117:0/594790074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec000ba70 con 0x7f6ec0004d40 2024-09-19T08:39:12.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.907+0000 7f6ed1d9b640 1 -- 172.21.15.117:0/594790074 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec000bc70 con 0x7f6ed40d0540 2024-09-19T08:39:12.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.907+0000 7f6ed259c640 1 --2- 172.21.15.117:0/594790074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ec0003b70 0x7f6ec0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.907+0000 7f6ec9d9b640 1 --2- 172.21.15.117:0/594790074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ed40d0540 0x7f6ec0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.907+0000 7f6ed2d9d640 1 --2- 172.21.15.117:0/594790074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ec0004d40 0x7f6ec00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.907+0000 7f6ed259c640 1 -- 172.21.15.117:0/594790074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ed40d0540 msgr2=0x7f6ec0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:12.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.907+0000 7f6ed259c640 1 --2- 172.21.15.117:0/594790074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ed40d0540 0x7f6ec0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.907+0000 7f6ed259c640 1 -- 172.21.15.117:0/594790074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ec0004d40 msgr2=0x7f6ec00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:12.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.907+0000 7f6ed259c640 1 --2- 172.21.15.117:0/594790074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ec0004d40 0x7f6ec00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.907+0000 7f6ed259c640 1 -- 172.21.15.117:0/594790074 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec0003520 con 0x7f6ec0003b70 2024-09-19T08:39:12.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.907+0000 7f6ed259c640 1 --2- 172.21.15.117:0/594790074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ec0003b70 0x7f6ec0003f70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40018d0 tx=0x7f6ec0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd3e4318108b07a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:12.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.908+0000 7f6ed1d9b640 1 -- 172.21.15.117:0/594790074 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec40014f0 con 0x7f6ec0003b70 2024-09-19T08:39:12.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.908+0000 7f6ed1d9b640 1 -- 172.21.15.117:0/594790074 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec40052d0 con 0x7f6ec0003b70 2024-09-19T08:39:12.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.908+0000 7f6ed1d9b640 1 -- 172.21.15.117:0/594790074 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec402aca0 con 0x7f6ec0003b70 2024-09-19T08:39:12.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.908+0000 7f6ed8f6f640 1 -- 172.21.15.117:0/594790074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ec0003b70 msgr2=0x7f6ec0003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.908+0000 7f6ed8f6f640 1 --2- 172.21.15.117:0/594790074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ec0003b70 0x7f6ec0003f70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40018d0 tx=0x7f6ec0005830 comp rx=0 tx=0).stop 2024-09-19T08:39:12.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.908+0000 7f6ed2d9d640 1 -- 172.21.15.117:0/594790074 reap_dead start 2024-09-19T08:39:12.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.908+0000 7f6ed8f6f640 1 -- 172.21.15.117:0/594790074 shutdown_connections 2024-09-19T08:39:12.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.908+0000 7f6ed8f6f640 1 -- 172.21.15.117:0/594790074 >> 172.21.15.117:0/594790074 conn(0x7f6ed40b3ed0 msgr2=0x7f6ed40b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:12.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.908+0000 7f6ed8f6f640 1 -- 172.21.15.117:0/594790074 shutdown_connections 2024-09-19T08:39:12.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.908+0000 7f6ed8f6f640 1 -- 172.21.15.117:0/594790074 wait complete. 2024-09-19T08:39:12.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.910+0000 7f6ed8f6f640 1 Processor -- start 2024-09-19T08:39:12.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.910+0000 7f6ed8f6f640 1 -- start start 2024-09-19T08:39:12.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.910+0000 7f6ed8f6f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ec0003b70 0x7f6ed40b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.910+0000 7f6ed8f6f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ed41f7db0 0x7f6ed41f8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.910+0000 7f6ed8f6f640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ed41f8750 0x7f6ed40b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.910+0000 7f6ed8f6f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed4142430 con 0x7f6ec0003b70 2024-09-19T08:39:12.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.910+0000 7f6ed8f6f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed415d1f0 con 0x7f6ed41f7db0 2024-09-19T08:39:12.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.910+0000 7f6ed8f6f640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f6ed41425b0 con 0x7f6ed41f8750 2024-09-19T08:39:12.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.910+0000 7f6ed259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ec0003b70 0x7f6ed40b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.911+0000 7f6ed259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ec0003b70 0x7f6ed40b7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45656/0 (socket says 172.21.15.117:45656) 2024-09-19T08:39:12.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.911+0000 7f6ed259c640 1 -- 172.21.15.117:0/4181417896 learned_addr learned my addr 172.21.15.117:0/4181417896 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:12.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.911+0000 7f6ed259c640 1 -- 172.21.15.117:0/4181417896 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ed41f8750 msgr2=0x7f6ed40b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.911+0000 7f6ec9d9b640 1 --2- 172.21.15.117:0/4181417896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ed41f7db0 0x7f6ed41f8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.911+0000 7f6ed259c640 1 --2- 172.21.15.117:0/4181417896 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ed41f8750 0x7f6ed40b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.911+0000 7f6ed259c640 1 -- 172.21.15.117:0/4181417896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ed41f7db0 msgr2=0x7f6ed41f8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:12.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.911+0000 7f6ed259c640 1 --2- 172.21.15.117:0/4181417896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ed41f7db0 0x7f6ed41f8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:12.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.911+0000 7f6ed259c640 1 -- 172.21.15.117:0/4181417896 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed41f8bd0 con 0x7f6ec0003b70 2024-09-19T08:39:12.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.911+0000 7f6ed259c640 1 --2- 172.21.15.117:0/4181417896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ec0003b70 0x7f6ed40b7c60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40018d0 tx=0x7f6ec40012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:12.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.911+0000 7f6ecb7fe640 1 -- 172.21.15.117:0/4181417896 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec403f020 con 0x7f6ec0003b70 2024-09-19T08:39:12.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.911+0000 7f6ecb7fe640 1 -- 172.21.15.117:0/4181417896 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec4006e50 con 0x7f6ec0003b70 2024-09-19T08:39:12.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.911+0000 7f6ed8f6f640 1 -- 172.21.15.117:0/4181417896 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ed40c7cf0 con 0x7f6ec0003b70 2024-09-19T08:39:12.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.911+0000 7f6ecb7fe640 1 -- 172.21.15.117:0/4181417896 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4037040 con 0x7f6ec0003b70 2024-09-19T08:39:12.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.911+0000 7f6ed8f6f640 1 -- 172.21.15.117:0/4181417896 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ed40c82b0 con 0x7f6ec0003b70 2024-09-19T08:39:12.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.912+0000 7f6ed8f6f640 1 -- 172.21.15.117:0/4181417896 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ed4141a60 con 0x7f6ec0003b70 2024-09-19T08:39:12.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.913+0000 7f6ecb7fe640 1 -- 172.21.15.117:0/4181417896 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6ec4042020 con 0x7f6ec0003b70 2024-09-19T08:39:12.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.913+0000 7f6ecb7fe640 1 --2- 172.21.15.117:0/4181417896 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6eb406c2e0 0x7f6eb406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:12.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.913+0000 7f6ecb7fe640 1 -- 172.21.15.117:0/4181417896 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f6ec40aafe0 con 0x7f6ec0003b70 2024-09-19T08:39:12.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.913+0000 7f6ec9d9b640 1 --2- 172.21.15.117:0/4181417896 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6eb406c2e0 0x7f6eb406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:12.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.914+0000 7f6ec9d9b640 1 --2- 172.21.15.117:0/4181417896 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6eb406c2e0 0x7f6eb406e7a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40c8e80 tx=0x7f6ebc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:12.921 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:12.917+0000 7f6ecb7fe640 1 -- 172.21.15.117:0/4181417896 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6ec4049030 con 0x7f6ec0003b70 2024-09-19T08:39:13.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.083+0000 7f6ed8f6f640 1 -- 172.21.15.117:0/4181417896 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f6ed40690c0 con 0x7f6eb406c2e0 2024-09-19T08:39:13.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.084+0000 7f6ecb7fe640 1 -- 172.21.15.117:0/4181417896 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6ed40690c0 con 0x7f6eb406c2e0 2024-09-19T08:39:13.084 INFO:teuthology.orchestra.run.smithi117.stderr:instructed osd(s) 3 to deep-scrub 2024-09-19T08:39:13.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.086+0000 7f6ed8f6f640 1 -- 172.21.15.117:0/4181417896 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6eb406c2e0 msgr2=0x7f6eb406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.086+0000 7f6ed8f6f640 1 --2- 172.21.15.117:0/4181417896 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6eb406c2e0 0x7f6eb406e7a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40c8e80 tx=0x7f6ebc008040 comp rx=0 tx=0).stop 2024-09-19T08:39:13.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.086+0000 7f6ed8f6f640 1 -- 172.21.15.117:0/4181417896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ec0003b70 msgr2=0x7f6ed40b7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.086+0000 7f6ed8f6f640 1 --2- 172.21.15.117:0/4181417896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ec0003b70 0x7f6ed40b7c60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40018d0 tx=0x7f6ec40012d0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.086+0000 7f6ed8f6f640 1 -- 172.21.15.117:0/4181417896 shutdown_connections 2024-09-19T08:39:13.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.086+0000 7f6ed8f6f640 1 --2- 172.21.15.117:0/4181417896 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f6eb406c2e0 0x7f6eb406e7a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.086+0000 7f6ed8f6f640 1 --2- 172.21.15.117:0/4181417896 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ed41f8750 0x7f6ed40b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.086+0000 7f6ed8f6f640 1 --2- 172.21.15.117:0/4181417896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ed41f7db0 0x7f6ed41f8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.086+0000 7f6ed8f6f640 1 --2- 172.21.15.117:0/4181417896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ec0003b70 0x7f6ed40b7c60 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.086+0000 7f6ed8f6f640 1 -- 172.21.15.117:0/4181417896 >> 172.21.15.117:0/4181417896 conn(0x7f6ed40b3ed0 msgr2=0x7f6ed413f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:13.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.086+0000 7f6ed8f6f640 1 -- 172.21.15.117:0/4181417896 shutdown_connections 2024-09-19T08:39:13.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.086+0000 7f6ed8f6f640 1 -- 172.21.15.117:0/4181417896 wait complete. 2024-09-19T08:39:13.097 INFO:tasks.ceph:Scrubbing osd.4 2024-09-19T08:39:13.097 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-19T08:39:13.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.198+0000 7f34d9227640 1 Processor -- start 2024-09-19T08:39:13.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.198+0000 7f34d9227640 1 -- start start 2024-09-19T08:39:13.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.199+0000 7f34d9227640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f34d40d04c0 0x7f34d41562c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.199+0000 7f34d9227640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34d40d22d0 con 0x7f34d415cb00 2024-09-19T08:39:13.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.199+0000 7f34d9227640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34d40d25b0 con 0x7f34d40d1ca0 2024-09-19T08:39:13.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.199+0000 7f34d9227640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f34d40b40b0 con 0x7f34d40d04c0 2024-09-19T08:39:13.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.199+0000 7f34d359e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f34d40d04c0 0x7f34d41562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.199+0000 7f34d2d9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f34d415cb00 0x7f34d415cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50178/0 (socket says 172.21.15.117:50178) 2024-09-19T08:39:13.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.199+0000 7f34d359e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f34d40d04c0 0x7f34d41562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45664/0 (socket says 172.21.15.117:45664) 2024-09-19T08:39:13.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.199+0000 7f34d2d9d640 1 -- 172.21.15.117:0/329018241 learned_addr learned my addr 172.21.15.117:0/329018241 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:13.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.200+0000 7f34d359e640 1 -- 172.21.15.117:0/329018241 >> v1:172.21.15.146:6789/0 conn(0x7f34d40d1ca0 legacy=0x7f34d40cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:13.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.200+0000 7f34d359e640 1 -- 172.21.15.117:0/329018241 >> v1:172.21.15.117:6789/0 conn(0x7f34d415cb00 legacy=0x7f34d415cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.200+0000 7f34d359e640 1 -- 172.21.15.117:0/329018241 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d40d2890 con 0x7f34d40d04c0 2024-09-19T08:39:13.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.200+0000 7f34d359e640 1 --2- 172.21.15.117:0/329018241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34d40d04c0 0x7f34d41562c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0097a0 tx=0x7f34cc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3b8971be8bd51d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:13.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.200+0000 7f34d1d9b640 1 -- 172.21.15.117:0/329018241 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc037070 con 0x7f34d40d04c0 2024-09-19T08:39:13.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.200+0000 7f34d1d9b640 1 -- 172.21.15.117:0/329018241 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34cc02ae50 con 0x7f34d40d04c0 2024-09-19T08:39:13.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.200+0000 7f34d1d9b640 1 -- 172.21.15.117:0/329018241 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc032660 con 0x7f34d40d04c0 2024-09-19T08:39:13.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.201+0000 7f34d9227640 1 -- 172.21.15.117:0/329018241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34d40d04c0 msgr2=0x7f34d41562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.201+0000 7f34d9227640 1 --2- 172.21.15.117:0/329018241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34d40d04c0 0x7f34d41562c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0097a0 tx=0x7f34cc02a140 comp rx=0 tx=0).stop 2024-09-19T08:39:13.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.201+0000 7f34d9227640 1 -- 172.21.15.117:0/329018241 shutdown_connections 2024-09-19T08:39:13.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.201+0000 7f34d9227640 1 --2- 172.21.15.117:0/329018241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34d40d04c0 0x7f34d41562c0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.201+0000 7f34d9227640 1 -- 172.21.15.117:0/329018241 >> 172.21.15.117:0/329018241 conn(0x7f34d4067fe0 msgr2=0x7f34d406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:13.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.201+0000 7f34d9227640 1 -- 172.21.15.117:0/329018241 shutdown_connections 2024-09-19T08:39:13.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.201+0000 7f34d9227640 1 -- 172.21.15.117:0/329018241 wait complete. 2024-09-19T08:39:13.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.202+0000 7f34d9227640 1 Processor -- start 2024-09-19T08:39:13.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.202+0000 7f34d9227640 1 -- start start 2024-09-19T08:39:13.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.203+0000 7f34d9227640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34d40d04c0 0x7f34d40b7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.203+0000 7f34d9227640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34d40d1ca0 0x7f34d40cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.203+0000 7f34d9227640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34d415cb00 0x7f34d414dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.203+0000 7f34d9227640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f34d415d770 con 0x7f34d40d04c0 2024-09-19T08:39:13.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.203+0000 7f34d9227640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f34d415d5f0 con 0x7f34d415cb00 2024-09-19T08:39:13.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.203+0000 7f34d9227640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f34d4140af0 con 0x7f34d40d1ca0 2024-09-19T08:39:13.206 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.203+0000 7f34d2d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34d40d04c0 0x7f34d40b7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.203+0000 7f34d2d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34d40d04c0 0x7f34d40b7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45670/0 (socket says 172.21.15.117:45670) 2024-09-19T08:39:13.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.203+0000 7f34d2d9d640 1 -- 172.21.15.117:0/3146527751 learned_addr learned my addr 172.21.15.117:0/3146527751 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:13.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.203+0000 7f34d359e640 1 --2- 172.21.15.117:0/3146527751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34d415cb00 0x7f34d414dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.204+0000 7f34d259c640 1 --2- 172.21.15.117:0/3146527751 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34d40d1ca0 0x7f34d40cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.204+0000 7f34d2d9d640 1 -- 172.21.15.117:0/3146527751 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34d40d1ca0 msgr2=0x7f34d40cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.204+0000 7f34d2d9d640 1 --2- 172.21.15.117:0/3146527751 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34d40d1ca0 0x7f34d40cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.204+0000 7f34d2d9d640 1 -- 172.21.15.117:0/3146527751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34d415cb00 msgr2=0x7f34d414dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.204+0000 7f34d2d9d640 1 --2- 172.21.15.117:0/3146527751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34d415cb00 0x7f34d414dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.204+0000 7f34d2d9d640 1 -- 172.21.15.117:0/3146527751 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d40c9e60 con 0x7f34d40d04c0 2024-09-19T08:39:13.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.204+0000 7f34d259c640 1 --2- 172.21.15.117:0/3146527751 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34d40d1ca0 0x7f34d40cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:39:13.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.204+0000 7f34d2d9d640 1 --2- 172.21.15.117:0/3146527751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34d40d04c0 0x7f34d40b7b30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f34c400ca70 tx=0x7f34c400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:13.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.204+0000 7f34bb7fe640 1 -- 172.21.15.117:0/3146527751 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4017070 con 0x7f34d40d04c0 2024-09-19T08:39:13.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.204+0000 7f34bb7fe640 1 -- 172.21.15.117:0/3146527751 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c400abd0 con 0x7f34d40d04c0 2024-09-19T08:39:13.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.204+0000 7f34d9227640 1 -- 172.21.15.117:0/3146527751 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d40ca140 con 0x7f34d40d04c0 2024-09-19T08:39:13.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.204+0000 7f34bb7fe640 1 -- 172.21.15.117:0/3146527751 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4012400 con 0x7f34d40d04c0 2024-09-19T08:39:13.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.204+0000 7f34d9227640 1 -- 172.21.15.117:0/3146527751 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d40ca700 con 0x7f34d40d04c0 2024-09-19T08:39:13.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.205+0000 7f34d9227640 1 -- 172.21.15.117:0/3146527751 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f34d40cfdb0 con 0x7f34d40d04c0 2024-09-19T08:39:13.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.205+0000 7f34bb7fe640 1 -- 172.21.15.117:0/3146527751 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f34c401a070 con 0x7f34d40d04c0 2024-09-19T08:39:13.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.206+0000 7f34bb7fe640 1 --2- 172.21.15.117:0/3146527751 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f34c006c2b0 0x7f34c006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.206+0000 7f34bb7fe640 1 -- 172.21.15.117:0/3146527751 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f34c408b760 con 0x7f34d40d04c0 2024-09-19T08:39:13.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.206+0000 7f34bb7fe640 1 --2- 172.21.15.117:0/3146527751 >> [v2:172.21.15.146:6816/128066450,v1:172.21.15.146:6817/128066450] conn(0x7f34c0072750 0x7f34c0074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.206+0000 7f34d259c640 1 --2- 172.21.15.117:0/3146527751 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f34c006c2b0 0x7f34c006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.206+0000 7f34bb7fe640 1 -- 172.21.15.117:0/3146527751 --> [v2:172.21.15.146:6816/128066450,v1:172.21.15.146:6817/128066450] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f34c4016ec0 con 0x7f34c0072750 2024-09-19T08:39:13.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.206+0000 7f34bb7fe640 1 -- 172.21.15.117:0/3146527751 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f34c408bbf0 con 0x7f34d40d04c0 2024-09-19T08:39:13.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.206+0000 7f34d359e640 1 --2- 172.21.15.117:0/3146527751 >> [v2:172.21.15.146:6816/128066450,v1:172.21.15.146:6817/128066450] conn(0x7f34c0072750 0x7f34c0074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.207+0000 7f34d259c640 1 --2- 172.21.15.117:0/3146527751 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f34c006c2b0 0x7f34c006e770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f34d40b73c0 tx=0x7f34c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:13.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.207+0000 7f34d359e640 1 --2- 172.21.15.117:0/3146527751 >> [v2:172.21.15.146:6816/128066450,v1:172.21.15.146:6817/128066450] conn(0x7f34c0072750 0x7f34c0074b90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:13.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.208+0000 7f34bb7fe640 1 -- 172.21.15.117:0/3146527751 <== osd.4 v2:172.21.15.146:6816/128066450 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f34c4016ec0 con 0x7f34c0072750 2024-09-19T08:39:13.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.220+0000 7f34d9227640 1 -- 172.21.15.117:0/3146527751 --> [v2:172.21.15.146:6816/128066450,v1:172.21.15.146:6817/128066450] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f34d40c8980 con 0x7f34c0072750 2024-09-19T08:39:13.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.221+0000 7f34bb7fe640 1 -- 172.21.15.117:0/3146527751 <== osd.4 v2:172.21.15.146:6816/128066450 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f34d40c8980 con 0x7f34c0072750 2024-09-19T08:39:13.221 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T08:39:13.221 INFO:teuthology.orchestra.run.smithi117.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T08:39:13.221 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T08:39:13.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.221+0000 7f34d9227640 1 -- 172.21.15.117:0/3146527751 >> [v2:172.21.15.146:6816/128066450,v1:172.21.15.146:6817/128066450] conn(0x7f34c0072750 msgr2=0x7f34c0074b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.221+0000 7f34d9227640 1 --2- 172.21.15.117:0/3146527751 >> [v2:172.21.15.146:6816/128066450,v1:172.21.15.146:6817/128066450] conn(0x7f34c0072750 0x7f34c0074b90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.221+0000 7f34d9227640 1 -- 172.21.15.117:0/3146527751 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f34c006c2b0 msgr2=0x7f34c006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.221+0000 7f34d9227640 1 --2- 172.21.15.117:0/3146527751 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f34c006c2b0 0x7f34c006e770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f34d40b73c0 tx=0x7f34c8009040 comp rx=0 tx=0).stop 2024-09-19T08:39:13.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.221+0000 7f34d9227640 1 -- 172.21.15.117:0/3146527751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34d40d04c0 msgr2=0x7f34d40b7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.221+0000 7f34d9227640 1 --2- 172.21.15.117:0/3146527751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34d40d04c0 0x7f34d40b7b30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f34c400ca70 tx=0x7f34c400cf30 comp rx=0 tx=0).stop 2024-09-19T08:39:13.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.221+0000 7f34d359e640 1 -- 172.21.15.117:0/3146527751 reap_dead start 2024-09-19T08:39:13.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.221+0000 7f34d9227640 1 -- 172.21.15.117:0/3146527751 shutdown_connections 2024-09-19T08:39:13.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.221+0000 7f34d9227640 1 -- 172.21.15.117:0/3146527751 >> 172.21.15.117:0/3146527751 conn(0x7f34d4067fe0 msgr2=0x7f34d415cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:13.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.221+0000 7f34d9227640 1 -- 172.21.15.117:0/3146527751 shutdown_connections 2024-09-19T08:39:13.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.221+0000 7f34d9227640 1 -- 172.21.15.117:0/3146527751 wait complete. 2024-09-19T08:39:13.232 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-19T08:39:13.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.331+0000 7f208289b640 1 Processor -- start 2024-09-19T08:39:13.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.331+0000 7f208289b640 1 -- start start 2024-09-19T08:39:13.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.332+0000 7f208289b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f207c15c140 0x7f207c160650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.332+0000 7f208289b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f207c160b90 con 0x7f207c0b6650 2024-09-19T08:39:13.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.332+0000 7f208289b640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f207c15c520 con 0x7f207c06f9d0 2024-09-19T08:39:13.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.332+0000 7f208289b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f207c15c7f0 con 0x7f207c15c140 2024-09-19T08:39:13.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.332+0000 7f207bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f207c15c140 0x7f207c160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.332+0000 7f2080e38640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f207c0b6650 0x7f207c15d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50184/0 (socket says 172.21.15.117:50184) 2024-09-19T08:39:13.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.332+0000 7f207bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f207c15c140 0x7f207c160650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45678/0 (socket says 172.21.15.117:45678) 2024-09-19T08:39:13.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.332+0000 7f2080e38640 1 -- 172.21.15.117:0/2786656682 learned_addr learned my addr 172.21.15.117:0/2786656682 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:13.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.332+0000 7f207bfff640 1 -- 172.21.15.117:0/2786656682 >> v1:172.21.15.146:6789/0 conn(0x7f207c06f9d0 legacy=0x7f207c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:13.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.332+0000 7f207bfff640 1 -- 172.21.15.117:0/2786656682 >> v1:172.21.15.117:6789/0 conn(0x7f207c0b6650 legacy=0x7f207c15d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.332+0000 7f207bfff640 1 -- 172.21.15.117:0/2786656682 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f207c15cad0 con 0x7f207c15c140 2024-09-19T08:39:13.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.332+0000 7f207affd640 1 -- 172.21.15.117:0/2786656682 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3014838581 0 0) 0x7f2074001490 con 0x7f207c0b6650 2024-09-19T08:39:13.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.333+0000 7f207bfff640 1 --2- 172.21.15.117:0/2786656682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f207c15c140 0x7f207c160650 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f206c0097a0 tx=0x7f206c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95ff76d915d4914 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:13.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.333+0000 7f207affd640 1 -- 172.21.15.117:0/2786656682 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c037070 con 0x7f207c15c140 2024-09-19T08:39:13.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.333+0000 7f207affd640 1 -- 172.21.15.117:0/2786656682 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206c032440 con 0x7f207c15c140 2024-09-19T08:39:13.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.333+0000 7f207affd640 1 -- 172.21.15.117:0/2786656682 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c032810 con 0x7f207c15c140 2024-09-19T08:39:13.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.334+0000 7f208289b640 1 -- 172.21.15.117:0/2786656682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f207c15c140 msgr2=0x7f207c160650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.334+0000 7f208289b640 1 --2- 172.21.15.117:0/2786656682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f207c15c140 0x7f207c160650 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f206c0097a0 tx=0x7f206c02a1e0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.334+0000 7f208289b640 1 -- 172.21.15.117:0/2786656682 shutdown_connections 2024-09-19T08:39:13.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.334+0000 7f208289b640 1 --2- 172.21.15.117:0/2786656682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f207c15c140 0x7f207c160650 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.334+0000 7f208289b640 1 -- 172.21.15.117:0/2786656682 >> 172.21.15.117:0/2786656682 conn(0x7f207c06bc10 msgr2=0x7f207c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:13.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.334+0000 7f208289b640 1 -- 172.21.15.117:0/2786656682 shutdown_connections 2024-09-19T08:39:13.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.334+0000 7f208289b640 1 -- 172.21.15.117:0/2786656682 wait complete. 2024-09-19T08:39:13.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.335+0000 7f208289b640 1 Processor -- start 2024-09-19T08:39:13.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.335+0000 7f208289b640 1 -- start start 2024-09-19T08:39:13.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.336+0000 7f208289b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f207c06f9d0 0x7f207c142350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.336+0000 7f208289b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f207c0b6650 0x7f207c151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.336+0000 7f208289b640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f207c15c140 0x7f207c159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.336+0000 7f208289b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f207c15d370 con 0x7f207c06f9d0 2024-09-19T08:39:13.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.336+0000 7f208289b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f207c15d090 con 0x7f207c0b6650 2024-09-19T08:39:13.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.336+0000 7f208289b640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f207c15dfa0 con 0x7f207c15c140 2024-09-19T08:39:13.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.336+0000 7f207bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f207c06f9d0 0x7f207c142350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.336+0000 7f207bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f207c06f9d0 0x7f207c142350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45682/0 (socket says 172.21.15.117:45682) 2024-09-19T08:39:13.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.336+0000 7f207bfff640 1 -- 172.21.15.117:0/3858836984 learned_addr learned my addr 172.21.15.117:0/3858836984 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:13.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.336+0000 7f207b7fe640 1 --2- 172.21.15.117:0/3858836984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f207c0b6650 0x7f207c151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.336+0000 7f2080e38640 1 --2- 172.21.15.117:0/3858836984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f207c15c140 0x7f207c159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.336+0000 7f207bfff640 1 -- 172.21.15.117:0/3858836984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f207c15c140 msgr2=0x7f207c159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.336+0000 7f207bfff640 1 --2- 172.21.15.117:0/3858836984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f207c15c140 0x7f207c159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.336+0000 7f207bfff640 1 -- 172.21.15.117:0/3858836984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f207c0b6650 msgr2=0x7f207c151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.336+0000 7f207bfff640 1 --2- 172.21.15.117:0/3858836984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f207c0b6650 0x7f207c151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.336+0000 7f207bfff640 1 -- 172.21.15.117:0/3858836984 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f207c143120 con 0x7f207c06f9d0 2024-09-19T08:39:13.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.336+0000 7f207b7fe640 1 --2- 172.21.15.117:0/3858836984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f207c0b6650 0x7f207c151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:39:13.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.336+0000 7f2080e38640 1 --2- 172.21.15.117:0/3858836984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f207c15c140 0x7f207c159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:39:13.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.336+0000 7f207bfff640 1 --2- 172.21.15.117:0/3858836984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f207c06f9d0 0x7f207c142350 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f206c000c00 tx=0x7f206c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:13.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.337+0000 7f2078ff9640 1 -- 172.21.15.117:0/3858836984 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c041070 con 0x7f207c06f9d0 2024-09-19T08:39:13.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.337+0000 7f2078ff9640 1 -- 172.21.15.117:0/3858836984 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206c03c930 con 0x7f207c06f9d0 2024-09-19T08:39:13.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.337+0000 7f208289b640 1 -- 172.21.15.117:0/3858836984 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f207c143400 con 0x7f207c06f9d0 2024-09-19T08:39:13.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.337+0000 7f2078ff9640 1 -- 172.21.15.117:0/3858836984 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c037040 con 0x7f207c06f9d0 2024-09-19T08:39:13.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.337+0000 7f208289b640 1 -- 172.21.15.117:0/3858836984 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f207c1439c0 con 0x7f207c06f9d0 2024-09-19T08:39:13.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.338+0000 7f208289b640 1 -- 172.21.15.117:0/3858836984 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f207c067fc0 con 0x7f207c06f9d0 2024-09-19T08:39:13.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.338+0000 7f2078ff9640 1 -- 172.21.15.117:0/3858836984 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f206c044070 con 0x7f207c06f9d0 2024-09-19T08:39:13.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.338+0000 7f2078ff9640 1 --2- 172.21.15.117:0/3858836984 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f206806c2b0 0x7f206806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.339+0000 7f2078ff9640 1 -- 172.21.15.117:0/3858836984 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f206c0ac070 con 0x7f207c06f9d0 2024-09-19T08:39:13.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.339+0000 7f207b7fe640 1 --2- 172.21.15.117:0/3858836984 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f206806c2b0 0x7f206806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.339+0000 7f207b7fe640 1 --2- 172.21.15.117:0/3858836984 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f206806c2b0 0x7f206806e770 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f207c1f5730 tx=0x7f2070009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:13.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.343+0000 7f2078ff9640 1 -- 172.21.15.117:0/3858836984 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f206c07ab00 con 0x7f207c06f9d0 2024-09-19T08:39:13.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.509+0000 7f208289b640 1 -- 172.21.15.117:0/3858836984 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f207c0cf8e0 con 0x7f206806c2b0 2024-09-19T08:39:13.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.509+0000 7f2078ff9640 1 -- 172.21.15.117:0/3858836984 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f207c0cf8e0 con 0x7f206806c2b0 2024-09-19T08:39:13.509 INFO:teuthology.orchestra.run.smithi117.stderr:instructed osd(s) 4 to deep-scrub 2024-09-19T08:39:13.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.511+0000 7f208289b640 1 -- 172.21.15.117:0/3858836984 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f206806c2b0 msgr2=0x7f206806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.511+0000 7f208289b640 1 --2- 172.21.15.117:0/3858836984 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f206806c2b0 0x7f206806e770 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f207c1f5730 tx=0x7f2070009040 comp rx=0 tx=0).stop 2024-09-19T08:39:13.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.511+0000 7f208289b640 1 -- 172.21.15.117:0/3858836984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f207c06f9d0 msgr2=0x7f207c142350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.511+0000 7f208289b640 1 --2- 172.21.15.117:0/3858836984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f207c06f9d0 0x7f207c142350 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f206c000c00 tx=0x7f206c0046c0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.511+0000 7f208289b640 1 -- 172.21.15.117:0/3858836984 shutdown_connections 2024-09-19T08:39:13.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.511+0000 7f208289b640 1 --2- 172.21.15.117:0/3858836984 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f206806c2b0 0x7f206806e770 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.511+0000 7f208289b640 1 --2- 172.21.15.117:0/3858836984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f207c15c140 0x7f207c159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.511+0000 7f208289b640 1 --2- 172.21.15.117:0/3858836984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f207c0b6650 0x7f207c151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.511+0000 7f208289b640 1 --2- 172.21.15.117:0/3858836984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f207c06f9d0 0x7f207c142350 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.511+0000 7f208289b640 1 -- 172.21.15.117:0/3858836984 >> 172.21.15.117:0/3858836984 conn(0x7f207c06bc10 msgr2=0x7f207c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:13.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.512+0000 7f208289b640 1 -- 172.21.15.117:0/3858836984 shutdown_connections 2024-09-19T08:39:13.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.512+0000 7f208289b640 1 -- 172.21.15.117:0/3858836984 wait complete. 2024-09-19T08:39:13.522 INFO:tasks.ceph:Scrubbing osd.5 2024-09-19T08:39:13.522 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-19T08:39:13.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.624+0000 7fc6528ed640 1 Processor -- start 2024-09-19T08:39:13.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.624+0000 7fc6528ed640 1 -- start start 2024-09-19T08:39:13.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.625+0000 7fc6528ed640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc64c15b120 0x7fc64c06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.625+0000 7fc6528ed640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc64c06dec0 0x7fc64c06e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.625+0000 7fc6528ed640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc64c15b500 con 0x7fc64c0d04b0 2024-09-19T08:39:13.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.625+0000 7fc6528ed640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fc64c06e940 con 0x7fc64c15b120 2024-09-19T08:39:13.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.625+0000 7fc6528ed640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fc64c06ec20 con 0x7fc64c06dec0 2024-09-19T08:39:13.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.625+0000 7fc64bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc64c15b120 0x7fc64c06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.625+0000 7fc650e8a640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fc64c0d04b0 0x7fc64c0c5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50188/0 (socket says 172.21.15.117:50188) 2024-09-19T08:39:13.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.625+0000 7fc64bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc64c15b120 0x7fc64c06f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45684/0 (socket says 172.21.15.117:45684) 2024-09-19T08:39:13.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.625+0000 7fc650e8a640 1 -- 172.21.15.117:0/4294291792 learned_addr learned my addr 172.21.15.117:0/4294291792 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:13.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.625+0000 7fc64b7fe640 1 --2- 172.21.15.117:0/4294291792 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc64c06dec0 0x7fc64c06e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.625+0000 7fc64bfff640 1 -- 172.21.15.117:0/4294291792 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc64c06dec0 msgr2=0x7fc64c06e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:13.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.625+0000 7fc64bfff640 1 --2- 172.21.15.117:0/4294291792 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc64c06dec0 0x7fc64c06e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.625+0000 7fc64bfff640 1 -- 172.21.15.117:0/4294291792 >> v1:172.21.15.117:6789/0 conn(0x7fc64c0d04b0 legacy=0x7fc64c0c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.625+0000 7fc64bfff640 1 -- 172.21.15.117:0/4294291792 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64c06ef00 con 0x7fc64c15b120 2024-09-19T08:39:13.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.625+0000 7fc64affd640 1 -- 172.21.15.117:0/4294291792 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1368928613 0 0) 0x7fc64c15b500 con 0x7fc64c0d04b0 2024-09-19T08:39:13.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.626+0000 7fc64bfff640 1 --2- 172.21.15.117:0/4294291792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc64c15b120 0x7fc64c06f9e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0097a0 tx=0x7fc63c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3858bba3b1e9f57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:13.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.626+0000 7fc64affd640 1 -- 172.21.15.117:0/4294291792 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c037070 con 0x7fc64c15b120 2024-09-19T08:39:13.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.626+0000 7fc64affd640 1 -- 172.21.15.117:0/4294291792 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63c032440 con 0x7fc64c15b120 2024-09-19T08:39:13.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.626+0000 7fc64affd640 1 -- 172.21.15.117:0/4294291792 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c032810 con 0x7fc64c15b120 2024-09-19T08:39:13.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.627+0000 7fc6528ed640 1 -- 172.21.15.117:0/4294291792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc64c15b120 msgr2=0x7fc64c06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.627+0000 7fc6528ed640 1 --2- 172.21.15.117:0/4294291792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc64c15b120 0x7fc64c06f9e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0097a0 tx=0x7fc63c02a180 comp rx=0 tx=0).stop 2024-09-19T08:39:13.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.627+0000 7fc6528ed640 1 -- 172.21.15.117:0/4294291792 shutdown_connections 2024-09-19T08:39:13.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.627+0000 7fc6528ed640 1 --2- 172.21.15.117:0/4294291792 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc64c06dec0 0x7fc64c06e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.627+0000 7fc6528ed640 1 --2- 172.21.15.117:0/4294291792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc64c15b120 0x7fc64c06f9e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.627+0000 7fc6528ed640 1 -- 172.21.15.117:0/4294291792 >> 172.21.15.117:0/4294291792 conn(0x7fc64c06bdf0 msgr2=0x7fc64c06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:13.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.627+0000 7fc6528ed640 1 -- 172.21.15.117:0/4294291792 shutdown_connections 2024-09-19T08:39:13.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.627+0000 7fc6528ed640 1 -- 172.21.15.117:0/4294291792 wait complete. 2024-09-19T08:39:13.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.628+0000 7fc6528ed640 1 Processor -- start 2024-09-19T08:39:13.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.628+0000 7fc6528ed640 1 -- start start 2024-09-19T08:39:13.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.629+0000 7fc6528ed640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc64c06dec0 0x7fc64c150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.629+0000 7fc6528ed640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc64c0d04b0 0x7fc64c0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.629+0000 7fc6528ed640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc64c15b120 0x7fc64c0cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.629+0000 7fc6528ed640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c0ce060 con 0x7fc64c15b120 2024-09-19T08:39:13.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.629+0000 7fc6528ed640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c06f4c0 con 0x7fc64c0d04b0 2024-09-19T08:39:13.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.629+0000 7fc6528ed640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fc64c0d0900 con 0x7fc64c06dec0 2024-09-19T08:39:13.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.629+0000 7fc650e8a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc64c15b120 0x7fc64c0cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.629+0000 7fc650e8a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc64c15b120 0x7fc64c0cb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45688/0 (socket says 172.21.15.117:45688) 2024-09-19T08:39:13.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.629+0000 7fc650e8a640 1 -- 172.21.15.117:0/8507170 learned_addr learned my addr 172.21.15.117:0/8507170 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:13.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.629+0000 7fc64bfff640 1 --2- 172.21.15.117:0/8507170 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc64c06dec0 0x7fc64c150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.629+0000 7fc64b7fe640 1 --2- 172.21.15.117:0/8507170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc64c0d04b0 0x7fc64c0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.629+0000 7fc650e8a640 1 -- 172.21.15.117:0/8507170 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc64c06dec0 msgr2=0x7fc64c150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.629+0000 7fc650e8a640 1 --2- 172.21.15.117:0/8507170 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc64c06dec0 0x7fc64c150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.629+0000 7fc650e8a640 1 -- 172.21.15.117:0/8507170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc64c0d04b0 msgr2=0x7fc64c0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.629+0000 7fc650e8a640 1 --2- 172.21.15.117:0/8507170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc64c0d04b0 0x7fc64c0cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.629+0000 7fc650e8a640 1 -- 172.21.15.117:0/8507170 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64c1f4dc0 con 0x7fc64c15b120 2024-09-19T08:39:13.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.629+0000 7fc64bfff640 1 --2- 172.21.15.117:0/8507170 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc64c06dec0 0x7fc64c150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:13.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.630+0000 7fc650e8a640 1 --2- 172.21.15.117:0/8507170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc64c15b120 0x7fc64c0cb840 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc64400c7e0 tx=0x7fc64400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:13.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.630+0000 7fc648ff9640 1 -- 172.21.15.117:0/8507170 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc644018070 con 0x7fc64c15b120 2024-09-19T08:39:13.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.630+0000 7fc648ff9640 1 -- 172.21.15.117:0/8507170 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc64400a640 con 0x7fc64c15b120 2024-09-19T08:39:13.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.630+0000 7fc6528ed640 1 -- 172.21.15.117:0/8507170 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc64c1548a0 con 0x7fc64c15b120 2024-09-19T08:39:13.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.630+0000 7fc648ff9640 1 -- 172.21.15.117:0/8507170 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64400aa30 con 0x7fc64c15b120 2024-09-19T08:39:13.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.630+0000 7fc6528ed640 1 -- 172.21.15.117:0/8507170 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc64c154e60 con 0x7fc64c15b120 2024-09-19T08:39:13.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.631+0000 7fc6528ed640 1 -- 172.21.15.117:0/8507170 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc64c155240 con 0x7fc64c15b120 2024-09-19T08:39:13.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.631+0000 7fc648ff9640 1 -- 172.21.15.117:0/8507170 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc64401b070 con 0x7fc64c15b120 2024-09-19T08:39:13.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.632+0000 7fc648ff9640 1 --2- 172.21.15.117:0/8507170 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc63806c2b0 0x7fc63806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.632+0000 7fc648ff9640 1 -- 172.21.15.117:0/8507170 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fc64408a810 con 0x7fc64c15b120 2024-09-19T08:39:13.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.632+0000 7fc648ff9640 1 --2- 172.21.15.117:0/8507170 >> [v2:172.21.15.146:6824/1051984651,v1:172.21.15.146:6825/1051984651] conn(0x7fc638072750 0x7fc638074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.632+0000 7fc648ff9640 1 -- 172.21.15.117:0/8507170 --> [v2:172.21.15.146:6824/1051984651,v1:172.21.15.146:6825/1051984651] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc638075260 con 0x7fc638072750 2024-09-19T08:39:13.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.632+0000 7fc648ff9640 1 -- 172.21.15.117:0/8507170 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7fc64408f2c0 con 0x7fc64c15b120 2024-09-19T08:39:13.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.632+0000 7fc64bfff640 1 --2- 172.21.15.117:0/8507170 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc63806c2b0 0x7fc63806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.632+0000 7fc64b7fe640 1 --2- 172.21.15.117:0/8507170 >> [v2:172.21.15.146:6824/1051984651,v1:172.21.15.146:6825/1051984651] conn(0x7fc638072750 0x7fc638074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.633+0000 7fc64b7fe640 1 --2- 172.21.15.117:0/8507170 >> [v2:172.21.15.146:6824/1051984651,v1:172.21.15.146:6825/1051984651] conn(0x7fc638072750 0x7fc638074b90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:13.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.633+0000 7fc64bfff640 1 --2- 172.21.15.117:0/8507170 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc63806c2b0 0x7fc63806e770 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc63c034000 tx=0x7fc63c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:13.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.633+0000 7fc648ff9640 1 -- 172.21.15.117:0/8507170 <== osd.5 v2:172.21.15.146:6824/1051984651 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc638075260 con 0x7fc638072750 2024-09-19T08:39:13.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.646+0000 7fc6528ed640 1 -- 172.21.15.117:0/8507170 --> [v2:172.21.15.146:6824/1051984651,v1:172.21.15.146:6825/1051984651] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc64c0d0d00 con 0x7fc638072750 2024-09-19T08:39:13.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.646+0000 7fc648ff9640 1 -- 172.21.15.117:0/8507170 <== osd.5 v2:172.21.15.146:6824/1051984651 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc64c0d0d00 con 0x7fc638072750 2024-09-19T08:39:13.646 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T08:39:13.647 INFO:teuthology.orchestra.run.smithi117.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T08:39:13.647 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T08:39:13.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.646+0000 7fc6528ed640 1 -- 172.21.15.117:0/8507170 >> [v2:172.21.15.146:6824/1051984651,v1:172.21.15.146:6825/1051984651] conn(0x7fc638072750 msgr2=0x7fc638074b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.646+0000 7fc6528ed640 1 --2- 172.21.15.117:0/8507170 >> [v2:172.21.15.146:6824/1051984651,v1:172.21.15.146:6825/1051984651] conn(0x7fc638072750 0x7fc638074b90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.647+0000 7fc6528ed640 1 -- 172.21.15.117:0/8507170 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc63806c2b0 msgr2=0x7fc63806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.647+0000 7fc6528ed640 1 --2- 172.21.15.117:0/8507170 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fc63806c2b0 0x7fc63806e770 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc63c034000 tx=0x7fc63c02e000 comp rx=0 tx=0).stop 2024-09-19T08:39:13.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.647+0000 7fc6528ed640 1 -- 172.21.15.117:0/8507170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc64c15b120 msgr2=0x7fc64c0cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.647+0000 7fc6528ed640 1 --2- 172.21.15.117:0/8507170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc64c15b120 0x7fc64c0cb840 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc64400c7e0 tx=0x7fc64400cca0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.647+0000 7fc650e8a640 1 -- 172.21.15.117:0/8507170 reap_dead start 2024-09-19T08:39:13.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.647+0000 7fc6528ed640 1 -- 172.21.15.117:0/8507170 shutdown_connections 2024-09-19T08:39:13.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.647+0000 7fc6528ed640 1 -- 172.21.15.117:0/8507170 >> 172.21.15.117:0/8507170 conn(0x7fc64c06bdf0 msgr2=0x7fc64c0ceb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:13.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.647+0000 7fc6528ed640 1 -- 172.21.15.117:0/8507170 shutdown_connections 2024-09-19T08:39:13.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.647+0000 7fc6528ed640 1 -- 172.21.15.117:0/8507170 wait complete. 2024-09-19T08:39:13.657 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-19T08:39:13.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.756+0000 7f5c13c82640 1 Processor -- start 2024-09-19T08:39:13.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.756+0000 7f5c13c82640 1 -- start start 2024-09-19T08:39:13.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.757+0000 7f5c13c82640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5c0c0d21f0 0x7f5c0c0d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.757+0000 7f5c13c82640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c0c0d2b10 con 0x7f5c0c072590 2024-09-19T08:39:13.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.757+0000 7f5c13c82640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c0c1620b0 con 0x7f5c0c141ad0 2024-09-19T08:39:13.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.757+0000 7f5c13c82640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f5c0c141750 con 0x7f5c0c0d21f0 2024-09-19T08:39:13.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.757+0000 7f5c11a1e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5c0c0d21f0 0x7f5c0c0d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.757+0000 7f5c1121d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f5c0c072590 0x7f5c0c06d0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50196/0 (socket says 172.21.15.117:50196) 2024-09-19T08:39:13.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.757+0000 7f5c1121d640 1 -- 172.21.15.117:0/2956959307 learned_addr learned my addr 172.21.15.117:0/2956959307 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:13.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.758+0000 7f5c11a1e640 1 -- 172.21.15.117:0/2956959307 >> v1:172.21.15.146:6789/0 conn(0x7f5c0c141ad0 legacy=0x7f5c0c141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:13.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.758+0000 7f5c11a1e640 1 -- 172.21.15.117:0/2956959307 >> v1:172.21.15.117:6789/0 conn(0x7f5c0c072590 legacy=0x7f5c0c06d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.758+0000 7f5c11a1e640 1 -- 172.21.15.117:0/2956959307 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0c162370 con 0x7f5c0c0d21f0 2024-09-19T08:39:13.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.758+0000 7f5c10a1c640 1 -- 172.21.15.117:0/2956959307 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2164210015 0 0) 0x7f5c0c0d2b10 con 0x7f5c0c072590 2024-09-19T08:39:13.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.758+0000 7f5c11a1e640 1 --2- 172.21.15.117:0/2956959307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c0c0d21f0 0x7f5c0c0d25d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5c08009d90 tx=0x7f5c0802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4829ff5dd9d1fa25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:13.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.758+0000 7f5c10a1c640 1 -- 172.21.15.117:0/2956959307 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08031600 con 0x7f5c0c0d21f0 2024-09-19T08:39:13.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.758+0000 7f5c10a1c640 1 -- 172.21.15.117:0/2956959307 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c080317a0 con 0x7f5c0c0d21f0 2024-09-19T08:39:13.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.758+0000 7f5c10a1c640 1 -- 172.21.15.117:0/2956959307 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08031b70 con 0x7f5c0c0d21f0 2024-09-19T08:39:13.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.759+0000 7f5c13c82640 1 -- 172.21.15.117:0/2956959307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c0c0d21f0 msgr2=0x7f5c0c0d25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.759+0000 7f5c13c82640 1 --2- 172.21.15.117:0/2956959307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c0c0d21f0 0x7f5c0c0d25d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5c08009d90 tx=0x7f5c0802a610 comp rx=0 tx=0).stop 2024-09-19T08:39:13.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.759+0000 7f5c13c82640 1 -- 172.21.15.117:0/2956959307 shutdown_connections 2024-09-19T08:39:13.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.759+0000 7f5c13c82640 1 --2- 172.21.15.117:0/2956959307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c0c0d21f0 0x7f5c0c0d25d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.759+0000 7f5c13c82640 1 -- 172.21.15.117:0/2956959307 >> 172.21.15.117:0/2956959307 conn(0x7f5c0c0b3ed0 msgr2=0x7f5c0c0b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:13.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.759+0000 7f5c13c82640 1 -- 172.21.15.117:0/2956959307 shutdown_connections 2024-09-19T08:39:13.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.759+0000 7f5c13c82640 1 -- 172.21.15.117:0/2956959307 wait complete. 2024-09-19T08:39:13.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.760+0000 7f5c13c82640 1 Processor -- start 2024-09-19T08:39:13.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.760+0000 7f5c13c82640 1 -- start start 2024-09-19T08:39:13.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.761+0000 7f5c13c82640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c072590 0x7f5c0c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.761+0000 7f5c13c82640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c0c0d21f0 0x7f5c0c157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.761+0000 7f5c13c82640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c0c141ad0 0x7f5c0c0b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.761+0000 7f5c13c82640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0c162930 con 0x7f5c0c0d21f0 2024-09-19T08:39:13.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.761+0000 7f5c13c82640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0c06d7f0 con 0x7f5c0c141ad0 2024-09-19T08:39:13.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.761+0000 7f5c13c82640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f5c0c162c10 con 0x7f5c0c072590 2024-09-19T08:39:13.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.761+0000 7f5c1121d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c0c0d21f0 0x7f5c0c157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.761+0000 7f5c1121d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c0c0d21f0 0x7f5c0c157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45702/0 (socket says 172.21.15.117:45702) 2024-09-19T08:39:13.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.761+0000 7f5c1121d640 1 -- 172.21.15.117:0/2946619282 learned_addr learned my addr 172.21.15.117:0/2946619282 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:13.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.761+0000 7f5c1221f640 1 --2- 172.21.15.117:0/2946619282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c0c141ad0 0x7f5c0c0b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.761+0000 7f5c11a1e640 1 --2- 172.21.15.117:0/2946619282 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c072590 0x7f5c0c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.761+0000 7f5c1121d640 1 -- 172.21.15.117:0/2946619282 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c072590 msgr2=0x7f5c0c0ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.761+0000 7f5c1121d640 1 --2- 172.21.15.117:0/2946619282 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c072590 0x7f5c0c0ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.761+0000 7f5c1121d640 1 -- 172.21.15.117:0/2946619282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c0c141ad0 msgr2=0x7f5c0c0b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.761+0000 7f5c1121d640 1 --2- 172.21.15.117:0/2946619282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c0c141ad0 0x7f5c0c0b6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.761+0000 7f5c1121d640 1 -- 172.21.15.117:0/2946619282 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0c0aed10 con 0x7f5c0c0d21f0 2024-09-19T08:39:13.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.762+0000 7f5c1121d640 1 --2- 172.21.15.117:0/2946619282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c0c0d21f0 0x7f5c0c157a80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00c4d0 tx=0x7f5bfc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:13.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.762+0000 7f5c027fc640 1 -- 172.21.15.117:0/2946619282 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc018070 con 0x7f5c0c0d21f0 2024-09-19T08:39:13.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.762+0000 7f5c027fc640 1 -- 172.21.15.117:0/2946619282 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bfc007500 con 0x7f5c0c0d21f0 2024-09-19T08:39:13.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.762+0000 7f5c13c82640 1 -- 172.21.15.117:0/2946619282 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c0c15a900 con 0x7f5c0c0d21f0 2024-09-19T08:39:13.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.762+0000 7f5c027fc640 1 -- 172.21.15.117:0/2946619282 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc004a20 con 0x7f5c0c0d21f0 2024-09-19T08:39:13.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.762+0000 7f5c13c82640 1 -- 172.21.15.117:0/2946619282 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c0c0aeff0 con 0x7f5c0c0d21f0 2024-09-19T08:39:13.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.763+0000 7f5c13c82640 1 -- 172.21.15.117:0/2946619282 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c0c158c30 con 0x7f5c0c0d21f0 2024-09-19T08:39:13.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.763+0000 7f5c027fc640 1 -- 172.21.15.117:0/2946619282 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5bfc01b070 con 0x7f5c0c0d21f0 2024-09-19T08:39:13.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.764+0000 7f5c027fc640 1 --2- 172.21.15.117:0/2946619282 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f5bf006c2b0 0x7f5bf006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:13.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.764+0000 7f5c027fc640 1 -- 172.21.15.117:0/2946619282 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f5bfc08a5b0 con 0x7f5c0c0d21f0 2024-09-19T08:39:13.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.764+0000 7f5c11a1e640 1 --2- 172.21.15.117:0/2946619282 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f5bf006c2b0 0x7f5bf006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:13.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.765+0000 7f5c11a1e640 1 --2- 172.21.15.117:0/2946619282 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f5bf006c2b0 0x7f5bf006e770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5c08034000 tx=0x7f5c0802f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:13.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.768+0000 7f5c027fc640 1 -- 172.21.15.117:0/2946619282 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5bfc058f20 con 0x7f5c0c0d21f0 2024-09-19T08:39:13.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.934+0000 7f5c13c82640 1 -- 172.21.15.117:0/2946619282 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f5c0c072290 con 0x7f5bf006c2b0 2024-09-19T08:39:13.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.935+0000 7f5c027fc640 1 -- 172.21.15.117:0/2946619282 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5c0c072290 con 0x7f5bf006c2b0 2024-09-19T08:39:13.935 INFO:teuthology.orchestra.run.smithi117.stderr:instructed osd(s) 5 to deep-scrub 2024-09-19T08:39:13.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.937+0000 7f5c13c82640 1 -- 172.21.15.117:0/2946619282 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f5bf006c2b0 msgr2=0x7f5bf006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.937+0000 7f5c13c82640 1 --2- 172.21.15.117:0/2946619282 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f5bf006c2b0 0x7f5bf006e770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5c08034000 tx=0x7f5c0802f000 comp rx=0 tx=0).stop 2024-09-19T08:39:13.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.937+0000 7f5c13c82640 1 -- 172.21.15.117:0/2946619282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c0c0d21f0 msgr2=0x7f5c0c157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:13.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.937+0000 7f5c13c82640 1 --2- 172.21.15.117:0/2946619282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c0c0d21f0 0x7f5c0c157a80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00c4d0 tx=0x7f5bfc00c990 comp rx=0 tx=0).stop 2024-09-19T08:39:13.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.937+0000 7f5c13c82640 1 -- 172.21.15.117:0/2946619282 shutdown_connections 2024-09-19T08:39:13.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.937+0000 7f5c13c82640 1 --2- 172.21.15.117:0/2946619282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c0c141ad0 0x7f5c0c0b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.937+0000 7f5c13c82640 1 --2- 172.21.15.117:0/2946619282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c0c0d21f0 0x7f5c0c157a80 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.937+0000 7f5c13c82640 1 --2- 172.21.15.117:0/2946619282 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f5bf006c2b0 0x7f5bf006e770 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.937+0000 7f5c13c82640 1 --2- 172.21.15.117:0/2946619282 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c072590 0x7f5c0c0ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:13.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.937+0000 7f5c13c82640 1 -- 172.21.15.117:0/2946619282 >> 172.21.15.117:0/2946619282 conn(0x7f5c0c0b3ed0 msgr2=0x7f5c0c15dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:13.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.937+0000 7f5c13c82640 1 -- 172.21.15.117:0/2946619282 shutdown_connections 2024-09-19T08:39:13.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:13.937+0000 7f5c13c82640 1 -- 172.21.15.117:0/2946619282 wait complete. 2024-09-19T08:39:13.947 INFO:tasks.ceph:Scrubbing osd.6 2024-09-19T08:39:13.948 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-19T08:39:14.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.049+0000 7f768096d640 1 Processor -- start 2024-09-19T08:39:14.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.049+0000 7f768096d640 1 -- start start 2024-09-19T08:39:14.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.050+0000 7f768096d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f767c0d0bc0 0x7f767c0cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.050+0000 7f768096d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f767c0cdee0 con 0x7f767c15bee0 2024-09-19T08:39:14.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.050+0000 7f768096d640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f767c0ce1c0 con 0x7f767c15c2c0 2024-09-19T08:39:14.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.050+0000 7f768096d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f767c0ceaf0 con 0x7f767c0d0bc0 2024-09-19T08:39:14.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.050+0000 7f767a59c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f767c15bee0 0x7f767c0d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50210/0 (socket says 172.21.15.117:50210) 2024-09-19T08:39:14.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.050+0000 7f767a59c640 1 -- 172.21.15.117:0/1678363584 learned_addr learned my addr 172.21.15.117:0/1678363584 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:14.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.050+0000 7f7679d9b640 1 --2- 172.21.15.117:0/1678363584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f767c0d0bc0 0x7f767c0cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f767959a640 1 -- 172.21.15.117:0/1678363584 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 282069927 0 0) 0x7f767c0cdee0 con 0x7f767c15bee0 2024-09-19T08:39:14.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f767959a640 1 -- 172.21.15.117:0/1678363584 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7664003520 con 0x7f767c15bee0 2024-09-19T08:39:14.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f767959a640 1 -- 172.21.15.117:0/1678363584 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 550878857 0 0) 0x7f7664003520 con 0x7f767c15bee0 2024-09-19T08:39:14.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f767959a640 1 -- 172.21.15.117:0/1678363584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f767c0d0bc0 msgr2=0x7f767c0cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:14.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f767959a640 1 --2- 172.21.15.117:0/1678363584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f767c0d0bc0 0x7f767c0cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f767959a640 1 -- 172.21.15.117:0/1678363584 >> v1:172.21.15.146:6789/0 conn(0x7f767c15c2c0 legacy=0x7f767c0cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f767959a640 1 -- 172.21.15.117:0/1678363584 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767c0ce4a0 con 0x7f767c15bee0 2024-09-19T08:39:14.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f767959a640 1 -- 172.21.15.117:0/1678363584 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f766c001670 con 0x7f767c15bee0 2024-09-19T08:39:14.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f767959a640 1 -- 172.21.15.117:0/1678363584 >> v1:172.21.15.117:6789/0 conn(0x7f767c15bee0 legacy=0x7f767c0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f767959a640 1 --2- 172.21.15.117:0/1678363584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f767c0d0bc0 0x7f76640039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f767959a640 1 --2- 172.21.15.117:0/1678363584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7664003f20 0x7f7664004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f767959a640 1 --2- 172.21.15.117:0/1678363584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7664004d40 0x7f76640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f767959a640 1 -- 172.21.15.117:0/1678363584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f767c0ceaf0 con 0x7f7664003f20 2024-09-19T08:39:14.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f767959a640 1 -- 172.21.15.117:0/1678363584 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f766400ba20 con 0x7f7664004d40 2024-09-19T08:39:14.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f767959a640 1 -- 172.21.15.117:0/1678363584 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f766400bc20 con 0x7f767c0d0bc0 2024-09-19T08:39:14.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f7679d9b640 1 --2- 172.21.15.117:0/1678363584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7664003f20 0x7f7664004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f767a59c640 1 --2- 172.21.15.117:0/1678363584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f767c0d0bc0 0x7f76640039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f767ad9d640 1 --2- 172.21.15.117:0/1678363584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7664004d40 0x7f76640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f7679d9b640 1 -- 172.21.15.117:0/1678363584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f767c0d0bc0 msgr2=0x7f76640039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:14.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f7679d9b640 1 --2- 172.21.15.117:0/1678363584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f767c0d0bc0 0x7f76640039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f7679d9b640 1 -- 172.21.15.117:0/1678363584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7664004d40 msgr2=0x7f76640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:14.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f7679d9b640 1 --2- 172.21.15.117:0/1678363584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7664004d40 0x7f76640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.051+0000 7f7679d9b640 1 -- 172.21.15.117:0/1678363584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7664003520 con 0x7f7664003f20 2024-09-19T08:39:14.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.052+0000 7f7679d9b640 1 --2- 172.21.15.117:0/1678363584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7664003f20 0x7f7664004800 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f767c0cadd0 tx=0x7f7664005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d8ec2e9395d90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:14.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.052+0000 7f767959a640 1 -- 172.21.15.117:0/1678363584 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7670036070 con 0x7f7664003f20 2024-09-19T08:39:14.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.052+0000 7f767959a640 1 -- 172.21.15.117:0/1678363584 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7670031400 con 0x7f7664003f20 2024-09-19T08:39:14.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.052+0000 7f767959a640 1 -- 172.21.15.117:0/1678363584 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7670009690 con 0x7f7664003f20 2024-09-19T08:39:14.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.053+0000 7f768096d640 1 -- 172.21.15.117:0/1678363584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7664003f20 msgr2=0x7f7664004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.053+0000 7f768096d640 1 --2- 172.21.15.117:0/1678363584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7664003f20 0x7f7664004800 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f767c0cadd0 tx=0x7f7664005830 comp rx=0 tx=0).stop 2024-09-19T08:39:14.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.053+0000 7f767ad9d640 1 -- 172.21.15.117:0/1678363584 reap_dead start 2024-09-19T08:39:14.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.053+0000 7f768096d640 1 -- 172.21.15.117:0/1678363584 shutdown_connections 2024-09-19T08:39:14.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.053+0000 7f768096d640 1 -- 172.21.15.117:0/1678363584 >> 172.21.15.117:0/1678363584 conn(0x7f767c06bdf0 msgr2=0x7f767c06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:14.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.053+0000 7f768096d640 1 -- 172.21.15.117:0/1678363584 shutdown_connections 2024-09-19T08:39:14.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.053+0000 7f768096d640 1 -- 172.21.15.117:0/1678363584 wait complete. 2024-09-19T08:39:14.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.054+0000 7f768096d640 1 Processor -- start 2024-09-19T08:39:14.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.054+0000 7f768096d640 1 -- start start 2024-09-19T08:39:14.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.055+0000 7f768096d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7664003f20 0x7f767c15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.055+0000 7f768096d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f767c1601e0 0x7f767c160660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.055+0000 7f768096d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f767c1f2100 0x7f767c1f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.055+0000 7f768096d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f767c06f050 con 0x7f767c1601e0 2024-09-19T08:39:14.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.055+0000 7f768096d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f767c06eed0 con 0x7f7664003f20 2024-09-19T08:39:14.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.055+0000 7f768096d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f767c0cf200 con 0x7f767c1f2100 2024-09-19T08:39:14.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.055+0000 7f7679d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f767c1601e0 0x7f767c160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.055+0000 7f767a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7664003f20 0x7f767c15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.055+0000 7f7679d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f767c1601e0 0x7f767c160660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45724/0 (socket says 172.21.15.117:45724) 2024-09-19T08:39:14.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.055+0000 7f7679d9b640 1 -- 172.21.15.117:0/772006334 learned_addr learned my addr 172.21.15.117:0/772006334 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:14.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.055+0000 7f767ad9d640 1 --2- 172.21.15.117:0/772006334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f767c1f2100 0x7f767c1f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.055+0000 7f767a59c640 1 -- 172.21.15.117:0/772006334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f767c1f2100 msgr2=0x7f767c1f2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.055+0000 7f767a59c640 1 --2- 172.21.15.117:0/772006334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f767c1f2100 0x7f767c1f2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.055+0000 7f767a59c640 1 -- 172.21.15.117:0/772006334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f767c1601e0 msgr2=0x7f767c160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.055+0000 7f767a59c640 1 --2- 172.21.15.117:0/772006334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f767c1601e0 0x7f767c160660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.055+0000 7f767a59c640 1 -- 172.21.15.117:0/772006334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767c1580b0 con 0x7f7664003f20 2024-09-19T08:39:14.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.056+0000 7f767a59c640 1 --2- 172.21.15.117:0/772006334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7664003f20 0x7f767c15ca30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f766c000c00 tx=0x7f766c007430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:14.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.056+0000 7f766affd640 1 -- 172.21.15.117:0/772006334 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c00f7b0 con 0x7f7664003f20 2024-09-19T08:39:14.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.056+0000 7f766affd640 1 -- 172.21.15.117:0/772006334 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f766c018070 con 0x7f7664003f20 2024-09-19T08:39:14.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.056+0000 7f768096d640 1 -- 172.21.15.117:0/772006334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767c158390 con 0x7f7664003f20 2024-09-19T08:39:14.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.056+0000 7f766affd640 1 -- 172.21.15.117:0/772006334 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c00fbd0 con 0x7f7664003f20 2024-09-19T08:39:14.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.056+0000 7f768096d640 1 -- 172.21.15.117:0/772006334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f767c1f2ac0 con 0x7f7664003f20 2024-09-19T08:39:14.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.057+0000 7f768096d640 1 -- 172.21.15.117:0/772006334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f767c0d04b0 con 0x7f7664003f20 2024-09-19T08:39:14.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.058+0000 7f766affd640 1 -- 172.21.15.117:0/772006334 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f766c01d460 con 0x7f7664003f20 2024-09-19T08:39:14.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.058+0000 7f766affd640 1 --2- 172.21.15.117:0/772006334 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f765c06c2e0 0x7f765c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.058+0000 7f766affd640 1 -- 172.21.15.117:0/772006334 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f766c08bcf0 con 0x7f7664003f20 2024-09-19T08:39:14.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.058+0000 7f7679d9b640 1 --2- 172.21.15.117:0/772006334 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f765c06c2e0 0x7f765c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.058+0000 7f766affd640 1 --2- 172.21.15.117:0/772006334 >> [v2:172.21.15.146:6808/2379859639,v1:172.21.15.146:6809/2379859639] conn(0x7f765c072780 0x7f765c074bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.058+0000 7f766affd640 1 -- 172.21.15.117:0/772006334 --> [v2:172.21.15.146:6808/2379859639,v1:172.21.15.146:6809/2379859639] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f765c075290 con 0x7f765c072780 2024-09-19T08:39:14.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.058+0000 7f766affd640 1 -- 172.21.15.117:0/772006334 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f766c08c0a0 con 0x7f7664003f20 2024-09-19T08:39:14.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.058+0000 7f767ad9d640 1 --2- 172.21.15.117:0/772006334 >> [v2:172.21.15.146:6808/2379859639,v1:172.21.15.146:6809/2379859639] conn(0x7f765c072780 0x7f765c074bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.059+0000 7f7679d9b640 1 --2- 172.21.15.117:0/772006334 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f765c06c2e0 0x7f765c06e7a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f767c1513a0 tx=0x7f7670008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:14.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.059+0000 7f767ad9d640 1 --2- 172.21.15.117:0/772006334 >> [v2:172.21.15.146:6808/2379859639,v1:172.21.15.146:6809/2379859639] conn(0x7f765c072780 0x7f765c074bc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:14.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.060+0000 7f766affd640 1 -- 172.21.15.117:0/772006334 <== osd.6 v2:172.21.15.146:6808/2379859639 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f765c075290 con 0x7f765c072780 2024-09-19T08:39:14.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.072+0000 7f768096d640 1 -- 172.21.15.117:0/772006334 --> [v2:172.21.15.146:6808/2379859639,v1:172.21.15.146:6809/2379859639] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f767c0741b0 con 0x7f765c072780 2024-09-19T08:39:14.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.072+0000 7f766affd640 1 -- 172.21.15.117:0/772006334 <== osd.6 v2:172.21.15.146:6808/2379859639 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f767c0741b0 con 0x7f765c072780 2024-09-19T08:39:14.072 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T08:39:14.072 INFO:teuthology.orchestra.run.smithi117.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T08:39:14.072 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T08:39:14.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.072+0000 7f768096d640 1 -- 172.21.15.117:0/772006334 >> [v2:172.21.15.146:6808/2379859639,v1:172.21.15.146:6809/2379859639] conn(0x7f765c072780 msgr2=0x7f765c074bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.072+0000 7f768096d640 1 --2- 172.21.15.117:0/772006334 >> [v2:172.21.15.146:6808/2379859639,v1:172.21.15.146:6809/2379859639] conn(0x7f765c072780 0x7f765c074bc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.072+0000 7f768096d640 1 -- 172.21.15.117:0/772006334 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f765c06c2e0 msgr2=0x7f765c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.072+0000 7f768096d640 1 --2- 172.21.15.117:0/772006334 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f765c06c2e0 0x7f765c06e7a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f767c1513a0 tx=0x7f7670008030 comp rx=0 tx=0).stop 2024-09-19T08:39:14.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.072+0000 7f768096d640 1 -- 172.21.15.117:0/772006334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7664003f20 msgr2=0x7f767c15ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.072+0000 7f768096d640 1 --2- 172.21.15.117:0/772006334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7664003f20 0x7f767c15ca30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f766c000c00 tx=0x7f766c007430 comp rx=0 tx=0).stop 2024-09-19T08:39:14.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.072+0000 7f767ad9d640 1 -- 172.21.15.117:0/772006334 reap_dead start 2024-09-19T08:39:14.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.073+0000 7f768096d640 1 -- 172.21.15.117:0/772006334 shutdown_connections 2024-09-19T08:39:14.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.073+0000 7f768096d640 1 -- 172.21.15.117:0/772006334 >> 172.21.15.117:0/772006334 conn(0x7f767c06bdf0 msgr2=0x7f767c0cc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:14.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.073+0000 7f768096d640 1 -- 172.21.15.117:0/772006334 shutdown_connections 2024-09-19T08:39:14.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.073+0000 7f768096d640 1 -- 172.21.15.117:0/772006334 wait complete. 2024-09-19T08:39:14.083 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-19T08:39:14.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.182+0000 7f2face5e640 1 Processor -- start 2024-09-19T08:39:14.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.182+0000 7f2face5e640 1 -- start start 2024-09-19T08:39:14.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.183+0000 7f2face5e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fa815bee0 0x7f2fa80d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.183+0000 7f2face5e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2fa815c2c0 0x7f2fa80d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.183+0000 7f2face5e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fa80cdee0 con 0x7f2fa80cf200 2024-09-19T08:39:14.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.183+0000 7f2face5e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2fa80ceaf0 con 0x7f2fa815c2c0 2024-09-19T08:39:14.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.183+0000 7f2face5e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f2fa80ce1c0 con 0x7f2fa815bee0 2024-09-19T08:39:14.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.183+0000 7f2f9ffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2fa815c2c0 0x7f2fa80d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.183+0000 7f2f9ffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2fa815c2c0 0x7f2fa80d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45738/0 (socket says 172.21.15.117:45738) 2024-09-19T08:39:14.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.183+0000 7f2f9ffff640 1 -- 172.21.15.117:0/2790614743 learned_addr learned my addr 172.21.15.117:0/2790614743 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:14.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.183+0000 7f2fa6d9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f2fa80cf200 0x7f2fa80cf6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:50220/0 (socket says 172.21.15.117:50220) 2024-09-19T08:39:14.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.183+0000 7f2fa659c640 1 --2- 172.21.15.117:0/2790614743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fa815bee0 0x7f2fa80d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.183+0000 7f2f9ffff640 1 -- 172.21.15.117:0/2790614743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fa815bee0 msgr2=0x7f2fa80d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:14.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.183+0000 7f2f9ffff640 1 --2- 172.21.15.117:0/2790614743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fa815bee0 0x7f2fa80d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.183+0000 7f2f9ffff640 1 -- 172.21.15.117:0/2790614743 >> v1:172.21.15.117:6789/0 conn(0x7f2fa80cf200 legacy=0x7f2fa80cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.183+0000 7f2fa5d9b640 1 -- 172.21.15.117:0/2790614743 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1186493136 0 0) 0x7f2fa80cdee0 con 0x7f2fa80cf200 2024-09-19T08:39:14.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.183+0000 7f2f9ffff640 1 -- 172.21.15.117:0/2790614743 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa80ce4a0 con 0x7f2fa815c2c0 2024-09-19T08:39:14.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.184+0000 7f2f9ffff640 1 --2- 172.21.15.117:0/2790614743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa815c2c0 0x7f2fa80d09f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009870 tx=0x7f2f9002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dceaf9ea19eea41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:14.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.184+0000 7f2fa5d9b640 1 -- 172.21.15.117:0/2790614743 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f90037070 con 0x7f2fa815c2c0 2024-09-19T08:39:14.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.184+0000 7f2fa5d9b640 1 -- 172.21.15.117:0/2790614743 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f90032440 con 0x7f2fa815c2c0 2024-09-19T08:39:14.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.184+0000 7f2fa5d9b640 1 -- 172.21.15.117:0/2790614743 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f90032810 con 0x7f2fa815c2c0 2024-09-19T08:39:14.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.185+0000 7f2face5e640 1 -- 172.21.15.117:0/2790614743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa815c2c0 msgr2=0x7f2fa80d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.185+0000 7f2face5e640 1 --2- 172.21.15.117:0/2790614743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa815c2c0 0x7f2fa80d09f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009870 tx=0x7f2f9002a270 comp rx=0 tx=0).stop 2024-09-19T08:39:14.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.185+0000 7f2face5e640 1 -- 172.21.15.117:0/2790614743 shutdown_connections 2024-09-19T08:39:14.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.185+0000 7f2face5e640 1 --2- 172.21.15.117:0/2790614743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa815c2c0 0x7f2fa80d09f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.185+0000 7f2face5e640 1 --2- 172.21.15.117:0/2790614743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fa815bee0 0x7f2fa80d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.185+0000 7f2face5e640 1 -- 172.21.15.117:0/2790614743 >> 172.21.15.117:0/2790614743 conn(0x7f2fa806bdf0 msgr2=0x7f2fa806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:14.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.185+0000 7f2face5e640 1 -- 172.21.15.117:0/2790614743 shutdown_connections 2024-09-19T08:39:14.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.185+0000 7f2face5e640 1 -- 172.21.15.117:0/2790614743 wait complete. 2024-09-19T08:39:14.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.186+0000 7f2face5e640 1 Processor -- start 2024-09-19T08:39:14.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.186+0000 7f2face5e640 1 -- start start 2024-09-19T08:39:14.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2face5e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa80cf200 0x7f2fa80738a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2face5e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fa815bee0 0x7f2fa80cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2face5e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fa815c2c0 0x7f2fa8099520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2face5e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa806e040 con 0x7f2fa80cf200 2024-09-19T08:39:14.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2face5e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa806dec0 con 0x7f2fa815bee0 2024-09-19T08:39:14.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2face5e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f2fa806e1c0 con 0x7f2fa815c2c0 2024-09-19T08:39:14.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2fa659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa80cf200 0x7f2fa80738a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2fa659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa80cf200 0x7f2fa80738a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45746/0 (socket says 172.21.15.117:45746) 2024-09-19T08:39:14.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2fa659c640 1 -- 172.21.15.117:0/1588942232 learned_addr learned my addr 172.21.15.117:0/1588942232 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:14.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2f9ffff640 1 --2- 172.21.15.117:0/1588942232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fa815bee0 0x7f2fa80cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2fa6d9d640 1 --2- 172.21.15.117:0/1588942232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fa815c2c0 0x7f2fa8099520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2fa659c640 1 -- 172.21.15.117:0/1588942232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fa815c2c0 msgr2=0x7f2fa8099520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2fa659c640 1 --2- 172.21.15.117:0/1588942232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fa815c2c0 0x7f2fa8099520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2fa659c640 1 -- 172.21.15.117:0/1588942232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fa815bee0 msgr2=0x7f2fa80cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2fa659c640 1 --2- 172.21.15.117:0/1588942232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fa815bee0 0x7f2fa80cc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2fa659c640 1 -- 172.21.15.117:0/1588942232 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa80c5b00 con 0x7f2fa80cf200 2024-09-19T08:39:14.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2fa659c640 1 --2- 172.21.15.117:0/1588942232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa80cf200 0x7f2fa80738a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800c7f0 tx=0x7f2f9800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:14.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2f9effd640 1 -- 172.21.15.117:0/1588942232 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98015070 con 0x7f2fa80cf200 2024-09-19T08:39:14.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2f9effd640 1 -- 172.21.15.117:0/1588942232 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f98004240 con 0x7f2fa80cf200 2024-09-19T08:39:14.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2face5e640 1 -- 172.21.15.117:0/1588942232 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa80c5de0 con 0x7f2fa80cf200 2024-09-19T08:39:14.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2f9effd640 1 -- 172.21.15.117:0/1588942232 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98007620 con 0x7f2fa80cf200 2024-09-19T08:39:14.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.187+0000 7f2face5e640 1 -- 172.21.15.117:0/1588942232 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa80c63a0 con 0x7f2fa80cf200 2024-09-19T08:39:14.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.188+0000 7f2face5e640 1 -- 172.21.15.117:0/1588942232 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa80cf6b0 con 0x7f2fa80cf200 2024-09-19T08:39:14.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.189+0000 7f2f9effd640 1 -- 172.21.15.117:0/1588942232 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2f980079d0 con 0x7f2fa80cf200 2024-09-19T08:39:14.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.189+0000 7f2f9effd640 1 --2- 172.21.15.117:0/1588942232 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2f8806c2b0 0x7f2f8806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.189+0000 7f2f9effd640 1 -- 172.21.15.117:0/1588942232 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f2f9808b310 con 0x7f2fa80cf200 2024-09-19T08:39:14.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.190+0000 7f2f9ffff640 1 --2- 172.21.15.117:0/1588942232 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2f8806c2b0 0x7f2f8806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.190+0000 7f2f9ffff640 1 --2- 172.21.15.117:0/1588942232 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2f8806c2b0 0x7f2f8806e770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2f90034000 tx=0x7f2f9002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:14.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.194+0000 7f2f9effd640 1 -- 172.21.15.117:0/1588942232 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2f980595a0 con 0x7f2fa80cf200 2024-09-19T08:39:14.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.360+0000 7f2face5e640 1 -- 172.21.15.117:0/1588942232 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f2fa815f9b0 con 0x7f2f8806c2b0 2024-09-19T08:39:14.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.361+0000 7f2f9effd640 1 -- 172.21.15.117:0/1588942232 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2fa815f9b0 con 0x7f2f8806c2b0 2024-09-19T08:39:14.361 INFO:teuthology.orchestra.run.smithi117.stderr:instructed osd(s) 6 to deep-scrub 2024-09-19T08:39:14.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.363+0000 7f2face5e640 1 -- 172.21.15.117:0/1588942232 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2f8806c2b0 msgr2=0x7f2f8806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.363+0000 7f2face5e640 1 --2- 172.21.15.117:0/1588942232 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2f8806c2b0 0x7f2f8806e770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2f90034000 tx=0x7f2f9002e000 comp rx=0 tx=0).stop 2024-09-19T08:39:14.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.363+0000 7f2face5e640 1 -- 172.21.15.117:0/1588942232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa80cf200 msgr2=0x7f2fa80738a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.363+0000 7f2face5e640 1 --2- 172.21.15.117:0/1588942232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa80cf200 0x7f2fa80738a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800c7f0 tx=0x7f2f9800ccb0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.363+0000 7f2face5e640 1 -- 172.21.15.117:0/1588942232 shutdown_connections 2024-09-19T08:39:14.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.363+0000 7f2face5e640 1 --2- 172.21.15.117:0/1588942232 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2f8806c2b0 0x7f2f8806e770 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.363+0000 7f2face5e640 1 --2- 172.21.15.117:0/1588942232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fa815c2c0 0x7f2fa8099520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.363+0000 7f2face5e640 1 --2- 172.21.15.117:0/1588942232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fa815bee0 0x7f2fa80cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.363+0000 7f2face5e640 1 --2- 172.21.15.117:0/1588942232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa80cf200 0x7f2fa80738a0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.363+0000 7f2face5e640 1 -- 172.21.15.117:0/1588942232 >> 172.21.15.117:0/1588942232 conn(0x7f2fa806bdf0 msgr2=0x7f2fa80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:14.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.364+0000 7f2face5e640 1 -- 172.21.15.117:0/1588942232 shutdown_connections 2024-09-19T08:39:14.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.364+0000 7f2face5e640 1 -- 172.21.15.117:0/1588942232 wait complete. 2024-09-19T08:39:14.376 INFO:tasks.ceph:Scrubbing osd.7 2024-09-19T08:39:14.376 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-19T08:39:14.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.478+0000 7f968b28d640 1 Processor -- start 2024-09-19T08:39:14.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.478+0000 7f968b28d640 1 -- start start 2024-09-19T08:39:14.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.479+0000 7f968b28d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968415f0d0 0x7f968415f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.479+0000 7f968b28d640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f96840d4130 0x7f96840d45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.479+0000 7f968b28d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96840d4b20 con 0x7f96840d0070 2024-09-19T08:39:14.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.479+0000 7f968b28d640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 -- 0x7f96840d1b10 con 0x7f96840d4130 2024-09-19T08:39:14.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.479+0000 7f968b28d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f96840cf2b0 con 0x7f968415f0d0 2024-09-19T08:39:14.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.479+0000 7f9688828640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f96840d0070 0x7f96840d1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:40062/0 (socket says 172.21.15.117:40062) 2024-09-19T08:39:14.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.479+0000 7f9688828640 1 -- 172.21.15.117:0/4079817083 learned_addr learned my addr 172.21.15.117:0/4079817083 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:14.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f968982a640 1 --2- 172.21.15.117:0/4079817083 >> v2:172.21.15.146:3300/0 conn(0x7f96840d4130 0x7f96840d45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f9689029640 1 --2- 172.21.15.117:0/4079817083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968415f0d0 0x7f968415f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f9683fff640 1 -- 172.21.15.117:0/4079817083 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 715137134 0 0) 0x7f9678001110 con 0x7f96840d0070 2024-09-19T08:39:14.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f9683fff640 1 -- 172.21.15.117:0/4079817083 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f966c003520 con 0x7f96840d0070 2024-09-19T08:39:14.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f9683fff640 1 -- 172.21.15.117:0/4079817083 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 867067963 0 0) 0x7f966c003520 con 0x7f96840d0070 2024-09-19T08:39:14.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f9683fff640 1 -- 172.21.15.117:0/4079817083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968415f0d0 msgr2=0x7f968415f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:14.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f9683fff640 1 --2- 172.21.15.117:0/4079817083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968415f0d0 0x7f968415f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f9683fff640 1 -- 172.21.15.117:0/4079817083 >> v2:172.21.15.146:3300/0 conn(0x7f96840d4130 msgr2=0x7f96840d45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:14.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f9683fff640 1 --2- 172.21.15.117:0/4079817083 >> v2:172.21.15.146:3300/0 conn(0x7f96840d4130 0x7f96840d45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f9683fff640 1 -- 172.21.15.117:0/4079817083 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96840cf590 con 0x7f96840d0070 2024-09-19T08:39:14.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f9683fff640 1 -- 172.21.15.117:0/4079817083 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f9678001840 con 0x7f96840d0070 2024-09-19T08:39:14.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f9683fff640 1 -- 172.21.15.117:0/4079817083 >> v1:172.21.15.117:6789/0 conn(0x7f96840d0070 legacy=0x7f96840d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f9683fff640 1 --2- 172.21.15.117:0/4079817083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968415f0d0 0x7f966c0039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f9683fff640 1 --2- 172.21.15.117:0/4079817083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f966c003f50 0x7f966c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f9683fff640 1 --2- 172.21.15.117:0/4079817083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f966c004d40 0x7f966c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f9683fff640 1 -- 172.21.15.117:0/4079817083 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f96840d1b10 con 0x7f966c004d40 2024-09-19T08:39:14.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f9683fff640 1 -- 172.21.15.117:0/4079817083 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f96840cf2b0 con 0x7f966c003f50 2024-09-19T08:39:14.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f9683fff640 1 -- 172.21.15.117:0/4079817083 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f966c00ba40 con 0x7f968415f0d0 2024-09-19T08:39:14.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f968982a640 1 --2- 172.21.15.117:0/4079817083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f966c004d40 0x7f966c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f9689029640 1 --2- 172.21.15.117:0/4079817083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968415f0d0 0x7f966c0039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f9688828640 1 --2- 172.21.15.117:0/4079817083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f966c003f50 0x7f966c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f968982a640 1 -- 172.21.15.117:0/4079817083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968415f0d0 msgr2=0x7f966c0039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:14.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f968982a640 1 --2- 172.21.15.117:0/4079817083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968415f0d0 0x7f966c0039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f968982a640 1 -- 172.21.15.117:0/4079817083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f966c003f50 msgr2=0x7f966c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:14.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f968982a640 1 --2- 172.21.15.117:0/4079817083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f966c003f50 0x7f966c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f968982a640 1 -- 172.21.15.117:0/4079817083 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966c003520 con 0x7f966c004d40 2024-09-19T08:39:14.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.480+0000 7f9688828640 1 --2- 172.21.15.117:0/4079817083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f966c003f50 0x7f966c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:14.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.481+0000 7f968982a640 1 --2- 172.21.15.117:0/4079817083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f966c004d40 0x7f966c0051c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9674009fc0 tx=0x7f966c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3131b586aafed5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:14.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.481+0000 7f9683fff640 1 -- 172.21.15.117:0/4079817083 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9674009c10 con 0x7f966c004d40 2024-09-19T08:39:14.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.481+0000 7f9683fff640 1 -- 172.21.15.117:0/4079817083 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9674036070 con 0x7f966c004d40 2024-09-19T08:39:14.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.481+0000 7f9683fff640 1 -- 172.21.15.117:0/4079817083 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967402d070 con 0x7f966c004d40 2024-09-19T08:39:14.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.482+0000 7f968b28d640 1 -- 172.21.15.117:0/4079817083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f966c004d40 msgr2=0x7f966c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.482+0000 7f968b28d640 1 --2- 172.21.15.117:0/4079817083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f966c004d40 0x7f966c0051c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9674009fc0 tx=0x7f966c005830 comp rx=0 tx=0).stop 2024-09-19T08:39:14.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.482+0000 7f968982a640 1 -- 172.21.15.117:0/4079817083 reap_dead start 2024-09-19T08:39:14.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.482+0000 7f968b28d640 1 -- 172.21.15.117:0/4079817083 shutdown_connections 2024-09-19T08:39:14.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.482+0000 7f968b28d640 1 -- 172.21.15.117:0/4079817083 >> 172.21.15.117:0/4079817083 conn(0x7f968409d760 msgr2=0x7f968408bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:14.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.482+0000 7f968b28d640 1 -- 172.21.15.117:0/4079817083 shutdown_connections 2024-09-19T08:39:14.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.482+0000 7f968b28d640 1 -- 172.21.15.117:0/4079817083 wait complete. 2024-09-19T08:39:14.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.483+0000 7f968b28d640 1 Processor -- start 2024-09-19T08:39:14.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.483+0000 7f968b28d640 1 -- start start 2024-09-19T08:39:14.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.484+0000 7f968b28d640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f966c004d40 0x7f96840cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.484+0000 7f968b28d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96840c7ef0 0x7f96840c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.484+0000 7f968b28d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96840b93d0 0x7f96840b9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.484+0000 7f968b28d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f96840cef60 con 0x7f96840c7ef0 2024-09-19T08:39:14.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.484+0000 7f968b28d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f96840cfb50 con 0x7f96840b93d0 2024-09-19T08:39:14.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.484+0000 7f968b28d640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f968415f4b0 con 0x7f966c004d40 2024-09-19T08:39:14.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.484+0000 7f9688828640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96840c7ef0 0x7f96840c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.484+0000 7f9688828640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96840c7ef0 0x7f96840c8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33244/0 (socket says 172.21.15.117:33244) 2024-09-19T08:39:14.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.484+0000 7f9688828640 1 -- 172.21.15.117:0/3070368510 learned_addr learned my addr 172.21.15.117:0/3070368510 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:14.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.484+0000 7f9689029640 1 --2- 172.21.15.117:0/3070368510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f966c004d40 0x7f96840cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.484+0000 7f968982a640 1 --2- 172.21.15.117:0/3070368510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96840b93d0 0x7f96840b9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.484+0000 7f9688828640 1 -- 172.21.15.117:0/3070368510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f966c004d40 msgr2=0x7f96840cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.484+0000 7f9688828640 1 --2- 172.21.15.117:0/3070368510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f966c004d40 0x7f96840cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.484+0000 7f9688828640 1 -- 172.21.15.117:0/3070368510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96840b93d0 msgr2=0x7f96840b9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.484+0000 7f9688828640 1 --2- 172.21.15.117:0/3070368510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96840b93d0 0x7f96840b9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.484+0000 7f9688828640 1 -- 172.21.15.117:0/3070368510 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96840cc3e0 con 0x7f96840c7ef0 2024-09-19T08:39:14.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.484+0000 7f968982a640 1 --2- 172.21.15.117:0/3070368510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96840b93d0 0x7f96840b9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:14.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.484+0000 7f9688828640 1 --2- 172.21.15.117:0/3070368510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96840c7ef0 0x7f96840c8370 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f967800e820 tx=0x7f967800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:14.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.484+0000 7f9681ffb640 1 -- 172.21.15.117:0/3070368510 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967800ee70 con 0x7f96840c7ef0 2024-09-19T08:39:14.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.485+0000 7f9681ffb640 1 -- 172.21.15.117:0/3070368510 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9678018070 con 0x7f96840c7ef0 2024-09-19T08:39:14.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.485+0000 7f9681ffb640 1 -- 172.21.15.117:0/3070368510 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967800ca70 con 0x7f96840c7ef0 2024-09-19T08:39:14.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.485+0000 7f968b28d640 1 -- 172.21.15.117:0/3070368510 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96840b8510 con 0x7f96840c7ef0 2024-09-19T08:39:14.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.485+0000 7f968b28d640 1 -- 172.21.15.117:0/3070368510 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96840b88f0 con 0x7f96840c7ef0 2024-09-19T08:39:14.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.485+0000 7f968b28d640 1 -- 172.21.15.117:0/3070368510 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f96840b8740 con 0x7f96840c7ef0 2024-09-19T08:39:14.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.486+0000 7f9681ffb640 1 -- 172.21.15.117:0/3070368510 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f967800cc10 con 0x7f96840c7ef0 2024-09-19T08:39:14.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.486+0000 7f9681ffb640 1 --2- 172.21.15.117:0/3070368510 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f967006c2b0 0x7f967006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.487+0000 7f9681ffb640 1 -- 172.21.15.117:0/3070368510 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f967808b020 con 0x7f96840c7ef0 2024-09-19T08:39:14.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.487+0000 7f9689029640 1 --2- 172.21.15.117:0/3070368510 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f967006c2b0 0x7f967006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.487+0000 7f9681ffb640 1 --2- 172.21.15.117:0/3070368510 >> [v2:172.21.15.146:6800/3875302444,v1:172.21.15.146:6801/3875302444] conn(0x7f9670072750 0x7f9670074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.487+0000 7f9681ffb640 1 -- 172.21.15.117:0/3070368510 --> [v2:172.21.15.146:6800/3875302444,v1:172.21.15.146:6801/3875302444] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9678011e50 con 0x7f9670072750 2024-09-19T08:39:14.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.487+0000 7f9681ffb640 1 -- 172.21.15.117:0/3070368510 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f9678092050 con 0x7f96840c7ef0 2024-09-19T08:39:14.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.487+0000 7f968982a640 1 --2- 172.21.15.117:0/3070368510 >> [v2:172.21.15.146:6800/3875302444,v1:172.21.15.146:6801/3875302444] conn(0x7f9670072750 0x7f9670074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.487+0000 7f9689029640 1 --2- 172.21.15.117:0/3070368510 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f967006c2b0 0x7f967006e770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f96840b75c0 tx=0x7f967c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:14.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.487+0000 7f968982a640 1 --2- 172.21.15.117:0/3070368510 >> [v2:172.21.15.146:6800/3875302444,v1:172.21.15.146:6801/3875302444] conn(0x7f9670072750 0x7f9670074b90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:14.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.488+0000 7f9681ffb640 1 -- 172.21.15.117:0/3070368510 <== osd.7 v2:172.21.15.146:6800/3875302444 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9678011e50 con 0x7f9670072750 2024-09-19T08:39:14.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.501+0000 7f968b28d640 1 -- 172.21.15.117:0/3070368510 --> [v2:172.21.15.146:6800/3875302444,v1:172.21.15.146:6801/3875302444] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f96840cd3d0 con 0x7f9670072750 2024-09-19T08:39:14.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.501+0000 7f9681ffb640 1 -- 172.21.15.117:0/3070368510 <== osd.7 v2:172.21.15.146:6800/3875302444 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9674036040 con 0x7f9670072750 2024-09-19T08:39:14.501 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T08:39:14.501 INFO:teuthology.orchestra.run.smithi117.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T08:39:14.502 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T08:39:14.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.502+0000 7f968b28d640 1 -- 172.21.15.117:0/3070368510 >> [v2:172.21.15.146:6800/3875302444,v1:172.21.15.146:6801/3875302444] conn(0x7f9670072750 msgr2=0x7f9670074b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.502+0000 7f968b28d640 1 --2- 172.21.15.117:0/3070368510 >> [v2:172.21.15.146:6800/3875302444,v1:172.21.15.146:6801/3875302444] conn(0x7f9670072750 0x7f9670074b90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.502+0000 7f968b28d640 1 -- 172.21.15.117:0/3070368510 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f967006c2b0 msgr2=0x7f967006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.502+0000 7f968b28d640 1 --2- 172.21.15.117:0/3070368510 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f967006c2b0 0x7f967006e770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f96840b75c0 tx=0x7f967c009190 comp rx=0 tx=0).stop 2024-09-19T08:39:14.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.502+0000 7f968b28d640 1 -- 172.21.15.117:0/3070368510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96840c7ef0 msgr2=0x7f96840c8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.502+0000 7f968b28d640 1 --2- 172.21.15.117:0/3070368510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96840c7ef0 0x7f96840c8370 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f967800e820 tx=0x7f967800ec20 comp rx=0 tx=0).stop 2024-09-19T08:39:14.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.502+0000 7f968982a640 1 -- 172.21.15.117:0/3070368510 reap_dead start 2024-09-19T08:39:14.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.502+0000 7f968b28d640 1 -- 172.21.15.117:0/3070368510 shutdown_connections 2024-09-19T08:39:14.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.502+0000 7f968b28d640 1 -- 172.21.15.117:0/3070368510 >> 172.21.15.117:0/3070368510 conn(0x7f968409d760 msgr2=0x7f968408bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:14.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.502+0000 7f968b28d640 1 -- 172.21.15.117:0/3070368510 shutdown_connections 2024-09-19T08:39:14.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.502+0000 7f968b28d640 1 -- 172.21.15.117:0/3070368510 wait complete. 2024-09-19T08:39:14.512 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-19T08:39:14.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.611+0000 7f2af3837640 1 Processor -- start 2024-09-19T08:39:14.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.612+0000 7f2af3837640 1 -- start start 2024-09-19T08:39:14.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.612+0000 7f2af3837640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2aec15f0d0 0x7f2aec15f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.612+0000 7f2af3837640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2aec0d4130 0x7f2aec0d45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.612+0000 7f2af3837640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2aec0d4b20 con 0x7f2aec0d0070 2024-09-19T08:39:14.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.612+0000 7f2af3837640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7f2aec0d1b10 con 0x7f2aec0d4130 2024-09-19T08:39:14.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.612+0000 7f2af3837640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f2aec0cf2b0 con 0x7f2aec15f0d0 2024-09-19T08:39:14.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.612+0000 7f2af1dd4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2aec0d4130 0x7f2aec0d45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.612+0000 7f2af1dd4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2aec0d4130 0x7f2aec0d45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33258/0 (socket says 172.21.15.117:33258) 2024-09-19T08:39:14.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.612+0000 7f2af1dd4640 1 -- 172.21.15.117:0/2235468412 learned_addr learned my addr 172.21.15.117:0/2235468412 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:14.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.613+0000 7f2af15d3640 1 --2- 172.21.15.117:0/2235468412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2aec15f0d0 0x7f2aec15f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.613+0000 7f2af1dd4640 1 -- 172.21.15.117:0/2235468412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2aec15f0d0 msgr2=0x7f2aec15f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:14.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.613+0000 7f2af1dd4640 1 --2- 172.21.15.117:0/2235468412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2aec15f0d0 0x7f2aec15f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.613+0000 7f2af1dd4640 1 -- 172.21.15.117:0/2235468412 >> v1:172.21.15.146:6789/0 conn(0x7f2aec0d0070 legacy=0x7f2aec0d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:14.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.613+0000 7f2af1dd4640 1 -- 172.21.15.117:0/2235468412 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aec0cf590 con 0x7f2aec0d4130 2024-09-19T08:39:14.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.613+0000 7f2af1dd4640 1 --2- 172.21.15.117:0/2235468412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2aec0d4130 0x7f2aec0d45e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0d2fc0 tx=0x7f2ae402a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baeafd03c768fc14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:14.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.614+0000 7f2aebfff640 1 -- 172.21.15.117:0/2235468412 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4037070 con 0x7f2aec0d4130 2024-09-19T08:39:14.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.614+0000 7f2aebfff640 1 -- 172.21.15.117:0/2235468412 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae4032440 con 0x7f2aec0d4130 2024-09-19T08:39:14.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.614+0000 7f2aebfff640 1 -- 172.21.15.117:0/2235468412 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4032810 con 0x7f2aec0d4130 2024-09-19T08:39:14.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.614+0000 7f2af3837640 1 -- 172.21.15.117:0/2235468412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2aec0d4130 msgr2=0x7f2aec0d45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.614+0000 7f2af3837640 1 --2- 172.21.15.117:0/2235468412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2aec0d4130 0x7f2aec0d45e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0d2fc0 tx=0x7f2ae402a160 comp rx=0 tx=0).stop 2024-09-19T08:39:14.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.614+0000 7f2af3837640 1 -- 172.21.15.117:0/2235468412 shutdown_connections 2024-09-19T08:39:14.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.614+0000 7f2af3837640 1 --2- 172.21.15.117:0/2235468412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2aec0d4130 0x7f2aec0d45e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.614+0000 7f2af3837640 1 --2- 172.21.15.117:0/2235468412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2aec15f0d0 0x7f2aec15f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.614+0000 7f2af3837640 1 -- 172.21.15.117:0/2235468412 >> 172.21.15.117:0/2235468412 conn(0x7f2aec09d760 msgr2=0x7f2aec08bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:14.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.614+0000 7f2af3837640 1 -- 172.21.15.117:0/2235468412 shutdown_connections 2024-09-19T08:39:14.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.614+0000 7f2af3837640 1 -- 172.21.15.117:0/2235468412 wait complete. 2024-09-19T08:39:14.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.615+0000 7f2af3837640 1 Processor -- start 2024-09-19T08:39:14.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.615+0000 7f2af3837640 1 -- start start 2024-09-19T08:39:14.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.616+0000 7f2af3837640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2aec0d0070 0x7f2aec0b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.616+0000 7f2af3837640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2aec0d4130 0x7f2aec0cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.616+0000 7f2af3837640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2aec15f0d0 0x7f2aec14d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.616+0000 7f2af3837640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec0cef60 con 0x7f2aec0d0070 2024-09-19T08:39:14.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.616+0000 7f2af3837640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec0cfb50 con 0x7f2aec0d4130 2024-09-19T08:39:14.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.616+0000 7f2af3837640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f2aec0b2f70 con 0x7f2aec15f0d0 2024-09-19T08:39:14.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.616+0000 7f2af15d3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2aec0d0070 0x7f2aec0b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.616+0000 7f2af15d3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2aec0d0070 0x7f2aec0b33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33266/0 (socket says 172.21.15.117:33266) 2024-09-19T08:39:14.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.616+0000 7f2af15d3640 1 -- 172.21.15.117:0/3090794442 learned_addr learned my addr 172.21.15.117:0/3090794442 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:14.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.616+0000 7f2af0dd2640 1 --2- 172.21.15.117:0/3090794442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2aec0d4130 0x7f2aec0cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.616+0000 7f2af1dd4640 1 --2- 172.21.15.117:0/3090794442 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2aec15f0d0 0x7f2aec14d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.616+0000 7f2af15d3640 1 -- 172.21.15.117:0/3090794442 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2aec15f0d0 msgr2=0x7f2aec14d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.616+0000 7f2af15d3640 1 --2- 172.21.15.117:0/3090794442 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2aec15f0d0 0x7f2aec14d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.616+0000 7f2af15d3640 1 -- 172.21.15.117:0/3090794442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2aec0d4130 msgr2=0x7f2aec0cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.616+0000 7f2af15d3640 1 --2- 172.21.15.117:0/3090794442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2aec0d4130 0x7f2aec0cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.616+0000 7f2af15d3640 1 -- 172.21.15.117:0/3090794442 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aec0b3c20 con 0x7f2aec0d0070 2024-09-19T08:39:14.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.616+0000 7f2af0dd2640 1 --2- 172.21.15.117:0/3090794442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2aec0d4130 0x7f2aec0cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:14.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.617+0000 7f2af15d3640 1 --2- 172.21.15.117:0/3090794442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2aec0d0070 0x7f2aec0b33d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00ccd0 tx=0x7f2adc00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:14.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.617+0000 7f2ae9ffb640 1 -- 172.21.15.117:0/3090794442 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2adc003990 con 0x7f2aec0d0070 2024-09-19T08:39:14.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.617+0000 7f2ae9ffb640 1 -- 172.21.15.117:0/3090794442 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2adc003b30 con 0x7f2aec0d0070 2024-09-19T08:39:14.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.617+0000 7f2ae9ffb640 1 -- 172.21.15.117:0/3090794442 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2adc004020 con 0x7f2aec0d0070 2024-09-19T08:39:14.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.617+0000 7f2af3837640 1 -- 172.21.15.117:0/3090794442 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aec0b3f00 con 0x7f2aec0d0070 2024-09-19T08:39:14.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.617+0000 7f2af3837640 1 -- 172.21.15.117:0/3090794442 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aec0b44c0 con 0x7f2aec0d0070 2024-09-19T08:39:14.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.618+0000 7f2af3837640 1 -- 172.21.15.117:0/3090794442 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aec0d45e0 con 0x7f2aec0d0070 2024-09-19T08:39:14.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.618+0000 7f2ae9ffb640 1 -- 172.21.15.117:0/3090794442 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2adc0041c0 con 0x7f2aec0d0070 2024-09-19T08:39:14.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.619+0000 7f2ae9ffb640 1 --2- 172.21.15.117:0/3090794442 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2ad806c2b0 0x7f2ad806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.619+0000 7f2ae9ffb640 1 -- 172.21.15.117:0/3090794442 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f2adc08b7e0 con 0x7f2aec0d0070 2024-09-19T08:39:14.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.619+0000 7f2af0dd2640 1 --2- 172.21.15.117:0/3090794442 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2ad806c2b0 0x7f2ad806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.619+0000 7f2af0dd2640 1 --2- 172.21.15.117:0/3090794442 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2ad806c2b0 0x7f2ad806e770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0d30d0 tx=0x7f2ae0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:14.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.623+0000 7f2ae9ffb640 1 -- 172.21.15.117:0/3090794442 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2adc014030 con 0x7f2aec0d0070 2024-09-19T08:39:14.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.787+0000 7f2af3837640 1 -- 172.21.15.117:0/3090794442 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f2aec0b4cc0 con 0x7f2ad806c2b0 2024-09-19T08:39:14.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.788+0000 7f2ae9ffb640 1 -- 172.21.15.117:0/3090794442 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2aec0b4cc0 con 0x7f2ad806c2b0 2024-09-19T08:39:14.788 INFO:teuthology.orchestra.run.smithi117.stderr:instructed osd(s) 7 to deep-scrub 2024-09-19T08:39:14.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.790+0000 7f2af3837640 1 -- 172.21.15.117:0/3090794442 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2ad806c2b0 msgr2=0x7f2ad806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.790+0000 7f2af3837640 1 --2- 172.21.15.117:0/3090794442 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2ad806c2b0 0x7f2ad806e770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0d30d0 tx=0x7f2ae0009040 comp rx=0 tx=0).stop 2024-09-19T08:39:14.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.790+0000 7f2af3837640 1 -- 172.21.15.117:0/3090794442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2aec0d0070 msgr2=0x7f2aec0b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.790+0000 7f2af3837640 1 --2- 172.21.15.117:0/3090794442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2aec0d0070 0x7f2aec0b33d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00ccd0 tx=0x7f2adc00a5c0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.790+0000 7f2af3837640 1 -- 172.21.15.117:0/3090794442 shutdown_connections 2024-09-19T08:39:14.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.790+0000 7f2af3837640 1 --2- 172.21.15.117:0/3090794442 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f2ad806c2b0 0x7f2ad806e770 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.790+0000 7f2af3837640 1 --2- 172.21.15.117:0/3090794442 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2aec15f0d0 0x7f2aec14d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.790+0000 7f2af3837640 1 --2- 172.21.15.117:0/3090794442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2aec0d4130 0x7f2aec0cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.790+0000 7f2af3837640 1 --2- 172.21.15.117:0/3090794442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2aec0d0070 0x7f2aec0b33d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.790+0000 7f2af3837640 1 -- 172.21.15.117:0/3090794442 >> 172.21.15.117:0/3090794442 conn(0x7f2aec09d760 msgr2=0x7f2aec0b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:14.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.790+0000 7f2af3837640 1 -- 172.21.15.117:0/3090794442 shutdown_connections 2024-09-19T08:39:14.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.790+0000 7f2af3837640 1 -- 172.21.15.117:0/3090794442 wait complete. 2024-09-19T08:39:14.801 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:39:14.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.899+0000 7f27f1ff6640 1 Processor -- start 2024-09-19T08:39:14.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.899+0000 7f27f1ff6640 1 -- start start 2024-09-19T08:39:14.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.900+0000 7f27f1ff6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27ec0d0540 0x7f27ec141a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.900+0000 7f27f1ff6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27ec15d710 con 0x7f27ec141680 2024-09-19T08:39:14.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.900+0000 7f27f1ff6640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27ec15c950 con 0x7f27ec141fa0 2024-09-19T08:39:14.902 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.900+0000 7f27f1ff6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f27ec15c6f0 con 0x7f27ec0d0540 2024-09-19T08:39:14.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.900+0000 7f27eb7fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f27ec141680 0x7f27ec0cfe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:40078/0 (socket says 172.21.15.117:40078) 2024-09-19T08:39:14.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.900+0000 7f27eb7fe640 1 -- 172.21.15.117:0/1867913128 learned_addr learned my addr 172.21.15.117:0/1867913128 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:14.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.900+0000 7f27eaffd640 1 --2- 172.21.15.117:0/1867913128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27ec0d0540 0x7f27ec141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.900+0000 7f27ea7fc640 1 -- 172.21.15.117:0/1867913128 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2624537665 0 0) 0x7f27ec15d710 con 0x7f27ec141680 2024-09-19T08:39:14.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.900+0000 7f27ea7fc640 1 -- 172.21.15.117:0/1867913128 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27d4003520 con 0x7f27ec141680 2024-09-19T08:39:14.903 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.901+0000 7f27eaffd640 1 -- 172.21.15.117:0/1867913128 >> v1:172.21.15.146:6789/0 conn(0x7f27ec141fa0 legacy=0x7f27ec13f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.901+0000 7f27ea7fc640 1 -- 172.21.15.117:0/1867913128 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3404710007 0 0) 0x7f27ec15c950 con 0x7f27ec141fa0 2024-09-19T08:39:14.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.901+0000 7f27eaffd640 1 -- 172.21.15.117:0/1867913128 >> v1:172.21.15.117:6789/0 conn(0x7f27ec141680 legacy=0x7f27ec0cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.901+0000 7f27eaffd640 1 -- 172.21.15.117:0/1867913128 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ec15cc30 con 0x7f27ec0d0540 2024-09-19T08:39:14.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.901+0000 7f27eaffd640 1 --2- 172.21.15.117:0/1867913128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27ec0d0540 0x7f27ec141a60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f27e00097d0 tx=0x7f27e002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baacfb03fa7667d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:14.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.902+0000 7f27ea7fc640 1 -- 172.21.15.117:0/1867913128 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e0037070 con 0x7f27ec0d0540 2024-09-19T08:39:14.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.902+0000 7f27ea7fc640 1 -- 172.21.15.117:0/1867913128 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e002ac10 con 0x7f27ec0d0540 2024-09-19T08:39:14.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.902+0000 7f27ea7fc640 1 -- 172.21.15.117:0/1867913128 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc0019f0 con 0x7f27ec0d0540 2024-09-19T08:39:14.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.902+0000 7f27f1ff6640 1 -- 172.21.15.117:0/1867913128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27ec0d0540 msgr2=0x7f27ec141a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.902+0000 7f27f1ff6640 1 --2- 172.21.15.117:0/1867913128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27ec0d0540 0x7f27ec141a60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f27e00097d0 tx=0x7f27e002a180 comp rx=0 tx=0).stop 2024-09-19T08:39:14.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.902+0000 7f27f1ff6640 1 -- 172.21.15.117:0/1867913128 shutdown_connections 2024-09-19T08:39:14.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.902+0000 7f27f1ff6640 1 --2- 172.21.15.117:0/1867913128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27ec0d0540 0x7f27ec141a60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.902+0000 7f27f1ff6640 1 -- 172.21.15.117:0/1867913128 >> 172.21.15.117:0/1867913128 conn(0x7f27ec0b3ed0 msgr2=0x7f27ec0b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:14.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.902+0000 7f27f1ff6640 1 -- 172.21.15.117:0/1867913128 shutdown_connections 2024-09-19T08:39:14.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.902+0000 7f27f1ff6640 1 -- 172.21.15.117:0/1867913128 wait complete. 2024-09-19T08:39:14.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.903+0000 7f27f1ff6640 1 Processor -- start 2024-09-19T08:39:14.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.904+0000 7f27f1ff6640 1 -- start start 2024-09-19T08:39:14.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.904+0000 7f27f1ff6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27ec0d0540 0x7f27ec0cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.904+0000 7f27f1ff6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27ec141680 0x7f27ec0c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.904+0000 7f27f1ff6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27ec141fa0 0x7f27ec0c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.904+0000 7f27f1ff6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec142430 con 0x7f27ec141fa0 2024-09-19T08:39:14.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.904+0000 7f27f1ff6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec15d1f0 con 0x7f27ec141680 2024-09-19T08:39:14.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.904+0000 7f27f1ff6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f27ec1425b0 con 0x7f27ec0d0540 2024-09-19T08:39:14.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.904+0000 7f27ebfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27ec141fa0 0x7f27ec0c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.904+0000 7f27ebfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27ec141fa0 0x7f27ec0c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33276/0 (socket says 172.21.15.117:33276) 2024-09-19T08:39:14.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.904+0000 7f27ebfff640 1 -- 172.21.15.117:0/2917827092 learned_addr learned my addr 172.21.15.117:0/2917827092 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:14.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.904+0000 7f27eaffd640 1 --2- 172.21.15.117:0/2917827092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27ec141680 0x7f27ec0c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.904+0000 7f27eb7fe640 1 --2- 172.21.15.117:0/2917827092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27ec0d0540 0x7f27ec0cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.905+0000 7f27ebfff640 1 -- 172.21.15.117:0/2917827092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27ec0d0540 msgr2=0x7f27ec0cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.905+0000 7f27ebfff640 1 --2- 172.21.15.117:0/2917827092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27ec0d0540 0x7f27ec0cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.905+0000 7f27ebfff640 1 -- 172.21.15.117:0/2917827092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27ec141680 msgr2=0x7f27ec0c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:14.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.905+0000 7f27ebfff640 1 --2- 172.21.15.117:0/2917827092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27ec141680 0x7f27ec0c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:14.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.905+0000 7f27ebfff640 1 -- 172.21.15.117:0/2917827092 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ec0cc5b0 con 0x7f27ec141fa0 2024-09-19T08:39:14.910 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.905+0000 7f27eb7fe640 1 --2- 172.21.15.117:0/2917827092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27ec0d0540 0x7f27ec0cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:14.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.905+0000 7f27eaffd640 1 --2- 172.21.15.117:0/2917827092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27ec141680 0x7f27ec0c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:14.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.905+0000 7f27ebfff640 1 --2- 172.21.15.117:0/2917827092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27ec141fa0 0x7f27ec0c86d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f27e400c3e0 tx=0x7f27e400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:14.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.905+0000 7f27d3fff640 1 -- 172.21.15.117:0/2917827092 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e4017070 con 0x7f27ec141fa0 2024-09-19T08:39:14.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.905+0000 7f27d3fff640 1 -- 172.21.15.117:0/2917827092 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e40035f0 con 0x7f27ec141fa0 2024-09-19T08:39:14.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.905+0000 7f27f1ff6640 1 -- 172.21.15.117:0/2917827092 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27ec158bd0 con 0x7f27ec141fa0 2024-09-19T08:39:14.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.905+0000 7f27d3fff640 1 -- 172.21.15.117:0/2917827092 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e40039e0 con 0x7f27ec141fa0 2024-09-19T08:39:14.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.905+0000 7f27f1ff6640 1 -- 172.21.15.117:0/2917827092 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27ec159190 con 0x7f27ec141fa0 2024-09-19T08:39:14.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.906+0000 7f27f1ff6640 1 -- 172.21.15.117:0/2917827092 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27ec141a60 con 0x7f27ec141fa0 2024-09-19T08:39:14.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.906+0000 7f27d3fff640 1 -- 172.21.15.117:0/2917827092 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f27e401a070 con 0x7f27ec141fa0 2024-09-19T08:39:14.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.907+0000 7f27d3fff640 1 --2- 172.21.15.117:0/2917827092 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f27d806c2b0 0x7f27d806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:14.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.907+0000 7f27d3fff640 1 -- 172.21.15.117:0/2917827092 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f27e408a660 con 0x7f27ec141fa0 2024-09-19T08:39:14.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.907+0000 7f27eb7fe640 1 --2- 172.21.15.117:0/2917827092 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f27d806c2b0 0x7f27d806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:14.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.907+0000 7f27eb7fe640 1 --2- 172.21.15.117:0/2917827092 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f27d806c2b0 0x7f27d806e770 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f27dc002180 tx=0x7f27dc005b70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:14.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:14.911+0000 7f27d3fff640 1 -- 172.21.15.117:0/2917827092 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f27e4058f40 con 0x7f27ec141fa0 2024-09-19T08:39:15.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:15.074+0000 7f27f1ff6640 1 -- 172.21.15.117:0/2917827092 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f27ec0690c0 con 0x7f27d806c2b0 2024-09-19T08:39:15.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:15.075+0000 7f27d3fff640 1 -- 172.21.15.117:0/2917827092 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13483 (secure 0 0 0) 0x7f27ec0690c0 con 0x7f27d806c2b0 2024-09-19T08:39:15.075 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:39:15.076 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-09-19T08:39:15.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:15.077+0000 7f27f1ff6640 1 -- 172.21.15.117:0/2917827092 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f27d806c2b0 msgr2=0x7f27d806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:15.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:15.077+0000 7f27f1ff6640 1 --2- 172.21.15.117:0/2917827092 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f27d806c2b0 0x7f27d806e770 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f27dc002180 tx=0x7f27dc005b70 comp rx=0 tx=0).stop 2024-09-19T08:39:15.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:15.077+0000 7f27f1ff6640 1 -- 172.21.15.117:0/2917827092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27ec141fa0 msgr2=0x7f27ec0c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:15.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:15.077+0000 7f27f1ff6640 1 --2- 172.21.15.117:0/2917827092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27ec141fa0 0x7f27ec0c86d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f27e400c3e0 tx=0x7f27e400c8a0 comp rx=0 tx=0).stop 2024-09-19T08:39:15.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:15.077+0000 7f27f1ff6640 1 -- 172.21.15.117:0/2917827092 shutdown_connections 2024-09-19T08:39:15.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:15.077+0000 7f27f1ff6640 1 --2- 172.21.15.117:0/2917827092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27ec141fa0 0x7f27ec0c86d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:15.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:15.077+0000 7f27f1ff6640 1 --2- 172.21.15.117:0/2917827092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27ec141680 0x7f27ec0c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:15.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:15.077+0000 7f27f1ff6640 1 --2- 172.21.15.117:0/2917827092 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f27d806c2b0 0x7f27d806e770 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:15.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:15.077+0000 7f27f1ff6640 1 --2- 172.21.15.117:0/2917827092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27ec0d0540 0x7f27ec0cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:15.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:15.077+0000 7f27f1ff6640 1 -- 172.21.15.117:0/2917827092 >> 172.21.15.117:0/2917827092 conn(0x7f27ec0b3ed0 msgr2=0x7f27ec0cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:15.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:15.077+0000 7f27f1ff6640 1 -- 172.21.15.117:0/2917827092 shutdown_connections 2024-09-19T08:39:15.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:15.078+0000 7f27f1ff6640 1 -- 172.21.15.117:0/2917827092 wait complete. 2024-09-19T08:39:15.089 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2024-09-19T08:39:13.874090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":222724,"kb_used_data":6472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751996,"statfs":{"total":773094113280,"available":772866043904,"internally_reserved":0,"allocated":6627328,"data_stored":3575280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12437,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-75,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001400"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":233,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-19T08:39:08.052797+0000","last_change":"2024-09-19T08:37:04.479071+0000","last_active":"2024-09-19T08:39:08.052797+0000","last_peered":"2024-09-19T08:39:08.052797+0000","last_clean":"2024-09-19T08:39:08.052797+0000","last_became_active":"2024-09-19T08:37:04.478199+0000","last_became_peered":"2024-09-19T08:37:04.478199+0000","last_unstale":"2024-09-19T08:39:08.052797+0000","last_undegraded":"2024-09-19T08:39:08.052797+0000","last_fullsized":"2024-09-19T08:39:08.052797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:37:02.519738+0000","last_clean_scrub_stamp":"2024-09-19T08:37:02.519738+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:32.963748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":679936,"data_stored":299318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509470,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1273856,"data_stored":889686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27692,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":679936,"data_stored":299318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":679936,"data_stored":299318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":679936,"data_stored":299318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509471,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1273856,"data_stored":889686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27692,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":679936,"data_stored":299318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27700,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":679936,"data_stored":299318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:39:15.091 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-19T08:37:02.519738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=8, tm_min=37, tm_sec=2, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=8, tm_min=39, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T08:39:15.091 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T08:39:35.093 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:39:35.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.204+0000 7ff80e5e4640 1 Processor -- start 2024-09-19T08:39:35.205 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.204+0000 7ff80e5e4640 1 -- start start 2024-09-19T08:39:35.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.205+0000 7ff80e5e4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff8080d0bc0 0x7ff8080cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:35.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.205+0000 7ff80e5e4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff80815c2c0 0x7ff8080cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:35.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.205+0000 7ff80e5e4640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8080cfc80 con 0x7ff80815bee0 2024-09-19T08:39:35.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.205+0000 7ff80e5e4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7ff8080ceaf0 con 0x7ff8080d0bc0 2024-09-19T08:39:35.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.205+0000 7ff80e5e4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7ff8080cdee0 con 0x7ff80815c2c0 2024-09-19T08:39:35.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.205+0000 7ff7fffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff8080d0bc0 0x7ff8080cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:35.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.205+0000 7ff7fffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff8080d0bc0 0x7ff8080cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40252/0 (socket says 172.21.15.117:40252) 2024-09-19T08:39:35.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.205+0000 7ff7fffff640 1 -- 172.21.15.117:0/1874693692 learned_addr learned my addr 172.21.15.117:0/1874693692 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:35.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.206+0000 7ff80cb81640 1 --2- 172.21.15.117:0/1874693692 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff80815c2c0 0x7ff8080cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:35.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.206+0000 7ff7fffff640 1 -- 172.21.15.117:0/1874693692 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff80815c2c0 msgr2=0x7ff8080cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:35.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.206+0000 7ff7fffff640 1 --2- 172.21.15.117:0/1874693692 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff80815c2c0 0x7ff8080cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.206+0000 7ff7fffff640 1 -- 172.21.15.117:0/1874693692 >> v1:172.21.15.146:6789/0 conn(0x7ff80815bee0 legacy=0x7ff8080d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:35.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.206+0000 7ff7fffff640 1 -- 172.21.15.117:0/1874693692 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8080ce1c0 con 0x7ff8080d0bc0 2024-09-19T08:39:35.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.206+0000 7ff80cb81640 1 --2- 172.21.15.117:0/1874693692 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff80815c2c0 0x7ff8080cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:39:35.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.206+0000 7ff7fffff640 1 --2- 172.21.15.117:0/1874693692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8080d0bc0 0x7ff8080cf200 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009870 tx=0x7ff7f002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84047c1374cc2b19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:35.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.207+0000 7ff8077fe640 1 -- 172.21.15.117:0/1874693692 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0037070 con 0x7ff8080d0bc0 2024-09-19T08:39:35.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.207+0000 7ff8077fe640 1 -- 172.21.15.117:0/1874693692 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7f0032440 con 0x7ff8080d0bc0 2024-09-19T08:39:35.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.207+0000 7ff8077fe640 1 -- 172.21.15.117:0/1874693692 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0032810 con 0x7ff8080d0bc0 2024-09-19T08:39:35.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.207+0000 7ff80e5e4640 1 -- 172.21.15.117:0/1874693692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8080d0bc0 msgr2=0x7ff8080cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:35.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.207+0000 7ff80e5e4640 1 --2- 172.21.15.117:0/1874693692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8080d0bc0 0x7ff8080cf200 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009870 tx=0x7ff7f002a250 comp rx=0 tx=0).stop 2024-09-19T08:39:35.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.207+0000 7ff80e5e4640 1 -- 172.21.15.117:0/1874693692 shutdown_connections 2024-09-19T08:39:35.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.207+0000 7ff80e5e4640 1 --2- 172.21.15.117:0/1874693692 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff80815c2c0 0x7ff8080cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.207+0000 7ff80e5e4640 1 --2- 172.21.15.117:0/1874693692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8080d0bc0 0x7ff8080cf200 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.207+0000 7ff80e5e4640 1 -- 172.21.15.117:0/1874693692 >> 172.21.15.117:0/1874693692 conn(0x7ff80806bdf0 msgr2=0x7ff80806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:35.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.207+0000 7ff80e5e4640 1 -- 172.21.15.117:0/1874693692 shutdown_connections 2024-09-19T08:39:35.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.207+0000 7ff80e5e4640 1 -- 172.21.15.117:0/1874693692 wait complete. 2024-09-19T08:39:35.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.208+0000 7ff80e5e4640 1 Processor -- start 2024-09-19T08:39:35.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.209+0000 7ff80e5e4640 1 -- start start 2024-09-19T08:39:35.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.209+0000 7ff80e5e4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8080d0bc0 0x7ff808148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:35.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.209+0000 7ff80e5e4640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff80815bee0 0x7ff80809a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:35.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.209+0000 7ff80e5e4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff80815c2c0 0x7ff80809a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:35.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.209+0000 7ff80e5e4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff80806dec0 con 0x7ff8080d0bc0 2024-09-19T08:39:35.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.209+0000 7ff80e5e4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff8080ce780 con 0x7ff80815c2c0 2024-09-19T08:39:35.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.209+0000 7ff80e5e4640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7ff80806e040 con 0x7ff80815bee0 2024-09-19T08:39:35.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.209+0000 7ff807fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8080d0bc0 0x7ff808148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:35.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.209+0000 7ff807fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8080d0bc0 0x7ff808148ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40258/0 (socket says 172.21.15.117:40258) 2024-09-19T08:39:35.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.209+0000 7ff807fff640 1 -- 172.21.15.117:0/1298375410 learned_addr learned my addr 172.21.15.117:0/1298375410 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:35.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.209+0000 7ff80cb81640 1 --2- 172.21.15.117:0/1298375410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff80815c2c0 0x7ff80809a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:35.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.209+0000 7ff7fffff640 1 --2- 172.21.15.117:0/1298375410 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff80815bee0 0x7ff80809a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:35.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.210+0000 7ff807fff640 1 -- 172.21.15.117:0/1298375410 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff80815bee0 msgr2=0x7ff80809a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:35.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.210+0000 7ff807fff640 1 --2- 172.21.15.117:0/1298375410 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff80815bee0 0x7ff80809a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.210+0000 7ff807fff640 1 -- 172.21.15.117:0/1298375410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff80815c2c0 msgr2=0x7ff80809a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:35.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.210+0000 7ff807fff640 1 --2- 172.21.15.117:0/1298375410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff80815c2c0 0x7ff80809a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.210+0000 7ff807fff640 1 -- 172.21.15.117:0/1298375410 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff808073a70 con 0x7ff8080d0bc0 2024-09-19T08:39:35.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.210+0000 7ff807fff640 1 --2- 172.21.15.117:0/1298375410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8080d0bc0 0x7ff808148ae0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800c400 tx=0x7ff7f800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:35.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.210+0000 7ff8057fa640 1 -- 172.21.15.117:0/1298375410 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f80052d0 con 0x7ff8080d0bc0 2024-09-19T08:39:35.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.210+0000 7ff8057fa640 1 -- 172.21.15.117:0/1298375410 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7f8005490 con 0x7ff8080d0bc0 2024-09-19T08:39:35.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.210+0000 7ff80e5e4640 1 -- 172.21.15.117:0/1298375410 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff808072ef0 con 0x7ff8080d0bc0 2024-09-19T08:39:35.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.210+0000 7ff8057fa640 1 -- 172.21.15.117:0/1298375410 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8007260 con 0x7ff8080d0bc0 2024-09-19T08:39:35.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.210+0000 7ff80e5e4640 1 -- 172.21.15.117:0/1298375410 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8080734b0 con 0x7ff8080d0bc0 2024-09-19T08:39:35.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.211+0000 7ff80e5e4640 1 -- 172.21.15.117:0/1298375410 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8080d04b0 con 0x7ff8080d0bc0 2024-09-19T08:39:35.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.212+0000 7ff8057fa640 1 -- 172.21.15.117:0/1298375410 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff7f8007400 con 0x7ff8080d0bc0 2024-09-19T08:39:35.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.212+0000 7ff8057fa640 1 --2- 172.21.15.117:0/1298375410 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff7e806c2b0 0x7ff7e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:35.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.212+0000 7ff8057fa640 1 -- 172.21.15.117:0/1298375410 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7ff7f808a750 con 0x7ff8080d0bc0 2024-09-19T08:39:35.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.212+0000 7ff7fffff640 1 --2- 172.21.15.117:0/1298375410 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff7e806c2b0 0x7ff7e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:35.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.213+0000 7ff7fffff640 1 --2- 172.21.15.117:0/1298375410 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff7e806c2b0 0x7ff7e806e770 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0034000 tx=0x7ff7f002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:35.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.217+0000 7ff8057fa640 1 -- 172.21.15.117:0/1298375410 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff7f80589e0 con 0x7ff8080d0bc0 2024-09-19T08:39:35.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.380+0000 7ff80e5e4640 1 -- 172.21.15.117:0/1298375410 --> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff80815b5b0 con 0x7ff7e806c2b0 2024-09-19T08:39:35.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.381+0000 7ff8057fa640 1 -- 172.21.15.117:0/1298375410 <== mgr.4103 v2:172.21.15.146:6832/948175974 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13359 (secure 0 0 0) 0x7ff80815b5b0 con 0x7ff7e806c2b0 2024-09-19T08:39:35.382 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:39:35.382 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-09-19T08:39:35.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.384+0000 7ff80e5e4640 1 -- 172.21.15.117:0/1298375410 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff7e806c2b0 msgr2=0x7ff7e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:35.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.384+0000 7ff80e5e4640 1 --2- 172.21.15.117:0/1298375410 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff7e806c2b0 0x7ff7e806e770 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0034000 tx=0x7ff7f002e000 comp rx=0 tx=0).stop 2024-09-19T08:39:35.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.384+0000 7ff80e5e4640 1 -- 172.21.15.117:0/1298375410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8080d0bc0 msgr2=0x7ff808148ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:35.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.384+0000 7ff80e5e4640 1 --2- 172.21.15.117:0/1298375410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8080d0bc0 0x7ff808148ae0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800c400 tx=0x7ff7f800c8c0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.384+0000 7ff80e5e4640 1 -- 172.21.15.117:0/1298375410 shutdown_connections 2024-09-19T08:39:35.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.384+0000 7ff80e5e4640 1 --2- 172.21.15.117:0/1298375410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff80815c2c0 0x7ff80809a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.384+0000 7ff80e5e4640 1 --2- 172.21.15.117:0/1298375410 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7ff7e806c2b0 0x7ff7e806e770 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.384+0000 7ff80e5e4640 1 --2- 172.21.15.117:0/1298375410 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff80815bee0 0x7ff80809a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.384+0000 7ff80e5e4640 1 --2- 172.21.15.117:0/1298375410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8080d0bc0 0x7ff808148ae0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.384+0000 7ff80e5e4640 1 -- 172.21.15.117:0/1298375410 >> 172.21.15.117:0/1298375410 conn(0x7ff80806bdf0 msgr2=0x7ff8080cc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:35.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.384+0000 7ff80e5e4640 1 -- 172.21.15.117:0/1298375410 shutdown_connections 2024-09-19T08:39:35.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.384+0000 7ff80e5e4640 1 -- 172.21.15.117:0/1298375410 wait complete. 2024-09-19T08:39:35.395 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2024-09-19T08:39:33.878020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":222708,"kb_used_data":6472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752012,"statfs":{"total":773094113280,"available":772866060288,"internally_reserved":0,"allocated":6627328,"data_stored":3575280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002442"},"pg_stats":[{"pgid":"1.0","version":"57'119","reported_seq":244,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-19T08:39:12.743944+0000","last_change":"2024-09-19T08:39:12.743992+0000","last_active":"2024-09-19T08:39:12.743944+0000","last_peered":"2024-09-19T08:39:12.743944+0000","last_clean":"2024-09-19T08:39:12.743944+0000","last_became_active":"2024-09-19T08:37:04.478199+0000","last_became_peered":"2024-09-19T08:37:04.478199+0000","last_unstale":"2024-09-19T08:39:12.743944+0000","last_undegraded":"2024-09-19T08:39:12.743944+0000","last_fullsized":"2024-09-19T08:39:12.743944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'119","last_scrub_stamp":"2024-09-19T08:39:12.743839+0000","last_deep_scrub":"57'119","last_deep_scrub_stamp":"2024-09-19T08:39:12.743839+0000","last_clean_scrub_stamp":"2024-09-19T08:39:12.743839+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:40.945709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":679936,"data_stored":299318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28268,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343572,"statfs":{"total":96636764160,"available":96607817728,"internally_reserved":0,"allocated":1273856,"data_stored":889686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27692,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":679936,"data_stored":299318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":679936,"data_stored":299318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27696,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":679936,"data_stored":299318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509475,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28268,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343572,"statfs":{"total":96636764160,"available":96607817728,"internally_reserved":0,"allocated":1273856,"data_stored":889686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27692,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":679936,"data_stored":299318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27700,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":679936,"data_stored":299318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:39:35.396 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-19T08:39:35.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.494+0000 7fed7f8e6640 1 Processor -- start 2024-09-19T08:39:35.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.494+0000 7fed7f8e6640 1 -- start start 2024-09-19T08:39:35.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.495+0000 7fed7f8e6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed7806f9e0 0x7fed780d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:35.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.495+0000 7fed7f8e6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fed780d09f0 0x7fed780c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:35.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.495+0000 7fed7f8e6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed7815b500 con 0x7fed7815b120 2024-09-19T08:39:35.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.495+0000 7fed7f8e6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 -- 0x7fed780d0e40 con 0x7fed780d09f0 2024-09-19T08:39:35.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.495+0000 7fed7f8e6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fed7806e940 con 0x7fed7806f9e0 2024-09-19T08:39:35.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.495+0000 7fed7d682640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fed7815b120 0x7fed7806dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:40756/0 (socket says 172.21.15.117:40756) 2024-09-19T08:39:35.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.495+0000 7fed7de83640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fed780d09f0 0x7fed780c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:35.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.495+0000 7fed7d682640 1 -- 172.21.15.117:0/918973598 learned_addr learned my addr 172.21.15.117:0/918973598 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:35.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.495+0000 7fed7de83640 1 -- 172.21.15.117:0/918973598 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed7806f9e0 msgr2=0x7fed780d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:35.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.495+0000 7fed7ce81640 1 --2- 172.21.15.117:0/918973598 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed7806f9e0 0x7fed780d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:35.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.495+0000 7fed6ffff640 1 -- 172.21.15.117:0/918973598 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1194466068 0 0) 0x7fed7815b500 con 0x7fed7815b120 2024-09-19T08:39:35.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.495+0000 7fed7de83640 1 --2- 172.21.15.117:0/918973598 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed7806f9e0 0x7fed780d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.495+0000 7fed7de83640 1 -- 172.21.15.117:0/918973598 >> v1:172.21.15.117:6789/0 conn(0x7fed7815b120 legacy=0x7fed7806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:35.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.495+0000 7fed7de83640 1 -- 172.21.15.117:0/918973598 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7806ec20 con 0x7fed780d09f0 2024-09-19T08:39:35.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.496+0000 7fed7de83640 1 --2- 172.21.15.117:0/918973598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed780d09f0 0x7fed780c5160 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fed70009d90 tx=0x7fed7002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc60fa345414a338 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:35.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.496+0000 7fed6ffff640 1 -- 172.21.15.117:0/918973598 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed70007740 con 0x7fed780d09f0 2024-09-19T08:39:35.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.496+0000 7fed6ffff640 1 -- 172.21.15.117:0/918973598 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed700078e0 con 0x7fed780d09f0 2024-09-19T08:39:35.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.496+0000 7fed6ffff640 1 -- 172.21.15.117:0/918973598 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed70007cb0 con 0x7fed780d09f0 2024-09-19T08:39:35.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.497+0000 7fed7f8e6640 1 -- 172.21.15.117:0/918973598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed780d09f0 msgr2=0x7fed780c5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:35.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.497+0000 7fed7f8e6640 1 --2- 172.21.15.117:0/918973598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed780d09f0 0x7fed780c5160 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fed70009d90 tx=0x7fed7002a660 comp rx=0 tx=0).stop 2024-09-19T08:39:35.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.497+0000 7fed7f8e6640 1 -- 172.21.15.117:0/918973598 shutdown_connections 2024-09-19T08:39:35.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.497+0000 7fed7f8e6640 1 --2- 172.21.15.117:0/918973598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed780d09f0 0x7fed780c5160 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.501 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.497+0000 7fed7f8e6640 1 --2- 172.21.15.117:0/918973598 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed7806f9e0 0x7fed780d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.497+0000 7fed7f8e6640 1 -- 172.21.15.117:0/918973598 >> 172.21.15.117:0/918973598 conn(0x7fed7806bdf0 msgr2=0x7fed7806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:35.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.497+0000 7fed7f8e6640 1 -- 172.21.15.117:0/918973598 shutdown_connections 2024-09-19T08:39:35.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.497+0000 7fed7f8e6640 1 -- 172.21.15.117:0/918973598 wait complete. 2024-09-19T08:39:35.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.498+0000 7fed7f8e6640 1 Processor -- start 2024-09-19T08:39:35.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.498+0000 7fed7f8e6640 1 -- start start 2024-09-19T08:39:35.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed7f8e6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed7806f9e0 0x7fed7814f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:35.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed7f8e6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed780d09f0 0x7fed781500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:35.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed7f8e6640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed7815b120 0x7fed78152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:35.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed7f8e6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fed7806f4c0 con 0x7fed780d09f0 2024-09-19T08:39:35.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed7f8e6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fed7806f1e0 con 0x7fed7806f9e0 2024-09-19T08:39:35.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed7f8e6640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7fed7806e5d0 con 0x7fed7815b120 2024-09-19T08:39:35.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed7ce81640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed780d09f0 0x7fed781500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:35.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed7ce81640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed780d09f0 0x7fed781500d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40282/0 (socket says 172.21.15.117:40282) 2024-09-19T08:39:35.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed7ce81640 1 -- 172.21.15.117:0/1680727554 learned_addr learned my addr 172.21.15.117:0/1680727554 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:35.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed7de83640 1 --2- 172.21.15.117:0/1680727554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed7815b120 0x7fed78152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:35.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed7d682640 1 --2- 172.21.15.117:0/1680727554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed7806f9e0 0x7fed7814f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:35.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed7ce81640 1 -- 172.21.15.117:0/1680727554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed7815b120 msgr2=0x7fed78152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:35.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed7ce81640 1 --2- 172.21.15.117:0/1680727554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed7815b120 0x7fed78152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed7ce81640 1 -- 172.21.15.117:0/1680727554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed7806f9e0 msgr2=0x7fed7814f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:35.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed7ce81640 1 --2- 172.21.15.117:0/1680727554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed7806f9e0 0x7fed7814f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed7ce81640 1 -- 172.21.15.117:0/1680727554 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed780b17f0 con 0x7fed780d09f0 2024-09-19T08:39:35.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed7d682640 1 --2- 172.21.15.117:0/1680727554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed7806f9e0 0x7fed7814f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:35.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed7ce81640 1 --2- 172.21.15.117:0/1680727554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed780d09f0 0x7fed781500d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fed6800c820 tx=0x7fed6800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:35.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed6dffb640 1 -- 172.21.15.117:0/1680727554 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed68015070 con 0x7fed780d09f0 2024-09-19T08:39:35.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed6dffb640 1 -- 172.21.15.117:0/1680727554 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed68004240 con 0x7fed780d09f0 2024-09-19T08:39:35.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed6dffb640 1 -- 172.21.15.117:0/1680727554 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6800ce10 con 0x7fed780d09f0 2024-09-19T08:39:35.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.499+0000 7fed7f8e6640 1 -- 172.21.15.117:0/1680727554 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed780b1ab0 con 0x7fed780d09f0 2024-09-19T08:39:35.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.500+0000 7fed7f8e6640 1 -- 172.21.15.117:0/1680727554 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed780b2070 con 0x7fed780d09f0 2024-09-19T08:39:35.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.501+0000 7fed7f8e6640 1 -- 172.21.15.117:0/1680727554 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed780ce060 con 0x7fed780d09f0 2024-09-19T08:39:35.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.501+0000 7fed6dffb640 1 -- 172.21.15.117:0/1680727554 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fed68007830 con 0x7fed780d09f0 2024-09-19T08:39:35.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.502+0000 7fed6dffb640 1 --2- 172.21.15.117:0/1680727554 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fed5c06c2b0 0x7fed5c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:35.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.502+0000 7fed6dffb640 1 -- 172.21.15.117:0/1680727554 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fed6808b010 con 0x7fed780d09f0 2024-09-19T08:39:35.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.502+0000 7fed7d682640 1 --2- 172.21.15.117:0/1680727554 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fed5c06c2b0 0x7fed5c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:35.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.502+0000 7fed7d682640 1 --2- 172.21.15.117:0/1680727554 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fed5c06c2b0 0x7fed5c06e770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fed74000f60 tx=0x7fed74007ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:35.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.506+0000 7fed6dffb640 1 -- 172.21.15.117:0/1680727554 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fed68059330 con 0x7fed780d09f0 2024-09-19T08:39:35.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.671+0000 7fed7f8e6640 1 -- 172.21.15.117:0/1680727554 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fed780cf140 con 0x7fed780d09f0 2024-09-19T08:39:35.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.674+0000 7fed6dffb640 1 -- 172.21.15.117:0/1680727554 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7fed6805d630 con 0x7fed780d09f0 2024-09-19T08:39:35.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.675+0000 7fed6dffb640 1 -- 172.21.15.117:0/1680727554 <== mon.0 v2:172.21.15.117:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fed68061e60 con 0x7fed780d09f0 2024-09-19T08:39:35.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.677+0000 7fed7f8e6640 1 -- 172.21.15.117:0/1680727554 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fed5c06c2b0 msgr2=0x7fed5c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:35.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.677+0000 7fed7f8e6640 1 --2- 172.21.15.117:0/1680727554 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fed5c06c2b0 0x7fed5c06e770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fed74000f60 tx=0x7fed74007ca0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.677+0000 7fed7f8e6640 1 -- 172.21.15.117:0/1680727554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed780d09f0 msgr2=0x7fed781500d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:35.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.677+0000 7fed7f8e6640 1 --2- 172.21.15.117:0/1680727554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed780d09f0 0x7fed781500d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fed6800c820 tx=0x7fed6800cce0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.677+0000 7fed7f8e6640 1 -- 172.21.15.117:0/1680727554 shutdown_connections 2024-09-19T08:39:35.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.677+0000 7fed7f8e6640 1 --2- 172.21.15.117:0/1680727554 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7fed5c06c2b0 0x7fed5c06e770 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.677+0000 7fed7f8e6640 1 --2- 172.21.15.117:0/1680727554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed7815b120 0x7fed78152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.677+0000 7fed7f8e6640 1 --2- 172.21.15.117:0/1680727554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed780d09f0 0x7fed781500d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.677+0000 7fed7f8e6640 1 --2- 172.21.15.117:0/1680727554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed7806f9e0 0x7fed7814f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.677+0000 7fed7f8e6640 1 -- 172.21.15.117:0/1680727554 >> 172.21.15.117:0/1680727554 conn(0x7fed7806bdf0 msgr2=0x7fed78156a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:35.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.677+0000 7fed7f8e6640 1 -- 172.21.15.117:0/1680727554 shutdown_connections 2024-09-19T08:39:35.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.677+0000 7fed7f8e6640 1 -- 172.21.15.117:0/1680727554 wait complete. 2024-09-19T08:39:35.688 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T08:39:35.688 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T08:39:35.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.787+0000 7f29a122e640 1 Processor -- start 2024-09-19T08:39:35.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.787+0000 7f29a122e640 1 -- start start 2024-09-19T08:39:35.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f29a122e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f299c0cd040 0x7f299c1653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:35.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f29a122e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f299c0b4540 con 0x7f299c0c5b00 2024-09-19T08:39:35.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f29a122e640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f299c0cf9b0 con 0x7f299c15a7b0 2024-09-19T08:39:35.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f29a122e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f299c0b4870 con 0x7f299c0cd040 2024-09-19T08:39:35.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f2993fff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f299c0c5b00 0x7f299c0cc930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:40760/0 (socket says 172.21.15.117:40760) 2024-09-19T08:39:35.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f2993fff640 1 -- 172.21.15.117:0/514460854 learned_addr learned my addr 172.21.15.117:0/514460854 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-09-19T08:39:35.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f299b59e640 1 --2- 172.21.15.117:0/514460854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f299c0cd040 0x7f299c1653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:35.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f299a59c640 1 -- 172.21.15.117:0/514460854 <== mon.0 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 912223956 0 0) 0x7f299c0b4540 con 0x7f299c0c5b00 2024-09-19T08:39:35.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f299a59c640 1 -- 172.21.15.117:0/514460854 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2988003520 con 0x7f299c0c5b00 2024-09-19T08:39:35.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f299a59c640 1 -- 172.21.15.117:0/514460854 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1128835751 0 0) 0x7f299c0cf9b0 con 0x7f299c15a7b0 2024-09-19T08:39:35.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f299a59c640 1 -- 172.21.15.117:0/514460854 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f299c0b4540 con 0x7f299c15a7b0 2024-09-19T08:39:35.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f299a59c640 1 -- 172.21.15.117:0/514460854 <== mon.0 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3217565258 0 0) 0x7f2988003520 con 0x7f299c0c5b00 2024-09-19T08:39:35.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f299a59c640 1 -- 172.21.15.117:0/514460854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f299c0cd040 msgr2=0x7f299c1653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:35.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f299a59c640 1 --2- 172.21.15.117:0/514460854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f299c0cd040 0x7f299c1653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f299a59c640 1 -- 172.21.15.117:0/514460854 >> v1:172.21.15.146:6789/0 conn(0x7f299c15a7b0 legacy=0x7f299c0cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:35.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f299a59c640 1 -- 172.21.15.117:0/514460854 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299c0cfc90 con 0x7f299c0c5b00 2024-09-19T08:39:35.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f299a59c640 1 -- 172.21.15.117:0/514460854 <== mon.0 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2766789435 0 0) 0x7f29840015f0 con 0x7f299c0c5b00 2024-09-19T08:39:35.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f299b59e640 1 --2- 172.21.15.117:0/514460854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f299c0cd040 0x7f299c1653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:39:35.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f299a59c640 1 -- 172.21.15.117:0/514460854 >> v1:172.21.15.117:6789/0 conn(0x7f299c0c5b00 legacy=0x7f299c0cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:35.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f299a59c640 1 --2- 172.21.15.117:0/514460854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2988003b70 0x7f2988003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:35.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f299a59c640 1 --2- 172.21.15.117:0/514460854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2988004800 0x7f2988004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:35.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f299a59c640 1 --2- 172.21.15.117:0/514460854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f299c0cd040 0x7f29880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:35.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f299a59c640 1 -- 172.21.15.117:0/514460854 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f299c0b4870 con 0x7f2988004800 2024-09-19T08:39:35.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f299a59c640 1 -- 172.21.15.117:0/514460854 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f298800ba70 con 0x7f2988003b70 2024-09-19T08:39:35.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.788+0000 7f299a59c640 1 -- 172.21.15.117:0/514460854 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f298800bc70 con 0x7f299c0cd040 2024-09-19T08:39:35.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.789+0000 7f2993fff640 1 --2- 172.21.15.117:0/514460854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2988004800 0x7f2988004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:35.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.789+0000 7f299ad9d640 1 --2- 172.21.15.117:0/514460854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2988003b70 0x7f2988003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:35.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.789+0000 7f299b59e640 1 --2- 172.21.15.117:0/514460854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f299c0cd040 0x7f29880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:35.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.789+0000 7f2993fff640 1 -- 172.21.15.117:0/514460854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f299c0cd040 msgr2=0x7f29880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:35.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.789+0000 7f2993fff640 1 --2- 172.21.15.117:0/514460854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f299c0cd040 0x7f29880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.789+0000 7f2993fff640 1 -- 172.21.15.117:0/514460854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2988003b70 msgr2=0x7f2988003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:39:35.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.789+0000 7f2993fff640 1 --2- 172.21.15.117:0/514460854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2988003b70 0x7f2988003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.789+0000 7f2993fff640 1 -- 172.21.15.117:0/514460854 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2988003520 con 0x7f2988004800 2024-09-19T08:39:35.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.790+0000 7f2993fff640 1 --2- 172.21.15.117:0/514460854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2988004800 0x7f2988004c80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2984007f30 tx=0x7f2988005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1deb70a620f12c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:35.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.790+0000 7f299a59c640 1 -- 172.21.15.117:0/514460854 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2984007b80 con 0x7f2988004800 2024-09-19T08:39:35.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.790+0000 7f299a59c640 1 -- 172.21.15.117:0/514460854 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f298402ae50 con 0x7f2988004800 2024-09-19T08:39:35.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.790+0000 7f299a59c640 1 -- 172.21.15.117:0/514460854 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2984005e10 con 0x7f2988004800 2024-09-19T08:39:35.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.790+0000 7f29a122e640 1 -- 172.21.15.117:0/514460854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2988004800 msgr2=0x7f2988004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:35.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.790+0000 7f29a122e640 1 --2- 172.21.15.117:0/514460854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2988004800 0x7f2988004c80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2984007f30 tx=0x7f2988005830 comp rx=0 tx=0).stop 2024-09-19T08:39:35.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.790+0000 7f299b59e640 1 -- 172.21.15.117:0/514460854 reap_dead start 2024-09-19T08:39:35.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.790+0000 7f29a122e640 1 -- 172.21.15.117:0/514460854 shutdown_connections 2024-09-19T08:39:35.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.790+0000 7f29a122e640 1 -- 172.21.15.117:0/514460854 >> 172.21.15.117:0/514460854 conn(0x7f299c06bdf0 msgr2=0x7f299c06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:35.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.790+0000 7f29a122e640 1 -- 172.21.15.117:0/514460854 shutdown_connections 2024-09-19T08:39:35.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.790+0000 7f29a122e640 1 -- 172.21.15.117:0/514460854 wait complete. 2024-09-19T08:39:35.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.792+0000 7f29a122e640 1 Processor -- start 2024-09-19T08:39:35.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.792+0000 7f29a122e640 1 -- start start 2024-09-19T08:39:35.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.792+0000 7f29a122e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2988004800 0x7f299c1ef1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:35.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.792+0000 7f29a122e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f299c14c340 0x7f299c0b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:35.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.792+0000 7f29a122e640 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f299c0b1980 0x7f299c0ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:35.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.792+0000 7f29a122e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f299c15ab90 con 0x7f299c14c340 2024-09-19T08:39:35.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.792+0000 7f29a122e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f299c0c5f40 con 0x7f2988004800 2024-09-19T08:39:35.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.792+0000 7f29a122e640 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 -- 0x7f299c0ca8c0 con 0x7f299c0b1980 2024-09-19T08:39:35.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.792+0000 7f2993fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f299c14c340 0x7f299c0b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:35.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.792+0000 7f2993fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f299c14c340 0x7f299c0b1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40300/0 (socket says 172.21.15.117:40300) 2024-09-19T08:39:35.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.792+0000 7f2993fff640 1 -- 172.21.15.117:0/1601339705 learned_addr learned my addr 172.21.15.117:0/1601339705 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T08:39:35.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.793+0000 7f299ad9d640 1 --2- 172.21.15.117:0/1601339705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2988004800 0x7f299c1ef1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:35.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.793+0000 7f299b59e640 1 --2- 172.21.15.117:0/1601339705 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f299c0b1980 0x7f299c0ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:35.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.793+0000 7f2993fff640 1 -- 172.21.15.117:0/1601339705 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f299c0b1980 msgr2=0x7f299c0ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:35.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.793+0000 7f2993fff640 1 --2- 172.21.15.117:0/1601339705 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f299c0b1980 0x7f299c0ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.793+0000 7f2993fff640 1 -- 172.21.15.117:0/1601339705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2988004800 msgr2=0x7f299c1ef1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:35.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.793+0000 7f2993fff640 1 --2- 172.21.15.117:0/1601339705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2988004800 0x7f299c1ef1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:35.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.793+0000 7f2993fff640 1 -- 172.21.15.117:0/1601339705 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299c1ef710 con 0x7f299c14c340 2024-09-19T08:39:35.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.793+0000 7f299ad9d640 1 --2- 172.21.15.117:0/1601339705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2988004800 0x7f299c1ef1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:39:35.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.793+0000 7f2993fff640 1 --2- 172.21.15.117:0/1601339705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f299c14c340 0x7f299c0b1440 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f29840058a0 tx=0x7f29840018f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:35.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.793+0000 7f29937fe640 1 -- 172.21.15.117:0/1601339705 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2984041020 con 0x7f299c14c340 2024-09-19T08:39:35.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.793+0000 7f29937fe640 1 -- 172.21.15.117:0/1601339705 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2984005ba0 con 0x7f299c14c340 2024-09-19T08:39:35.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.793+0000 7f29a122e640 1 -- 172.21.15.117:0/1601339705 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f299c0b1e90 con 0x7f299c14c340 2024-09-19T08:39:35.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.793+0000 7f29937fe640 1 -- 172.21.15.117:0/1601339705 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2984007070 con 0x7f299c14c340 2024-09-19T08:39:35.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.793+0000 7f29a122e640 1 -- 172.21.15.117:0/1601339705 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f299c0b2450 con 0x7f299c14c340 2024-09-19T08:39:35.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.794+0000 7f29a122e640 1 -- 172.21.15.117:0/1601339705 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f299c0cc930 con 0x7f299c14c340 2024-09-19T08:39:35.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.795+0000 7f29937fe640 1 -- 172.21.15.117:0/1601339705 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2984044020 con 0x7f299c14c340 2024-09-19T08:39:35.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.795+0000 7f29937fe640 1 --2- 172.21.15.117:0/1601339705 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f297c06c280 0x7f297c06e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:39:35.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.795+0000 7f29937fe640 1 -- 172.21.15.117:0/1601339705 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f29840ab640 con 0x7f299c14c340 2024-09-19T08:39:35.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.795+0000 7f299ad9d640 1 --2- 172.21.15.117:0/1601339705 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f297c06c280 0x7f297c06e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:39:35.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.796+0000 7f299ad9d640 1 --2- 172.21.15.117:0/1601339705 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f297c06c280 0x7f297c06e740 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f298c000c00 tx=0x7f298c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:39:35.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.799+0000 7f29937fe640 1 -- 172.21.15.117:0/1601339705 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f298404b030 con 0x7f299c14c340 2024-09-19T08:39:35.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.998+0000 7f29a122e640 1 -- 172.21.15.117:0/1601339705 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f299c06ce20 con 0x7f299c14c340 2024-09-19T08:39:35.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:35.998+0000 7f29937fe640 1 -- 172.21.15.117:0/1601339705 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+3917 (secure 0 0 0) 0x7f2984079e90 con 0x7f299c14c340 2024-09-19T08:39:35.999 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T08:39:35.999 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":24,"btime":"2024-09-19T08:39:05:189350+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1753143760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1753143760},{"type":"v1","addr":"172.21.15.146:6836","nonce":1753143760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/283458533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6833","nonce":283458533},{"type":"v1","addr":"172.21.15.117:6835","nonce":283458533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6834/3844667733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3844667733},{"type":"v1","addr":"172.21.15.117:6834","nonce":3844667733}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5356,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/855649249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":855649249},{"type":"v1","addr":"172.21.15.146:6837","nonce":855649249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[]} 2024-09-19T08:39:36.000 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 24 2024-09-19T08:39:36.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:36.000+0000 7f29a122e640 1 -- 172.21.15.117:0/1601339705 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f297c06c280 msgr2=0x7f297c06e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:36.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:36.000+0000 7f29a122e640 1 --2- 172.21.15.117:0/1601339705 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f297c06c280 0x7f297c06e740 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f298c000c00 tx=0x7f298c009040 comp rx=0 tx=0).stop 2024-09-19T08:39:36.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:36.000+0000 7f29a122e640 1 -- 172.21.15.117:0/1601339705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f299c14c340 msgr2=0x7f299c0b1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:39:36.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:36.000+0000 7f29a122e640 1 --2- 172.21.15.117:0/1601339705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f299c14c340 0x7f299c0b1440 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f29840058a0 tx=0x7f29840018f0 comp rx=0 tx=0).stop 2024-09-19T08:39:36.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:36.000+0000 7f29a122e640 1 -- 172.21.15.117:0/1601339705 shutdown_connections 2024-09-19T08:39:36.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:36.000+0000 7f29a122e640 1 --2- 172.21.15.117:0/1601339705 >> [v2:172.21.15.146:6832/948175974,v1:172.21.15.146:6833/948175974] conn(0x7f297c06c280 0x7f297c06e740 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:36.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:36.000+0000 7f29a122e640 1 --2- 172.21.15.117:0/1601339705 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f299c0b1980 0x7f299c0ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:36.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:36.000+0000 7f29a122e640 1 --2- 172.21.15.117:0/1601339705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f299c14c340 0x7f299c0b1440 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:36.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:36.000+0000 7f29a122e640 1 --2- 172.21.15.117:0/1601339705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2988004800 0x7f299c1ef1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:39:36.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:36.000+0000 7f29a122e640 1 -- 172.21.15.117:0/1601339705 >> 172.21.15.117:0/1601339705 conn(0x7f299c06bdf0 msgr2=0x7f299c0cdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:39:36.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:36.000+0000 7f29a122e640 1 -- 172.21.15.117:0/1601339705 shutdown_connections 2024-09-19T08:39:36.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T08:39:36.000+0000 7f29a122e640 1 -- 172.21.15.117:0/1601339705 wait complete. 2024-09-19T08:39:36.011 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-19T08:39:36.011 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-19T08:39:36.012 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T08:39:36.012 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:39:36.021 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T08:39:36.021 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T08:39:36.022 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:39:36.071 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T08:39:36.072 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T08:39:36.072 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:39:36.084 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T08:39:36.084 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T08:39:36.084 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:39:36.136 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T08:39:36.136 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-19T08:39:36.137 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-19T08:39:36.137 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:39:36.169 INFO:tasks.ceph.osd.0:Stopped 2024-09-19T08:39:36.169 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-19T08:39:36.169 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:39:36.235 INFO:tasks.ceph.osd.1:Stopped 2024-09-19T08:39:36.235 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-19T08:39:36.235 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:39:36.248 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T08:39:36.277 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T08:39:36.305 INFO:tasks.ceph.osd.2:Stopped 2024-09-19T08:39:36.305 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-19T08:39:36.305 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:39:36.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-19T08:39:36.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-19T08:39:36.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-19T08:39:36.371 INFO:tasks.ceph.osd.3:Stopped 2024-09-19T08:39:36.372 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-19T08:39:36.372 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:39:36.405 INFO:tasks.ceph.osd.4:Stopped 2024-09-19T08:39:36.406 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-19T08:39:36.406 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:39:36.476 INFO:tasks.ceph.osd.5:Stopped 2024-09-19T08:39:36.477 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-19T08:39:36.477 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:39:36.551 INFO:tasks.ceph.osd.6:Stopped 2024-09-19T08:39:36.551 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-19T08:39:36.551 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:39:36.619 INFO:tasks.ceph.osd.7:Stopped 2024-09-19T08:39:36.619 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-19T08:39:36.620 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-19T08:39:36.620 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:39:36.645 INFO:tasks.ceph.mgr.y:Stopped 2024-09-19T08:39:36.645 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-19T08:39:36.645 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:39:36.690 INFO:tasks.ceph.mgr.x:Stopped 2024-09-19T08:39:36.690 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-19T08:39:36.690 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-19T08:39:36.690 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:39:36.702 INFO:tasks.ceph.mon.a:Stopped 2024-09-19T08:39:36.702 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-19T08:39:36.702 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:39:36.742 INFO:tasks.ceph.mon.b:Stopped 2024-09-19T08:39:36.743 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-19T08:39:36.743 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T08:39:36.794 INFO:tasks.ceph.mon.c:Stopped 2024-09-19T08:39:36.795 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-19T08:39:36.795 DEBUG:teuthology.orchestra.run.smithi117:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | egrep -v 'object missing on disk' | egrep -v 'Invalid tag char' | head -n 1 2024-09-19T08:39:36.832 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T08:39:36.833 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-19T08:39:37.035 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T08:39:37.036 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-19T08:39:37.124 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T08:39:37.124 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-19T08:39:37.174 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T08:39:37.174 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-19T08:39:37.225 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-19T08:39:37.225 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-19T08:39:37.354 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-19T08:39:37.354 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-19T08:39:37.439 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-19T08:39:37.440 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-19T08:39:37.504 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-19T08:39:37.504 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-19T08:39:37.564 INFO:tasks.ceph:Archiving mon data... 2024-09-19T08:39:37.565 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911862/data/mon.a.tgz 2024-09-19T08:39:37.565 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-09-19T08:39:37.582 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.AgnRVfMOXI 2024-09-19T08:39:37.582 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.AgnRVfMOXI 2024-09-19T08:39:37.738 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.AgnRVfMOXI 2024-09-19T08:39:37.823 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.AgnRVfMOXI is 332KB 2024-09-19T08:39:37.920 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.AgnRVfMOXI 2024-09-19T08:39:37.935 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911862/data/mon.b.tgz 2024-09-19T08:39:37.936 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2024-09-19T08:39:37.954 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.ILti8mTvsO 2024-09-19T08:39:37.954 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ILti8mTvsO 2024-09-19T08:39:38.117 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.ILti8mTvsO 2024-09-19T08:39:38.201 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.ILti8mTvsO is 443KB 2024-09-19T08:39:38.299 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.ILti8mTvsO 2024-09-19T08:39:38.314 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911862/data/mon.c.tgz 2024-09-19T08:39:38.314 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2024-09-19T08:39:38.369 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.YGxdyKrEWD 2024-09-19T08:39:38.369 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.YGxdyKrEWD 2024-09-19T08:39:38.516 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.YGxdyKrEWD 2024-09-19T08:39:38.600 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.YGxdyKrEWD is 443KB 2024-09-19T08:39:38.698 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.YGxdyKrEWD 2024-09-19T08:39:38.713 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-19T08:39:38.713 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-19T08:39:38.716 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-19T08:39:38.797 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-19T08:39:38.833 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-19T08:39:38.833 INFO:tasks.ceph:Archiving crash dumps... 2024-09-19T08:39:38.835 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911862/remote/smithi117/crash 2024-09-19T08:39:38.835 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-19T08:39:38.864 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911862/remote/smithi146/crash 2024-09-19T08:39:38.865 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-19T08:39:38.898 INFO:tasks.ceph:Shutting down logrotate 2024-09-19T08:39:38.898 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T08:39:38.909 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T08:39:38.993 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-19T08:39:39.018 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-19T08:39:39.043 INFO:tasks.ceph:Compressing logs... 2024-09-19T08:39:39.043 DEBUG:teuthology.orchestra.run.smithi117:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T08:39:39.061 DEBUG:teuthology.orchestra.run.smithi146:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T08:39:39.130 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36828.log 2024-09-19T08:39:39.130 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-19T08:39:39.130 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42596.log 2024-09-19T08:39:39.130 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36828.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36741.log 2024-09-19T08:39:39.131 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36828.log.gz 2024-09-19T08:39:39.131 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.1.42596.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-19T08:39:39.131 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36741.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-19T08:39:39.131 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.1.42596.log.gz 2024-09-19T08:39:39.131 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mds.b.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36741.log.gz 2024-09-19T08:39:39.131 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36697.log 2024-09-19T08:39:39.131 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-19T08:39:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43048.log 2024-09-19T08:39:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.audit.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36697.log.gz 2024-09-19T08:39:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-19T08:39:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.3.43048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36577.log 2024-09-19T08:39:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-19T08:39:39.132 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4%/var/log/ceph/ceph-client.admin.36577.log: -- replaced with /var/log/ceph/ceph-client.3.43048.log.gz 2024-09-19T08:39:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36577.log.gz 2024-09-19T08:39:39.133 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-19T08:39:39.133 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-19T08:39:39.133 INFO:teuthology.orchestra.run.smithi146.stderr: 93.7%/var/log/ceph/ceph-osd.5.log: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-19T08:39:39.133 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36537.log 2024-09-19T08:39:39.133 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-19T08:39:39.133 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.36537.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36537.log.gz 2024-09-19T08:39:39.134 INFO:teuthology.orchestra.run.smithi146.stderr: 92.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-19T08:39:39.134 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-19T08:39:39.134 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-19T08:39:39.134 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mgr.x.log: 92.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-19T08:39:39.134 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36788.log 2024-09-19T08:39:39.144 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36657.log 2024-09-19T08:39:39.144 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36788.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36788.log.gz 2024-09-19T08:39:39.151 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36617.log 2024-09-19T08:39:39.152 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36657.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36657.log.gz 2024-09-19T08:39:39.163 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36617.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36617.log.gz 2024-09-19T08:39:39.176 INFO:teuthology.orchestra.run.smithi146.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-19T08:39:39.194 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-19T08:39:39.194 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47620.log 2024-09-19T08:39:39.195 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44177.log 2024-09-19T08:39:39.195 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.47620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54200.log 2024-09-19T08:39:39.195 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44177.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47620.log.gz 2024-09-19T08:39:39.195 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47452.log 2024-09-19T08:39:39.195 INFO:teuthology.orchestra.run.smithi117.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44177.log.gz 2024-09-19T08:39:39.195 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47201.log 2024-09-19T08:39:39.195 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.54200.log: /var/log/ceph/ceph-client.admin.47452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48728.log 2024-09-19T08:39:39.195 INFO:teuthology.orchestra.run.smithi117.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54200.log.gz 2024-09-19T08:39:39.196 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.47201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47914.log 89.6% 2024-09-19T08:39:39.196 INFO:teuthology.orchestra.run.smithi117.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47452.log.gz 2024-09-19T08:39:39.196 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50668.log/var/log/ceph/ceph-client.admin.48728.log: 2024-09-19T08:39:39.196 INFO:teuthology.orchestra.run.smithi117.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47201.log.gz 2024-09-19T08:39:39.196 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.47914.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48728.log.gz 2024-09-19T08:39:39.196 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45892.log 2024-09-19T08:39:39.196 INFO:teuthology.orchestra.run.smithi117.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47914.log.gz 2024-09-19T08:39:39.196 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.50668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48984.log 2024-09-19T08:39:39.197 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.45892.log: gzip 87.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.50668.log.gz --verbose 2024-09-19T08:39:39.197 INFO:teuthology.orchestra.run.smithi117.stderr: -- /var/log/ceph/ceph-client.admin.45119.log 2024-09-19T08:39:39.197 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.48984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42109.log 2024-09-19T08:39:39.197 INFO:teuthology.orchestra.run.smithi117.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48984.log.gz 2024-09-19T08:39:39.197 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.45119.log: 89.0% -- replaced with /var/log/ceph/ceph-client.0.45892.log.gz 2024-09-19T08:39:39.197 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53948.log 2024-09-19T08:39:39.197 INFO:teuthology.orchestra.run.smithi117.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45119.log.gz 2024-09-19T08:39:39.198 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41692.log 2024-09-19T08:39:39.198 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.42109.log: /var/log/ceph/ceph-client.admin.53948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42533.log 2024-09-19T08:39:39.198 INFO:teuthology.orchestra.run.smithi117.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42109.log.gz 2024-09-19T08:39:39.198 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.41692.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53948.log.gz 2024-09-19T08:39:39.198 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53331.log 2024-09-19T08:39:39.198 INFO:teuthology.orchestra.run.smithi117.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41692.log.gz 2024-09-19T08:39:39.199 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.42533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46524.log 2024-09-19T08:39:39.199 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.53331.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42533.log.gz 2024-09-19T08:39:39.199 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44741.log 2024-09-19T08:39:39.199 INFO:teuthology.orchestra.run.smithi117.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53331.log.gz 2024-09-19T08:39:39.199 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.46524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46718.log 2024-09-19T08:39:39.199 INFO:teuthology.orchestra.run.smithi117.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46524.log.gz 2024-09-19T08:39:39.199 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44521.log 2024-09-19T08:39:39.200 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.46718.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44741.log.gz 2024-09-19T08:39:39.200 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48159.log 2024-09-19T08:39:39.200 INFO:teuthology.orchestra.run.smithi117.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46718.log.gz 2024-09-19T08:39:39.200 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46676.log 2024-09-19T08:39:39.200 INFO:teuthology.orchestra.run.smithi117.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44521.log.gz 2024-09-19T08:39:39.200 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.48159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50083.log 2024-09-19T08:39:39.200 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.46676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44188.log 2024-09-19T08:39:39.200 INFO:teuthology.orchestra.run.smithi117.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48159.log.gz 2024-09-19T08:39:39.201 INFO:teuthology.orchestra.run.smithi117.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46676.log.gz 2024-09-19T08:39:39.201 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.50083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50890.log 2024-09-19T08:39:39.201 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44188.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50083.log.gz 2024-09-19T08:39:39.201 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53864.log 2024-09-19T08:39:39.201 INFO:teuthology.orchestra.run.smithi117.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44188.log.gz 2024-09-19T08:39:39.201 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.50890.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-19T08:39:39.201 INFO:teuthology.orchestra.run.smithi117.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50890.log.gz 2024-09-19T08:39:39.201 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5/var/log/ceph/ceph-client.admin.53864.log: --verbose -- /var/log/ceph/ceph-client.admin.44879.log 2024-09-19T08:39:39.202 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48244.log 2024-09-19T08:39:39.202 INFO:teuthology.orchestra.run.smithi117.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53864.log.gz 2024-09-19T08:39:39.202 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44878.log 2024-09-19T08:39:39.202 INFO:teuthology.orchestra.run.smithi117.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44879.log.gz 2024-09-19T08:39:39.202 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.48244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45245.log 2024-09-19T08:39:39.202 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44878.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48244.log.gz 2024-09-19T08:39:39.202 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49865.log 2024-09-19T08:39:39.202 INFO:teuthology.orchestra.run.smithi117.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44878.log.gz 2024-09-19T08:39:39.203 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53612.log 2024-09-19T08:39:39.203 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.45245.log: /var/log/ceph/ceph-client.admin.49865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48456.log 2024-09-19T08:39:39.203 INFO:teuthology.orchestra.run.smithi117.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45245.log.gz 2024-09-19T08:39:39.203 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.53612.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49865.log.gz 2024-09-19T08:39:39.203 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46844.log 2024-09-19T08:39:39.203 INFO:teuthology.orchestra.run.smithi117.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53612.log.gz 2024-09-19T08:39:39.203 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44515.log 2024-09-19T08:39:39.203 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.48456.log: /var/log/ceph/ceph-client.admin.46844.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48456.log.gz 2024-09-19T08:39:39.204 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50157.log 2024-09-19T08:39:39.204 INFO:teuthology.orchestra.run.smithi117.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46844.log.gz 2024-09-19T08:39:39.204 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52851.log 2024-09-19T08:39:39.204 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44515.log: /var/log/ceph/ceph-client.admin.50157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53486.log 2024-09-19T08:39:39.204 INFO:teuthology.orchestra.run.smithi117.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44515.log.gz 2024-09-19T08:39:39.204 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.52851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42405.log 2024-09-19T08:39:39.204 INFO:teuthology.orchestra.run.smithi117.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50157.log.gz 2024-09-19T08:39:39.204 INFO:teuthology.orchestra.run.smithi117.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52851.log.gz 2024-09-19T08:39:39.205 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.53486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46928.log 2024-09-19T08:39:39.205 INFO:teuthology.orchestra.run.smithi117.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53486.log.gz 2024-09-19T08:39:39.205 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42617.log 2024-09-19T08:39:39.205 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.42405.log: /var/log/ceph/ceph-client.admin.46928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44874.log 2024-09-19T08:39:39.205 INFO:teuthology.orchestra.run.smithi117.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42405.log.gz 2024-09-19T08:39:39.205 INFO:teuthology.orchestra.run.smithi117.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46928.log.gz 2024-09-19T08:39:39.205 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.42617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47494.log 2024-09-19T08:39:39.205 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51865.log 2024-09-19T08:39:39.206 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44874.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42617.log.gz 2024-09-19T08:39:39.206 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.47494.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44874.log.gz 2024-09-19T08:39:39.206 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43589.log 2024-09-19T08:39:39.206 INFO:teuthology.orchestra.run.smithi117.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47494.log.gz 2024-09-19T08:39:39.206 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.51865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48117.log 2024-09-19T08:39:39.206 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.43589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42275.log 2024-09-19T08:39:39.206 INFO:teuthology.orchestra.run.smithi117.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51865.log.gz 2024-09-19T08:39:39.206 INFO:teuthology.orchestra.run.smithi117.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43589.log.gz 2024-09-19T08:39:39.207 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.48117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54116.log 2024-09-19T08:39:39.207 INFO:teuthology.orchestra.run.smithi117.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48117.log.gz 2024-09-19T08:39:39.207 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.42275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52632.log 2024-09-19T08:39:39.207 INFO:teuthology.orchestra.run.smithi117.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42275.log.gz 2024-09-19T08:39:39.207 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52033.log 2024-09-19T08:39:39.207 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.54116.log: /var/log/ceph/ceph-client.admin.52632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53103.log 2024-09-19T08:39:39.207 INFO:teuthology.orchestra.run.smithi117.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54116.log.gz 2024-09-19T08:39:39.207 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.52033.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52632.log.gz 2024-09-19T08:39:39.208 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42363.log 2024-09-19T08:39:39.208 INFO:teuthology.orchestra.run.smithi117.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52033.log.gz 2024-09-19T08:39:39.208 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47662.log 2024-09-19T08:39:39.208 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.53103.log: /var/log/ceph/ceph-client.admin.42363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48896.log 2024-09-19T08:39:39.208 INFO:teuthology.orchestra.run.smithi117.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53103.log.gz 2024-09-19T08:39:39.208 INFO:teuthology.orchestra.run.smithi117.stderr: 89.3%/var/log/ceph/ceph-client.admin.47662.log: -- replaced with /var/log/ceph/ceph-client.admin.42363.log.gz 2024-09-19T08:39:39.208 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49076.log 2024-09-19T08:39:39.209 INFO:teuthology.orchestra.run.smithi117.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47662.log.gz 2024-09-19T08:39:39.209 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50626.log/var/log/ceph/ceph-client.admin.48896.log: 2024-09-19T08:39:39.209 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.49076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47159.log 2024-09-19T08:39:39.209 INFO:teuthology.orchestra.run.smithi117.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48896.log.gz 2024-09-19T08:39:39.209 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.50626.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49076.log.gz 2024-09-19T08:39:39.209 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54032.log 2024-09-19T08:39:39.209 INFO:teuthology.orchestra.run.smithi117.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50626.log.gz 2024-09-19T08:39:39.209 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.47159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44524.log 2024-09-19T08:39:39.210 INFO:teuthology.orchestra.run.smithi117.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47159.log.gz 2024-09-19T08:39:39.210 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51111.log 2024-09-19T08:39:39.210 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.54032.log: /var/log/ceph/ceph-client.admin.44524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51487.log 2024-09-19T08:39:39.210 INFO:teuthology.orchestra.run.smithi117.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54032.log.gz 2024-09-19T08:39:39.210 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.51111.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44524.log.gz 2024-09-19T08:39:39.211 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46402.log 2024-09-19T08:39:39.212 INFO:teuthology.orchestra.run.smithi117.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51111.log.gz 2024-09-19T08:39:39.212 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47578.log 2024-09-19T08:39:39.212 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.51487.log: /var/log/ceph/ceph-client.2.46402.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-19T08:39:39.212 INFO:teuthology.orchestra.run.smithi117.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51487.log.gz 2024-09-19T08:39:39.212 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.47578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53145.log 2024-09-19T08:39:39.212 INFO:teuthology.orchestra.run.smithi117.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47578.log.gz 2024-09-19T08:39:39.212 INFO:teuthology.orchestra.run.smithi117.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.2.46402.log.gz 2024-09-19T08:39:39.212 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50542.log 2024-09-19T08:39:39.213 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50231.log 2024-09-19T08:39:39.213 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.53145.log: /var/log/ceph/ceph-client.admin.50542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48518.log 2024-09-19T08:39:39.213 INFO:teuthology.orchestra.run.smithi117.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53145.log.gz 2024-09-19T08:39:39.213 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.50231.log: gzip -5 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50542.log.gz 2024-09-19T08:39:39.213 INFO:teuthology.orchestra.run.smithi117.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54368.log 2024-09-19T08:39:39.213 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.48518.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50231.log.gz 2024-09-19T08:39:39.213 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54242.log 2024-09-19T08:39:39.213 INFO:teuthology.orchestra.run.smithi117.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-19T08:39:39.214 INFO:teuthology.orchestra.run.smithi117.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48518.log.gz 2024-09-19T08:39:39.214 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46886.log 2024-09-19T08:39:39.214 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.54368.log: /var/log/ceph/ceph-client.admin.54242.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54368.log.gz 2024-09-19T08:39:39.214 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51191.log 2024-09-19T08:39:39.214 INFO:teuthology.orchestra.run.smithi117.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54242.log.gz 2024-09-19T08:39:39.214 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45203.log 2024-09-19T08:39:39.214 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.46886.log: /var/log/ceph/ceph-client.admin.51191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52609.log 2024-09-19T08:39:39.214 INFO:teuthology.orchestra.run.smithi117.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46886.log.gz 2024-09-19T08:39:39.215 INFO:teuthology.orchestra.run.smithi117.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51191.log.gz 2024-09-19T08:39:39.215 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.45203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45287.log 2024-09-19T08:39:39.215 INFO:teuthology.orchestra.run.smithi117.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45203.log.gz 2024-09-19T08:39:39.215 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50500.log 2024-09-19T08:39:39.215 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.52609.log: /var/log/ceph/ceph-client.admin.45287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48412.log 2024-09-19T08:39:39.215 INFO:teuthology.orchestra.run.smithi117.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52609.log.gz 2024-09-19T08:39:39.215 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.50500.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45287.log.gz 2024-09-19T08:39:39.215 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50120.log 2024-09-19T08:39:39.216 INFO:teuthology.orchestra.run.smithi117.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50500.log.gz 2024-09-19T08:39:39.216 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.48412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42191.log 2024-09-19T08:39:39.216 INFO:teuthology.orchestra.run.smithi117.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48412.log.gz 2024-09-19T08:39:39.216 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.50120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51401.log 2024-09-19T08:39:39.216 INFO:teuthology.orchestra.run.smithi117.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50120.log.gz 2024-09-19T08:39:39.216 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48854.log 2024-09-19T08:39:39.216 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.42191.log: /var/log/ceph/ceph-client.admin.51401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53822.log 2024-09-19T08:39:39.216 INFO:teuthology.orchestra.run.smithi117.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42191.log.gz 2024-09-19T08:39:39.217 INFO:teuthology.orchestra.run.smithi117.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51401.log.gz 2024-09-19T08:39:39.217 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.48854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48370.log 2024-09-19T08:39:39.217 INFO:teuthology.orchestra.run.smithi117.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48854.log.gz 2024-09-19T08:39:39.217 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47023.log 2024-09-19T08:39:39.217 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.53822.log: /var/log/ceph/ceph-client.admin.48370.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53822.log.gz 2024-09-19T08:39:39.217 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50000.log 2024-09-19T08:39:39.217 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45077.log 2024-09-19T08:39:39.217 INFO:teuthology.orchestra.run.smithi117.stderr: 88.4%/var/log/ceph/ceph-client.admin.47023.log: -- replaced with /var/log/ceph/ceph-client.admin.48370.log.gz 2024-09-19T08:39:39.218 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.50000.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47023.log.gz 2024-09-19T08:39:39.218 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45329.log 2024-09-19T08:39:39.218 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose 88.1% -- /var/log/ceph/ceph-client.admin.50974.log -- replaced with /var/log/ceph/ceph-client.admin.50000.log.gz 2024-09-19T08:39:39.218 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-19T08:39:39.218 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.45077.log: /var/log/ceph/ceph-client.admin.45329.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45077.log.gz 2024-09-19T08:39:39.218 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51781.log 2024-09-19T08:39:39.218 INFO:teuthology.orchestra.run.smithi117.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45329.log.gz 2024-09-19T08:39:39.218 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44522.log 2024-09-19T08:39:39.219 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.50974.log: /var/log/ceph/ceph-client.admin.51781.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50974.log.gz 2024-09-19T08:39:39.219 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53654.log 2024-09-19T08:39:39.219 INFO:teuthology.orchestra.run.smithi117.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51781.log.gz 2024-09-19T08:39:39.219 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48202.log 2024-09-19T08:39:39.219 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44522.log: /var/log/ceph/ceph-client.admin.53654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44880.log 2024-09-19T08:39:39.219 INFO:teuthology.orchestra.run.smithi117.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44522.log.gz 2024-09-19T08:39:39.219 INFO:teuthology.orchestra.run.smithi117.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53654.log.gz 2024-09-19T08:39:39.219 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.48202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49486.log 2024-09-19T08:39:39.219 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-19T08:39:39.220 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44880.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48202.log.gz 2024-09-19T08:39:39.220 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.49486.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44880.log.gz 2024-09-19T08:39:39.220 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54326.log 2024-09-19T08:39:39.220 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36643.log 2024-09-19T08:39:39.220 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.54326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47788.log 2024-09-19T08:39:39.220 INFO:teuthology.orchestra.run.smithi117.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54326.log.gz 2024-09-19T08:39:39.220 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.36643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50848.log 2024-09-19T08:39:39.220 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.47788.log: gzip -5 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36643.log.gz 2024-09-19T08:39:39.221 INFO:teuthology.orchestra.run.smithi117.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53570.log 2024-09-19T08:39:39.221 INFO:teuthology.orchestra.run.smithi117.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47788.log.gz 2024-09-19T08:39:39.221 INFO:teuthology.orchestra.run.smithi117.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-19T08:39:39.221 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.50848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47830.log 2024-09-19T08:39:39.221 INFO:teuthology.orchestra.run.smithi117.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50848.log.gz 2024-09-19T08:39:39.221 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.53570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52141.log 2024-09-19T08:39:39.221 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.47830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53289.log 2024-09-19T08:39:39.221 INFO:teuthology.orchestra.run.smithi117.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53570.log.gz 2024-09-19T08:39:39.222 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.52141.log: gzip 88.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.47830.log.gz 2024-09-19T08:39:39.222 INFO:teuthology.orchestra.run.smithi117.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52741.log 2024-09-19T08:39:39.222 INFO:teuthology.orchestra.run.smithi117.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52141.log.gz 2024-09-19T08:39:39.222 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42743.log 2024-09-19T08:39:39.222 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.53289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53019.log 2024-09-19T08:39:39.222 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.52741.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53289.log.gz 2024-09-19T08:39:39.222 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.42743.log: gzip -5 --verbose 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52741.log.gz 2024-09-19T08:39:39.222 INFO:teuthology.orchestra.run.smithi117.stderr: -- /var/log/ceph/ceph-client.admin.48939.log 2024-09-19T08:39:39.223 INFO:teuthology.orchestra.run.smithi117.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42743.log.gz 2024-09-19T08:39:39.223 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.53019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43673.log 2024-09-19T08:39:39.223 INFO:teuthology.orchestra.run.smithi117.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53019.log.gz 2024-09-19T08:39:39.223 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42491.log 2024-09-19T08:39:39.223 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.48939.log: /var/log/ceph/ceph-client.admin.43673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54074.log 2024-09-19T08:39:39.223 INFO:teuthology.orchestra.run.smithi117.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48939.log.gz 2024-09-19T08:39:39.223 INFO:teuthology.orchestra.run.smithi117.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43673.log.gz 2024-09-19T08:39:39.223 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.42491.log: 93.1% -- replaced with /var/log/ceph/ceph-client.0.49486.log.gz 2024-09-19T08:39:39.223 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44009.log 2024-09-19T08:39:39.224 INFO:teuthology.orchestra.run.smithi117.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42491.log.gz 2024-09-19T08:39:39.224 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5/var/log/ceph/ceph-client.admin.54074.log: --verbose -- /var/log/ceph/ceph-client.admin.44873.log 2024-09-19T08:39:39.224 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47333.log 2024-09-19T08:39:39.224 INFO:teuthology.orchestra.run.smithi117.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54074.log.gz 2024-09-19T08:39:39.224 INFO:teuthology.orchestra.run.smithi117.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44009.log.gz 2024-09-19T08:39:39.224 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42785.log 2024-09-19T08:39:39.224 INFO:teuthology.orchestra.run.smithi117.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44873.log.gz 2024-09-19T08:39:39.224 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.47333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44868.log 2024-09-19T08:39:39.225 INFO:teuthology.orchestra.run.smithi117.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47333.log.gz 2024-09-19T08:39:39.225 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51016.log 2024-09-19T08:39:39.225 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.42785.log: /var/log/ceph/ceph-client.admin.44868.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30344.log 2024-09-19T08:39:39.225 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.51016.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44868.log.gz 2024-09-19T08:39:39.225 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44527.log 2024-09-19T08:39:39.225 INFO:teuthology.orchestra.run.smithi117.stderr: 91.2% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42785.log.gz -- replaced with /var/log/ceph/ceph-client.admin.51016.log.gz 2024-09-19T08:39:39.225 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-19T08:39:39.225 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45371.log 2024-09-19T08:39:39.226 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph.tmp-client.admin.30344.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30344.log.gz 2024-09-19T08:39:39.226 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43715.log 2024-09-19T08:39:39.226 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.45371.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44527.log.gz 2024-09-19T08:39:39.226 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48770.log 2024-09-19T08:39:39.226 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51739.log 2024-09-19T08:39:39.226 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.43715.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45371.log.gz 2024-09-19T08:39:39.226 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.48770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51445.log 2024-09-19T08:39:39.226 INFO:teuthology.orchestra.run.smithi117.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43715.log.gz 2024-09-19T08:39:39.227 INFO:teuthology.orchestra.run.smithi117.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48770.log.gz 2024-09-19T08:39:39.227 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.51739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43631.log 2024-09-19T08:39:39.227 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.51445.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-19T08:39:39.227 INFO:teuthology.orchestra.run.smithi117.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51739.log.gz 2024-09-19T08:39:39.227 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.43631.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51445.log.gz 2024-09-19T08:39:39.227 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45500.log 2024-09-19T08:39:39.227 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mon.a.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.43631.log.gz 2024-09-19T08:39:39.227 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43883.log 2024-09-19T08:39:39.227 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.45500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50194.log 2024-09-19T08:39:39.228 INFO:teuthology.orchestra.run.smithi117.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45500.log.gz 2024-09-19T08:39:39.228 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.43883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44191.log 2024-09-19T08:39:39.228 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.50194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44186.log 2024-09-19T08:39:39.228 INFO:teuthology.orchestra.run.smithi117.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43883.log.gz 2024-09-19T08:39:39.228 INFO:teuthology.orchestra.run.smithi117.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.50194.log.gz 2024-09-19T08:39:39.228 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53696.log 2024-09-19T08:39:39.228 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47994.log 2024-09-19T08:39:39.228 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44186.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44191.log.gz 2024-09-19T08:39:39.229 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.53696.log: gzip -5 --verbose 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44186.log.gz 2024-09-19T08:39:39.229 INFO:teuthology.orchestra.run.smithi117.stderr: -- /var/log/ceph/ceph-client.admin.45161.log 2024-09-19T08:39:39.229 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.47994.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53696.log.gz 2024-09-19T08:39:39.229 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48686.log 2024-09-19T08:39:39.229 INFO:teuthology.orchestra.run.smithi117.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47994.log.gz 2024-09-19T08:39:39.229 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.45161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43841.log 2024-09-19T08:39:39.229 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.48686.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45161.log.gz 2024-09-19T08:39:39.229 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51315.log 2024-09-19T08:39:39.230 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.43841.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48686.log.gz 2024-09-19T08:39:39.230 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46802.log 2024-09-19T08:39:39.230 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.51315.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43841.log.gz 2024-09-19T08:39:39.230 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42701.log 2024-09-19T08:39:39.230 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.46802.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51315.log.gz 2024-09-19T08:39:39.230 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43512.log 2024-09-19T08:39:39.230 INFO:teuthology.orchestra.run.smithi117.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46802.log.gz 2024-09-19T08:39:39.230 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.42701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47872.log 2024-09-19T08:39:39.231 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.43512.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42701.log.gz 2024-09-19T08:39:39.231 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47410.log 2024-09-19T08:39:39.231 INFO:teuthology.orchestra.run.smithi117.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43512.log.gz 2024-09-19T08:39:39.231 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.47872.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-19T08:39:39.231 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.47410.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47872.log.gz 2024-09-19T08:39:39.231 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51991.log 2024-09-19T08:39:39.231 INFO:teuthology.orchestra.run.smithi117.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47410.log.gz 2024-09-19T08:39:39.231 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53187.log 2024-09-19T08:39:39.231 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.51991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50932.log 2024-09-19T08:39:39.232 INFO:teuthology.orchestra.run.smithi117.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51991.log.gz 2024-09-19T08:39:39.232 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.53187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43967.log 2024-09-19T08:39:39.232 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 89.1%/var/log/ceph/ceph-client.admin.50932.log: -- replaced with /var/log/ceph/ceph-client.admin.53187.log.gz 2024-09-19T08:39:39.232 INFO:teuthology.orchestra.run.smithi117.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51949.log 2024-09-19T08:39:39.232 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.43967.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50932.log.gz 2024-09-19T08:39:39.232 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47746.log 2024-09-19T08:39:39.232 INFO:teuthology.orchestra.run.smithi117.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43967.log.gz 2024-09-19T08:39:39.232 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.51949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42233.log 2024-09-19T08:39:39.233 INFO:teuthology.orchestra.run.smithi117.stderr:gzip/var/log/ceph/ceph-client.admin.47746.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51273.log 2024-09-19T08:39:39.233 INFO:teuthology.orchestra.run.smithi117.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51949.log.gz 2024-09-19T08:39:39.233 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.42233.log: gzip -5 --verbose -- 89.0% /var/log/ceph/ceph-client.admin.53528.log 2024-09-19T08:39:39.233 INFO:teuthology.orchestra.run.smithi117.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47746.log.gz 2024-09-19T08:39:39.233 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.51273.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42233.log.gz 2024-09-19T08:39:39.233 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48812.log 2024-09-19T08:39:39.233 INFO:teuthology.orchestra.run.smithi117.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51273.log.gz 2024-09-19T08:39:39.233 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.53528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47081.log 2024-09-19T08:39:39.234 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5/var/log/ceph/ceph-client.admin.48812.log: --verbose 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53528.log.gz 2024-09-19T08:39:39.234 INFO:teuthology.orchestra.run.smithi117.stderr: -- /var/log/ceph/ceph-client.admin.52075.log 2024-09-19T08:39:39.234 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.47081.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48812.log.gz 2024-09-19T08:39:39.234 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51529.log 2024-09-19T08:39:39.234 INFO:teuthology.orchestra.run.smithi117.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47081.log.gz 2024-09-19T08:39:39.234 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.52075.log: /var/log/ceph/ceph-client.admin.42575.log 2024-09-19T08:39:39.234 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.51529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54158.log 2024-09-19T08:39:39.234 INFO:teuthology.orchestra.run.smithi117.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51529.log.gz/var/log/ceph/ceph-client.admin.42575.log: 2024-09-19T08:39:39.235 INFO:teuthology.orchestra.run.smithi117.stderr:gzip 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52075.log.gz 2024-09-19T08:39:39.235 INFO:teuthology.orchestra.run.smithi117.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53780.log 2024-09-19T08:39:39.235 INFO:teuthology.orchestra.run.smithi117.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42575.log.gz 2024-09-19T08:39:39.235 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.54158.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-19T08:39:39.235 INFO:teuthology.orchestra.run.smithi117.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54158.log.gz 2024-09-19T08:39:39.235 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.53780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42659.log 2024-09-19T08:39:39.235 INFO:teuthology.orchestra.run.smithi117.stderr:gzip/var/log/ceph/ceph-mgr.y.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46760.log 2024-09-19T08:39:39.235 INFO:teuthology.orchestra.run.smithi117.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53780.log.gz 2024-09-19T08:39:39.236 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.42659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36746.log 2024-09-19T08:39:39.236 INFO:teuthology.orchestra.run.smithi117.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49226.log 2024-09-19T08:39:39.236 INFO:teuthology.orchestra.run.smithi117.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42659.log.gz 2024-09-19T08:39:39.236 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.46760.log: /var/log/ceph/ceph-client.admin.36746.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-19T08:39:39.236 INFO:teuthology.orchestra.run.smithi117.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46760.log.gz 2024-09-19T08:39:39.236 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.49226.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36746.log.gz 2024-09-19T08:39:39.236 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49118.log 2024-09-19T08:39:39.236 INFO:teuthology.orchestra.run.smithi117.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49226.log.gz 2024-09-19T08:39:39.236 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52935.log 2024-09-19T08:39:39.237 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.49118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43757.log 2024-09-19T08:39:39.237 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.52935.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49118.log.gz 2024-09-19T08:39:39.237 INFO:teuthology.orchestra.run.smithi117.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52935.log.gz 2024-09-19T08:39:39.237 INFO:teuthology.orchestra.run.smithi117.stderr: 85.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-19T08:39:39.237 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53906.log 2024-09-19T08:39:39.237 INFO:teuthology.orchestra.run.smithi117.stderr:gzip/var/log/ceph/ceph-client.admin.43757.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42013.log 2024-09-19T08:39:39.237 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.53906.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43757.log.gz 2024-09-19T08:39:39.237 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50416.log 2024-09-19T08:39:39.238 INFO:teuthology.orchestra.run.smithi117.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53906.log.gz 2024-09-19T08:39:39.238 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-19T08:39:39.238 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52893.log 2024-09-19T08:39:39.238 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.42013.log: 88.6%/var/log/ceph/ceph-client.admin.50416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44183.log 2024-09-19T08:39:39.238 INFO:teuthology.orchestra.run.smithi117.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42013.log.gz 2024-09-19T08:39:39.238 INFO:teuthology.orchestra.run.smithi117.stderr:gzip/var/log/ceph/ceph-client.admin.52893.log: -5 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50416.log.gz 2024-09-19T08:39:39.238 INFO:teuthology.orchestra.run.smithi117.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53247.log 2024-09-19T08:39:39.238 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44183.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52893.log.gz 2024-09-19T08:39:39.239 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44183.log.gz 2024-09-19T08:39:39.239 INFO:teuthology.orchestra.run.smithi117.stderr: -- /var/log/ceph/ceph-client.admin.51907.log 2024-09-19T08:39:39.239 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.53247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44526.log 2024-09-19T08:39:39.239 INFO:teuthology.orchestra.run.smithi117.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53247.log.gz 2024-09-19T08:39:39.239 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.51907.log: gzip -5 --verbose -- 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51907.log.gz 2024-09-19T08:39:39.239 INFO:teuthology.orchestra.run.smithi117.stderr: /var/log/ceph/ceph-client.admin.51655.log 2024-09-19T08:39:39.239 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53061.log 2024-09-19T08:39:39.239 INFO:teuthology.orchestra.run.smithi117.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44526.log.gz 2024-09-19T08:39:39.240 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.51655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44189.log 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51655.log.gz 2024-09-19T08:39:39.240 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-19T08:39:39.240 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.53061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49160.log 2024-09-19T08:39:39.240 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44189.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53061.log.gz 2024-09-19T08:39:39.240 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44189.log.gz 2024-09-19T08:39:39.240 INFO:teuthology.orchestra.run.smithi117.stderr: /var/log/ceph/ceph-client.admin.36391.log 2024-09-19T08:39:39.240 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.49160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44516.log 2024-09-19T08:39:39.240 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.36391.log: gzip -5 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49160.log.gz 2024-09-19T08:39:39.240 INFO:teuthology.orchestra.run.smithi117.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42447.log 2024-09-19T08:39:39.241 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44516.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.36391.log.gz 2024-09-19T08:39:39.241 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43925.log 2024-09-19T08:39:39.241 INFO:teuthology.orchestra.run.smithi117.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50584.log 2024-09-19T08:39:39.241 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.42447.log: -- replaced with /var/log/ceph/ceph-client.admin.44516.log.gz 2024-09-19T08:39:39.241 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.43925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44881.log 2024-09-19T08:39:39.241 INFO:teuthology.orchestra.run.smithi117.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42447.log.gz 2024-09-19T08:39:39.241 INFO:teuthology.orchestra.run.smithi117.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43925.log.gz 2024-09-19T08:39:39.241 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52401.log 2024-09-19T08:39:39.242 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.50584.log: /var/log/ceph/ceph-client.admin.44881.log: gzip -5 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50584.log.gz 2024-09-19T08:39:39.242 INFO:teuthology.orchestra.run.smithi117.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53738.log 2024-09-19T08:39:39.242 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.0.52401.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44881.log.gz 2024-09-19T08:39:39.242 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48075.log 2024-09-19T08:39:39.242 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.53738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47704.log 2024-09-19T08:39:39.242 INFO:teuthology.orchestra.run.smithi117.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53738.log.gz/var/log/ceph/ceph-client.admin.48075.log: 2024-09-19T08:39:39.242 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48560.log 2024-09-19T08:39:39.242 INFO:teuthology.orchestra.run.smithi117.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48075.log.gz 2024-09-19T08:39:39.243 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.47704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51823.log 2024-09-19T08:39:39.243 INFO:teuthology.orchestra.run.smithi117.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47704.log.gz 2024-09-19T08:39:39.243 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.48560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51613.log 2024-09-19T08:39:39.243 INFO:teuthology.orchestra.run.smithi117.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48560.log.gz 2024-09-19T08:39:39.243 INFO:teuthology.orchestra.run.smithi117.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.52401.log.gz 2024-09-19T08:39:39.243 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.51823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50458.log 2024-09-19T08:39:39.243 INFO:teuthology.orchestra.run.smithi117.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51823.log.gz 2024-09-19T08:39:39.243 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.51613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50805.log 2024-09-19T08:39:39.244 INFO:teuthology.orchestra.run.smithi117.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51613.log.gz 2024-09-19T08:39:39.244 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.50458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50374.log 2024-09-19T08:39:39.244 INFO:teuthology.orchestra.run.smithi117.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.50458.log.gz 2024-09-19T08:39:39.244 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.50805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42851.log 2024-09-19T08:39:39.244 INFO:teuthology.orchestra.run.smithi117.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50805.log.gz 2024-09-19T08:39:39.244 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.50374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46015.log 2024-09-19T08:39:39.244 INFO:teuthology.orchestra.run.smithi117.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50374.log.gz/var/log/ceph/ceph-client.admin.42851.log: 2024-09-19T08:39:39.244 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43454.log 2024-09-19T08:39:39.245 INFO:teuthology.orchestra.run.smithi117.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42851.log.gz 2024-09-19T08:39:39.245 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.46015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44525.log 2024-09-19T08:39:39.245 INFO:teuthology.orchestra.run.smithi117.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46015.log.gz 2024-09-19T08:39:39.245 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.43454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47536.log 2024-09-19T08:39:39.245 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44525.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43454.log.gz 2024-09-19T08:39:39.245 INFO:teuthology.orchestra.run.smithi117.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44525.log.gz 2024-09-19T08:39:39.245 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48602.log 2024-09-19T08:39:39.245 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48286.log 2024-09-19T08:39:39.246 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.47536.log: /var/log/ceph/ceph-client.admin.48602.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47536.log.gz 2024-09-19T08:39:39.246 INFO:teuthology.orchestra.run.smithi117.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48644.log 2024-09-19T08:39:39.246 INFO:teuthology.orchestra.run.smithi117.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48602.log.gz 2024-09-19T08:39:39.246 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.48286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51571.log 2024-09-19T08:39:39.246 INFO:teuthology.orchestra.run.smithi117.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48286.log.gz 2024-09-19T08:39:39.246 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.48644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48328.log 2024-09-19T08:39:39.246 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.51571.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48644.log.gz 2024-09-19T08:39:39.246 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47275.log 2024-09-19T08:39:39.247 INFO:teuthology.orchestra.run.smithi117.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51571.log.gz 2024-09-19T08:39:39.247 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.48328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50753.log 2024-09-19T08:39:39.247 INFO:teuthology.orchestra.run.smithi117.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48328.log.gz 2024-09-19T08:39:39.247 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.47275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49034.log 2024-09-19T08:39:39.247 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.50753.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47275.log.gz 2024-09-19T08:39:39.247 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43799.log 2024-09-19T08:39:39.247 INFO:teuthology.orchestra.run.smithi117.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50753.log.gz 2024-09-19T08:39:39.247 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.49034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51357.log 2024-09-19T08:39:39.247 INFO:teuthology.orchestra.run.smithi117.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49034.log.gz 2024-09-19T08:39:39.248 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5/var/log/ceph/ceph-client.admin.43799.log: --verbose -- /var/log/ceph/ceph-client.admin.50042.log 2024-09-19T08:39:39.248 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.51357.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43799.log.gz 2024-09-19T08:39:39.248 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51357.log.gz 2024-09-19T08:39:39.248 INFO:teuthology.orchestra.run.smithi117.stderr: /var/log/ceph/ceph-client.admin.50710.log 2024-09-19T08:39:39.248 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.50042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52977.log 2024-09-19T08:39:39.248 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.50710.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50042.log.gz 2024-09-19T08:39:39.248 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49923.log 2024-09-19T08:39:39.248 INFO:teuthology.orchestra.run.smithi117.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50710.log.gz 2024-09-19T08:39:39.249 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.52977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54450.log 2024-09-19T08:39:39.249 INFO:teuthology.orchestra.run.smithi117.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52977.log.gz 2024-09-19T08:39:39.249 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.49923.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-19T08:39:39.249 INFO:teuthology.orchestra.run.smithi117.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49923.log.gz 2024-09-19T08:39:39.249 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.54450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42319.log 2024-09-19T08:39:39.249 INFO:teuthology.orchestra.run.smithi117.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54450.log.gz 2024-09-19T08:39:39.249 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44190.log 2024-09-19T08:39:39.250 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.42319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54408.log 2024-09-19T08:39:39.250 INFO:teuthology.orchestra.run.smithi117.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42319.log.gz 2024-09-19T08:39:39.250 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44190.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-19T08:39:39.250 INFO:teuthology.orchestra.run.smithi117.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44190.log.gz 2024-09-19T08:39:39.250 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.54408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53990.log 2024-09-19T08:39:39.250 INFO:teuthology.orchestra.run.smithi117.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54408.log.gz 2024-09-19T08:39:39.250 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54284.log 2024-09-19T08:39:39.250 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44184.log 2024-09-19T08:39:39.250 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.53990.log: /var/log/ceph/ceph-client.admin.54284.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53990.log.gz 2024-09-19T08:39:39.251 INFO:teuthology.orchestra.run.smithi117.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-19T08:39:39.251 INFO:teuthology.orchestra.run.smithi117.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54284.log.gz 2024-09-19T08:39:39.251 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51697.log 2024-09-19T08:39:39.251 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.44184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46566.log 2024-09-19T08:39:39.251 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.51697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43280.log 2024-09-19T08:39:39.251 INFO:teuthology.orchestra.run.smithi117.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44184.log.gz 2024-09-19T08:39:39.251 INFO:teuthology.orchestra.run.smithi117.stderr: 88.6%/var/log/ceph/ceph-client.admin.46566.log: -- replaced with /var/log/ceph/ceph-client.admin.51697.log.gz 2024-09-19T08:39:39.251 INFO:teuthology.orchestra.run.smithi117.stderr: 89.2%/var/log/ceph/ceph-client.admin.43280.log: -- replaced with /var/log/ceph/ceph-client.admin.46566.log.gz 2024-09-19T08:39:39.252 INFO:teuthology.orchestra.run.smithi117.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.43280.log.gz 2024-09-19T08:39:39.252 INFO:teuthology.orchestra.run.smithi146.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-19T08:39:39.253 INFO:teuthology.orchestra.run.smithi146.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-19T08:39:39.253 INFO:teuthology.orchestra.run.smithi146.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-19T08:39:39.323 INFO:teuthology.orchestra.run.smithi117.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-19T08:39:39.814 INFO:teuthology.orchestra.run.smithi146.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-19T08:39:39.814 INFO:teuthology.orchestra.run.smithi146.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-19T08:39:39.825 INFO:teuthology.orchestra.run.smithi117.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-19T08:39:39.825 INFO:teuthology.orchestra.run.smithi117.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-19T08:39:39.840 INFO:teuthology.orchestra.run.smithi146.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-19T08:39:39.851 INFO:teuthology.orchestra.run.smithi117.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-19T08:39:39.870 INFO:teuthology.orchestra.run.smithi146.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-19T08:39:39.872 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-19T08:39:39.872 INFO:teuthology.orchestra.run.smithi146.stderr:real 0m0.770s 2024-09-19T08:39:39.872 INFO:teuthology.orchestra.run.smithi146.stderr:user 0m3.172s 2024-09-19T08:39:39.872 INFO:teuthology.orchestra.run.smithi146.stderr:sys 0m0.125s 2024-09-19T08:39:39.917 INFO:teuthology.orchestra.run.smithi117.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-19T08:39:39.919 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-19T08:39:39.919 INFO:teuthology.orchestra.run.smithi117.stderr:real 0m0.845s 2024-09-19T08:39:39.919 INFO:teuthology.orchestra.run.smithi117.stderr:user 0m3.153s 2024-09-19T08:39:39.919 INFO:teuthology.orchestra.run.smithi117.stderr:sys 0m0.263s 2024-09-19T08:39:39.920 INFO:tasks.ceph:Archiving logs... 2024-09-19T08:39:39.920 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911862/remote/smithi117/log 2024-09-19T08:39:39.921 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T08:39:40.552 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911862/remote/smithi146/log 2024-09-19T08:39:40.553 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T08:39:41.018 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T08:39:41.029 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T08:39:41.029 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T08:39:41.033 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T08:39:41.115 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T08:39:41.124 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T08:39:41.124 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:39:41.127 DEBUG:teuthology.orchestra.run.smithi146:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:39:41.139 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:39:41.142 INFO:teuthology.orchestra.run.smithi146.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:39:41.145 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:39:41.145 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-09-19T08:39:41.145 INFO:teuthology.orchestra.run.smithi117.stdout:^* hv01.front.sepia.ceph.com 3 6 377 47 +1361us[+1362us] +/- 52ms 2024-09-19T08:39:41.145 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 49 -3699us[-3698us] +/- 74ms 2024-09-19T08:39:41.145 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 +1764us[+1765us] +/- 76ms 2024-09-19T08:39:41.145 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:39:41.147 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:39:41.147 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2024-09-19T08:39:41.147 INFO:teuthology.orchestra.run.smithi146.stdout:^* hv01.front.sepia.ceph.com 3 6 377 48 +1361us[+1367us] +/- 52ms 2024-09-19T08:39:41.147 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 49 -3707us[-3701us] +/- 75ms 2024-09-19T08:39:41.147 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 +1774us[+1774us] +/- 76ms 2024-09-19T08:39:41.147 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:39:41.148 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T08:39:41.162 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T08:39:41.163 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T08:39:41.213 DEBUG:teuthology.orchestra.run.smithi117:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T08:39:41.283 DEBUG:teuthology.orchestra.run.smithi146:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T08:39:41.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-19T08:39:41.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-19T08:39:41.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-19T08:39:41.349 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:39:41.377 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:39:41.377 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:39:41.405 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:39:41.405 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T08:39:41.414 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T08:39:41.446 INFO:teuthology.task.internal:Duration was 540.885818 seconds 2024-09-19T08:39:41.447 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T08:39:41.497 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T08:39:41.497 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T08:39:41.499 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T08:39:41.536 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:39:41.538 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:39:41.794 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T08:39:41.795 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T08:39:41.795 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T08:39:41.855 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi146.front.sepia.ceph.com 2024-09-19T08:39:41.855 DEBUG:teuthology.orchestra.run.smithi146:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T08:39:41.878 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T08:39:41.878 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T08:39:41.898 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T08:39:41.943 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T08:39:41.944 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T08:39:41.964 DEBUG:teuthology.orchestra.run.smithi146:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T08:39:42.086 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T08:39:42.096 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T08:39:42.096 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T08:39:42.121 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T08:39:42.146 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T08:39:42.156 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:39:42.164 DEBUG:teuthology.orchestra.run.smithi146:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:39:42.184 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2024-09-19T08:39:42.210 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = core 2024-09-19T08:39:42.223 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:39:42.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:39:42.253 DEBUG:teuthology.orchestra.run.smithi146:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:39:42.277 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:39:42.278 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T08:39:42.288 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T08:39:42.289 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911862/remote/smithi117 2024-09-19T08:39:42.290 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T08:39:42.329 DEBUG:teuthology.misc:Transferring archived files from smithi146:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911862/remote/smithi146 2024-09-19T08:39:42.329 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T08:39:42.362 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T08:39:42.362 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T08:39:42.366 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T08:39:42.412 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T08:39:42.423 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T08:39:42.423 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T08:39:42.471 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T08:39:42.471 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T08:39:42.475 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T08:39:42.486 INFO:teuthology.orchestra.run.smithi117.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 08:39 /home/ubuntu/cephtest 2024-09-19T08:39:42.489 INFO:teuthology.orchestra.run.smithi146.stdout: 265503 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 08:39 /home/ubuntu/cephtest 2024-09-19T08:39:42.490 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T08:39:42.523 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T08:39:42.626 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/forward-scrub} duration: 540.8858184814453 failure_reason: 'Test failure: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=30a20160d42a4f22b83f37a2bf1ed6e5 status: fail success: false 2024-09-19T08:39:42.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T08:39:42.706 INFO:teuthology.run:FAIL